Bug 334397

Summary:	baloo eats up 800% CPU and most of the data access rate
Product:	[Unmaintained] Baloo	Reporter:	gleb <bobbi>
Component:	General	Assignee:	Vishesh Handa <me>
Status:	RESOLVED FIXED
Severity:	grave	CC:	bobbi
Priority:	NOR
Version First Reported In:	4.13
Target Milestone:	---
Platform:	Kubuntu
OS:	Linux
Latest Commit:		Version Fixed/Implemented In:	4.13.1
Sentry Crash Report:

Description gleb 2014-05-06 00:34:12 UTC

Last Friday I updated Kubuntu 13.10 to 14.04. After that, Kdevelop took 2 min to start, switching and launching other applications took up to 30 seconds. Thunderbird crashed twice. Baloo was eating up 1 CPU core (nice). Today, it was eating all my 8 cores. I had to rename the baloo starter in /usr/share/autostart and restart to be able to be productive at my workplace.
DEAR DEVELOPERS, PLEASE CONCENTRATE ON CREATING A FAST SYSTEM - FAST BOOT, ETC. I DO NOT NEED ANY SEARCH DEAMON, STILL LESS ONE THAT I CANNOT CONTROL.

Reproducible: Always




Kubuntu 14.04. 64-bit
Linux version 3.13.0-24-generic (buildd@panlong) (gcc version 4.8.2 (Ubuntu 4.8.2-19ubuntu1) ) #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014
Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz
8 GB

Comment 1 Vishesh Handa 2014-05-06 10:17:17 UTC

Please provide more information after following the guide over here - http://community.kde.org/Baloo/Debugging

Comment 2 Christoph Feck 2014-06-04 00:00:07 UTC

If you can provide the information requested in comment #1, please add it.

Comment 3 gleb 2014-06-04 07:35:58 UTC

bg@bg-Opti:~/Documents$ ps -ef  | grep baloo_file_extractor
bg        3822  2038  2 17:30 ?        00:00:00 /usr/bin/baloo_file_extractor 31854 31853 31852 31851 31850 31849 31848 31847 31846 31845 31844 31843 31842 31841 31840 31839 31838 31837 31836 31835 31834 31833 31832 31831 31830 31829 31828 31827 31826 31825 31824 31823 31822 31821 31820 31819 31818 31817 31816 31815
bg        3832  2189  0 17:30 pts/4    00:00:00 grep --color=auto baloo_file_extractor

bg@bg-Opti:~/Documents$ balooshow 31854 31853 31852 31851 31850 31849 31848 31847 31846 31845 31844 31843 31842 31841 31840 31839 31838 31837 31836 31835 31834 31833 31832 31831 31830 31829 31828 31827 31826 31825 31824 31823 31822 31821 31820 31819 31818 31817 31816 31815
Object::connect: No such signal org::freedesktop::UPower::DeviceAdded(QDBusObjectPath)
Object::connect: No such signal org::freedesktop::UPower::DeviceRemoved(QDBusObjectPath)
31854 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_41_130.plt
        Word Count: 7003
        Line Count: 1016
31853 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_132.plt
        Word Count: 73111
        Line Count: 4057
31852 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_61_185.plt
        Word Count: 9179
        Line Count: 1336
31851 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_101_25.plt
        Word Count: 3195
        Line Count: 456
31850 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_129.plt
        Word Count: 70930
        Line Count: 3941
31849 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_43.plt
        Word Count: 30406
        Line Count: 1772
31848 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_141_5.plt
        Word Count: 2344
        Line Count: 331
31847 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_112.plt
        Word Count: 71391
        Line Count: 3959
31846 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_22.plt
        Word Count: 16918
        Line Count: 1415
31845 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_42.plt
        Word Count: 31521
        Line Count: 2299
31844 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_57.plt
        Word Count: 38847
        Line Count: 2760
31843 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_96.plt
        Word Count: 58134
        Line Count: 4037
31842 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_183.plt
        Word Count: 111201
        Line Count: 7392
31841 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_69.plt
        Word Count: 44873
        Line Count: 2546
31840 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_112.plt
        Word Count: 68459
        Line Count: 4689
31839 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_61.plt
        Word Count: 40562
        Line Count: 2874
31838 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_21_155.plt
        Word Count: 8193
        Line Count: 1191
31837 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_61_75.plt
        Word Count: 5031
        Line Count: 726
31836 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_81_70.plt
        Word Count: 4895
        Line Count: 706
31835 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_51.plt
        Word Count: 36372
        Line Count: 2595
31834 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_36.plt
        Word Count: 26350
        Line Count: 1557
31833 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_107.plt
        Word Count: 58523
        Line Count: 3276
31832 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_66.plt
        Word Count: 43058
        Line Count: 3040
31831 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_171.plt
        Word Count: 99378
        Line Count: 5464
31830 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_141_180.plt
        Word Count: 8839
        Line Count: 1286
31829 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_101_180.plt
        Word Count: 8907
        Line Count: 1296
31828 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_134.plt
        Word Count: 83491
        Line Count: 5613
31827 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_101.plt
        Word Count: 56287
        Line Count: 3156
31826 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_64.plt
        Word Count: 42648
        Line Count: 3003
31825 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_115.plt
        Word Count: 71606
        Line Count: 4869
31824 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_41_105.plt
        Word Count: 6119
        Line Count: 886
31823 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_121_125.plt
        Word Count: 6901
        Line Count: 1001
31822 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_120.plt
        Word Count: 66733
        Line Count: 3716
31821 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_161_100.plt
        Word Count: 5915
        Line Count: 856
31820 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_161_135.plt
        Word Count: 7207
        Line Count: 1046
31819 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_21_20.plt
        Word Count: 3161
        Line Count: 451
31818 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_1_176.plt
        Word Count: 107576
        Line Count: 7119
31817 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_181_53.plt
        Word Count: 37264
        Line Count: 2141
31816 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_141_110.plt
        Word Count: 6289
        Line Count: 911
31815 /home/bg/Documents/tmp/trunk2/TEST_00/Solution/Current/draw_81_120.plt
        Word Count: 6799
        Line Count: 986


Sorry guys I AM NOT GOING TO RUN extractor on every single file.

Comment 4 Vishesh Handa 2014-06-04 14:40:38 UTC

This was fixed in 4.13.1. Please upgrade. It was released about 3 weeks ago.

Comment 5 gleb 2014-06-24 00:56:00 UTC

no it is not fixed in 4.13.1. It is just a little better but the system is still not well usable the 2nd day after upgrading to 4.13.1. Luckily you have the option to switch it off now.

Comment 6 Vishesh Handa 2014-06-25 09:53:01 UTC

Gleb, could you please provide the information which you provided last time. Those files should no longer be indexed, so it is a different problem.

Comment 7 gleb 2014-06-27 05:20:43 UTC

Hi Vishesh, after your message I tried to switch Desktop Search on again and restart the system several times. The processes were running:

bg@bg-Opti:~/Documents$ ps aux | grep baloo
bg        2023  0.2  0.2 323232 17956 ?        DN   10:46   0:01 /usr/bin/baloo_file
bg        2990  0.0  0.0  11752   912 pts/6    S+   10:54   0:00 grep --color=auto baloo
bg@bg-Opti:~/Documents$ ps aux | grep baloo_file_extractor
bg        2992  0.0  0.0  11748   920 pts/6    S+   10:54   0:00 grep --color=auto baloo_file_extractor

  -- but obviously without arguments and I noticed almost no background activity. Then I tried to check if I can find anything in my files. In Dolphin, I searched for several files by name and content (always 1 word). Most of the times, it found nothing, which was wrong. Then I switched Desktop Search off again and then tried to find the same things. It worked, surely slower, but in a few seconds I always found all I needed.

So I think I need no search indexing. Sorry I did not send you the files at the first occasion after I just upgraded to 4.13.1 - I called balooshow and there were many files again but this time when I enter the same command it says

bg@bg-Opti:~/Documents$ balooshow 93314 93313 93312 93311 93310 93309 93308 93306 93305 93304 93303 93302 93301 93300 93299 93298 93297 93296 93295 93294 93293 93291 93290 93289 93287 93286 93285 93284 93283 93282 93281 93279 93278 93277 93276 93275 93274 93273 93272 93271
Object::connect: No such signal org::freedesktop::UPower::DeviceAdded(QDBusObjectPath)
Object::connect: No such signal org::freedesktop::UPower::DeviceRemoved(QDBusObjectPath)
No index information found

Comment 8 gleb 2014-06-27 05:26:54 UTC

Hi Vishesh, after your message I tried to switch Desktop Search on again and restart the system several times. The processes were running:

bg@bg-Opti:~/Documents$ ps aux | grep baloo
bg        2023  0.2  0.2 323232 17956 ?        DN   10:46   0:01 /usr/bin/baloo_file
bg        2990  0.0  0.0  11752   912 pts/6    S+   10:54   0:00 grep --color=auto baloo
bg@bg-Opti:~/Documents$ ps aux | grep baloo_file_extractor
bg        2992  0.0  0.0  11748   920 pts/6    S+   10:54   0:00 grep --color=auto baloo_file_extractor

  -- but obviously without arguments and I noticed almost no background activity. Then I tried to check if I can find anything in my files. In Dolphin, I searched for several files by name and content (always 1 word). Most of the times, it found nothing, which was wrong. Then I switched Desktop Search off again and then tried to find the same things. It worked, surely slower, but in a few seconds I always found all I needed.

So I think I need no search indexing. Sorry I did not send you the files at the first occasion after I just upgraded to 4.13.1 - I called balooshow and there were many files again but this time when I enter the same command it says

bg@bg-Opti:~/Documents$ balooshow 93314 93313 93312 93311 93310 93309 93308 93306 93305 93304 93303 93302 93301 93300 93299 93298 93297 93296 93295 93294 93293 93291 93290 93289 93287 93286 93285 93284 93283 93282 93281 93279 93278 93277 93276 93275 93274 93273 93272 93271
Object::connect: No such signal org::freedesktop::UPower::DeviceAdded(QDBusObjectPath)
Object::connect: No such signal org::freedesktop::UPower::DeviceRemoved(QDBusObjectPath)
No index information found

Comment 9 Vishesh Handa 2014-07-09 09:59:53 UTC

The problem was that your "Plt" files were being detected as text files and being indexed. They contain too much information to index as a text file. With 13.1, we now only index text files which are end with a ".txt". It's not ideal, but until we can handle more amount of text. It's what we're doing.

What surprises me is that they are getting detected as a text file. I tried downloading some plt files from here - http://einnej.typepad.com/einnej/free-plt-files.html and for me they get detected as a "application/octet-stream". Do you think you could send me one of your plt files, please?

Closing this bug for now. The excessive CPU and IO problems are now clearly fixed.