Bug 326704 - akonadi_nepomuk_feeder using large amounts of memory after rebuild of Akonadi database
Summary: akonadi_nepomuk_feeder using large amounts of memory after rebuild of Akonadi...
Status: RESOLVED UNMAINTAINED
Alias: None
Product: Akonadi
Classification: Frameworks and Libraries
Component: Nepomuk Feeder Agents (show other bugs)
Version: 4.11
Platform: Debian unstable Linux
: NOR normal
Target Milestone: ---
Assignee: kdepim bugs
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2013-10-26 21:00 UTC by Jan Binder
Modified: 2015-03-17 12:39 UTC (History)
4 users (show)

See Also:
Latest Commit:
Version Fixed In:


Attachments
pmap -x output for akonadi_nepomuk_feeder (38.49 KB, text/plain)
2013-10-26 21:01 UTC, Jan Binder
Details
/proc/$pid/smap for akonadi_nepomuk_feeder (299.00 KB, text/plain)
2013-10-26 21:02 UTC, Jan Binder
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Jan Binder 2013-10-26 21:00:46 UTC
Due to the CPU contention issue with Akonadi, I had to use this piece of advice:
https://bugs.launchpad.net/ubuntu/+source/akonadi/+bug/909022/comments/7
This worked, and CPU use by Akonadi components is back to a tolerable level.

However, after the Akonadi database rebuild finished, akonadi_nepomuk_feeder is still holding on to a lage amount of memory, as visible in the attached smaps file and pmap -x output.

Reproducible: Didn't try

Steps to Reproduce:
1. Get a decently sized mail collection of ~40000 mails with attachments or more.
2. Be forced to wipe Akonadi database due to unusability.
3. Have Nepomuk indexing enabled, you want to search all that mail.
4. Wait a long time for database rebuild to finish.
Actual Results:  
akonadi_nepomuk_feeder now holds onto a lot of memory, most of it on its heap (anonymous, non-shared memory).

Expected Results:  
akonadi_nepomuk_feeder should not have to keep all that memory, as the data is supposedly indexed and stored in virtuoso?

Mail is stored in several seperate akonadi_imap_resource and a few pieces in a local mail folder.
Reproducing tends to take about a day, which is why it was not done.
Comment 1 Jan Binder 2013-10-26 21:01:45 UTC
Created attachment 83137 [details]
pmap -x output for akonadi_nepomuk_feeder
Comment 2 Jan Binder 2013-10-26 21:02:37 UTC
Created attachment 83138 [details]
/proc/$pid/smap for akonadi_nepomuk_feeder
Comment 3 Daniel Vrátil 2013-10-29 20:26:30 UTC
I can confirm. When indexing large amount of emails, the feeder is leaking memory. I've seen my feeder to get over 1GB of memory.
Comment 4 Vishesh Handa 2013-10-30 10:29:50 UTC
Confirmed. I can reproduce this in a small test case. The leak seems to be in the Akonadi libs. I'll bring this up during the PIM sprint and we can investigate.
Comment 5 Vishesh Handa 2015-03-17 12:39:03 UTC
The Nepomuk project is no longer maintained in KDE since 4.13. For email indexing, Baloo provided an Akonadi resource to index emails, contacts and events. Tags are now maintained by Akonadi itself.