| Summary: | Excessive I/O usage during mail import with KMailCVT. | ||
|---|---|---|---|
| Product: | [Frameworks and Libraries] Akonadi | Reporter: | Martin Steigerwald <Martin> |
| Component: | Maildir Resource | Assignee: | kdepim bugs <kdepim-bugs> |
| Status: | RESOLVED UNMAINTAINED | ||
| Severity: | grave | ||
| Priority: | NOR | ||
| Version: | 4.10 | ||
| Target Milestone: | --- | ||
| Platform: | Debian unstable | ||
| OS: | Linux | ||
| Latest Commit: | Version Fixed In: | ||
| Sentry Crash Report: | |||
| Attachments: |
atopsar output during the time of high disk I/O usage
atop log file which can be used together with atopsar screenshot of atop with statistic since boot typical 10 seconds snapshot of atop with maildir agent doing lots of I/O |
||
|
Description
Martin Steigerwald
2013-05-01 10:24:01 UTC
Akonadi does not seem to make any progress in sorting the file_db_data mails into the Maildir: martin@merkaba:/home2/martin#130> date ; du -sch Akonadi/* Nepomuk ; du -sch Akonadi/Datenbank/db_data Akonadi/Datenbank/file_db_data Mi 1. Mai 12:31:13 CEST 2013 8,4G Akonadi/Datenbank 276K Akonadi/Konfiguration 349M Akonadi/Mails 452M Nepomuk 9,2G insgesamt 2,4G Akonadi/Datenbank/db_data 6,1G Akonadi/Datenbank/file_db_data 8,4G insgesamt ~/.local/share/local-mails is symlinked to Akonadi/Mails ~/.local/share/akonadi is symlinked to Akonadi/Datenbank ~/.config/akonadi is symlinked to Akonadi/Konfiguration ~/.kde/share/apps/nepomuk is symlinked to Nepomuk This is to have all Akonadi related data (except calender and addresses) on Ext4, instead of BTRFS as suggested. It is setting at 349 MB mails for over an hour already. After - akonadictl stop - wait until notification that it really stopped (about a minute) - akonadictl start Akonadi seems to process file_db_data stuff: martin@merkaba:/home2/martin> date ; du -sch Akonadi/* Nepomuk ; du -sch Akonadi/Datenbank/db_data Akonadi/Datenbank/file_db_data Mi 1. Mai 12:38:09 CEST 2013 8,4G Akonadi/Datenbank 27M Akonadi/Konfiguration 410M Akonadi/Mails 485M Nepomuk 9,3G insgesamt 2,4G Akonadi/Datenbank/db_data 6,1G Akonadi/Datenbank/file_db_data 8,4G insgesamt martin@merkaba:/home2/martin> date ; du -sch Akonadi/* Nepomuk ; du -sch Akonadi/Datenbank/db_data Akonadi/Datenbank/file_db_data Mi 1. Mai 12:38:57 CEST 2013 8,4G Akonadi/Datenbank 27M Akonadi/Konfiguration 458M Akonadi/Mails 487M Nepomuk 9,4G insgesamt 2,4G Akonadi/Datenbank/db_data 6,1G Akonadi/Datenbank/file_db_data 8,4G insgesamt If it now also sets read/unread status of imported mails correctly, that would be fine. I know I do not have >7500 unread mails in my inbox. Created attachment 79605 [details]
atopsar output during the time of high disk I/O usage
Created attachment 79606 [details]
atop log file which can be used together with atopsar
Some reports:
- Disk utilization: atopsar -d -r atop_20130501
- Top 3 Disk using processes: atopsar -D -r atop_20130501
CPU stats are also in this file.
Created attachment 79608 [details]
screenshot of atop with statistic since boot
akonadi maildir resource has written more than 450 GiB!
Created attachment 79610 [details]
typical 10 seconds snapshot of atop with maildir agent doing lots of I/O
It usually did about 800 MiB during 10 seconds.
I had another attempt of migrating afterwards and so far it seems it was successful. I just put the contents of the old KMail-1 maildir - which doesn´t contain any mbox files - into ~/.local/share/local-mail and started with a clean configuration. I added most important filter rules and so far it seems to behave. Even address completion works :)
I keep mail indexing switched off for now however.
This was still in Nepomuk times. I am not sure whether its reproducable anymore with current versions and Baloo. And as my setup is long migrated frankly I do not care to reproduce it. Thus closing. If anyone else sees this, or has this, feel free to reopen. |