| Summary: | data loss in maildir resource: Mails that were accessible disappeared and are not visible in maildir directory anymore | ||
|---|---|---|---|
| Product: | [Frameworks and Libraries] Akonadi | Reporter: | Martin Steigerwald <Martin> |
| Component: | Maildir Resource | Assignee: | kdepim bugs <kdepim-bugs> |
| Status: | RESOLVED WORKSFORME | ||
| Severity: | critical | CC: | alejandronova, amantia, wbauer1 |
| Priority: | NOR | ||
| Version: | 4.10 | ||
| Target Milestone: | --- | ||
| Platform: | Other | ||
| OS: | Linux | ||
| Latest Commit: | Version Fixed In: | ||
| Sentry Crash Report: | |||
| Attachments: | Picture that shows a clear data loss | ||
|
Description
Martin Steigerwald
2013-04-16 13:10:30 UTC
Created attachment 78959 [details]
Picture that shows a clear data loss
The mail from Modestas definately has been displayed by KMail. Then it displayed as empty and then KMail/Akonadi removed it from the message list view.
Unfortunately I missed storing away ~/.xsession-errors this time. I wasn´t fully aware that its overwritten on each KDE login and relogged after downgrading to KDE SC 4.8.4 which allows to be installed with KDEPIM 4.4.11 in Debian. But I will gather my exact setup configuration from the config files from an BTRFS snapshot in case its needed. My other probably related data loss related bug reports contain more data: [Akonadi] [Bug 318227] New: Data loss on restarting Akonadi to get it responsive again [Akonadi] [Bug 318290] New: Empty mails: AkonadiAgentServer(4890)/libakonadi Akonadi::ResourceBase::itemRetrieved: Item does not provide part "HEAD"/"RFC822" I'm surprised by this bug, as I use maildir with pop3 exetnsively and don't have mail losses. Can you try to put the Mail directory onto an ext4 fs and see if you still have problems? András, thank you. I am surprised as well, cause I did not read about any data losses since quite some time on kdepim and kdepim-users mailing lists, but I do not know how many users use POP3. So you think that some detail in BTRFS behavior may cause this? I am pretty confident that the BTRFS filesystem is okay despite that scrubbing issue I mentioned elsewhere, but even then BTRFS may implement some filesystem operation differently than other filesystems. I do have a way to test on Ext4, but I do not like to move my /home filesystem around. Symlinking the main maildir directory to an should work I think. Would you also recommend to put the MySQL database and the Virtuoso database to an Ext4 filesystem (I have about 25 GB left for one)? Would symlinking ~/.kde/share/apps/nepomuk as well as ~/.local/share/akonadi to the Ext4 partition work there as well? Is my setup as described above sane otherwise? I won´t test it this week while in Berlin and will wait for a time where I have some free time to deal with any issues, but I am willing to test it on Ext4. Thanks, Martin Guys, this has nothing to do with data loss caused by filesystem. It's simple: if we check the bug poster's name, Martin Steigerwald, we'll notice he is German, or, better, comes from a non-English country. I've reproduced this issue, and now I know why does it happen.
STEPS TO REPRODUCE.
1. Install KDE without proper language packages, but in your language (let's say, Spanish).
2. Run KDE and start Akonadi. The Akonadi Maildir resource will create folders with special names ("inbox", among others)
3. Install your proper language packages, switch your KDE language to your own (Spanish) and reboot.
4. The Akonadi Maildir resource, under certain conditions, will create again those special folders, but with LOCALIZED NAMES ("bandeja de entrada", for instance)
5. Now Akonadi will confuse itself between "inbox" and "bandeja de entrada" and will sometimes send mail to the wrong folder. Also, sometimes, all mail will disappear, since KDE will attempt to display the other Inbox folder, which is empty.
The solution seems to be: wait until Akonadi displays both inboxes, change the name of the only inbox whose name can be changed, move all mail from one to another, and delete the bogus inbox folder. I've tested that, it works, and since I did that I'm not losing mails anymore.
This also provokes a host of side effects, including a memory leak and a hang in Kontact.
Suggestion: please stop creating localized folders and simply create "inbox" folders, and then localize the name. The code for that exists, and it currently competes with the code which creates localized folders.
This speaks by itself [elyria@localhost local-mail]$ ls -la total 68 drwxrwxr-x. 17 elyria elyria 4096 oct 4 11:38 . drwxr-xr-x. 15 elyria elyria 4096 oct 8 08:08 .. drwxrwxr-x. 5 elyria elyria 4096 oct 4 11:37 bandeja de entrada drwxrwxr-x. 5 elyria elyria 4096 oct 4 11:37 bandeja de salida drwxrwxr-x. 5 elyria elyria 4096 oct 4 11:37 borradores drwxrwxr-x. 5 elyria elyria 4096 oct 4 11:37 correo-enviado drwxrwxr-x. 2 elyria elyria 4096 oct 1 11:00 cur drwxrwxr-x. 5 elyria elyria 4096 oct 1 11:00 drafts drwxrwxr-x. 5 elyria elyria 4096 oct 1 11:00 inbox drwxrwxr-x. 2 elyria elyria 4096 oct 1 11:00 new drwxrwxr-x. 5 elyria elyria 4096 oct 1 11:00 outbox drwxrwxr-x. 5 elyria elyria 4096 oct 4 11:38 papelera drwxrwxr-x. 5 elyria elyria 4096 oct 4 11:38 plantillas drwxrwxr-x. 5 elyria elyria 4096 oct 1 11:00 sent-mail drwxrwxr-x. 5 elyria elyria 4096 oct 1 11:00 templates drwxrwxr-x. 2 elyria elyria 4096 oct 1 11:00 tmp drwxrwxr-x. 5 elyria elyria 4096 oct 1 11:00 trash Check also how many local mail directories do you have in your ~/.local/share/ folder. I found two and you may find even more (local-mail, .local-mail.directory, akonadi-maildir-resource_?). All of those will and can produce bogus folders which can confuse Akonadi. (In reply to comment #6) > Suggestion: please stop creating localized folders and simply create "inbox" > folders, and then localize the name. Yes, I would prefer that as well. And it was done like this in KMail1. This should prevent problems when switching locales. I don´t think that has been my problem. Cause I do not see any localized or duplicate folder names. The data loss issue I could reproduce so far is [Akonadi] [Bug 319226] New: produces 1-byte-sized files on failed move attempts while filtering This I didn´t see this one again, I think its good too close it. If you still see localized folder names for default folders please open a separate bug report for this one. Now closing this one. Thanks, Martin |