291332 2012-01-12 06:09:43 +0000 kmail uses nonstandard IMAP message flags - does not comply with RFC2060 2015-01-11 21:35:51 +0000 1 1 2 Applications kmail2 general unspecified openSUSE Linux RESOLVED FIXED NOR normal --- 1 stefan pim-bugs-null blackravener eva fischer g huwie kde-bugs-68795 kdebugs lfranchi paul_crook pim-bugs-null rock8000 sam.carcagno sven.burmeister tmp_prince-promo vkrause Vojtech.Zeisek wbauer1 winter woebbeking wstephenson http://commits.kde.org/kdepim-runtime/658056eef812eeebb8b3d995378e178b0ae3c9e6 4.11.2 51 oldest_to_newest 1213375 0 stefan 2012-01-12 06:09:43 +0000 Version: unspecified (using KDE 4.7.2) OS: Linux kmail2 uses it's own IMAP flags. Instead of RFC2060 compliant flags, like eg "\Answered", it uses "$REPLIED". That throws off other clients, e.g. Hastymail² webmailer which then cannot display the message status properly. Reproducible: Always Steps to Reproduce: Reply to a message, check message flags Expected Results: Comply with RFC2060 1213563 1 ervin 2012-01-12 14:11:18 +0000 The IMAP resource just forwards what the client says, so kmail2 was really the right place. 1213963 2 wstephenson 2012-01-13 11:26:15 +0000 Right, it is using Replied instead of Answered (which kmail/akonadi also know about) http://lxr.kde.org/source/kde/kdepim-runtime/agents/maildispatcher/sentactionhandler.cpp#37 Akonadi flags http://lxr.kde.org/source/kde/kdepimlibs/akonadi/kmime/messageflags.h#49 Which are converted to standard IMAP flags, or else passed through verbatim: http://lxr.kde.org/source/kde/kdepim-runtime/resources/imap/resourcetask.cpp#317 I guess that since KMail's internal API vocabulary uses the term 'Replied', the Replied flag was used. Leo, any comment as the author? 1215042 3 paul_crook 2012-01-16 13:05:13 +0000 As per Will Stephenson comments (in bug 278082) it looks like bug 278082 is related. I.e. the flag $SENT is being passed through and causing APPEND to fail on MS Exchange servers (amoung others). 1269542 4 Vojtech.Zeisek 2012-06-24 21:18:01 +0000 I think it's same issue. On my IMAP server I use RoundCube webmailer. When I forward, reply or mark with IMAP label any message in RoundCube, Thunderbird or K-9 Mail (Android, well it does not support labels), those changes are synchronized among each other and to KMail. So KMail does understand it. But when I reply, forward or mark with IMAP label any message in KMail, those information are not synchronized with webmail, nor other clients. Only marking as important ("starring") works as expected (among all clients in all directions). Is it possible to force KMail to use correct flags? I faced this in openSUSE 12.1 in KDE 4.7.2 as well as 4.7.4. 1279421 5 72797 kdebugs 2012-07-27 18:16:10 +0000 Created attachment 72797 kdepim-runtime patch to use IMAP standard reply flag Hi, I've got into this problem too. As said in previous comments, KMail uses $REPLIED own IMAP flag instead of \Answered standard flag. Well, the problem is actually in kdepim-runtime package. kdepim-runtime only sets $REPLIED IMAP flag when replying a message but can recognize both flags as a kind of "synonyms". So, it can recognize as replied messages that have been replied from other mail clients but these other mail clients can't recognize as replied messages that have been replied from kdepim-runtime. I attach a patch that modifies kdepim-runtime to set \Answered IMAP flag instead of $REPLIED when you reply a message. Since kdepim-runtime can recognize both flags, there shouldn't be any side effect and I was using this patch for weeks without noticing any problem. But if you find any problem with it, please report. 1299619 6 74101 kdebugs 2012-09-22 23:27:08 +0000 Created attachment 74101 kdepim-runtime patch to use IMAP standard reply flag Updated patch for KDE 4.9. 1299795 7 winter 2012-09-23 12:59:43 +0000 Chuso, Would you please post your patch to reviewboard.kde.org? 1311787 8 kdebugs 2012-11-02 16:51:36 +0000 Hi, Allen. Thanks for the advice. The patch is now posted at reviewboard (107179). Sorry for the delay, but I didn't receive an e-mail notifying me of your comment as supposed. 1359635 9 huwie 2013-04-11 14:33:12 +0000 Is there any update for this? I'm getting behaviour that could be related; my sent emails are not being stored on the mail server (which, to me, is a critical failure) and I suspect it's something to do with non-standard flags being used. 1371638 10 wbauer1 2013-05-27 22:14:41 +0000 *** This bug has been confirmed by popular vote. *** 1395080 11 tmp_prince-promo 2013-09-04 11:42:36 +0000 I can confirm this bug in Kmail 4.10.5. The sent messages are not stored on the IMAP server "Sent" folder, but are shown locally in the same folder. The mails are also marked by different icons in the message list window (a closed envelope for the messages saved on the server, and visible to all clients, a stamp for the messages shown only in Kmail). The problem arises with some IMAP servers only, with some other (Office 365) all works well. Probably some servers can accept also non standard flags for the mails. 1395087 12 huwie 2013-09-04 11:59:05 +0000 Thanks for the additional confirmation Carlo, however the KDE devs apparently don't give a damn about this critical bug. 1395126 13 tmp_prince-promo 2013-09-04 13:33:23 +0000 In my case the problem is related to the $SENT flag. Akonadi debug log says: C: A000035 APPEND "Sent" (\Seen $SENT) {422} S: A000035 BAD invalid APPEND command syntax, invalid message flags list syntax Whereas the server supports: FLAGS ( \Answered \Flagged \Deleted \Seen \Draft $MDNSent $fax $urgent $voice ) 1395132 14 tmp_prince-promo 2013-09-04 13:44:07 +0000 In the case of Microsoft Office 365 IMAP server, the answer is: C: A000150 APPEND "Sent Items" (\Seen $SENT) {559} S: + Ready for additional command text. The message is accepted and the unknown flag is ignored, all messages in the "Sent" folder are marked simply as \Seen: C: A000198 SELECT "Sent Items" S: * 278 EXISTS S: * 0 RECENT S: * FLAGS ( \Seen \Answered \Flagged \Deleted \Draft $MDNSent ) S: * OK Permanent flags [ PERMANENTFLAGS ( \Seen \Answered \Flagged \Deleted \Draft $MDNSent ) ] S: * OK UIDVALIDITY value [ UIDVALIDITY 11 ] S: * OK The next unique identifier value [ UIDNEXT 663 ] S: A000198 OK SELECT completed. [ READ-WRITE ] C: A000199 FETCH 1:278 (FLAGS UID) S: * 1 FETCH ( FLAGS (\Seen) UID 385 ) Hence the different icon shown in the message list window in Kmail. 1397152 15 woebbeking 2013-09-13 12:26:46 +0000 Git commit 658056eef812eeebb8b3d995378e178b0ae3c9e6 by Andre Woebbeking. Committed on 13/09/2013 at 12:21. Pushed by woebbe into branch 'KDE/4.11'. Convert the Akonadi flags to IMAP flags in ChangeItemsFlagsTask like it's done in ChangeItemTask and handle Akonadi::MessageFlags::Replied in ResourceTask::fromAkonadiFlags(). FIXED-IN: 4.11.2 REVIEW:112482 M +2 -2 resources/imap/changeitemsflagstask.cpp M +1 -1 resources/imap/resourcetask.cpp http://commits.kde.org/kdepim-runtime/658056eef812eeebb8b3d995378e178b0ae3c9e6 1398149 16 kdebugs 2013-09-19 09:10:02 +0000 Andre's commit worked for me. 1412930 17 mollekopf 2013-11-20 10:58:41 +0000 *** Bug 322346 has been marked as a duplicate of this bug. *** 1412932 18 mollekopf 2013-11-20 10:59:22 +0000 *** Bug 292399 has been marked as a duplicate of this bug. *** 1412948 19 mollekopf 2013-11-20 12:05:18 +0000 *** Bug 309946 has been marked as a duplicate of this bug. *** 1436807 20 eva 2014-03-21 16:29:24 +0000 In version 4.11.5 this issue is fixed for new emails. However, I still have a bunch of old sent mails that the server (Kerio) does not accept for uploading. How can I fix the flag for those old "sent" mails? 1436844 21 wbauer1 2014-03-21 20:13:02 +0000 Just move them to a different folder and back again. That should be enough I think. If not, move them to a different resource (your "Local Folders" f.e.) and back. You could of course also remove the offending flag with akonadiconsole. Either do that on the "Resources" tab, or use some SQL statement to remove the "$SENT" flag everywhere ("DB console"). The mails should then be uploaded to the server when the folder gets synchronized the next time. I guess the first thing is easier to do especially for not so experienced users... ;-) 1436935 22 woebbeking 2014-03-22 13:04:51 +0000 > --- Comment #20 from eva@kde.org --- > In version 4.11.5 this issue is fixed for new emails. However, I still have > a bunch of old sent mails that the server (Kerio) does not accept for > uploading. How can I fix the flag for those old "sent" mails? Hi Eva, can you please try a 4.12.x version. My fix here was not complete :-( but is in 4.12. If your server reports which flags it supports. Cheers, André 1490152 23 blackravener 2015-01-10 13:47:58 +0000 (In reply to Andre Woebbeking from comment #22) > > --- Comment #20 from eva@kde.org --- > > In version 4.11.5 this issue is fixed for new emails. However, I still have > > a bunch of old sent mails that the server (Kerio) does not accept for > > uploading. How can I fix the flag for those old "sent" mails? > > Hi Eva, can you please try a 4.12.x version. My fix here was not complete > :-( > but is in 4.12. If your server reports which flags it supports. > > > Cheers, > André BUG 292399 report sais that it is resolved by resolving a duplicate bug 291332 (i.e.) this one. There also is a Bug 286692 that in esssence is the same as 292399 but is not resolved. Basicaly, I've tried this on OpenSuse 13.1 and 13.2 and kmail 4.14.2 and 4.14.3 and attachment icon is till not shown. i've also tried in on kubuntu 14.10 with kmail 4.14.1 and issue is present there as well. I've tried with MS Excahge mail account connecting over DavMail and I've tried Gmail through IMAP directly and attachment icons are not displayed. So what's the status on this? This is very annoying bug! I'd love to use kmail for by business, but not this one bug is holding me back. 1490347 24 woebbeking 2015-01-11 14:59:07 +0000 Well, I only fixed that Exchange hasn't to cope with unknown IMAP flags and complains with errors. And unfortunately there is no IMAP flag like "has attachment". Other IMAP servers allow any flags (also self defined as Akonadi's $ATTACHMENT). If you select a mail with an attachement Akonadi sees it and flags it. But with the next sync this is overwritten :-( This is probably caused by the fact that the Akonadi developers only work with IMAP servers allowing any flags, so the flags in Akonadi and the IMAP server are the same and can be synced without information loss. 1490350 25 blackravener 2015-01-11 15:07:53 +0000 (In reply to Andre Woebbeking from comment #24) > Well, I only fixed that Exchange hasn't to cope with unknown IMAP flags and > complains with errors. And unfortunately there is no IMAP flag like "has > attachment". From what you are saying it sounds like it is not going to be fixed (unless kmail stops depending on Akonadi, which is not going to happen any time soon), not any time soon and not for all systems anyways. Am I misunderstanding you? 1490409 26 woebbeking 2015-01-11 21:35:51 +0000 (In reply to Larry CK from comment #25) > Am I misunderstanding you? Yep :-) I'm no Akonadi expert but I think it's fixable without changing Akonadi. But as usual someone has to do the work. 72797 2012-07-27 18:16:10 +0000 2012-09-22 23:27:08 +0000 kdepim-runtime patch to use IMAP standard reply flag kdepim-imap-flags.patch text/plain 1392 kdebugs ZGlmZiAtdXIgYWdlbnRzL21haWxkaXNwYXRjaGVyL3NlbnRhY3Rpb25oYW5kbGVyLmNwcCBhZ2Vu dHMvbWFpbGRpc3BhdGNoZXIvc2VudGFjdGlvbmhhbmRsZXIuY3BwCi0tLSBhZ2VudHMvbWFpbGRp c3BhdGNoZXIvc2VudGFjdGlvbmhhbmRsZXIuY3BwCTIwMTItMDctMDUgMTg6Mjg6MjYuOTgwMjQ0 MTU4ICswMjAwCisrKyBhZ2VudHMvbWFpbGRpc3BhdGNoZXIvc2VudGFjdGlvbmhhbmRsZXIuY3Bw CTIwMTItMDctMDUgMTg6Mjk6MzMuOTM5NDA3MDUyICswMjAwCkBAIC01OSw3ICs1OSw3IEBACiAK ICAgY29uc3QgU2VudEFjdGlvbkF0dHJpYnV0ZTo6QWN0aW9uOjpUeXBlIHR5cGUgPSBzdGF0aWNf Y2FzdDxTZW50QWN0aW9uQXR0cmlidXRlOjpBY3Rpb246OlR5cGU+KCBqb2ItPnByb3BlcnR5KCAi dHlwZSIgKS50b0ludCgpICk7CiAgIGlmICggdHlwZSA9PSBTZW50QWN0aW9uQXR0cmlidXRlOjpB Y3Rpb246Ok1hcmtBc1JlcGxpZWQgKSB7Ci0gICAgaXRlbS5zZXRGbGFnKCBBa29uYWRpOjpNZXNz YWdlRmxhZ3M6OlJlcGxpZWQgKTsKKyAgICBpdGVtLnNldEZsYWcoIEFrb25hZGk6Ok1lc3NhZ2VG bGFnczo6QW5zd2VyZWQgKTsKICAgfSBlbHNlIGlmICggdHlwZSA9PSBTZW50QWN0aW9uQXR0cmli dXRlOjpBY3Rpb246Ok1hcmtBc0ZvcndhcmRlZCApIHsKICAgICBpdGVtLnNldEZsYWcoIEFrb25h ZGk6Ok1lc3NhZ2VGbGFnczo6Rm9yd2FyZGVkICk7CiAgIH0KZGlmZiAtdXIgcmVzb3VyY2VzL21h aWxkaXIvbGlibWFpbGRpci9tYWlsZGlyLmNwcCByZXNvdXJjZXMvbWFpbGRpci9saWJtYWlsZGly L21haWxkaXIuY3BwCi0tLSByZXNvdXJjZXMvbWFpbGRpci9saWJtYWlsZGlyL21haWxkaXIuY3Bw CTIwMTItMDctMDUgMTg6Mjg6MjUuMjgxMjY1Mzk4ICswMjAwCisrKyByZXNvdXJjZXMvbWFpbGRp ci9saWJtYWlsZGlyL21haWxkaXIuY3BwCTIwMTItMDctMDUgMTg6Mjk6MjUuNTY3NTExNzE1ICsw MjAwCkBAIC02MTksNyArNjE5LDcgQEAKICAgICBRX0ZPUkVBQ0goIEFrb25hZGk6Okl0ZW06OkZs YWcgZmxhZywgZmxhZ3MgKSB7CiAgICAgICBpZiAoIGZsYWcgPT0gQWtvbmFkaTo6TWVzc2FnZUZs YWdzOjpGb3J3YXJkZWQgKQogICAgICAgICBtYWlsRGlyRmxhZ3MgPDwgUUxhdGluMVN0cmluZygi UCIpOwotICAgICAgaWYgKCBmbGFnID09IEFrb25hZGk6Ok1lc3NhZ2VGbGFnczo6UmVwbGllZCAp CisgICAgICBpZiAoIGZsYWcgPT0gQWtvbmFkaTo6TWVzc2FnZUZsYWdzOjpBbnN3ZXJlZCApCiAg ICAgICAgIG1haWxEaXJGbGFncyA8PCBRTGF0aW4xU3RyaW5nKCJSIik7CiAgICAgICBpZiAoIGZs YWcgPT0gQWtvbmFkaTo6TWVzc2FnZUZsYWdzOjpTZWVuICkKICAgICAgICAgbWFpbERpckZsYWdz IDw8IFFMYXRpbjFTdHJpbmcoIlMiKTsK 74101 2012-09-22 23:27:08 +0000 2012-09-22 23:27:08 +0000 kdepim-runtime patch to use IMAP standard reply flag kdepim_49-imap-flags.patch text/plain 1405 kdebugs ZGlmZiAtdXIgYWdlbnRzL21haWxkaXNwYXRjaGVyL3NlbnRhY3Rpb25oYW5kbGVyLmNwcCBhZ2Vu dHMvbWFpbGRpc3BhdGNoZXIvc2VudGFjdGlvbmhhbmRsZXIuY3BwCi0tLSBhZ2VudHMvbWFpbGRp c3BhdGNoZXIvc2VudGFjdGlvbmhhbmRsZXIuY3BwCTIwMTItMDktMjIgMjE6NTg6MDguNzYzNDkx MzE4ICswMjAwCisrKyBhZ2VudHMvbWFpbGRpc3BhdGNoZXIvc2VudGFjdGlvbmhhbmRsZXIuY3Bw CTIwMTItMDktMjIgMjE6NTg6MzYuODg4MTM5NzExICswMjAwCkBAIC01OSw3ICs1OSw3IEBACiAK ICAgY29uc3QgU2VudEFjdGlvbkF0dHJpYnV0ZTo6QWN0aW9uOjpUeXBlIHR5cGUgPSBzdGF0aWNf Y2FzdDxTZW50QWN0aW9uQXR0cmlidXRlOjpBY3Rpb246OlR5cGU+KCBqb2ItPnByb3BlcnR5KCAi dHlwZSIgKS50b0ludCgpICk7CiAgIGlmICggdHlwZSA9PSBTZW50QWN0aW9uQXR0cmlidXRlOjpB Y3Rpb246Ok1hcmtBc1JlcGxpZWQgKSB7Ci0gICAgaXRlbS5zZXRGbGFnKCBBa29uYWRpOjpNZXNz YWdlRmxhZ3M6OlJlcGxpZWQgKTsKKyAgICBpdGVtLnNldEZsYWcoIEFrb25hZGk6Ok1lc3NhZ2VG bGFnczo6QW5zd2VyZWQgKTsKICAgfSBlbHNlIGlmICggdHlwZSA9PSBTZW50QWN0aW9uQXR0cmli dXRlOjpBY3Rpb246Ok1hcmtBc0ZvcndhcmRlZCApIHsKICAgICBpdGVtLnNldEZsYWcoIEFrb25h ZGk6Ok1lc3NhZ2VGbGFnczo6Rm9yd2FyZGVkICk7CiAgIH0KZGlmZiAtdXIgcmVzb3VyY2VzL21h aWxkaXIvbGlibWFpbGRpci9tYWlsZGlyLmNwcCByZXNvdXJjZXMvbWFpbGRpci9saWJtYWlsZGly L21haWxkaXIuY3BwCi0tLSByZXNvdXJjZXMvbWFpbGRpci9saWJtYWlsZGlyL21haWxkaXIuY3Bw CTIwMTItMDktMjIgMjE6NTg6MDkuMjk2NDg0NjU1ICswMjAwCisrKyByZXNvdXJjZXMvbWFpbGRp ci9saWJtYWlsZGlyL21haWxkaXIuY3BwCTIwMTItMDktMjIgMjE6NTk6MjguMzkxNDk1ODI3ICsw MjAwCkBAIC02MTEsNyArNjExLDcgQEAKICAgICBRX0ZPUkVBQ0ggKCBjb25zdCBBa29uYWRpOjpJ dGVtOjpGbGFnIGZsYWcsIGZsYWdzICkgewogICAgICAgaWYgKCBmbGFnID09IEFrb25hZGk6Ok1l c3NhZ2VGbGFnczo6Rm9yd2FyZGVkICkKICAgICAgICAgbWFpbERpckZsYWdzIDw8IFFMYXRpbjFT dHJpbmcoICJQIiApOwotICAgICAgaWYgKCBmbGFnID09IEFrb25hZGk6Ok1lc3NhZ2VGbGFnczo6 UmVwbGllZCApCisgICAgICBpZiAoIGZsYWcgPT0gQWtvbmFkaTo6TWVzc2FnZUZsYWdzOjpBbnN3 ZXJlZCApCiAgICAgICAgIG1haWxEaXJGbGFncyA8PCBRTGF0aW4xU3RyaW5nKCAiUiIgKTsKICAg ICAgIGlmICggZmxhZyA9PSBBa29uYWRpOjpNZXNzYWdlRmxhZ3M6OlNlZW4gKQogICAgICAgICBt YWlsRGlyRmxhZ3MgPDwgUUxhdGluMVN0cmluZyggIlMiICk7Cg==