Bug 326977 - many related problems with folders
Summary: many related problems with folders
Status: RESOLVED WAITINGFORINFO
Alias: None
Product: kmail2
Classification: Applications
Component: general (show other bugs)
Version: 4.10.5
Platform: Kubuntu Linux
: NOR critical
Target Milestone: ---
Assignee: kdepim bugs
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2013-11-01 08:34 UTC by davidblunkett
Modified: 2016-09-28 10:00 UTC (History)
1 user (show)

See Also:
Latest Commit:
Version Fixed In:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description davidblunkett 2013-11-01 08:34:54 UTC
I have many related problems with folders - I cannot work out where the problem lies but here are the symptoms:

Messages are sent ok but remain in outbox (marked unread) they are also copied to sent-mail and appear in the index of sent-mail but the content is missing (although I can read them in outbox).

My chosen spam destination is "local folders/spam" but every time kmail starts this is deleted and "local folders/wastebin/spam" is created and all the spam filters are broken.  Sometimes when I move it back to "local folders" it is sorted to the correct place in the list other times it sticks around the first few special folders (somewhere between inbox and templates).  Lots of times spam is filtered to my spam filter and deleted from the inbox - however if I select a different folder and then go back to the inbox the spam email reappears for a moment before getting filtered again - I get new mail notifications and multiple copies in my spam folder.  This continues indefinitely until I delete the spam.

On restarting some emails are lost in through these problems!

As a for instance - the spam filters id'd something as spam yesterday - it was filtered and kept reappearing - eventually I had 15 copies in spam and one (transient) in inbox which I deleted because I was sick of the continual notifications of new mail.  I still had 15 copies in spam.  Today I started kmail, the spam folder was relocated, the filters were all unconfigured and the spam was missing from all folders - data lost.

Sometimes when I delete emails they reappear (this is an occasional problem).

I am using a pop via gmail to get messages and the messages are not left on the server.

I have the following messages at stderr:

 kmail2(13722)/kdepimlibs (mailtransport) MailTransport::Transport::usrReadConfig: Akonadi transport with invalid resource instance.
kmail2(13722)/kdepimlibs (mailtransport) MailTransport::Transport::usrReadConfig: Type unknown to manager.
lots of the next one
kmail2(13722)/kdepimlibs (mailtransport) MailTransport::SendQueuedAction::itemAccepted: Item doesn't have DispatchModeAttribute.
kmail2(13722)/kdepimlibs (mailtransport) MailTransport::Transport::transportType: Invalid transport type.



Reproducible: Always

Steps to Reproduce:
fire up kmail and it is as described
Actual Results:  
all sorts of odd folder behaviour as described

Expected Results:  
the spam folder should stay put

spam filtering should work

the outbox->sentmail should work (ie once sent messages should move the sentmail and leave outbox).

I shouldn't lose messages

Messages I delete should stay deleted
Comment 1 davidblunkett 2013-11-01 09:35:03 UTC
Typically I've developed a new (related) problem since posting this: I filter messages from mailing lists into folders and now one of these is showing two new unread emails and i have had a notification of the arrival of two new email, but, when I click on the folder, it appears to have nothing in it, nothing in the top pane and nothing in the bottom.
Comment 2 davidblunkett 2013-11-01 09:42:09 UTC
And another new irritation - an old spam has reappeared in my inbox - it just sits there - I click on it and press the spam button - it vanishes - but as soon as I return to the inbox it returns - this is an <old> spam from a few days ago and this time it isn't leaving copies in the spam folder.

Moving this email manually into the spam folder has the same problem - it goes (but this time leave a record in the spam folder) and then returns. Each time these files return they give a new email notification.
Comment 3 davidblunkett 2013-11-01 10:11:10 UTC
Now I don't know what has happened but without restarting the spam folder has moved back to the wastebin folder and all the spam filters are broken again - AFAIK all I did that provoked it was press "check mail" but this might be a coincidence
Comment 4 davidblunkett 2013-11-01 10:12:44 UTC
Add to this last mail that a substantial number of emails in the spam folder dissappeared at the same time and appear to be permanently lost.
Comment 5 davidblunkett 2013-11-01 10:28:37 UTC
Having got sick of moving the spam folder from wastebin to local folders I've tried a different track - create a new spam folder.  This doesn't appear to have made any difference but has some more diagnostics:

Marking spam in the inbox moves it to local folders/spam and removes it until I return the inbox when it reappears as before.

Moving the contents of wastebin/spam to spam results multiple copies of the emails - the move into the new spam folder but remain in the old one. Moving emails from the inbox to the new spam folder does the same - but I get the added benefit of a new mail notification when the email is recreated in the inbox.
Comment 6 davidblunkett 2013-11-01 11:53:35 UTC
I think it is worse than above - I reckon I've lost ~15 email since Monday - luckily nothing really important but I can see them in the upper pane with the subject, sender and date but cannot read them (lower pane blank) and loads of message on the console:

kmail2(9353)/kdepimlibs (mailtransport) MailTransport::SendQueuedAction::itemAccepted: Item doesn't have DispatchModeAttribute.
kmailcvt(9437)/kdepimlibs (kmime) KMime::Base64Decoder::decode: Base64Decoder: unexpected paddingcharacter in input stream
kmailcvt(9437)/kdepimlibs (kmime) KMime::Base64Decoder::decode: Base64Decoder: unexpected paddingcharacter in input stream
kmail2(9353)/kdepimlibs (mailtransport) MailTransport::SendQueuedAction::itemAccepted: Item doesn't have DispatchModeAttribute.
kmail2(9353)/kdepimlibs (mailtransport) MailTransport::SendQueuedAction::itemAccepted: Item ...repeat...
kmail2(9353)/kdepimlibs (mailtransport) MailTransport::SendQueuedAction::itemAccepted: Item doesn't have DispatchModeAttribute.
kmail2(9353) showJobError: There is no GUI delegate set for a kjob, and it failed with error: "Unable to retrieve item from resource: <html>Invalid item retrieved</html>"
kmail2(9353)/kdepimlibs (mailtransport) MailTransport::SendQueuedAction::itemAccepted: Item doesn't have DispatchModeAttribute.
Comment 7 Laurent Montel 2013-11-01 17:02:50 UTC
Hi,
Thanks for all report but it's better to split on "x" bug report.
It's not easy to told "it's fixed" if there is 30 bugs report in 1 bug report :)

I will read all tomorrow away now.

Regards
Comment 8 davidblunkett 2013-11-01 23:23:35 UTC
I think all the different symptoms are manifestations of the same problem! 

it is very tricky to understand - my money is on some configuration problem and I'd sure like to start from scratch - (I did try moving a folder away and then starting again and reimporting it but loads of emails didn't make it through the process (they appeared in the top pane but the contents we missing).  Based on this I reckon I could lose 50% of my emails (>90% of recent ones) so I am very reluctant to try starting from scratch.)  

A few months ago akonadi went haywire and the databases were corrupted - I can't remember if this problem pre or post dated the akonadi issue but I recall having to set something up with akonadi to do with accounts and folders before kmail would fetch emails again.
Comment 9 davidblunkett 2013-11-01 23:27:09 UTC
I forgot to say I also have occasional popups that say "unable to retrieve item from resource, invalid item retrieved" - normally when I try to do something with an problem email (copy move etc).
Comment 10 davidblunkett 2013-11-05 08:01:18 UTC
This is a bit odd but:

If a email is tagged by the spam filter it constant reappears in my inbox for a moment then gets filtered to the spam folder.  Once this has happened I cannot move it manually either - if I drag it to the spam folder it disappears for a moment and then reappears (leaving an additional copy in the spam folder).  This only seems to occur for the emails tagged as spam - I can move other emails and my other filters appear to be working (+/- they keep losing the destination folders for some reason).
Comment 11 davidblunkett 2013-11-06 12:42:12 UTC
Having tried several different combinations of the spam filters created with the spam filter wizard I can safely say this all of them produce the same results - the spam appears to leave the inbox, gets copied to the spam folder then reappears. This happens everytime I look at the inbox (after looking elsewhere) and everytime mail is checked in.

The result is spam amplification - instead of never seeing the spam I get endless notifications and endless copies of it in the spam folder.
Comment 12 davidblunkett 2013-11-11 18:18:41 UTC
Here is possibly an interesting symptom:

All spam handling filters are turned off and have been for several days.  I move the email into the spam folder it duplicates itself as before.  I move the same email into another folder - it behaves fine.  I move it from this folder into the spam folder it duplicates itself again.  The common thread is moving into the spam folder.
Comment 13 davidblunkett 2013-11-11 18:31:34 UTC
Next I create a new folder "junk" this behaves fine - I can move files into it without duplication.

Next I recreate the spam filters and everything works fine - the spam is filtered to "junk" and not duplicated.

Previously I created the spam folder fresh and setup the filters exactly as I've done here (only calling the folder "spam") and this seemed to cause the problem.

The spam folder appears broken still - many of the emails there cannot be read, moved or deleted which is annoying.
Comment 14 Denis Kurz 2016-09-24 18:09:46 UTC
This bug has only been reported for versions before 4.14, which have been unsupported for at least two years now. Can anyone tell if this bug still present?

If noone confirms this bug for a Framework-based version of kmail2 (version 5.0 or later, as part of KDE Applications 15.12 or later), it gets closed in about three months.
Comment 15 davidblunkett 2016-09-28 10:00:15 UTC
I haven't seen this bug since newer version - changing to resolved