Bug 185681 - kmail deletes seenUidList -> mail download doublettes (error #3 described below)
Summary: kmail deletes seenUidList -> mail download doublettes (error #3 described below)
Status: RESOLVED UNMAINTAINED
Alias: None
Product: kmail
Classification: Applications
Component: pop3 (show other bugs)
Version: 1.9.10
Platform: unspecified Linux
: NOR normal
Target Milestone: ---
Assignee: kdepim bugs
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2009-02-27 09:05 UTC by reisenweber
Modified: 2015-04-12 09:59 UTC (History)
3 users (show)

See Also:
Latest Commit:
Version Fixed In:


Attachments
screenshot showing download of lots of old msgs (33.47 KB, image/jpeg)
2009-02-27 09:05 UTC, reisenweber
Details
prefetch-cmd script to create backup of UIDL list, and restore in case of error. Needs edit for your specific account's filename (712 bytes, text/plain)
2010-03-12 12:30 UTC, reisenweber
Details

Note You need to log in before you can comment on or make changes to this bug.
Description reisenweber 2009-02-27 09:05:06 UTC
Created attachment 31668 [details]
screenshot showing download of lots of old msgs

+++ This bug was initially created as a clone of Bug #185679 +++

Created an attachment (id=31666)
traceback of crash on error#2 described above

+++ This bug was initially created as a clone of Bug #185677 +++

Created an attachment (id=31665)
screenshot showing UIDL-requester

+++ This bug was initially created as a clone of Bug #157946 +++

Version:           1.9.10 (openSUSE 11.1)
Prerequisites/Preset:
POP3 account, msgs stay on server, (about 2500 msgs/25Meg on server).
Lots of mails in kmail (search msgtext takes some 10 min)

Reproduce (occurred >1 times. Though it's a timing issue, hard to reproduce - maybe with SIGSTOP KMail, or Netfilters):
During searching of local mails (50% CPU usage on a 2GHz dualcore system) POP3 UIDL obviously times out, opening requester stating the server allegedly "doesn't support UIDL"
o- Error requester "server does not support UIDL (see attachment)
This is bug #1: UIDL timeout mustn't be handled identically to error-response from server

o- i click "abort message download" at bottom right some times (because i know what will follow), then i click "ok" on error-requester **)
o- KONTACT coredumps (see attachment)
This is bug #2: kmail must NOT coredump

o- kmail deletes local list of mails already downloaded:
~/.kde/share/kmail/<user>@<serverdomain>:@pop.<serverdomain>:995 is void. 
seenUidList=<nullstring>
size before: ~121k, size after error: ~70byte
This is bug #3: list of downloaded mails MUST NOT be deleted on failure of UIDL.
This bug also appeared when kmail didn't segfault on error#2, it's directly related to UIDL-failure and 100% reproduceable (given you manage to get the UIDL not supported warning)


resulting problems: _all_msgs_ are downloaded a second time, to restore seenUidList. 


seen identically in SuSE10.1 version of Kontact

workaround: 
o- avoid lowmem/high-cpu-load when polling POP3.
o- when error happens: CANCEL DOWNLOAD IMMEDIATELY! Create filter to download all msgs older 1day to a temporary mail dir. Poll. (Disable filter. I keep it for catching errors during unattended polls)
o- *OR* CANCEL DOWNLOAD IMMEDIATELY! restore ~/.kde/share/kmail/<user>@<serverdomain>* from yesterday's backup.
o- then use <CTRL>+* to delete doublettes


jOERG
Comment 1 reisenweber 2010-03-12 12:30:48 UTC
Created attachment 41568 [details]
prefetch-cmd script to create backup of UIDL list, and restore in case of error. Needs edit for your specific account's filename
Comment 2 reisenweber 2010-03-12 12:33:19 UTC
problem persists on kmail-1.12.2 / Kontact-4.3.2

every once in a while internet connectivity is interrupted by e.g. 24h forced
disconnect just the moment while kmail is waiting for response from
pop3-server. Result is an "empty"
.kde/share/kmail/<user>@<serverdomain>:@pop.<serverdomain>:995 file as
described above.

attached a script to invoke in kmail's account-extended-prefetchCmd settings,
to catch the situation and recover in a somewhat sane way

jOERG
Comment 3 gerlos 2010-07-11 13:33:24 UTC
I got the same problem (duplicate messages) on Kmail 1.13.5 undek KDE SC 4.4.5 on Kubuntu 10.04, but just for my two Yahoo mail acocunts, it doesn't seem to happen for my other two acocunts on different providers.

I also got this error message:
Could not read file Risposta non valida dal server:
«.
».

I'm not sure that there's a CPU usage problem in my situation, since when I check for mail my CPU usage remains low.
Comment 4 gerlos 2010-07-12 13:39:52 UTC
I'm not sure if there's any relation with the origina problem, but when I get the error message:
Could not read file Risposta non valida dal server:
«.
».
kmail stops download mail from the server. I've seen also that I get this error more frequently when I set the language of the application in Italian. If I switch to "British English" kmail donwloads missing mails, and the error window appears less often.
Comment 5 Laurent Montel 2015-04-12 09:59:36 UTC
Thank you for taking the time to file a bug report.

KMail2 was released in 2011, and the entire code base went through significant changes. We are currently in the process of porting to Qt5 and KF5. It is unlikely that these bugs are still valid in KMail2.

We welcome you to try out KMail 2 with the KDE 4.14 release and give your feedback.