Bug 151113

Summary:	Mails sometimes disappear when filtering with spamassassin
Product:	[Unmaintained] kmail	Reporter:	Elgar Pichler <epichler>
Component:	filtering	Assignee:	kdepim bugs <kdepim-bugs>
Status:	RESOLVED WORKSFORME
Severity:	grave	CC:	gregormueckl, mailinglist, ruchir.brahmbhatt
Priority:	NOR	Keywords:	triaged
Version:	unspecified
Target Milestone:	---
Platform:	Fedora RPMs
OS:	Linux
Latest Commit:		Version Fixed In:
Sentry Crash Report:

Description Elgar Pichler 2007-10-20 22:06:54 UTC

Version: (using KDE KDE 3.5.7)
Installed from: Fedora RPMs
OS: Linux

Used RPMS:
----------
kdepim-3.5.7-3.fc7
spamassassin-3.2.3-44.fc7

Set-up:
-------
Created standard spam filter with kmail anit-spam wizard.

Expected behavior:
------------------
Incoming messages should be piped through Spamassassin Check filter command and classified accordingly as spam/no-spam. Messages classified as spam should be marked as spam and moved into a local folder spam by the subsequent Spam handling filter.

Observed behavior:
------------------
Incoming messages seem to be filtered through spamassassin (corresponding spamassassin processes are spawned during filtering), but some e-mail messages are lost in that process. I.e., ~2-5 messages in 10 simply disappear from kmail (cannot be found in any of the kmail folders). No reason for those disappearances could be identified so far, messages seem to disappear randomly, regardless if they seem to be spam or non-spam messages.
Disabling the spam related filters for incoming messages takes care of the disappearing problem, but lack of spam filtering is of course also not desirable.

Other comments:
---------------
Filtering incoming messages through anti-virus check and handler filters (created by the anti-virus wizard, using klamav) seems to work as expected.
No reproducibility tests have been performed with, e.g., runs over the same /var/spool/mail/foo user mail spool file. I'd suggest starting with tests like that where /var/spool/mail/foo contains 10-20 e-mails of different length, some of them spam, some not.
I have also no clue at the moment if this is
- a spamassassin bug,
- a kmail/spamassassin integration bug,
- or an artefact of my setup.
Thanks in advance for investigating this. Would be interested to know if you can reproduce that bug or what your suggestions are. Cheers,
e2.

Comment 1 Helmut Pozimski 2008-09-23 18:27:05 UTC

I can confirm this bug with kmail 1.9.9 on Debian lenny. Except that for me the messages don't just disappear, just the content is deleted and the kmail-information ist still there. Looks like this:

X-Bogosity: Unsure, tests=bogofilter, spamicity=0.520000, version=1.1.7
X-UID: 
Status: RO
X-Status: RC
X-KMail-EncryptionState: N
X-KMail-SignatureState: N
X-KMail-MDN-Sent:  

It happens regardless of the tool used even with bogofilter or crm114. However I don't see a reason or anything that could help to reproduce the bug. I filed a similar bug in the Debian bugtracker under: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=498065 .

Comment 2 gregormueckl 2008-10-18 02:17:55 UTC

I see the same behaviour with KMail 1.10.1 on Arch Linux and bogofilter. It is entirely reproduceable and related only to the pipe through filter that passes the mails through bogofilter (activating this filter breaks mail reception, deactivating it gets behaviour back to normal).

Still, this broke literally over night for me. One evening all was fine and in the next morning (still with the same process) this was broken.

Comment 3 Ruchir Brahmbhatt 2009-04-22 14:22:38 UTC

I tried to reproduce using many mails(spam & normal) to my local accounts but no message was lost. Normal messages went to inbox and spam went to trash. I'm closing this bug for now. Please feel free to reopen if you can still reproduce it.