Bug 151113 - Mails sometimes disappear when filtering with spamassassin
Summary: Mails sometimes disappear when filtering with spamassassin
Status: RESOLVED WORKSFORME
Alias: None
Product: kmail
Classification: Applications
Component: filtering (show other bugs)
Version: unspecified
Platform: Fedora RPMs Linux
: NOR grave
Target Milestone: ---
Assignee: kdepim bugs
URL:
Keywords: triaged
Depends on:
Blocks:
 
Reported: 2007-10-20 22:06 UTC by Elgar Pichler
Modified: 2009-04-22 14:22 UTC (History)
3 users (show)

See Also:
Latest Commit:
Version Fixed In:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Elgar Pichler 2007-10-20 22:06:54 UTC
Version:            (using KDE KDE 3.5.7)
Installed from:    Fedora RPMs
OS:                Linux

Used RPMS:
----------
kdepim-3.5.7-3.fc7
spamassassin-3.2.3-44.fc7

Set-up:
-------
Created standard spam filter with kmail anit-spam wizard.

Expected behavior:
------------------
Incoming messages should be piped through Spamassassin Check filter command and classified accordingly as spam/no-spam. Messages classified as spam should be marked as spam and moved into a local folder spam by the subsequent Spam handling filter.

Observed behavior:
------------------
Incoming messages seem to be filtered through spamassassin (corresponding spamassassin processes are spawned during filtering), but some e-mail messages are lost in that process. I.e., ~2-5 messages in 10 simply disappear from kmail (cannot be found in any of the kmail folders). No reason for those disappearances could be identified so far, messages seem to disappear randomly, regardless if they seem to be spam or non-spam messages.
Disabling the spam related filters for incoming messages takes care of the disappearing problem, but lack of spam filtering is of course also not desirable.

Other comments:
---------------
Filtering incoming messages through anti-virus check and handler filters (created by the anti-virus wizard, using klamav) seems to work as expected.
No reproducibility tests have been performed with, e.g., runs over the same /var/spool/mail/foo user mail spool file. I'd suggest starting with tests like that where /var/spool/mail/foo contains 10-20 e-mails of different length, some of them spam, some not.
I have also no clue at the moment if this is
  - a spamassassin bug,
  - a kmail/spamassassin integration bug,
  - or an artefact of my setup.
Thanks in advance for investigating this. Would be interested to know if you can reproduce that bug or what your suggestions are. Cheers,
e2.
Comment 1 Helmut Pozimski 2008-09-23 18:27:05 UTC
I can confirm this bug with kmail 1.9.9 on Debian lenny. Except that for me the messages don't just disappear, just the content is deleted and the kmail-information ist still there. Looks like this:

X-Bogosity: Unsure, tests=bogofilter, spamicity=0.520000, version=1.1.7
X-UID: 
Status: RO
X-Status: RC
X-KMail-EncryptionState: N
X-KMail-SignatureState: N
X-KMail-MDN-Sent:  

It happens regardless of the tool used even with bogofilter or crm114. However I don't see a reason or anything that could help to reproduce the bug. I filed a similar bug in the Debian bugtracker under: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=498065 . 
Comment 2 gregormueckl 2008-10-18 02:17:55 UTC
I see the same behaviour with KMail 1.10.1 on Arch Linux and bogofilter. It is entirely reproduceable and related only to the pipe through filter that passes the mails through bogofilter (activating this filter breaks mail reception, deactivating it gets behaviour back to normal).

Still, this broke literally over night for me. One evening all was fine and in the next morning (still with the same process) this was broken.
Comment 3 Ruchir Brahmbhatt 2009-04-22 14:22:38 UTC
I tried to reproduce using many mails(spam & normal) to my local accounts but no message was lost. Normal messages went to inbox and spam went to trash. I'm closing this bug for now. Please feel free to reopen if you can still reproduce it.