Bug 81634 - huge mail import uses too much memory and probably leaks
Summary: huge mail import uses too much memory and probably leaks
Status: RESOLVED FIXED
Alias: None
Product: kmail
Classification: Applications
Component: kmailcvt (show other bugs)
Version: 1.6.2
Platform: RedHat Enterprise Linux Linux
: NOR normal
Target Milestone: ---
Assignee: kdepim bugs
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2004-05-15 16:59 UTC by Doncho N. Gunchev
Modified: 2007-09-14 12:17 UTC (History)
0 users

See Also:
Latest Commit:
Version Fixed In:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Doncho N. Gunchev 2004-05-15 16:59:40 UTC
Version:           1.6.2 (using KDE KDE 3.2.2KDE 1.2)
Installed from:    RedHat RPMsRedHat RPMs

When importing huge mbox files (100-150MB) kmail uses about 650MB memory and preforms very slow. After closing and reopening, it uses about 60MB to work with the same mail folder. When applying filters on this folder I get many 'QGArray::at: Absolute index -910304128 out of range', 'QGArray::at: Absolute index 599536224 out of range' and similar error messages on the console (I started it from konsole). If the number of mails in the folder is bigger than about 30000 mails it is unusably slow (I waited 20 hours for 250MB mbox - 40000 mails approximately).
    In some cases (I don't remember after killall kmail or not) while applying filters I still get all filtered messages in the old folder. When clicked these messages change to Unknown (zero size). Removing the folder's indexes and starting kmail again helps.
Comment 1 Chris Howells 2004-10-26 04:29:58 UTC
I had this issue too. It seems to be a memory leak somewhere related to the dcop interface that kmailcvt uses.
Comment 2 Daniel Molkentin 2005-02-01 03:13:15 UTC
CVS commit by danimo: 

* Applying slightly adopted patches by Danny Kukawka <dkukawka@suse.de>, fixing an averanche of bugs:

- Gets rid of duplicated messages
- Allows for unattended import
- Eliminates severe performance issues
- Add filters for Evolution 2, Thunderbird 1.0 and Opera

* Reorder combobox entries, specific applications first, generic importers last
* Slight markup fixes

BUG:51844
BUG:87971
BUG:81634
BUG:83311

Danny, please check if everything still works as expected.

CCMAIL:dkukawka@suse.de


  A            filter_evolution_v2.cxx   1.1 [GPL (v2+)]
  A            filter_evolution_v2.hxx   1.1 [GPL (v2+)]
  A            filter_opera.cxx   1.1 [GPL (v2+)]
  A            filter_opera.hxx   1.1 [GPL (v2+)]
  A            filter_thunderbird.cxx   1.1 [GPL (v2+)]
  A            filter_thunderbird.hxx   1.1 [GPL (v2+)]
  M +7 -2      Makefile.am   1.28
  M +17 -3     filter_evolution.cxx   1.3
  M +46 -30    filter_mailapp.cxx   1.2
  M +52 -28    filter_mbox.cxx   1.7
  M +14 -3     filter_oe.cxx   1.16
  M +1 -1      filter_oe.hxx   1.4
  M +18 -2     filter_plain.cxx   1.21
  M +24 -6     filter_pmail.cxx   1.34
  M +54 -8     filters.cxx   1.45
  M +9 -3      filters.hxx   1.30
  M +1 -1      kmailcvt.cpp   1.32
  M +15 -3     kselfilterpage.cpp   1.11
  M +1 -0      kselfilterpage.h   1.7
  M +47 -33    kselfilterpagedlg.ui   1.8



Comment 3 Scott Beck 2005-05-20 06:12:58 UTC
Did this go out in 3.4? The date on this ticket shows that it may have.. I'm still seeing a memory leak on importing a 400M mbox. I have a gig of ram and it used all the memory on the system. It made it to 62% before it wouldn't go any further (the kernel ended up killing it after it killed kde).
Comment 4 Danny Kukawka 2005-05-20 09:50:22 UTC
This is fixed in the KDE 3.4 branch (http://webcvs.kde.org/kdepim/kmail/kmkernel.cpp?rev=1.329&view=log  ->Revision 1.328.2.1) Should be in KDE 3.4.1