Bug 21842 - Excessive memory use (leak?) when rendering long pages.
Summary: Excessive memory use (leak?) when rendering long pages.
Status: CLOSED FIXED
Alias: None
Product: konqueror
Classification: Applications
Component: khtml (show other bugs)
Version: unspecified
Platform: RedHat Enterprise Linux Linux
: NOR normal
Target Milestone: ---
Assignee: Konqueror Developers
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2001-03-07 20:48 UTC by meldroc
Modified: 2002-09-16 14:43 UTC (History)
0 users

See Also:
Latest Commit:
Version Fixed In:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description meldroc 2001-03-07 20:18:54 UTC
(*** This bug was imported into bugs.kde.org ***)

Package:           khtml
Version:           KDE 2.1.0 
Severity:          normal
Installed from:    RedHat RPMs
Compiler:          gcc version 2.96 20000731 (Red Hat Linux 7.0)
OS:                Linux
OS/Compiler notes: Not Specified

This could almost be considered a memory leak but Konqueror appears to clean itself up after it (finally) finished rendering this page.

When I browse to this page 

http://www.kuro5hin.org/?op=displaystory;sid=2001/3/5/134153/5253

Konqueror loads the page until the progress meter gets to 98% then starts using memory like MAD.  It uses all my physical memory and nearly all of swap and causes my machine to thrash and become nearly unresponsive.  Eventually if I'm patient enough the memory is suddenly freed and Konqueror goes back to normal.

Hopefully the above link will help determine why Konqueror or KHTML is leaking memory.

(Submitted via bugs.kde.org)
Comment 1 Tomas Pospisek 2001-03-13 11:19:39 UTC
Package: konqueror
Version: 4:2.1.0-4.1
Severity: normal

I'm seeing a similar problem like 21842@bugs.kde.org when pointing
konqueror to:

http://freshmeat.net/daily/2001/03/13/

Konqueror will start eating up all memory (>400MB) untill my system
becomes unresponsive. I haven't had the patience to wait and see if the
system ever wakes up again.
*t

PS: Sorry Ivan it's again my mixed potato/woody system.

-----------------------------------------------------------------------
     Tomas Pospisek
     sourcepole    -   Linux & Open Source Solutions
     http://sourcepole.com
     Elestastrasse 18  7310 Bad Ragaz  Switzerland
     Tel:+41 (81) 330 77 13  Fax:+41 (81) 330 77 12
------------------------------------------------------------------------
Comment 2 Tomas Pospisek 2001-03-13 11:21:13 UTC
Sorry the correct killer-URL is:

http://freshmeat.net/daily/2001/03/12/

-----------------------------------------------------------------------
     Tomas Pospisek
     sourcepole    -   Linux & Open Source Solutions
     http://sourcepole.com
     Elestastrasse 18  7310 Bad Ragaz  Switzerland
     Tel:+41 (81) 330 77 13  Fax:+41 (81) 330 77 12
------------------------------------------------------------------------
Comment 3 Dirk Mueller 2001-03-13 18:15:22 UTC
Moin Tomas!

Tomas Pospisek schrieb am Dienstag den 13. M=E4rz 2001:

> Package: konqueror
> Version: 4:2.1.0-4.1
> Severity: normal
>=20
> I'm seeing a similar problem like 21842@bugs.kde.org when pointing
> konqueror to:
>=20
> http://freshmeat.net/daily/2001/03/13/
>=20
> Konqueror will start eating up all memory (>400MB) untill my system
> becomes unresponsive. I haven't had the patience to wait and see if the
> system ever wakes up again.
> *t
>=20
> PS: Sorry Ivan it's again my mixed potato/woody system.

I can't reproduce that one. well it leaks about 60k of memory and it uses=
=20
about 4MB total. so I don't understand why you see such a problem.=20

try recompiling probably a binary incompatibility somewhere.=20


Dirk
Comment 4 Tomas Pospisek 2001-03-13 22:47:07 UTC
Hallo Dirk

Zitiere Dirk Mueller <mueller@kde.org>:

> > Package: konqueror
> > Version: 4:2.1.0-4.1
> > Severity: normal
> > 
> > I'm seeing a similar problem like 21842@bugs.kde.org when pointing
> > konqueror to:
> > 
> > http://freshmeat.net/daily/2001/03/13/
> > 
> > Konqueror will start eating up all memory (>400MB) untill my system
> > becomes unresponsive. I haven't had the patience to wait and see if
> > the system ever wakes up again.
>
> I can't reproduce that one. well it leaks about 60k of memory and it
> uses about 4MB total. so I don't understand why you see such a problem.

It's the page of preceding day (as I wrote in the follow-up). I'm sorry.
The correct URL should be:

http://freshmeat.net/daily/2001/03/12/
 
> try recompiling probably a binary incompatibility somewhere. 

I'm using Ivan's binary-i386 Debian package (from potato).

I see this behaveour occassionaly here but with the above page it's
100% reproducible. The effect is exactly as described by the other
person to whoms report I was following up. If you want I can send you a
strace or such...

I'm sorry but I will not be recompiling the stuff. I should be keeping up
with my own Debian package and it's a shame that I haven't even been able
to do that for the past two months... :-/

Danke!
*t

-----------------------------------------------------------------------
     Tomas Pospisek
     sourcepole    -   Linux & Open Source Solutions
     http://sourcepole.com
     Elestastrasse 18  7310 Bad Ragaz  Switzerland
     Tel:+41 (81) 330 77 13  Fax:+41 (81) 330 77 12
------------------------------------------------------------------------
Comment 5 Tomas Pospisek 2001-03-15 11:21:52 UTC
On Wed 14 Mar 2001 Dirk Mueller wrote:

> > The correct URL should be:
> >
> > http://freshmeat.net/daily/2001/03/12/
>
> > I see this behaveour occassionaly here but with the above page it's
> > 100% reproducible. The effect is exactly as described by the other
> > person to whoms report I was following up. If you want I can send you a
> > strace or such...
>
> not reproduceable here.

You can find a strace of the process at

http://spin.ch/~tpo/konqueror-strace

I have started konqueror and gone to freshmeat. Only *then* I started the
strace on the process. After that I've entered the "bad URL" in question
and have waited untill I saw that konqueror was starting to swallow
huge chunks of memory (>230M). Then I killed (SIGTERM) the process.

*t

-----------------------------------------------------------------------
     Tomas Pospisek
     sourcepole    -   Linux & Open Source Solutions
     http://sourcepole.com
     Elestastrasse 18  7310 Bad Ragaz  Switzerland
     Tel:+41 (81) 330 77 13  Fax:+41 (81) 330 77 12
------------------------------------------------------------------------
Comment 6 Dirk Mueller 2001-03-15 14:01:19 UTC
Moin Tomas!

> You can find a strace of the process at
> 
> http://spin.ch/~tpo/konqueror-strace
> 
> I have started konqueror and gone to freshmeat. Only *then* I started the
> strace on the process. After that I've entered the "bad URL" in question
> and have waited untill I saw that konqueror was starting to swallow
> huge chunks of memory (>230M). Then I killed (SIGTERM) the process.

well that doesn't help me. all I see is that it eats memory. well i know 
the page is big and our memory management for big pages is suboptimal. these 
things are going to be fixed at some point. but there is no memory 
corruption going on and no uninitialized memory read or write beyond range 
so nothing strange is happening I verified that. 
you're sure you don't have efence or something like that enabled ? :)
it uses about 8MB of memory here. thats not too bad. well the 2.1 release 
version leaked some memory but all those things are fixed already and it 
won't sum up more than the total page requires in any case either. 

you can try recompiling everything switch to 2.1.1 pre (or better) to CVS 
HEAD but otherwise I can only close your bugreport. haven't heard of 
anybody else being able to reproduce that one either. 

maybe you can tell me your distribution installation method qt version 
xft support enabled maybe that gives a hint. 

Dirk
Comment 7 Tomas Pospisek 2001-03-15 14:59:48 UTC
On Thu 15 Mar 2001 Dirk Mueller wrote:

> you're sure you don't have efence or something like that enabled ? :)

I haven't ever installed such a thing here so no I guess not.

> haven't heard of anybody else being able to reproduce that one either.

I have written to the other guy reporting a similar error. We'll see
whether he'll reply.

> maybe you can tell me your distribution installation method qt version
> xft support enabled maybe that gives a hint.

From reportbug:

-- System Information
Debian Release: testing/unstable
Architecture: i386
Kernel: Linux tpo2 2.2.16 #1 Wed Aug 2 20:22:26 GMT 2000 i686

Versions of packages konqueror depends on:
ii  debconf          0.2.80.17               Debian configuration management sy
ii  kdebase-libs     4:2.1.0-4.1             KDE libraries amd modules for kdeb
ii  kdelibs3         4:2.1.0-0.potato2       KDE core libraries (runtime files)
hi  lesstif1         1:0.91.3-1              OSF/Motif implementation released
ii  libc6            2.2.2-1                 GNU C Library: Shared libraries an
hi  libjpeg62        6b-1.2                  The Independent JPEG Group's JPEG
ii  libkonq3         4:2.1.0-4.1             Core libraries for KDE's file mana
ii  liblcms          1.07-1                  Color management library
hi  libmng1          1.0.0-0.potato2         Multiple-image Network Graphics li
ii  libpng2          1.0.8-1                 PNG library - runtime
ii  libqt2           2:2.3.0-final-0.potato1 Qt GUI Library (runtime version).
hi  libstdc++2.10    1:2.95.2-7              The GNU stdc++ library
ii  xlib6g           4.0.2-1                 pseudopackage providing X librarie
hi  zlib1g [libz1]   1:1.1.3-5               compression library - runtime

*t

-----------------------------------------------------------------------
     Tomas Pospisek
     sourcepole    -   Linux & Open Source Solutions
     http://sourcepole.com
     Elestastrasse 18  7310 Bad Ragaz  Switzerland
     Tel:+41 (81) 330 77 13  Fax:+41 (81) 330 77 12
------------------------------------------------------------------------
Comment 8 Tomas Pospisek 2001-03-29 19:32:00 UTC
Moin Dirk

FYI as of konqueror from KDE 2.1.1 the URL below does *not* cause
konqueror to eat up all memory any more. So you can close the bug.

Btw there was a similar bugreport by Meldroc <meldroc@frii.com> which I
guess you can close as well.

Congrats to you and the whole kfm team for your *excellent* work. Keep
it rolling and all the best!
*t

Zitiere Tomas Pospisek <tpo@sourcepole.ch>:

> On Wed 14 Mar 2001 Dirk Mueller wrote:
> 
> > > Tomas Pospisek wrote:
> > >
> > > http://freshmeat.net/daily/2001/03/12/
(cut)
> >
> > not reproduceable here.

-----------------------------------------------------------------------
     Tomas Pospisek
     sourcepole    -   Linux & Open Source Solutions
     http://sourcepole.com
     Elestastrasse 18  7310 Bad Ragaz  Switzerland
     Tel:+41 (81) 330 77 13  Fax:+41 (81) 330 77 12
------------------------------------------------------------------------
Comment 9 Dirk Mueller 2001-03-29 19:46:13 UTC
closing