Bug 162612 - konqueror opens many kio_http processes
Summary: konqueror opens many kio_http processes
Status: RESOLVED FIXED
Alias: None
Product: kio
Classification: Frameworks and Libraries
Component: general (show other bugs)
Version: SVN
Platform: Compiled Sources Linux
: NOR normal
Target Milestone: ---
Assignee: Thiago Macieira
URL:
Keywords:
: 169643 (view as bug list)
Depends on:
Blocks:
 
Reported: 2008-05-25 19:25 UTC by Przemyslaw Kaminski
Modified: 2011-03-22 09:14 UTC (History)
17 users (show)

See Also:
Latest Commit:
Version Fixed In:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Przemyslaw Kaminski 2008-05-25 19:25:34 UTC
Version:            (using Devel)
Installed from:    Compiled sources
OS:                Linux

Konqueror opens many kio_http processes. Each takes about 2 MB of memory, which sums up to a lot when browsing for a while (this is much much more than Mozilla :)).
For example, when I open http://last.fm, I immediately get about 11 kio_http processes. Closing Konqueror doesn't kill the processes, they need to be killed by hand.
I'm using the most recent kdemod packages, with KDE 4.0.80-1.
Comment 1 FiNeX 2008-05-26 13:41:15 UTC
It opens 17 kio_http to me ... using trunk r812722. Everyone use a lot of CPU and mem while the page loads.
Comment 2 Volker Hemmann 2008-08-05 18:45:28 UTC
and then they stay around. And which each site opened more kio_http instances accumulate. And konqueror. And kio_pop3 and kmail? never goes away. After some hours you either hit your fork limit or you oom.

...
Comment 3 A. Spehr 2008-08-23 09:53:21 UTC
*** Bug 169643 has been marked as a duplicate of this bug. ***
Comment 4 FiNeX 2008-08-23 11:12:27 UTC
shouldn't this bug be assigned to KIO?
Comment 5 eli 2008-09-20 06:54:36 UTC
Problem persists in 4.1.1
Comment 6 eli 2008-09-22 21:19:27 UTC
Could you please make this a priority as Konqueror is next to unuseable because of all of the spawned processes being left behind. The result of this is that kde becomes very unresponsive.

As a result of this I've been forced to make Firefox my default web browser. I miss Konqueror.
Comment 7 nick 2008-09-24 19:04:09 UTC
Also, nspluginwrapper and nspluginviewer processes seem to stack up as well as their konqueror processes.
Just visit finance.google.com and visit the page for a single stock, then exit or open another in a different tab/window. You will have several nsplugin* processes gobbling up memory that stay _forever_.

As an aside, konqueror processes never seem to exit *at all*, even with Settings -> Configure Konqueror -> Performance -> preloading max set to 0.

This is not good.
Comment 8 eli 2008-09-25 06:55:42 UTC
Something changed in Fedora 9 between the release in the updates-testing and the move to the updates repository. You still get a lot of kio-http processes and they still take up quite a bit of memory, but when Konqueror is closed, it takes a while, but the running kio-http processes eventually close. If there is a change. I will let you know.
Comment 9 eli 2008-09-25 21:21:13 UTC
Wrote a little too soon. It would seem that things are better, but really not 100%. kio-http is still leaving being processes, but significantly less.
Comment 10 eli 2008-09-29 07:00:45 UTC
OK... the remainder of the kio-http processes may be coming from kmail. I need to investigate a little further.
Comment 11 eli 2008-10-10 06:54:26 UTC
This is back with a vengence in 4.1.2
Comment 12 eli 2008-10-10 07:08:02 UTC
This bug will kill konqueror. Please fix ASAP
Comment 13 Jörg Walter 2008-10-19 18:21:18 UTC
Isn't this the same as #162612? This also affects me, including npviewer-processes and kioexec processes. 
Comment 14 Jörg Walter 2008-10-19 18:22:12 UTC
Bah, typo. I was referring to Bug #172566.
Comment 15 eli 2008-11-16 09:20:49 UTC
Problem persists in 4.1.3
Comment 16 nick 2008-11-17 17:26:25 UTC
Can we bump the severity level up on this?
This bug is not just an annoyance--it's a show stopper.
I've used konqy as my primary browser for 10 years, and I've
stopped using konqy altogether because of this bug.
It really is that bad.

Comment 17 Volker Hemmann 2008-11-17 18:13:28 UTC
16, you are right, this is a showstopper - and it is unfixed in svn.

A lot of people have some ulimit setting to protect the system from fork bombs - and with the current kio_* misbehaviour you soon DOS yourself. It is really great if you can't even get a shell, because a bunch of kio processes blocks everything. Yeah, I know, switch to vt, log in as root, kill '
em - still that is just a workaround, not a solution and with the current state of video drivers, where a switch to vt and back can freeze your system, it is a very, very bad workaround.
Comment 18 Thiago Macieira 2008-11-17 20:02:22 UTC
My KDE 4.2 build doesn't seem affected. kio_http seems to be dying as expected.

However, I have a 14 kio_file running, some of which have been running for almost a month. They are stuck in a select(2) call, waiting for activity in their incoming sockets.

Unfortunately, I can't debug the older slaves. I can't see either which application they think they are connected to. I'll have to wait and see what happens.

In any case, I have 12 slaves that are older than a day, in 26 days running. That doesn't count as DoS.
Comment 19 Thiago Macieira 2008-11-17 20:54:03 UTC
Found something interesting: there seems to be a file descriptor leak somewhere. My zsh processes inside konsole are connected to kdeinit4, which doesn't make sense at all.

The sockets being duplicated in many processes and not closed properly would explain this bug.
Comment 20 nick 2008-11-17 21:02:11 UTC
You might be on to something.
For me, both kdeinit4 and krunner processes tend to collect as well.
Comment 21 nick 2008-11-17 21:09:14 UTC
As for DoS, it might just be your usage pattern.

If I click around finance.google.com a bit looking at stock charts, it
doesn't take me long before I'll have 50-100+ nspluginwrapper,
nspluginviewer, kio_http and konqueror --silent processes hanging around.
These windows do auto refresh as well, so they are not even idle, even
though they are "out of scope".

If I do any google searching (krunner alt+f2, gg:<some search term>), then
close the window when I'm done, there will always be two konqueror processes
with that search term in their arg list that hang around indefinitely until
I explicitely kill them. Do a search that takes you to a page with tons of
plugins or looping js and it eats away cpu as well as ram. Thank god for
htop...


Comment 22 Volker Hemmann 2008-11-25 03:13:25 UTC
I have built from svn today, and I still get this behaviour with konqueror. I closed all running instances, waited a bit and:
1000     24524  0.0  0.2 148820  9100 ?        S    02:22   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../plasmab11841.slave-so
1000     24528  0.0  0.2 148820  9128 ?        S    02:22   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../plasmal11841.slave-so
1000     24529  0.0  0.2 148820  9124 ?        S    02:22   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../plasmaZ11841.slave-so
1000     24530  0.0  0.2 148820  9084 ?        S    02:22   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../plasmaZ11841.slave-so
1000     24531  0.0  0.2 148820  9028 ?        S    02:22   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-..../plasmat11841.slave-so
1000     24536  0.0  0.1 138984  5116 ?        S    02:22   0:00 kdeinit4: kio_file [kdeinit] file local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../plasmapkgX24533.slave
1000     24550  0.0  0.1 139084  5940 ?        S    02:23   0:00 kdeinit4: kio_trash [kdeinit] trash local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../plasmay24546.slave-
1000     24559  0.0  0.1 138616  4128 ?        S    02:24   0:00 kdeinit4: kio_about [kdeinit] about local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorF24558.sla
1000     24567  0.0  0.2 149380  9492 ?        S    02:24   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorc24558.slave
1000     24570  0.0  0.2 149172  9264 ?        S    02:24   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorB24558.slave
1000     24571  0.0  0.2 149044  9316 ?        S    02:24   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorV24558.slave
1000     24572  0.0  0.2 148948  9184 ?        S    02:24   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorn24558.slave
1000     24573  0.0  0.2 148948  9188 ?        S    02:24   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorX24558.slave
1000     24595  0.0  0.1  42696  4488 ?        S    02:24   0:02 /usr/lib64/nspluginwrapper/i386/linux/npviewer.bin --plugin /usr/lib32/nsbrowser/plugins/libflashplayer.so --connection /org/wrapper/NSPlugins
1000     24840  0.0  0.1 140876  5904 ?        S    02:33   0:00 kdeinit4: kio_file [kdeinit] file local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konqueroro24834.slave
1000     25414  0.0  0.1 138616  4128 ?        S    02:51   0:00 kdeinit4: kio_about [kdeinit] about local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerors25411.sla
1000     25447  0.0  0.2 148820  9236 ?        S    02:52   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerord25411.slave
1000     25451  0.0  0.2 148820  9224 ?        S    02:52   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorr25411.slave
1000     25452  0.0  0.2 148820  9236 ?        S    02:52   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorW25411.slave
1000     25453  0.0  0.2 148884  9200 ?        S    02:52   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-...klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorZ25411.slave
1000     25472  0.0  0.1  42696  4424 ?        S    02:52   0:00 /usr/lib64/nspluginwrapper/i386/linux/npviewer.bin --plugin /usr/lib32/nsbrowser/plugins/libflashplayer.so --connection /org/wrapper/NSPlugins
1000     25607  0.0  0.2 148820  9176 ?        S    02:54   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorF25411.slave
1000     25674  0.0  0.2 148820  9180 ?        S    02:57   0:00 kdeinit4: kio_http [kdeinit] http local:/tmp/ksocket-.../klauncherT11689.slave-socket local:/tmp/ksocket-.../konquerorP25411.slave
Comment 23 Dario Andres 2008-12-20 02:40:30 UTC
*** Bug 178243 has been marked as a duplicate of this bug. ***
Comment 24 Charles Joseph Christie II 2009-02-09 22:52:06 UTC
Having the same problem, OpenSUSE 11.1 KDE 4.2 binaries.

I think that it might be kmail (and possibly akregator) causing the problem for me.
Comment 25 Charles Joseph Christie II 2009-02-10 19:25:16 UTC
After further investigation, it seems to be caused by the kio_http process being denied access through my school's proxy. Instead of giving up, it just keeps trying, over and over and over again. Setting up the proxy through the System Settings doesn't change things, because I can't set my proxy username and password (it's grayed out) and it's not "prompting for password as necessary" like it says it will. It's also not obeying my system environment proxy settings. If I could set my proxy username and password, this problem may fix itself. However, unlike the others in this thread, instead of many kio_https I only get one.
Comment 26 Markus Kohls 2009-02-11 03:15:11 UTC
Maybe another site to try is www.glob2.org
kio_http processes instantly rise from around 10 to 102.
Comment 27 Angel Blue01 2009-03-04 17:19:11 UTC
I get this in 4.2, no proxy and only Konqueror (with 5 tabs) open.

I don't even know if they're safe to close
Comment 28 mb1 2009-05-13 04:38:27 UTC
Bump.

I get this in KDEmod4.2.2 on Arch64.  OPening Konqueror with 4 tabs generates 50+!!! instances of kio_http.
Comment 29 eric 2009-07-11 02:23:01 UTC
I have this problem too when visiting a large webpages like http://iyalucu08.blogspot.com/

I didn't count how many kio_http processes I have, but they surely slow down my computer and eats my memory.

This bug may be the same as #196117
Comment 30 Volker Hemmann 2009-07-16 20:22:49 UTC
going through the dilbert archives I hit the bug again after a while. Twice so far. Whenever sites with pictures are involved it happens.

kde 4.3.60 from snv a few days ago
gcc 4.4
glibc 2.10.1
qt-copy
Comment 31 Jörg Walter 2010-02-25 10:33:13 UTC
Using KDE-4.4/kubuntu, I have the feeling that ioslaves still spawn in impressive numbers, but they shut down after a while. This may be just normal operation, but it's hard to tell, since there is no indication what each ioslave is doing at the moment.
Comment 32 Alexander 2010-05-02 14:44:47 UTC
Not only Konqueror. I think that is the full KDE engineers fault. Every request opens a new kio_http process. So any applications that use kio opens many new processes, whether Amarok (if you enable photos widget, for example), Ktorent etc. This applies not only to kio_http. Any protocols that supported by KIO works the same way. This isn't very noticeably with some application like Kmail ('cause I have 4 mail box and accordingly I can see 4 kio_imap4 after launching Kmail) but when I open my video folder (with 40-50 files) through Dolphin — it's a very different situation. Confirmation:
http://bugs.kde.org/show_bug.cgi?id=185881
http://bugs.kde.org/show_bug.cgi?id=202308
http://bugs.kde.org/show_bug.cgi?id=203628
http://bugs.kde.org/show_bug.cgi?id=234030

Now, for convenient KDE using, I needed 32Gb of RAM and Intel Core i7-980X Extreme Edition processor. Experience Freedom!
Comment 33 Dawit Alemayehu 2011-03-05 08:15:56 UTC
The issue with ioslave explosions should have improved after the 4.4.1 release. See http://websvn.kde.org/?view=revision&revision=1071917 and should have gotten a whole lot better after the new KIO scheduler was released with KDE 4.5.

If any of you still have experience this issue with the KDE v4.5 and up, please speak up and comment on this ticket. Otherwise, this report should be marked fixed.
Comment 34 Dawit Alemayehu 2011-03-22 09:14:39 UTC
See comment #33.