Bug 84103 - bad solution of downloading files from "list all links"
Summary: bad solution of downloading files from "list all links"
Status: RESOLVED FIXED
Alias: None
Product: kget
Classification: Applications
Component: general (show other bugs)
Version: unspecified
Platform: unspecified Linux
: NOR normal
Target Milestone: ---
Assignee: KGet authors
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2004-06-27 21:15 UTC by Lukas Stec
Modified: 2007-09-22 17:01 UTC (History)
0 users

See Also:
Latest Commit:
Version Fixed In:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Lukas Stec 2004-06-27 21:15:17 UTC
Version:           v0.8.3 (using KDE 3.2 BRANCH >= 20040204, Mandrake Linux Cooker i586 - Cooker)
Compiler:          gcc version 3.3.2 (Mandrake Linux 10.0 3.3.2-6mdk)
OS:                Linux (i686) release 2.6.3-13mdk

I wanted to download all images from http://b0rg.wavenet.pl/rotfl/index.php?task=Pokaz&offl=0&offr=500
so i clicked "list all links" then i selected 500 links and clicked download (it was late i wasn't thinking, and links pointed to .php LOL).
After 5 minutes of 100% cpu usage and eating 80MB of ram (20MB left as buffers) on my AMD 2000+ kget window started reacting...
All files were called img.php...
after clicking on 200 dialog boxes i killed it. (it was to late to play with it).
today when kget runed after rm'ing ~/.kde/blahblah/tranfers.sth.
Comment 1 Mohd Asif Ali Rizwaan 2006-01-21 01:50:49 UTC
kget hangs and abuses webserver with too many connections when download all links is used!

try downloading all files from this link:
http://mobilelibrary.cdacnoida.com/book.html

what happens after we do "select all links" and choose all links and click download selected files:

1. KGet tries to check whether all links are online! this is a very bad behavior of kget, this thing of "checking all links before download" causes too much load on the server and also kget hangs and becomes unresponsive for quite a while.

Expected Behvior:
-----------------

Kget should add all links (selected for download), and start downloading "as per limit" feature.

it should only check the file's "online availability" only when it is about to download the said file/link.

in this way the server won't get hurt and kget won't hang. There are many ftp sites which bans IP addresses who make too many connections (mostly more than 2) at a time.

so please don't let kget ban my ip ;) thanks!
Comment 2 Urs Wolfer 2007-09-22 17:01:27 UTC
You can now filter the result of the KGet Konqueror plugin. This way you can for example only download all wished files.