Bug 84103

Summary: bad solution of downloading files from "list all links"
Product: [Applications] kget Reporter: Lukas Stec <nemesis-87>
Component: generalAssignee: KGet authors <kget>
Status: RESOLVED FIXED    
Severity: normal    
Priority: NOR    
Version: unspecified   
Target Milestone: ---   
Platform: unspecified   
OS: Linux   
Latest Commit: Version Fixed In:
Sentry Crash Report:

Description Lukas Stec 2004-06-27 21:15:17 UTC 
Version:           v0.8.3 (using KDE 3.2 BRANCH >= 20040204, Mandrake Linux Cooker i586 - Cooker)
Compiler:          gcc version 3.3.2 (Mandrake Linux 10.0 3.3.2-6mdk)
OS:                Linux (i686) release 2.6.3-13mdk

I wanted to download all images from http://b0rg.wavenet.pl/rotfl/index.php?task=Pokaz&offl=0&offr=500
so i clicked "list all links" then i selected 500 links and clicked download (it was late i wasn't thinking, and links pointed to .php LOL).
After 5 minutes of 100% cpu usage and eating 80MB of ram (20MB left as buffers) on my AMD 2000+ kget window started reacting...
All files were called img.php...
after clicking on 200 dialog boxes i killed it. (it was to late to play with it).
today when kget runed after rm'ing ~/.kde/blahblah/tranfers.sth.
Comment 1 Mohd Asif Ali Rizwaan 2006-01-21 01:50:49 UTC 
kget hangs and abuses webserver with too many connections when download all links is used!

try downloading all files from this link:
http://mobilelibrary.cdacnoida.com/book.html

what happens after we do "select all links" and choose all links and click download selected files:

1. KGet tries to check whether all links are online! this is a very bad behavior of kget, this thing of "checking all links before download" causes too much load on the server and also kget hangs and becomes unresponsive for quite a while.

Expected Behvior:
-----------------

Kget should add all links (selected for download), and start downloading "as per limit" feature.

it should only check the file's "online availability" only when it is about to download the said file/link.

in this way the server won't get hurt and kget won't hang. There are many ftp sites which bans IP addresses who make too many connections (mostly more than 2) at a time.

so please don't let kget ban my ip ;) thanks!
Comment 2 Urs Wolfer 2007-09-22 17:01:27 UTC 
You can now filter the result of the KGet Konqueror plugin. This way you can for example only download all wished files.