Bug 233732

Summary: kget download only a part of a file
Product: [Applications] kget Reporter: Philippe ROUBACH <philippe.roubach>
Component: generalAssignee: KGet authors <kget>
Status: RESOLVED FIXED    
Severity: normal CC: a.samirh78, aiacovitti, david.narvaez, kde, mat69, trueg
Priority: NOR    
Version: 2.8.3   
Target Milestone: ---   
Platform: unspecified   
OS: Linux   
Latest Commit: Version Fixed In:
Sentry Crash Report:
Attachments: kget pb
kgetdebugoutput
kget.log
kget403.png
kget403.log
kget299.png
kgetset.png
kget 2.8.4 debug log

Description Philippe ROUBACH 2010-04-08 14:21:17 UTC
Version:           2.4.2 (using 4.4.2 (KDE 4.4.2), Mandriva Linux release 2010.1 (Cooker) for i586)
Compiler:          gcc
OS:                Linux (i686) release 2.6.33.2-desktop-1mnb

kget is the default konqueror downloader
the phenomenon is a random one

when downloading
then
kget points the file is 100 % downloaded
then
you notice with dolphin the file size is some 99 KB intead of for example 29 MB
or some 200 KB instead of 900 KB

no pb when kget is not the default donwloader of konqueror
Comment 1 Philippe ROUBACH 2010-04-08 14:23:57 UTC
see my report

https://qa.mandriva.com/show_bug.cgi?id=57597
Comment 2 Lukas Appelhans 2010-04-08 14:30:07 UTC
Can you post the link you want to download from?

Lukas
Comment 3 Philippe ROUBACH 2010-04-08 14:56:40 UTC
today i tried to download simpleviewer

http://www.simpleviewer.net/downloads/simpleviewer.zip

the result is 67 ko

at the second try simpleviewer is well downloaded 399 ko
Comment 4 Lukas Appelhans 2010-04-08 15:29:50 UTC
Mmh I tried two times and both downloads were correct...

Lukas
Comment 5 Matthias Fuchs 2010-04-10 21:49:07 UTC
Could you please post the debug output?
Comment 6 Philippe ROUBACH 2010-04-10 22:09:30 UTC
(In reply to comment #5)
> Could you please post the debug output?

what is the debug output ?
Comment 7 Lukas Appelhans 2010-04-11 15:39:26 UTC
That's the output you get when you start KGet from Konsole...

Lukas
Comment 8 Philippe ROUBACH 2010-04-11 17:18:12 UTC
Created attachment 42687 [details]
kget pb

you see
- 1st atempt : 67,8 kio
- 2nd atempt : 399,5 kio

i will send you a debug output
Comment 9 Philippe ROUBACH 2010-04-11 17:33:36 UTC
Created attachment 42688 [details]
kgetdebugoutput

i launch konqueror in konsole
then
i copy the url
http://www.simpleviewer.net/downloads/simpleviewer.zip
in the url field
then
"enter"
then
save in ~/Images
then
kget says it' finished in the notifier
then
i go to ~/Images
then
simpleviewer.zip 67,8 kio !
then
i close konqueror

see kgetdebugoutput file
Comment 10 Lukas Appelhans 2010-04-11 18:08:45 UTC
Well we need th debug output of KGet not Konqueror... just start KGet from Konsole, then do your stuff in Konqueror and then post the KGet output... :)

Lukas
Comment 11 Philippe ROUBACH 2010-04-11 18:29:14 UTC
i don't use kget alone
Comment 12 Lukas Appelhans 2010-04-11 18:49:45 UTC
Sure, but you need to *start* it alone... :)

Lukas
Comment 13 Philippe ROUBACH 2010-04-11 20:11:13 UTC
i extract this from my the file kgetdebugoutput :

...
konqueror(3426)/khtml (caret) DOM::Selection::validate: [character:baseIsStart] true Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 )
konqueror(3426) FixHostUriFilter::filterUri: FixHostUriFilter::filterUri:  KUrl("http://www.simpleviewer.net/downloads/simpleviewer.zip")
konqueror(3426) KonqMainWindow::openFilteredUrl: url "http://www.simpleviewer.net/downloads/simpleviewer.zip" filtered into KUrl("http://www.simpleviewer.net/downloads/simpleviewer.zip")
konqueror(3426) KonqMainWindow::openUrl: url= KUrl("http://www.simpleviewer.net/downloads/simpleviewer.zip") mimeType= "" _req= "[typedUrl=http://www.simpleviewer.net/downloads/simpleviewer.zip newTabInFront]" view= QObject(0x0)
konqueror(3426) KonqMainWindow::openUrl: Creating new konqrun for KUrl("http://www.simpleviewer.net/downloads/simpleviewer.zip") req.typedUrl= "http://www.simpleviewer.net/downloads/simpleviewer.zip"
konqueror(3426)/kparts KParts::BrowserRun::scanFile: KUrl("http://www.simpleviewer.net/downloads/simpleviewer.zip")
konqueror(3426)/kparts KParts::BrowserRun::slotBrowserMimetype: found "application/zip" for KUrl("http://www.simpleviewer.net/downloads/simpleviewer.zip")
konqueror(3426) KonqMainWindow::openView: "application/zip" KUrl("http://www.simpleviewer.net/downloads/simpleviewer.zip") childView= KonqView(0x9e2aa20) req: "[typedUrl=http://www.simpleviewer.net/downloads/simpleviewer.zip newTabInFront]"
konqueror(3426) KonqFactory::createView: Trying to create view for "application/zip" ""
konqueror(3426)/kdecore (trader) KMimeTypeTrader::query: query for mimeType  "application/zip" ,  "Application"  : returning  1  offers
konqueror(3426)/kdecore (trader) KMimeTypeTrader::query: query for mimeType  "application/zip" ,  "KParts/ReadOnlyPart"  : returning  0  offers
konqueror(3426) KonqFactory::createView: no part was associated with "application/zip" 
konqueror(3426)/kdecore (trader) KMimeTypeTrader::query: query for mimeType  "application/zip" ,  "Application"  : returning  1  offers
konqueror(3426)/kparts KParts::BrowserRun::saveUrl: Using:  "kget"  as Download Manager
konqueror(3426)/kparts KParts::BrowserRun::saveUrl: Calling command "/usr/bin/kget http://www.simpleviewer.net/downloads/simpleviewer.zip"
konqueror(3426)/kparts KParts::BrowserRun::handleNonEmbeddable: Save: returning Handled
QApplication::qAppName: Please instantiate the QApplication object first
kget is already running!
<unknown program name>(3925)/: Communication problem with  "kget" , it probably crashed. 
Error message was:  "org.freedesktop.DBus.Error.NoReply" : " "Did not receive a reply. Possible causes include: the remote application did not send a reply, the message bus security policy blocked the reply, the reply timeout expired, or the network connection was broken." " 

konqueror(3426) KProcessRunner::slotProcessExited: ""
konqueror(3426)/kio (KDirListerCache) KDirListerCache::slotFilesAdded: KUrl("nepomuksearch:/?sparql=select%20distinct%20%3Fr%20where%20%7B%20%3Fr%20a%20%3Chttp%3A%2F%2Fwww.semanticdesktop.org%2Fontologies%2F2007%2F03%2F22%2Fnfo%23FileDataObject%3E%20.%20%20OPTIONAL%20%7B%20%3Fr2%20a%20nfo%3AFolder%20.%20FILTER%28%3Fr%3D%3Fr2%29%20.%20%7D%20.%20FILTER%28%21BOUND%28%3Fr2%29%29%20%7D%20LIMIT%20100")
konqueror(3426)/kio (KDirListerCache) KDirListerCache::updateDirectory: KUrl("nepomuksearch:/?sparql=select%20distinct%20%3Fr%20where%20%7B%20%3Fr%20a%20%3Chttp%3A%2F%2Fwww.semanticdesktop.org%2Fontologies%2F2007%2F03%2F22%2Fnfo%23FileDataObject%3E%20.%20%20OPTIONAL%20%7B%20%3Fr2%20a%20nfo%3AFolder%20.%20FILTER%28%3Fr%3D%3Fr2%29%20.%20%7D%20.%20FILTER%28%21BOUND%28%3Fr2%29%29%20%7D%20LIMIT%20100")
konqueror(3426)/khtml (caret) DOM::Selection::moveTo: Selection[ Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) 1 ] Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 )
konqueror(3426)/khtml (caret) DOM::Selection::validate: Selection[ Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) Position( 0x0 "null" : 0 ) 1 ] 0
...
Comment 14 Lukas Appelhans 2010-04-11 20:47:07 UTC
Doesn't matter if the download opens up in KGet...

We need the output of KGet itself...

Lukas
Comment 15 Philippe ROUBACH 2010-04-12 12:11:49 UTC
i can't reproduce the phenomenon with kget alone

bad interaction between konqueror and kget ?
Comment 16 Lukas Appelhans 2010-04-12 12:18:00 UTC
Could theoretically happen... do those steps:
1) Quit KGet and then restart it manually in a Konsole-Window
2) Go to Konqueror and click download/whatever -> the transfer gets added to KGet
3) Post the output KGet gave...

Lukas
Comment 17 Philippe ROUBACH 2010-04-12 15:12:16 UTC
i can't reproduce phenomenon, i tried with 2 sites
but i detected another pb !

in dolphin i see a file is completely downloaded  30 MB
kget indicates 30 MB , 0% progress and waiting state

we see the notifier without stopping, turning and turning

after 5 mn kget indicates 1 % progress

when i quit kget then kget crashes
Comment 18 Philippe ROUBACH 2010-04-12 15:18:14 UTC
Created attachment 42715 [details]
kget.log

the log corresponding to my comment #17
Comment 19 Matthias Fuchs 2010-04-12 17:06:47 UTC
Do you have a backtrace for the crash of #17? If you have one please create an own bug report for this issue.
Comment 20 Philippe ROUBACH 2010-04-12 17:55:24 UTC
(In reply to comment #19)
> Do you have a backtrace for the crash of #17? If you have one please create an
> own bug report for this issue.

no i have not a backtrace
Comment 21 Philippe ROUBACH 2010-04-12 17:56:45 UTC
addendum
in my comment #17 i applied lukas method (comment #16)
Comment 22 Matthias Fuchs 2010-04-13 00:34:31 UTC
(In reply to comment #21)
> addendum
> in my comment #17 i applied lukas method (comment #16)
This does not really help as at least here doing what is described in comment #16 does not result in a crash. So if it is reproduceable for you please try to get a backtrace otherwise tracking down the error is not feasible.
Comment 23 Philippe ROUBACH 2010-04-13 10:41:21 UTC
to make a backtrace you need to install debug packet of :
- konqueror
- kget

yes ?

is there any other packet to install ?
Comment 24 Nicolas L. 2010-04-13 11:05:53 UTC
kdebase4-debug
kdenetwork4-debug
Comment 25 Philippe ROUBACH 2010-04-13 13:00:12 UTC
1. Experimentation
i want to download simpleviewer 399,5 kiB

i launch kget with gdb

gdb kget
then
run
with konqueror i start downloading simpleviewer
then
kget downloads 403,1 kiB 
then
kget stops indicate about  99 %, waiting
then
after 1 mn
kget indicates 100 %, 403,1 kiB, terminated
then
i close kget
then
there is no crash

i send you :
- a capture of kget gui indicating 403,1 kiB, 100 %, terminated
kget403.png

- a log of kget output but no backtrace (when i execute "thread apply all backtrace" i got nothing)
kget403.log

3. this time the phenomenon is different and the contrary of my first experiment
defined in "description"

the file is bigger 403,1 kiB instead of 399,5 kiB
Comment 26 Philippe ROUBACH 2010-04-13 13:01:03 UTC
Created attachment 42739 [details]
kget403.png
Comment 27 Philippe ROUBACH 2010-04-13 13:02:32 UTC
Created attachment 42740 [details]
kget403.log
Comment 28 Philippe ROUBACH 2010-04-13 13:09:46 UTC
addendum
i checked with dolphin the 403.1 kiB
Comment 29 Lukas Appelhans 2010-04-15 15:13:45 UTC
But you can open the file?

Lukas
Comment 30 Matthias Fuchs 2010-04-15 15:35:00 UTC
There is only a backtrace if the program crashes.
Acutally SimpleViewer has 403 kb (tried it with KGet, wget, Firefox --> always same size), so that is correct. Maybe there was simply an update and that is why there is a different filesize now.

I cannot see anything bad in the log, but try to disable Nepomuk (in system settigns advanced) and check if there also is that 1 minute gap.
Comment 31 Philippe ROUBACH 2010-04-15 15:39:19 UTC
i can open the zip file.
i can navigate among folders tree
Comment 32 Philippe ROUBACH 2010-04-15 16:06:27 UTC
1. 

i unactivate nepomuk
then
i dolwload without pb
then
i activate nepomuk adn strigi
then
i have a pb

2. details of the experiment

the file is downloaded till 403,1 kio
then
kget indicates "99 %, wait"
we see notifier turning and turning
then
kget indicates "n.d, wait"
we see notifier turning and turning
curiously kget title bar indicayes 299 % (see the capture kget299.png)
then
kget indicates 100 %, terminated
then
without action by me kget crashes
see the capture lket
Comment 33 Philippe ROUBACH 2010-04-15 16:07:14 UTC
Created attachment 42802 [details]
kget299.png
Comment 34 Philippe ROUBACH 2010-04-15 16:24:45 UTC
kget crashe backtrace :

Application: KGet (kget), signal: Segmentation fault
[KCrash Handler]
#6  0xb74e365c in QNetworkProxy::QNetworkProxy() () from /usr/lib/libQtNetwork.so.4
#7  0xb7500852 in ?? () from /usr/lib/libQtNetwork.so.4
#8  0xb7503e84 in QTcpSocket::QTcpSocket(QObject*) () from /usr/lib/libQtNetwork.so.4
#9  0xb750a80a in ?? () from /usr/lib/libQtNetwork.so.4
#10 0xb7506c38 in QLocalSocket::QLocalSocket(QObject*) () from /usr/lib/libQtNetwork.so.4
#11 0xb5c2520b in ?? () from /usr/lib/libsopranoclient.so.1
#12 0xb5c26450 in ?? () from /usr/lib/libsopranoclient.so.1
#13 0xb5c26bde in ?? () from /usr/lib/libsopranoclient.so.1
#14 0xb5c29715 in ?? () from /usr/lib/libsopranoclient.so.1
#15 0xb76555f0 in ?? () from /usr/lib/libnepomuk.so.4
#16 0xb7655782 in ?? () from /usr/lib/libnepomuk.so.4
#17 0xb7651bc9 in ?? () from /usr/lib/libnepomuk.so.4
#18 0xb61b5c4f in ?? () from /lib/i686/libc.so.6
#19 0xb76b8b9c in Soprano::LiteralValue::toString() const () from /usr/lib/libnepomuk.so.4
#20 0x00000000 in ?? ()
Comment 35 Nicolas L. 2010-04-15 16:38:56 UTC
please install 
qt4-debug
soprano-debug
kdelibs4-debug

and give the backtrace again
Comment 36 Lukas Appelhans 2010-04-15 22:35:18 UTC
The last backtrace seems pretty Soprano/Nepomuk related, no Sebastian?

Lukas
Comment 37 Nicolas L. 2010-04-15 22:37:54 UTC
this is completly a nepomuk issue for the last trace
Comment 38 Philippe ROUBACH 2010-04-15 23:02:16 UTC
i have other reports where nepomuk is a pb :
- when opening file selector gui in firefox
https://qa.mandriva.com/show_bug.cgi?id=58776
- when recording a document with OOwriter
https://qa.mandriva.com/show_bug.cgi?id=58159
Comment 39 Sebastian Trueg 2010-04-16 09:02:31 UTC
https://qa.mandriva.com/show_bug.cgi?id=58776 has been fixed already. https://qa.mandriva.com/show_bug.cgi?id=58159 should be the same.

This bug, however, does not look related to the other two. It could, however be that this will be fixed by Soprano 2.4.2.
Comment 40 Philippe ROUBACH 2010-04-16 17:29:58 UTC
with scribo 0.6.2 and soprano 2.4.2

now each times i download a file
i have immediately

"stop, n.d., 0 %"
and that's all : i wait for a few minutes

when i click on "start" then the file :
either is well downloaded without error
or we have " 99%,wait" for 1 or 2 minute then "terminated,100 %"
the file is good
Comment 41 Philippe ROUBACH 2010-04-16 17:31:32 UTC
addendum

it seems there is no more crash
Comment 42 Matthias Fuchs 2010-04-23 17:22:24 UTC
SVN commit 1117967 by mfuchs:

When download finished do nepomuk tagging etc. after the status text has changed.
That way 100% is always showed, even if tagging might take very long.

CCBUG:233732

 M  +8 -8      transfer.cpp  


WebSVN link: http://websvn.kde.org/?view=rev&revision=1117967
Comment 43 Matthias Fuchs 2010-04-23 17:23:24 UTC
SVN commit 1117969 by mfuchs:

Fowardport r1117967
When download finished do nepomuk tagging etc. after the status text has changed.
That way 100% is always showed, even if tagging might take very long.

CCBUG:233732

 M  +8 -8      transfer.cpp  


WebSVN link: http://websvn.kde.org/?view=rev&revision=1117969
Comment 44 Philippe ROUBACH 2010-08-05 10:28:47 UTC
Mandriva 2010.1 32 bit
kde 4.4.3

again file is partly downloaded
today i downloaded GoogleEarthLinux.bin from google server

size : 99 B !
content of the file : 4 lines !
*************************************************
#!/bin/sh
# This script was generated using Makeself 2.1.5

CRCsum="3247353429"
MD5="3c77e1a6fc6fdd
***********************************************
Comment 45 Matthias Fuchs 2010-08-10 19:15:46 UTC
Can you please go to the KGet settings and tell me which plugins are activated? If the "KIO" plugin is activated then please retry with it deactivated.
Comment 46 Philippe ROUBACH 2010-08-10 21:38:49 UTC
kio plugin is activated

see the capture kgetset.png
Comment 47 Philippe ROUBACH 2010-08-10 21:39:54 UTC
Created attachment 49980 [details]
kgetset.png
Comment 48 Philippe ROUBACH 2010-08-10 21:40:41 UTC
ok i will test with konqueror+kget and kio plugin unactivated
Comment 49 Lukas Appelhans 2012-06-14 11:11:01 UTC
*** Bug 300368 has been marked as a duplicate of this bug. ***
Comment 50 Lukas Appelhans 2012-06-14 11:12:06 UTC
Reopen this bug again as it seems not to be fixed yet...
Comment 51 David E. Narvaez 2012-11-17 12:50:16 UTC
Do you have any example URLs to test? I at least know that downloading patches from KDE's Review Board will consistently result in truncated files.
Comment 52 Andrea Iacovitti 2013-01-25 11:26:52 UTC
Created attachment 76707 [details]
kget 2.8.4 debug log

Attaching debug output of kget (v2.8.4) when downloading commit diff from quickgit.kde.org.
The downloaded file size is 751 bytes while it should be of 1478 bytes.
Comment 53 Philippe ROUBACH 2019-03-09 11:38:54 UTC
kde app 18.12.2
plasma 5.15.2
kde framewoork 5.55.0
qt 5.12.1

no more problem