Bug 103661

Did you compile kio_fish with debugging? If so, it might be spewing debugging information to ~/.xsession-errors and causing a noticeable slow-down.

I've compiled it like this:
configure --prefix=/opt/kde --disable-debug
make
make install

I don't think this is the problem.
My ~/.xsession-errors file is only 2.8K

xset:  bad font path element (#63), possible causes are:
    Directory does not exist or has wrong permissions
    Directory missing fonts.dir
    Incorrect font server address or syntax
xset:  bad font path element (#63), possible causes are:
    Directory does not exist or has wrong permissions
    Directory missing fonts.dir
    Incorrect font server address or syntax
xset:  bad font path element (#63), possible causes are:
    Directory does not exist or has wrong permissions
    Directory missing fonts.dir
    Incorrect font server address or syntax
xset:  bad font path element (#63), possible causes are:
    Directory does not exist or has wrong permissions
    Directory missing fonts.dir
    Incorrect font server address or syntax
xset:  bad font path element (#63), possible causes are:
    Directory does not exist or has wrong permissions
    Directory missing fonts.dir
    Incorrect font server address or syntax
startkde: Starting up...
kbuildsycoca running...
kdecore (KLibLoader): WARNING: KLibrary: /opt/kde/lib/kde3/kcm_kdnssd.so: undefined symbol: init_kdnssd
ALSA lib pcm_hw.c:549:(snd_pcm_hw_start) SNDRV_PCM_IOCTL_START failed: Broken pipe
ALSA lib pcm_hw.c:549:(snd_pcm_hw_start) SNDRV_PCM_IOCTL_START failed: Broken pipe
ALSA lib pcm_hw.c:549:(snd_pcm_hw_start) SNDRV_PCM_IOCTL_START failed: Broken pipe
konqueror: WARNING: Unknown class  in session saved data!
konqueror: WARNING: Unknown class  in session saved data!
konqueror: WARNING: Unknown class  in session saved data!
konqueror: WARNING: Unknown class  in session saved data!
ALSA lib pcm_hw.c:549:(snd_pcm_hw_start) SNDRV_PCM_IOCTL_START failed: Broken pipe
ALSA lib pcm_hw.c:549:(snd_pcm_hw_start) SNDRV_PCM_IOCTL_START failed: Broken pipe
kio (KIOConnection): ERROR: Header read failed, errno=104
kio (KIOConnection): ERROR: Header has invalid size (-1)
X Error: BadWindow (invalid Window parameter) 3
  Major opcode:  20
  Minor opcode:  0
  Resource id:  0x2600022
X Error: BadWindow (invalid Window parameter) 3
  Major opcode:  20
  Minor opcode:  0
  Resource id:  0x0
ALSA lib pcm_hw.c:549:(snd_pcm_hw_start) SNDRV_PCM_IOCTL_START failed: Broken pipe
X connection to :0.0 broken (explicit kill or server shutdown).
X Error: BadWindow (invalid Window parameter) 3
  Major opcode:  20
  Minor opcode:  0
  Resource id:  0x2c00011
X Error: BadWindow (invalid Window parameter) 3
  Major opcode:  20
  Minor opcode:  0
  Resource id:  0x0
X Error: BadWindow (invalid Window parameter) 3
  Major opcode:  20
  Minor opcode:  0
  Resource id:  0x0
QClipboard: Unknown SelectionClear event received.
X Error: BadWindow (invalid Window parameter) 3
  Major opcode:  20
  Minor opcode:  0
  Resource id:  0x2c003a4
X Error: BadWindow (invalid Window parameter) 3
  Major opcode:  20
  Minor opcode:  0
  Resource id:  0x0

I can confirm this:

fish: -> local is fast (up to 11 MBit/s)
local -> fish: is slow (1.2 MBit/s)

I'm running SuSE 9.1 with KDE 3.4 (from SuSE supplementary).

I can confirm this also, but with a 10Mbps+ internet connection:

Copying file from my workstation, which is on a 250Mbps internet connection (during not peak hours), to a remote machine on a 10Mbps internet connection

file:
007-TLBS20Apr05.ogg (~17.8 MB)

scp:
007-TLBS20Apr05.ogg                           100%   18MB 505.5KB/s   00:36

fish:
66.6KB/s (screen: http://www.roback.cc/tmp/fish_bug.jpg)

I repeated the tests 3 times with the results within ~5kb of the original tests. I seen this happen since 3.3.x. :(

KDE-3.4
openssh-3.9_p1

Tested on both Gentoo & Kubuntu with same results. My .xsession-errors file is empty also.

I receive the same slow results with the sftp:// kio slave also. Maybe it is not a fish specific problem...

Still in kde 3.5 I find a rate of 1 Mbps with fish when scp gets to 10 Mbps.

I can also confirm that this problem still exists in KDE 3.5.1 (gentoo):

local <- fish://remote : 10 MB/s
local -> fish://remote : 1 MB/s
local -> fish://localhost : very fast  (NO traffic in ethereal monitoring any)
local -> fish://127.0.0.1 : about 500 KB/s (traffic in ethereal monitoring any)

Note that on both machines the CPU is almost idle during the slow transfers.

This bug still exists in KDE 3.5.2

sftp://: ~3MB/s
scp: 8-9MB/s

I can confirm this bug in KDE 3.5.2. Uploads via fish always get stalled. I can't finish an upload any more.

kio-Sftp is 2.6 times slower than commandline sftp client:

Commandline sftp:
---
sftp mw@xxxx
cd xyz
get amarok-1.4.0-23.2.i586.rpm
[...]
100%  18MB  2.6MB/s   00:07
---

kio-sftp:
---
~1MByte/second
---

I used IPTraf to count the transfered bytes and packets:

sftp commandline client:
---
Packets incoming:  13312
Bytes incoming: 19795472
(~2000 packets/s)
Packets outgoing:   6814
Bytes outgoing:   499884
(~1000 packets/s)

kio-sftp:
---
Packets incoming:  13978
Bytes incoming: 19821409
(~770 packets/s)
Packets outgoing:   7293
Bytes outgoing:   514770
(~400 packets/s)

Ping is 1.60 ms (== 1/625)

Could it be that kio sftp waits for an ack after each package, while the commandline sftp client has some more intelligent design to achieve those high packet rates (>2000 per second)?

Same problem with Kubuntu 5.10 and 6.06.
scp ~10MB/s
fish ~1.1MB/s

Both fish and sftp are slow, but fish is much more slower than sftp. At least, sftp is useable.

Gentoo up-to-date. Kde 3.5.3.

*** This bug has been confirmed by popular vote. ***

Same problem on Kubuntu Feisty and Edgy. No way it goes at more than 1.1MB/s. If I open two sessions, each session will still do 1.1MB/s. Idle CPU on both computers and a 100Mb/s ethernet link LAN.

Confirmed in KDE 3.5.5 (Debian Etch). Standard sftp/fish tools are faster by a multiple of 3-5x.

For me, this has changed with the latest KDE 3.5. Anyone, please re-open if it persists.

Still going on on Gutsy for me.

Works for me, same speeds in Konqueror using fish or sftp as sftp client, KDE 3.5.8 (Debian Lenny/Testing).

Same problem here, gentoo up to date, kde compiled from source v 3.5.8:
scp ~10MB/s
fish ~1.1MB/s

Reopening, fish is still slow (~1MB/s) in both KDE 3.5.8 and KDE4 trunk.

fish and sftp kioslaves performance are really bad. please fix this!

This bug exists in Fedora 10 (kde 4.1.3-1). I get ~40 MB/s across a Gigabit-LAN with scp but only ~12 MB/s with fish://.

Sometimes the transfer stalls completely (after a few hundred MB) when transferring a big (1 GB) file. 

kio_fish no longer stalls for a file transfer, see bug 147948.‎

The command iptraf shows us that the average package size is around 75 bytes while it could be 1500. This explains imo why it is so slow.

In 4.2 final I get the following transfer rates:
fish: 8 MB/s
sftp: 5.5 MB/s
scp: 9.5 MB/s

Because of some overhead, fish may be slower than scp. But as long as fish is more than 50% slower than scp, I would like to have this bug open.

I see that scp gets a high CPU utilization (per time, not per copied byte) while during a fish transfer, the CPU utilization is very low. iptraf shows us that as well fish as scp almost only send very small packages.

OK, I copied a 2.2 GB file using KDE 4.1 and using scp.

scp:  34 MB/s
fish: 25 MB/s

fish should become better, but it is understandable that it is slow in my environment - it outputs a lot of debugging messages that go into files that make the whole system slow. The time needed by fish is not a (>2) multiple of what scp takes. Closing this bug. Do not re-open for KDE 3.5.

Now really closing this bug :)