Bug 428073 - KIO filesystem actions are very slow for small files
Summary: KIO filesystem actions are very slow for small files
Status: RESOLVED DUPLICATE of bug 342056
Alias: None
Product: frameworks-kio
Classification: Frameworks and Libraries
Component: general (show other bugs)
Version: unspecified
Platform: Debian unstable Linux
: NOR normal
Target Milestone: ---
Assignee: KIO Bugs
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2020-10-21 20:08 UTC by Valentin Petzel
Modified: 2020-10-22 09:53 UTC (History)
2 users (show)

See Also:
Latest Commit:
Version Fixed In:


Attachments
IO using cp and kcp (244.00 KB, application/x-tar)
2020-10-21 20:08 UTC, Valentin Petzel
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Valentin Petzel 2020-10-21 20:08:49 UTC
Created attachment 132618 [details]
IO using cp and kcp

Copying files over KIO is significantly slower than native filesystem actions when performing on many small files.
I did a test with 40000 files of 50K for
a) On a tmpfs cp took about a second, kcp took about 6 seconds. I guess this is a good measure of the cpu overhead of KIO copy.
b) On a hard drive cp took about 53 seconds, kcp took about 3m41s. Now this is a very significant difference.

I monitored the process in KSysGuard, and I found that copying over KIO leads to much less reading operations per second and a much lower reading speed, as you can see from the attached screenshots. (kcp reads data at about 1/10 of the rate of cp!)

I guess one possible reason for this could be an artificial limit to read ops to prevent system freezes on copy operations?
Comment 1 Patrick Silva 2020-10-22 09:53:31 UTC

*** This bug has been marked as a duplicate of bug 342056 ***