Bug 474174 - Please add multithread / multicore extraction and compression
Summary: Please add multithread / multicore extraction and compression
Status: REOPENED
Alias: None
Product: ark
Classification: Applications
Component: general (show other bugs)
Version: 23.08.0
Platform: Arch Linux Linux
: NOR wishlist
Target Milestone: ---
Assignee: Elvis Angelaccio
URL:
Keywords:
: 474805 (view as bug list)
Depends on:
Blocks:
 
Reported: 2023-09-05 06:24 UTC by etfaker
Modified: 2024-06-18 09:16 UTC (History)
6 users (show)

See Also:
Latest Commit:
Version Fixed In: 24.02
Sentry Crash Report:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description etfaker 2023-09-05 06:24:50 UTC
SUMMARY
***
Please add multithread / multicore extraction and compression.
On modern systems, especially with fast 7.000MB/s NVME's, the extraction and compression could be a lot faster.
Comparing speeds with Windows (e.g. 7-zip) gives me sometimes 4-5 times of a quicker extraction than with Ark on Linux.
I can also monitor the system load when extracting and it doesn't do any real load to CPU/NVME.
***


STEPS TO REPRODUCE
Extract / Compress anything

OBSERVED RESULT
Slow speed

EXPECTED RESULT
Faster speed

SOFTWARE/OS VERSIONS
Linux/KDE Plasma: x86_64 Linux 6.4.12-arch1-1
KDE Plasma Version: 5.27.7
KDE Frameworks Version: 5.109.0-1
Qt Version:  	5.15.10

ADDITIONAL INFORMATION
Thinkpad T14s G3 AMD (Ryzen 7 6850U, 32GB RAM, Solidigm P44 Pro NVME)
Comment 1 etfaker 2023-09-27 12:17:56 UTC
I don't want to be ignorant but why doesn't this get more attention? Am I missing smth?
Comment 2 Patrick Silva 2023-09-27 17:08:53 UTC
*** Bug 474805 has been marked as a duplicate of this bug. ***
Comment 3 Bug Janitor Service 2023-10-18 05:52:15 UTC
A possibly relevant merge request was started @ https://invent.kde.org/utilities/ark/-/merge_requests/207
Comment 4 Elvis Angelaccio 2023-11-05 11:58:27 UTC
Git commit e0928747e26415a1b46e753c517fb83b4b24c62c by Elvis Angelaccio, on behalf of Zhangzhi Hu.
Committed on 05/11/2023 at 12:58.
Pushed by elvisangelaccio into branch 'master'.

Add support for xz & zstd multithread compression

xz & zstd compression was single-threaded; make it multi-threaded,
with an algorithm to calculate the ideal number of threads based
on the number of CPU cores.
FIXED-IN: 24.02

M  +18   -0    plugins/libarchive/readwritelibarchiveplugin.cpp

https://invent.kde.org/utilities/ark/-/commit/e0928747e26415a1b46e753c517fb83b4b24c62c
Comment 5 etfaker 2023-11-05 12:03:59 UTC
Multithread fornxz and zstd was added but the majority of ppl work with zip,7z and rar which still doesn't have multithread and makes using Ark a lot.slower compared to other tools.