Bug 365038 - Copy large file (> 10 GB) => panel becomes unresponsive
Summary: Copy large file (> 10 GB) => panel becomes unresponsive
Status: RESOLVED WORKSFORME
Alias: None
Product: plasmashell
Classification: Plasma
Component: general (show other bugs)
Version: 5.6.4
Platform: Other Linux
: NOR major
Target Milestone: 1.0
Assignee: David Edmundson
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2016-07-03 14:08 UTC by Gregor Mi
Modified: 2020-12-08 04:34 UTC (History)
4 users (show)

See Also:
Latest Commit:
Version Fixed In:


Attachments
panel progress is stuck (19.26 KB, image/png)
2016-07-03 14:08 UTC, Gregor Mi
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Gregor Mi 2016-07-03 14:08:27 UTC
Created attachment 99827 [details]
panel progress is stuck

The following often happens when I copy large files (e.g. backup an 50 GB virtual machine image to an external USB drive) with dolphin:

1. The copy process begins normally.
2. After some time the panel (and the desktop widget) becomes unresponsive. Trying to create a new folder in dolphin renders the application unresponsive (takes about one minute until the New folder dialog appears).
3. I attached a screenshot where the panel file transfer progress is stuck at about 15 % (because the whole panel including system tray, clock and k-menu) but the file copying operation is still in progress.

Other applications and for example krunner and Alt+Tab to switch windows are still working.

Hardware: Intel Core i3 M, 8 GB RAM, 64 Bit, 500 GB internal SSD hard drive, external USB 2.0 hard drive, Kernel 4.1.26-21-default
Comment 1 Valerio Pilo 2017-02-28 16:27:01 UTC
It might not be KDE related.

Try this:

echo never >/sys/kernel/mm/transparent_hugepage/defrag
echo 0 > /sys/kernel/mm/transparent_hugepage/khugepaged/defrag 

taken from
https://bbs.archlinux.org/viewtopic.php?id=112846&p=4
Comment 2 Gregor Mi 2017-03-05 21:53:35 UTC
Today, I tried to reproduce the behaviour with some external hard drive on two different USB ports (if this has any influence). But I could not reproduce it. Kernel version: 4.1.36-44-default, openSUSE Leap 42.1, Plasma 5.8.5. I continue to have a watch.

@Valerio: Thanks for forum post. A few answers down someone writes that only this one line

$ echo madvise > /sys/kernel/mm/transparent_hugepage/defrag

should be enough and that "madvise" might have less side effects than "never".

One related thing is interesting though: when I used an USB stick instead of the drive and I copied 900 MB to it, I watched in dolphin how the new file size was growing. After it reached to target file size (pretty quickly) the job in the notification area did not stop for another minute or so. Could that be emptying some filesystem cache?
Comment 3 Valerio Pilo 2017-03-06 14:11:35 UTC
Yes, usually it's due to caching enabled for USB drives.
Comment 4 Gregor Mi 2017-03-08 21:40:59 UTC
This is a bit off-topic, but do you know how to configure the system in a way that it is save to remove the USB stick after having copied files to it without prior unmounting (for users who easily forget that)?
Comment 5 Valerio Pilo 2017-03-08 23:27:08 UTC
Actually not, but a quick search for 'linux disable usb cache' yielded this: http://ubuntuhandbook.org/index.php/2014/01/disable-disk-caching-prevent-data-loss/
It might be what you need. Good luck!
Comment 6 Gregor Mi 2017-03-10 01:40:17 UTC
Thanks for the hint. The suggested solution works for my internal HDD ("... WriteCache=enabled ...") but an USB stick I tried yielded:

sudo hdparm -i /dev/sdb

/dev/sdb1:
SG_IO: bad/missing sense data, sb[]:  70 00 05 00 00 00 00 0a 00 00 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
 HDIO_GET_IDENTITY failed: Invalid argument

Detailed investigation would be part of another thread.
Comment 7 Justin Zobel 2020-11-08 09:16:17 UTC
Thanks for the report Gregor, it looks like you have identified the issue and resolved this. Can you please confirm so we can resolve the bug report, thanks.
Comment 8 Bug Janitor Service 2020-11-23 04:34:00 UTC
Dear Bug Submitter,

This bug has been in NEEDSINFO status with no change for at least
15 days. Please provide the requested information as soon as
possible and set the bug status as REPORTED. Due to regular bug
tracker maintenance, if the bug is still in NEEDSINFO status with
no change in 30 days the bug will be closed as RESOLVED > WORKSFORME
due to lack of needed information.

For more information about our bug triaging procedures please read the
wiki located here:
https://community.kde.org/Guidelines_and_HOWTOs/Bug_triaging

If you have already provided the requested information, please
mark the bug as REPORTED so that the KDE team knows that the bug is
ready to be confirmed.

Thank you for helping us make KDE software even better for everyone!
Comment 9 Bug Janitor Service 2020-12-08 04:34:25 UTC
This bug has been in NEEDSINFO status with no change for at least
30 days. The bug is now closed as RESOLVED > WORKSFORME
due to lack of needed information.

For more information about our bug triaging procedures please read the
wiki located here:
https://community.kde.org/Guidelines_and_HOWTOs/Bug_triaging

Thank you for helping us make KDE software even better for everyone!