Bug 339871 - The process kio_file is using approximately 3.2 GB of memory.
Summary: The process kio_file is using approximately 3.2 GB of memory.
Status: RESOLVED FIXED
Alias: None
Product: kio
Classification: Frameworks and Libraries
Component: file (show other bugs)
Version: 4.13.3
Platform: Ubuntu Linux
: NOR normal
Target Milestone: ---
Assignee: David Faure
URL:
Keywords: triaged
: 284117 342145 (view as bug list)
Depends on:
Blocks:
 
Reported: 2014-10-11 10:09 UTC by Guillaume Debray
Modified: 2018-10-01 12:51 UTC (History)
6 users (show)

See Also:
Latest Commit:
Version Fixed In:


Attachments
screen of activity system (215.81 KB, image/jpeg)
2014-10-11 10:11 UTC, Guillaume Debray
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Guillaume Debray 2014-10-11 10:09:28 UTC
From activity system detail:
"It is using 3.2 GB privately, and a further 19.9 MB that is, or could be, shared with other programs.
Dividing up the shared memory between all the processes sharing that memory we get a reduced shared memory usage of 1439.0 KB. Adding that to the private usage, we get the above mentioned total memory footprint of 3.2 GB."

:~$ top -d 12
top - 11:30:20 up 18:48, 3 users, load average: 0,78, 0,97, 1,12
Tasks: 254 total, 5 running, 249 sleeping, 0 stopped, 0 zombie
%Cpu(s): 11,9 us, 6,8 sy, 1,4 ni, 79,4 id, 0,3 wa, 0,0 hi, 0,2 si, 0,0 st
KiB Mem: 8119100 total, 7994144 used, 124956 free, 16292 buffers
KiB Swap: 0 total, 0 used, 0 free. 1392064 cached Mem

  PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
25477 guillau+ 20 0 4220264 3,549g 3248 R 7,8 45,8 25:50.39 kio_file

Reproducible: Couldn't Reproduce
Comment 1 Guillaume Debray 2014-10-11 10:11:21 UTC
Created attachment 89089 [details]
screen of activity system
Comment 2 Guillaume Debray 2014-10-11 10:24:40 UTC
I have forgotten to say that I'm copying files via ssh.
Another link: https://bugs.launchpad.net/ubuntu/+source/ktorrent/+bug/503841
Comment 3 Guillaume Debray 2014-10-11 10:29:11 UTC
After 2 hours, the used ram is 4.2 Go:
:~$ top -d 12
top - 12:28:24 up 19:46,  3 users,  load average: 1,23, 0,93, 0,92
Tasks: 250 total,   4 running, 246 sleeping,   0 stopped,   0 zombie
%Cpu(s): 13,7 us,  8,6 sy,  0,1 ni, 77,2 id,  0,2 wa,  0,0 hi,  0,2 si,  0,0 st
KiB Mem:   8119100 total,  7967528 used,   151572 free,     2364 buffers
KiB Swap:        0 total,        0 used,        0 free.   856652 cached Mem

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND                                                            
25477 guillau+  20   0 4889544 4,214g   3132 S   9,3 54,4  31:13.96 kio_file
Comment 4 Christoph Feck 2014-10-11 13:25:28 UTC
> copying files via ssh

Are you copying from local to ssh or from ssh to local? There seems to be a leak inside kio_file when copying, but to get to gigabytes memory leak you were probably copying terabytes?
Comment 5 Guillaume Debray 2014-10-11 13:38:12 UTC
I'm copying files from ssh to local, about 500Go (200 files)
The source is a Raspberry Pi's hard drive connected with USB, and the destination is an external drive connected in eSATA to the local KDE machine. (I can't remove the first hd of the rpi, it should be more easy !!)

So, after the ram was completly full (and the machine started to freeze), I had to stop the copy and re-launch it with the non-copied files.
I have looked the process evolution, and it seems that the process take 1Mb every 5s, something like that.

(In reply to Christoph Feck from comment #4)
> > copying files via ssh
> 
> Are you copying from local to ssh or from ssh to local? There seems to be a
> leak inside kio_file when copying, but to get to gigabytes memory leak you
> were probably copying terabytes?
Comment 6 Guillaume Debray 2014-10-11 13:48:42 UTC
(All HDs file-system is ext4)
Comment 7 Dawit Alemayehu 2014-10-18 13:47:49 UTC
Copying from ssh to local should not involve kio_file if you are using the kio_sftp (sftp://). Such copy should involve only kio_sftp. So are you using kio_fish (fish://) to copy these files?
Comment 8 Guillaume Debray 2014-10-18 14:25:18 UTC
> So are you using kio_fish (fish://) to copy these files?

Yes, I have configured Dolphin with fish://pi@192.168.2.2:22/home/pi/
and I copy the files with it. Sorry for the confuse.
Comment 9 Christoph Feck 2014-10-25 00:07:44 UTC
Dawit, does comment #8 provide the requested information? Please set the bug status or add a comment.
Comment 10 Dawit Alemayehu 2014-10-27 17:36:28 UTC
Yes. This seems to be a kio_file issue to me. I could not find the source of the leak even though I attempted to debug kio_file using valgrind.
Comment 11 Christoph Feck 2014-12-23 15:32:06 UTC
*** Bug 342145 has been marked as a duplicate of this bug. ***
Comment 12 Christoph Feck 2014-12-23 15:32:51 UTC
*** Bug 284117 has been marked as a duplicate of this bug. ***
Comment 13 Nate Graham 2018-06-29 17:44:48 UTC
I've never seen this happen with a KF5 version of KIO. Is this still an issue for anyone with KDE Frameworks 5.47 and Dolphin 18.04.x?
Comment 14 Andrew Crouthamel 2018-09-28 03:19:46 UTC
Dear Bug Submitter,

This bug has been in NEEDSINFO status with no change for at least 15 days. Please provide the requested information as soon as possible and set the bug status as REPORTED. Due to regular bug tracker maintenance, if the bug is still in NEEDSINFO status with no change in 30 days, the bug will be closed as RESOLVED > WORKSFORME due to lack of needed information.

For more information about our bug triaging procedures please read the wiki located here: https://community.kde.org/Guidelines_and_HOWTOs/Bug_triaging

If you have already provided the requested information, please set the bug status as REPORTED so that the KDE team knows that the bug is ready to be confirmed.

Thank you for helping us make KDE software even better for everyone!
Comment 15 Guillaume Debray 2018-10-01 10:12:56 UTC
This bug is solved in the 18.04 version (Kubuntu x64)
Thanks
Comment 16 Nate Graham 2018-10-01 12:51:56 UTC
Thanks for confirming!