Bug 376669

Summary: window title doesn't show utf-8 folders
Product: [Applications] konsole Reporter: csaba zsadányi-nagy <rhadath>
Component: fontAssignee: Konsole Developer <konsole-devel>
Status: RESOLVED WORKSFORME    
Severity: normal CC: egmont, sebastian.englbrecht
Priority: NOR Keywords: investigated, triaged
Version: 15.12.3   
Target Milestone: ---   
Platform: Other   
OS: Linux   
Latest Commit: Version Fixed In:
Sentry Crash Report:
Attachments: utf-8 is not recognized in window titlw

Description csaba zsadányi-nagy 2017-02-19 13:15:34 UTC
Created attachment 104113 [details]
utf-8 is not recognized in window titlw

window title of konsole doesn't recognize utf-8 file/folder names; however it works insede the application, and dolphin, krusader handle these folders correctly. it also worked in kde4 (kubuntu 12.04)

Qt: 5.5.1
KDE Frameworks: 5.18.0
Kubuntu 16.04.2 LTS

$ locale
LANG=en_US.UTF-8
LANGUAGE=en_US
LC_CTYPE=hu_HU.UTF-8
LC_NUMERIC=hu_HU.UTF-8
LC_TIME=hu_HU.UTF-8
LC_COLLATE=hu_HU.UTF-8
LC_MONETARY=hu_HU.UTF-8
LC_MESSAGES=en_US.UTF-8
LC_PAPER=hu_HU.UTF-8
LC_NAME=hu_HU.UTF-8
LC_ADDRESS=hu_HU.UTF-8
LC_TELEPHONE=hu_HU.UTF-8
LC_MEASUREMENT=hu_HU.UTF-8
LC_IDENTIFICATION=hu_HU.UTF-8
LC_ALL=

used font for kde: dejavu sans family

used font in my konsole profile: dejavu sans mono

used encoding in my konsole profile: utf-8
Comment 1 Kurt Hindenburg 2017-02-19 13:35:56 UTC
What OS are you using?  It appears to work as expected on Linux.
Comment 2 csaba zsadányi-nagy 2017-02-19 23:12:33 UTC
> What OS are you using?  It appears to work as expected on Linux.

as i wrote: Kubuntu 16.04.2 LTS, and it was the same in 16.04.1
Comment 3 csaba zsadányi-nagy 2017-02-20 08:31:40 UTC
checked more system settings:

# grep -v "^#" /etc/locale.gen
en_US.UTF-8 UTF-8
hu_HU.UTF-8 UTF-8

# env | egrep '^(LANG|LC_)' | sort
LANG=en_US.UTF-8
LANGUAGE=en_US
LC_ADDRESS=hu_HU.UTF-8
LC_ALL=
LC_CTYPE=hu_HU.UTF-8
LC_IDENTIFICATION=hu_HU.UTF-8
LC_MEASUREMENT=hu_HU.UTF-8
LC_MESSAGES=en_US.UTF-8
LC_MONETARY=hu_HU.UTF-8
LC_NAME=hu_HU.UTF-8
LC_NUMERIC=hu_HU.UTF-8
LC_PAPER=hu_HU.UTF-8
LC_TELEPHONE=hu_HU.UTF-8
LC_TIME=hu_HU.UTF-8

# less /usr/share/i18n/SUPPORTED | egrep '^(en_US|hu_HU)'
en_US.UTF-8 UTF-8
en_US ISO-8859-1
en_US.ISO-8859-15 ISO-8859-15
hu_HU.UTF-8 UTF-8
hu_HU ISO-8859-2

# less /var/lib/locales/supported.d/local | egrep '^(en_US|hu_HU)'
en_US.UTF-8 UTF-8
hu_HU.UTF-8 UTF-8

and again, it worked before using plasma5
Comment 4 Egmont Koblinger 2017-02-20 11:40:02 UTC
Just wondering, could it be that your konsole itself is running with an 8-bit locale (e.g. "C", "en_US" or "hu_HU") and the UTF-8 locale is set only for the shell inside?

Could you please verify by running:

cat /proc/$(pidof konsole)/environ | tr '\0' '\n' | egrep '^(LANG|LC_)'

If I start up konsole with LC_ALL=C, and set both the actual encoding in the profile as well as the shell's locale to UTF-8, subsequent titles are messed up just as shown in your screenshot (both for the current working directory and the title set by the shell.

This is wrong: Whereas for the current directory it's probably debatable, the title set by the OSC 0 escape sequence should definitely be interpreted according to the terminal's current encoding, and not according to konsole's locale.
Comment 5 csaba zsadányi-nagy 2017-02-20 17:26:26 UTC
> could it be that your konsole itself is running with an
> 8-bit locale (e.g. "C", "en_US" or "hu_HU") and the UTF-8 locale is set only
> for the shell inside?

you nailed it, LANGUAGE=en_US w/o UTF-8

it's an easy way to overwrite it in user profile or somewhere else?

$ cat /proc/$(pidof konsole)/environ | tr '\0' '\n' | egrep '^(LANG|LC_)'
LANGUAGE=en_US
LC_TIME=hu_HU.UTF-8
LC_MONETARY=hu_HU.UTF-8
LC_CTYPE=hu_HU.UTF-8
LC_COLLATE=hu_HU.UTF-8
LC_ADDRESS=hu_HU.UTF-8
LC_TELEPHONE=hu_HU.UTF-8
LANG=en_US.UTF-8
LC_MESSAGES=en_US.UTF-8
LC_NAME=hu_HU.UTF-8
LC_MEASUREMENT=hu_HU.UTF-8
LC_IDENTIFICATION=hu_HU.UTF-8
LC_ALL=
LC_NUMERIC=hu_HU.UTF-8
LC_PAPER=hu_HU.UTF-8
Comment 6 csaba zsadányi-nagy 2017-02-20 17:32:21 UTC
so do you say, LANGUAGE=en_US should be LANGUAGE=en_US.UTF-8 too?
Comment 7 Egmont Koblinger 2017-02-20 17:40:27 UTC
Nope, LANGUAGE should be without charset. So my guess was wrong.
Comment 8 Christoph Feck 2017-02-21 03:46:28 UTC
Random idea: Is the window manager (KWin) running with an UTF-8 locale?
Comment 9 csaba zsadányi-nagy 2017-02-21 12:22:11 UTC
thanks Egmont! at least we know that's not the case

@Christoph: what should i check? i found nothing related encoding in kwin*rc files

there is a ~/.config/plasma-localerc file, its content looks fine:

[Formats]
LANG=en_US.UTF-8
LC_ALL=""
LC_COLLATE=hu_HU.UTF-8
LC_CTYPE=hu_HU.UTF-8
LC_MEASUREMENT=hu_HU.UTF-8
LC_MONETARY=hu_HU.UTF-8
LC_NUMERIC=hu_HU.UTF-8
LC_TIME=hu_HU.UTF-8
LC_MESSAGES=en_US.UTF-8
useDetailed=true

[Translations]
LANGUAGE=en_US
Comment 10 Egmont Koblinger 2017-02-21 15:55:44 UTC
I _guess_ Christoph meant to repeat the command that I showed for konsole itself:

cat /proc/$(pidof kwin -- or I'm not sure what's the exact process name)...

But at this point it seems your whole desktop is UTF-8 and the problem lies somewhere else. And, kwin's locale should not matter (unless, of course, it's buggy).
Comment 11 Egmont Koblinger 2017-02-21 16:02:31 UTC
In Edit Current Profile -> Tabs -> Tab title format, could you please confirm that the value is "%D : %n" (or something very similar, maybe "%d : %n")?

Could you please add a "%w" as well and then try this command:

echo -ne '\e]0;árvíztűrő\a'; sleep 100

Does this word appear correctly in your title? If not, is it 1 or 2 question marks instead of each accented character?
Comment 12 csaba zsadányi-nagy 2017-02-21 20:47:02 UTC
(In reply to Egmont Koblinger from comment #11)

> cat /proc/$(pidof kwin -- or I'm not sure what's the exact process name)

it's kwin_x11 on my system, and everything is *.UTF-8 (except LANGUAGE)


> echo -ne '\e]0;árvíztűrő\a'; sleep 100

it works perfectly, i see all acceented chars

first i thought the filenames are corrupted, so tried this: in konsole

$ mkdir árvíztűrő

when i check it in dolphin or krusader, it's ok, and ls shows the name correctly in konsole too, but after entering in it, i see two question marks instead of  all accented chars (so "á" and "í" don't work either, which are part of latin1) in the window title

anyway, it's not too serious issue, more likely aestethical, it's just weird
Comment 13 Egmont Koblinger 2017-02-21 20:59:00 UTC
> anyway, it's not too serious issue, more likely aestethical, it's just weird

Well, in a fully UTF-8 environment things like this really shouldn't occur.

I'd really love to get to the bottom of this, but I cannot reproduce the issue and I'm not a KDE or Konsole developer either :P so I'm afraid I have to take a step back and watch if others can resolve this issue. :(
Comment 14 Sebastian 2018-10-30 19:27:39 UTC
Note: I am no maintainer but from the bugsquad.

It seems that no-one took the challenge.
Unfortunately I also could not reproduce this bug.

It could be that this bug "resolved iteself" in newer versions, taking into account that UTF-8 support gets updated quite often.

Can you give us an update csaba?
Can you still reproduce this bug?

System Information:
konsole 17.12.3
kde-plasma-version: 5.12.6
kde-frameworks-version: 5.44.0
qt-version: 5.9.5
Comment 15 Bug Janitor Service 2018-11-14 11:33:23 UTC
Dear Bug Submitter,

This bug has been in NEEDSINFO status with no change for at least
15 days. Please provide the requested information as soon as
possible and set the bug status as REPORTED. Due to regular bug
tracker maintenance, if the bug is still in NEEDSINFO status with
no change in 30 days the bug will be closed as RESOLVED > WORKSFORME
due to lack of needed information.

For more information about our bug triaging procedures please read the
wiki located here:
https://community.kde.org/Guidelines_and_HOWTOs/Bug_triaging

If you have already provided the requested information, please
mark the bug as REPORTED so that the KDE team knows that the bug is
ready to be confirmed.

Thank you for helping us make KDE software even better for everyone!
Comment 16 Bug Janitor Service 2018-11-29 09:47:43 UTC
This bug has been in NEEDSINFO status with no change for at least
30 days. The bug is now closed as RESOLVED > WORKSFORME
due to lack of needed information.

For more information about our bug triaging procedures please read the
wiki located here:
https://community.kde.org/Guidelines_and_HOWTOs/Bug_triaging

Thank you for helping us make KDE software even better for everyone!