Bug 410138 - Strange characters displayed in emails when viewed as html or plain text, when there should be a quote character
Summary: Strange characters displayed in emails when viewed as html or plain text, whe...
Status: RESOLVED NOT A BUG
Alias: None
Product: kmail2
Classification: Applications
Component: misc (show other bugs)
Version: 5.11.3
Platform: Neon Linux
: NOR normal
Target Milestone: ---
Assignee: kdepim bugs
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2019-07-23 14:28 UTC by Nick
Modified: 2019-07-25 09:37 UTC (History)
0 users

See Also:
Latest Commit:
Version Fixed In:


Attachments
email in HTML view showing odd character (circled) instead of ' character (233.06 KB, image/png)
2019-07-23 14:28 UTC, Nick
Details
Email properly rendered in gmail, correctly showing ' character (237.65 KB, image/png)
2019-07-23 14:29 UTC, Nick
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Nick 2019-07-23 14:28:14 UTC
Created attachment 121694 [details]
email in HTML view showing odd character (circled) instead of ' character

SOFTWARE/OS VERSIONS KDE NEON
Linux/KDE Plasma: Neon 5.16.3
KDE Plasma Version: 5.16.3
KDE Frameworks Version: 5.60.0
Qt Version: 5.12.3
Kernel 4.15.0-55-generic
64bit

SUMMARY

When displaying some emails (either HTML or text mode) you get some strange looking characters inserted amongst the text as shown below.

Here's an extract... notice the '┬' character 4th line up from the bottom and 2nd line up from the bottom.

Images not loading? Click Here to view this newsletter in your browser.(http://emailclick.imlgrouponthenet.net/profile/S-23344@aawG9tsEOImiTXAR1Zm2UUCtJMmysgmQ6-mvyV8oq5U.@11)


EPDT's July 2019 issue is now available, in print & digital editions!

Read the digital issue(http://emailclick.imlgrouponthenet.net/email/S-23344@1068604@aawG9tsEOImiTXAR1Zm2UUCtJMmysgmQ6-mvyV8oq5U.@) now or register to receive the print magazine(http://emailclick.imlgrouponthenet.net/email/S-23344@1068605@aawG9tsEOImiTXAR1Zm2UUCtJMmysgmQ6-mvyV8oq5U.@) each month.

This monthтАЩs issue(http://emailclick.imlgrouponthenet.net/email/S-23344@1068606@aawG9tsEOImiTXAR1Zm2UUCtJMmysgmQ6-mvyV8oq5U.@) contains features on Electromechanical technologies and Mil/Aero applications, as well as EPDT's twice-yearly IoT & Industry 4.0 supplement(http://emailclick.imlgrouponthenet.net/email/S-23344@1068607@aawG9tsEOImiTXAR1Zm2UUCtJMmysgmQ6-mvyV8oq5U.@).
┬а
(http://emailclick.imlgrouponthenet.net/email/S-23344@1068608@aawG9tsEOImiTXAR1Zm2UUCtJMmysgmQ6-mvyV8oq5U.@)  ┬а ┬а
Inside EPDT's July issue:

Take a look at the two attachment pictures. One picture is the HTML version of the above email. The other is how it is rendered properly in gmail.


STEPS TO REPRODUCE
Just look through your emails for odd looking characters

OBSERVED RESULT
See one of the attachments, I have circled the strange character where there should be a ' character.

EXPECTED RESULT
See one of the attachments for the HTML email rendered correctly in gmail.
Comment 1 Nick 2019-07-23 14:29:24 UTC
Created attachment 121695 [details]
Email properly rendered in gmail, correctly showing ' character
Comment 2 Nick 2019-07-23 14:40:50 UTC
This is not just the incorrect display of quote characters but also the copyright character and I would imagine lots of other non alpha numeric characters. I'm not exactly sure when this bug appeared but I think it might have been after a recent update.
Comment 3 Nick 2019-07-23 15:13:00 UTC
Again, here's a direct copy of the rendered text in a HTML email

hereтАЩs a cool little email exclusive for your weekend тАУ weтАЩre trimming 15% off your takeaway*. And thatтАЩs whether you order Friday, Saturday or Sunday. Tuck in!

and here's what that specific section of the email source looks like.

here=E2=80=99s a cool little email exclusive fo=
r your weekend =E2=80=93 we=E2=80=99re trimming 15% off your takeaway*. And=
 that=E2=80=99s whether you order Friday, Saturday or Sunday. Tuck in!

Notice the =E2=80=99 where there should be a ` or '
Comment 4 Nick 2019-07-23 15:33:07 UTC
Here's another easy way to reproduce the problem by sending yourself an email containing a special character such as the copyright symbol.

To insert a special character, from the menu edit->insert special character. select European Latin 1 supplement. Click on the copyright symbol.

The copyright symbol correctly appears in your composed email but after you have sent that email to yourself and view it in kmail the copyright symbol is now a й

If you view that same email in gmail the copyright symbol is displayed correctly.
Comment 5 Nick 2019-07-23 15:36:37 UTC
So kmail manages to display the correct character when composing the email but not when viewing the email, however that same email when viewed in gmail displays the copyright symbol correctly.
Comment 6 Nick 2019-07-23 15:43:57 UTC
In the email header for the above simple email I have

Content-Type: text/plain; charset="iso-8859-1"

So it's like the kmail code that displays the email is using the wrong character encoding to render the text correctly.
Comment 7 Nick 2019-07-24 15:05:36 UTC
Fixed !.

I don't know why but the encoding kmail was using was set to Cyrillic(IBM866). Changing kmails encoding to 'auto' removed the incorrect characters.

To change encoding in kmail. Select form the drop down menus, view->set encoding and then select auto.
Comment 8 Nick 2019-07-25 09:19:40 UTC
Re-opened.

I just found encoding in kmail has switched back to Cyrillic(IBM866) all on it's own !. I'm the only person who has access to this system. So something is switching encoding from 'auto' to specifically Cyrillic(IBM866). I've rebooted the system so need to investigate whether the switch from auto to Cyrillic(IBM866) occurs after a reboot.
Comment 9 Nick 2019-07-25 09:29:36 UTC
ok, so if you change encoding to auto then reboot the system OR simply exit kmail your encoding will revert back to Cyrillic(IBM866) with the incorrect display of special characters in emails.

So it would appear that when I change encoding to auto it doesn't seem to be saved. Is there a setting somewhere that sets default encoding to Cyrillic(IBM866) ?
Comment 10 Nick 2019-07-25 09:37:00 UTC
Ok, closed again as not a bug ! hopefully.

In Settings->configure kmail->appearance->general there is a setting called override character encoding. This was set to Cyrillic(IBM866).

Switching 'override character encoding' to 'auto' now means that 'auto' encoding is retained after kmail is shutdown and restarted.