304187 2012-07-28 17:16:42 +0000 XMP sidecar files do not write Unicode characters in the Dublin Core section 2020-08-28 07:39:14 +0000 1 1 2 Applications digikam Metadata-Sidecar 2.8.0 Ubuntu Linux RESOLVED FIXED NOR normal --- 0 james digikam-bugs-null alan.pater caulier.gilles https://invent.kde.org/graphics/digikam/commit/ad0ab9efeba6e2fe3bb86207a91499e4e8eb170f 7.1.0 0 oldest_to_newest 1279534 0 james 2012-07-28 17:16:42 +0000 The string "UnicoƉe" is written as "Unico?e" in the Dublin Core section of XMP sidecar files. Reproducible: Always Steps to Reproduce: 1. Set digikam to write metadata to XMP sidecar files. 2. Edit photo metadata to add a caption "UnicoƉe" 3. Click apply to write XMP sidecar file. Actual Results: TIFF and EXIF sections correctly record the description as "UnicoƉe" but the DC section records "Unico?e". Expected Results: All instances of the caption string are recorded as per the original data entry. This may be by design for some reason that I do not know. 1279557 1 caulier.gilles 2012-07-28 18:58:11 +0000 Please try again with digiKam 2.7.0 and last libkexiv2 release published with KDE through kdegraphics component... Gilles Caulier 1299455 2 marcel.wiesweg 2012-09-22 13:06:06 +0000 A simple test shows that it actually works. 1299469 3 caulier.gilles 2012-09-22 14:05:29 +0000 It work for me too, using digiKam SC 3.0.0 source code. Gilles Caulier 1307665 4 74676 james 2012-10-20 14:48:42 +0000 Created attachment 74676 Example XMP file showing non-storage of Unicode character in DC section Re-tested in DIgikam 2.8.0 Using KDE Development Platform 4.9.2 on Ubuntu 12.10. Issue is still present. 1307666 5 james 2012-10-20 14:49:50 +0000 Setting status back to Unconfirmed, hope this is the right thing to do. 1307667 6 james 2012-10-20 14:52:10 +0000 Sorry, I notice this was marked as fixed in 3.0.0; I only have 2.8.0. Was there actually a bug that was fixed, or are you saying that you can't reproduce the issue? 1307670 7 caulier.gilles 2012-10-20 14:58:44 +0000 yes, it is, but as it's annoted before, it's work with 3.0.0, which still in beta2 for the moment. But lead XMP management code is drived trough libkexiv2 from KDEGraphics components which is released outside digiKam with KDE project. Also, in background Exiv2 shared lib is used to perform all in-deep metadata changes. Considering to update both libs on your system and try again... Gilles Caulier 1308547 8 marcel.wiesweg 2012-10-23 19:59:10 +0000 The important part here, which I did not replay with my test, is writing to a sidecar. It is fully reproducible using the exiv2 command line tool. I will open an upstream bug. 1308550 9 marcel.wiesweg 2012-10-23 20:16:08 +0000 http://dev.exiv2.org/issues/863 1509559 10 91954 alan.pater 2015-04-08 19:18:43 +0000 Created attachment 91954 XMP sidecar with correct unicode. The issue cannot be reproduced using digikam 4.8.0 and exiv2 0.24. I created a new test image, added Title and Caption tags. Resulting XMP sidecar is attached. 1953550 11 caulier.gilles 2020-08-28 07:39:14 +0000 Git commit ad0ab9efeba6e2fe3bb86207a91499e4e8eb170f by Gilles Caulier. Committed on 28/08/2020 at 05:19. Pushed by cgilles into branch 'master'. IPTC and Utf8 support: If a tag is string, check if global IPTC characterset is null to convert in latin1, else we expect to interpret the string as utf8. We use std::string accessor from Exiv2 to get an Utf8 cenversion of string. If it do not work, well this problem need to be reported as UPSTREAM to Exiv2 as pre-cenversion of string is not done in background by the library. This patch prevent to display latin1 string with a wrong Utf8 conversion which can break some characters. BUGS: 379581 BUGS: 379050 FIXED-IN: 7.1.0 M +27 -3 core/libs/metadataengine/engine/metaengine_iptc.cpp https://invent.kde.org/graphics/digikam/commit/ad0ab9efeba6e2fe3bb86207a91499e4e8eb170f 74676 2012-10-20 14:48:42 +0000 2012-10-20 14:48:42 +0000 Example XMP file showing non-storage of Unicode character in DC section 2012-10-09 19.14.55.jpg.xmp application/xml 2864 james PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiPz4KPHg6eG1wbWV0YSB4bWxuczp4 PSJhZG9iZTpuczptZXRhLyIgeDp4bXB0az0iWE1QIENvcmUgNC40LjAtRXhpdjIiPgogPHJkZjpS REYgeG1sbnM6cmRmPSJodHRwOi8vd3d3LnczLm9yZy8xOTk5LzAyLzIyLXJkZi1zeW50YXgtbnMj Ij4KICA8cmRmOkRlc2NyaXB0aW9uIHJkZjphYm91dD0iIgogICAgeG1sbnM6eG1wPSJodHRwOi8v bnMuYWRvYmUuY29tL3hhcC8xLjAvIgogICAgeG1sbnM6ZGlnaUthbT0iaHR0cDovL3d3dy5kaWdp a2FtLm9yZy9ucy8xLjAvIgogICAgeG1sbnM6ZXhpZj0iaHR0cDovL25zLmFkb2JlLmNvbS9leGlm LzEuMC8iCiAgICB4bWxuczp0aWZmPSJodHRwOi8vbnMuYWRvYmUuY29tL3RpZmYvMS4wLyIKICAg IHhtbG5zOnBob3Rvc2hvcD0iaHR0cDovL25zLmFkb2JlLmNvbS9waG90b3Nob3AvMS4wLyIKICAg IHhtbG5zOmRjPSJodHRwOi8vcHVybC5vcmcvZGMvZWxlbWVudHMvMS4xLyIKICAgeG1wOkNyZWF0 b3JUb29sPSJkaWdpS2FtLTIuOC4wIgogICB4bXA6Q3JlYXRlRGF0ZT0iMjAxMi0xMC0wOVQxOTox NDo1NSIKICAgeG1wOk1ldGFkYXRhRGF0ZT0iMjAxMi0xMC0wOVQxOToxNDo1NSIKICAgeG1wOk1v ZGlmeURhdGU9IjIwMTItMTAtMDlUMTk6MTQ6NTUiCiAgIGRpZ2lLYW06UGlja0xhYmVsPSIwIgog ICBkaWdpS2FtOkNvbG9yTGFiZWw9IjAiCiAgIGV4aWY6RGF0ZVRpbWVPcmlnaW5hbD0iMjAxMi0x MC0wOVQxOToxNDo1NSIKICAgZXhpZjpFeGlmVmVyc2lvbj0iMDIyMCIKICAgZXhpZjpGbGFzaHBp eFZlcnNpb249IjAxMDAiCiAgIGV4aWY6Q29sb3JTcGFjZT0iMSIKICAgZXhpZjpQaXhlbFhEaW1l bnNpb249IjMyNjQiCiAgIGV4aWY6UGl4ZWxZRGltZW5zaW9uPSIyNDQ4IgogICBleGlmOkRhdGVU aW1lRGlnaXRpemVkPSIyMDEyLTEwLTA5VDE5OjE0OjU1IgogICBleGlmOkV4cG9zdXJlVGltZT0i MS8xNyIKICAgZXhpZjpGTnVtYmVyPSIyNi8xMCIKICAgZXhpZjpFeHBvc3VyZVByb2dyYW09IjMi CiAgIGV4aWY6U2h1dHRlclNwZWVkVmFsdWU9IjEwMzkvMjU2IgogICBleGlmOkFwZXJ0dXJlVmFs dWU9IjI3Ni8xMDAiCiAgIGV4aWY6QnJpZ2h0bmVzc1ZhbHVlPSI1OC8yNTYiCiAgIGV4aWY6RXhw b3N1cmVCaWFzVmFsdWU9IjAvMTAiCiAgIGV4aWY6TWF4QXBlcnR1cmVWYWx1ZT0iMjc2LzEwMCIK ICAgZXhpZjpNZXRlcmluZ01vZGU9IjEiCiAgIGV4aWY6Rm9jYWxMZW5ndGg9IjM3LzEwIgogICBl eGlmOkV4cG9zdXJlTW9kZT0iMCIKICAgZXhpZjpXaGl0ZUJhbGFuY2U9IjAiCiAgIGV4aWY6U2Nl bmVDYXB0dXJlVHlwZT0iMCIKICAgZXhpZjpJbWFnZVVuaXF1ZUlEPSJHREZGMDMiCiAgIHRpZmY6 RGF0ZVRpbWU9IjIwMTItMTAtMDlUMTk6MTQ6NTUiCiAgIHRpZmY6SW1hZ2VXaWR0aD0iMzI2NCIK ICAgdGlmZjpJbWFnZUxlbmd0aD0iMjQ0OCIKICAgdGlmZjpPcmllbnRhdGlvbj0iMSIKICAgdGlm ZjpZQ2JDclBvc2l0aW9uaW5nPSIxIgogICB0aWZmOlhSZXNvbHV0aW9uPSI3Mi8xIgogICB0aWZm OllSZXNvbHV0aW9uPSI3Mi8xIgogICB0aWZmOlJlc29sdXRpb25Vbml0PSIyIgogICB0aWZmOk1h a2U9IlNBTVNVTkciCiAgIHRpZmY6TW9kZWw9IkdULUk5MzAwIgogICB0aWZmOlNvZnR3YXJlPSJJ OTMwMFhYQkxHOCIKICAgcGhvdG9zaG9wOkRhdGVDcmVhdGVkPSIyMDEyLTEwLTA5Ij4KICAgPGRp Z2lLYW06Q2FwdGlvbnNBdXRob3JOYW1lcz4KICAgIDxyZGY6QWx0PgogICAgIDxyZGY6bGkgeG1s Omxhbmc9IngtZGVmYXVsdCIvPgogICAgPC9yZGY6QWx0PgogICA8L2RpZ2lLYW06Q2FwdGlvbnNB dXRob3JOYW1lcz4KICAgPGRpZ2lLYW06Q2FwdGlvbnNEYXRlVGltZVN0YW1wcz4KICAgIDxyZGY6 QWx0PgogICAgIDxyZGY6bGkgeG1sOmxhbmc9IngtZGVmYXVsdCI+MjAxMi0xMC0yMFQxNTo0NToy MzwvcmRmOmxpPgogICAgPC9yZGY6QWx0PgogICA8L2RpZ2lLYW06Q2FwdGlvbnNEYXRlVGltZVN0 YW1wcz4KICAgPGV4aWY6Rmxhc2gKICAgIGV4aWY6RmlyZWQ9IkZhbHNlIgogICAgZXhpZjpSZXR1 cm49IjAiCiAgICBleGlmOk1vZGU9IjAiCiAgICBleGlmOkZ1bmN0aW9uPSJGYWxzZSIKICAgIGV4 aWY6UmVkRXllTW9kZT0iRmFsc2UiLz4KICAgPGV4aWY6Q29tcG9uZW50c0NvbmZpZ3VyYXRpb24+ CiAgICA8cmRmOlNlcT4KICAgICA8cmRmOmxpPjE8L3JkZjpsaT4KICAgICA8cmRmOmxpPjI8L3Jk ZjpsaT4KICAgICA8cmRmOmxpPjM8L3JkZjpsaT4KICAgICA8cmRmOmxpPjA8L3JkZjpsaT4KICAg IDwvcmRmOlNlcT4KICAgPC9leGlmOkNvbXBvbmVudHNDb25maWd1cmF0aW9uPgogICA8ZXhpZjpV c2VyQ29tbWVudD4KICAgIDxyZGY6QWx0PgogICAgIDxyZGY6bGkgeG1sOmxhbmc9IngtZGVmYXVs dCI+VW5pY2/GiWU8L3JkZjpsaT4KICAgIDwvcmRmOkFsdD4KICAgPC9leGlmOlVzZXJDb21tZW50 PgogICA8ZXhpZjpJU09TcGVlZFJhdGluZ3M+CiAgICA8cmRmOlNlcT4KICAgICA8cmRmOmxpPjMy MDwvcmRmOmxpPgogICAgPC9yZGY6U2VxPgogICA8L2V4aWY6SVNPU3BlZWRSYXRpbmdzPgogICA8 dGlmZjpJbWFnZURlc2NyaXB0aW9uPgogICAgPHJkZjpBbHQ+CiAgICAgPHJkZjpsaSB4bWw6bGFu Zz0ieC1kZWZhdWx0Ij5Vbmljb8aJZTwvcmRmOmxpPgogICAgPC9yZGY6QWx0PgogICA8L3RpZmY6 SW1hZ2VEZXNjcmlwdGlvbj4KICAgPGRjOmRlc2NyaXB0aW9uPgogICAgPHJkZjpBbHQ+CiAgICAg PHJkZjpsaSB4bWw6bGFuZz0ieC1kZWZhdWx0Ij5Vbmljbz9lPC9yZGY6bGk+CiAgICA8L3JkZjpB bHQ+CiAgIDwvZGM6ZGVzY3JpcHRpb24+CiAgPC9yZGY6RGVzY3JpcHRpb24+CiA8L3JkZjpSREY+ CjwveDp4bXBtZXRhPgo= 91954 2015-04-08 19:18:43 +0000 2015-04-08 19:18:43 +0000 XMP sidecar with correct unicode. 883.exiv2.jpg.xmp application/x-wine-extension-xmp 2166 alan.pater PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0iVVRGLTgiPz4KPHg6eG1wbWV0YSB4bWxuczp4 PSJhZG9iZTpuczptZXRhLyIgeDp4bXB0az0iWE1QIENvcmUgNC40LjAtRXhpdjIiPgogPHJkZjpS REYgeG1sbnM6cmRmPSJodHRwOi8vd3d3LnczLm9yZy8xOTk5LzAyLzIyLXJkZi1zeW50YXgtbnMj Ij4KICA8cmRmOkRlc2NyaXB0aW9uIHJkZjphYm91dD0iIgogICAgeG1sbnM6eG1wPSJodHRwOi8v bnMuYWRvYmUuY29tL3hhcC8xLjAvIgogICAgeG1sbnM6ZGlnaUthbT0iaHR0cDovL3d3dy5kaWdp a2FtLm9yZy9ucy8xLjAvIgogICAgeG1sbnM6dGlmZj0iaHR0cDovL25zLmFkb2JlLmNvbS90aWZm LzEuMC8iCiAgICB4bWxuczpwaG90b3Nob3A9Imh0dHA6Ly9ucy5hZG9iZS5jb20vcGhvdG9zaG9w LzEuMC8iCiAgICB4bWxuczptd2ctcnM9Imh0dHA6Ly93d3cubWV0YWRhdGF3b3JraW5nZ3JvdXAu Y29tL3NjaGVtYXMvcmVnaW9ucy8iCiAgICB4bWxuczpNUD0iaHR0cDovL25zLm1pY3Jvc29mdC5j b20vcGhvdG8vMS4yLyIKICAgIHhtbG5zOk1QUkk9Imh0dHA6Ly9ucy5taWNyb3NvZnQuY29tL3Bo b3RvLzEuMi90L1JlZ2lvbkluZm8jIgogICAgeG1sbnM6ZXhpZj0iaHR0cDovL25zLmFkb2JlLmNv bS9leGlmLzEuMC8iCiAgICB4bWxuczpkYz0iaHR0cDovL3B1cmwub3JnL2RjL2VsZW1lbnRzLzEu MS8iCiAgIHhtcDpDcmVhdG9yVG9vbD0iZGlnaUthbS00LjguMCIKICAgeG1wOkNyZWF0ZURhdGU9 IjIwMTUtMDQtMDhUMTM6NTM6NTQiCiAgIHhtcDpNZXRhZGF0YURhdGU9IjIwMTUtMDQtMDhUMTM6 NTM6NTQiCiAgIHhtcDpNb2RpZnlEYXRlPSIyMDE1LTA0LTA4VDEzOjUzOjU0IgogICBkaWdpS2Ft OlBpY2tMYWJlbD0iMCIKICAgZGlnaUthbTpDb2xvckxhYmVsPSIwIgogICB0aWZmOkRhdGVUaW1l PSIyMDE1LTA0LTA4VDEzOjUzOjU0IgogICB0aWZmOlNvZnR3YXJlPSJkaWdpS2FtLTQuOC4wIgog ICBwaG90b3Nob3A6VXJnZW5jeT0iMCIKICAgcGhvdG9zaG9wOkRhdGVDcmVhdGVkPSIyMDE1LTA0 LTA4IgogICBleGlmOkRhdGVUaW1lT3JpZ2luYWw9IjIwMTUtMDQtMDhUMTM6NTM6NTQiPgogICA8 ZGlnaUthbTpDYXB0aW9uc0F1dGhvck5hbWVzPgogICAgPHJkZjpBbHQ+CiAgICAgPHJkZjpsaSB4 bWw6bGFuZz0ieC1kZWZhdWx0Ii8+CiAgICA8L3JkZjpBbHQ+CiAgIDwvZGlnaUthbTpDYXB0aW9u c0F1dGhvck5hbWVzPgogICA8ZGlnaUthbTpDYXB0aW9uc0RhdGVUaW1lU3RhbXBzPgogICAgPHJk ZjpBbHQ+CiAgICAgPHJkZjpsaSB4bWw6bGFuZz0ieC1kZWZhdWx0Ij4yMDE1LTA0LTA4VDEzOjU1 OjMxPC9yZGY6bGk+CiAgICA8L3JkZjpBbHQ+CiAgIDwvZGlnaUthbTpDYXB0aW9uc0RhdGVUaW1l U3RhbXBzPgogICA8dGlmZjpJbWFnZURlc2NyaXB0aW9uPgogICAgPHJkZjpBbHQ+CiAgICAgPHJk ZjpsaSB4bWw6bGFuZz0ieC1kZWZhdWx0Ij5Vbmljb8aJZTwvcmRmOmxpPgogICAgPC9yZGY6QWx0 PgogICA8L3RpZmY6SW1hZ2VEZXNjcmlwdGlvbj4KICAgPG13Zy1yczpSZWdpb25zIHJkZjpwYXJz ZVR5cGU9IlJlc291cmNlIj4KICAgIDxtd2ctcnM6UmVnaW9uTGlzdD4KICAgICA8cmRmOkJhZy8+ CiAgICA8L213Zy1yczpSZWdpb25MaXN0PgogICA8L213Zy1yczpSZWdpb25zPgogICA8TVA6UmVn aW9uSW5mbyByZGY6cGFyc2VUeXBlPSJSZXNvdXJjZSI+CiAgICA8TVBSSTpSZWdpb25zPgogICAg IDxyZGY6QmFnLz4KICAgIDwvTVBSSTpSZWdpb25zPgogICA8L01QOlJlZ2lvbkluZm8+CiAgIDxl eGlmOlVzZXJDb21tZW50PgogICAgPHJkZjpBbHQ+CiAgICAgPHJkZjpsaSB4bWw6bGFuZz0ieC1k ZWZhdWx0Ij5Vbmljb8aJZTwvcmRmOmxpPgogICAgPC9yZGY6QWx0PgogICA8L2V4aWY6VXNlckNv bW1lbnQ+CiAgIDxkYzp0aXRsZT4KICAgIDxyZGY6QWx0PgogICAgIDxyZGY6bGkgeG1sOmxhbmc9 IngtZGVmYXVsdCI+VW5pY2/GiWU8L3JkZjpsaT4KICAgIDwvcmRmOkFsdD4KICAgPC9kYzp0aXRs ZT4KICAgPGRjOmRlc2NyaXB0aW9uPgogICAgPHJkZjpBbHQ+CiAgICAgPHJkZjpsaSB4bWw6bGFu Zz0ieC1kZWZhdWx0Ij5Vbmljb8aJZTwvcmRmOmxpPgogICAgPC9yZGY6QWx0PgogICA8L2RjOmRl c2NyaXB0aW9uPgogIDwvcmRmOkRlc2NyaXB0aW9uPgogPC9yZGY6UkRGPgo8L3g6eG1wbWV0YT4K