SUMMARY I export a set of files (images and videos) from computer A to a portable disk including sidecars. After I add the portable disk as a collection on computer B or import the items from the portable disk to computer B I see the tags and labels of all images, but only few of the video clips. Both computers run digiKam 8.0.0 on Windows 10. NOTE: If you are reporting a crash, please try to attach a backtrace with debug symbols. See https://community.kde.org/Guidelines_and_HOWTOs/Debugging/How_to_create_useful_crash_reports *** STEPS TO REPRODUCE 1. Export a set of items with tags and labels to a portable disk including sidecars 2. Add the portable disk to the set of collections on a second computer OBSERVED RESULT Tags and labels visible of all images, but some video clips only EXPECTED RESULT Tags and labels visible of all items. SOFTWARE/OS VERSIONS Windows: 10 macOS: Linux/KDE Plasma: (available in About System) KDE Plasma Version: KDE Frameworks Version: Qt Version: ADDITIONAL INFORMATION
Sidecar reading on computer B is enabled? The desired tags and labels are in the video files Sidecar? The problem can also arise with different advanced Metadata settings. In digiKam-8.0.0 you can export the advanced metadata settings from computer A and import them back to computer B. A quick test here shows no problems. A sidecar as a sample from a video file where you miss tags or labels would be good. Maik
Created attachment 159674 [details] Sidecar of a video file for which no tags and labels are shown. Sidecar reading on computer B is enabled? Yes. Writing on computer A is enabled for read-only items only. The problem occurs for .mp4 and .mov files The desired tags and labels are in the video files Sidecar? Yes The problem can also arise with different advanced Metadata settings. As far as I know I am using the default settings on both computers. Attached are two sidecars. Tags and labels of A001C084_230508_DJ0B.MOV.xmp are shown, of A001C018_230422_DJ0B.MOV.xmp not. I now noticed that video files that show tags and labels on computer B get 3 stars on computer B. They had no stars on computer A.
Created attachment 159675 [details] Sidecar of a video file for which tags and labels are shown
I think all metadata is present in the sidecars. The sidecar filenames were created with different options for "Sidecar name compatible for commercial programs". You have to decide on a type you need and rename the sidecar accordingly or write the metadata again in computer A with the desired option. The option must be set identically in computer B. In digiKam-8.0.0 only the sidecar specified by this option is actually read. Option "Sidecar name compatible for commercial programs" deactivated -> BASISNAME.EXT.xmp Option "Sidecar name compatible for commercial programs" activated -> BASISNAME.xmp Maik
I made a mistake by renaming the sidecar, both are created with the same option. Nevertheless, check whether the settings are correct and whether you have both sidecar types in your directory. In any case, both sidecars have tags and color labels. Maik
Created attachment 159688 [details] Side car settings
Hi Mike, What do you mean with "check whether you have both sidecar types in your directory"? I have only one .xml per media file.
I now noted something else. I tried to export again from computer A to the portable disk. I kept copy sidecar enabled. The associated .xml file was no copied to the portable disk, only the image file. However, if I made some label change first and copied after that the .xml file was created. Rgds. Jan
Are you using digiKam's Local Export Tool? Ok, I'll test it with that. There is this Bug 468845 fixed in digiKam-8.1.0, but it doesn't affect video files. Please check whether there really is a sidecar in computer A for the video files in question. If a sidecar is only created now when you make a change, an older digiKam version may have caused no sidecar to be created. Maik
Are you using digiKam's Local Export Tool? Ok, I'll test it with that. ==> Yes, export to local storage Please check whether there really is a sidecar in computer A for the video files in question. ==> there is a sidecar for all files on computer A. I attach the sidecar that wasn't copied.
Created attachment 159699 [details] Sidecar that wasn't copied by export
Does the missing metadata get added when you re-read the metadata via the Item menu? We already have a bug report from Windows users who report that not all metadata is always read, only after a re-read. The cause is unknown, I could never reproduce it. The cause could be a file locking by certain AntiVirus programs, Explorer or other. Maik
The missing metadata is always added. I made an error resetting options after I did some experiments. However, I noticed that when I do a reread 5 stars are added. The stars are not in the metadata (see below). ?xpacket begin="" id="W5M0MpCehiHzreSzNTczkc9d"?> <x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0-Exiv2"> <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"> <rdf:Description rdf:about="" xmlns:video="http://www.video/" xmlns:xmpDM="http://ns.adobe.com/xmp/1.0/DynamicMedia/" xmlns:audio="http://www.audio/" xmlns:exif="http://ns.adobe.com/exif/1.0/" xmlns:tiff="http://ns.adobe.com/tiff/1.0/" xmlns:xmp="http://ns.adobe.com/xap/1.0/" xmlns:acdsee="http://ns.acdsee.com/iptc/1.0/" xmlns:digiKam="http://www.digikam.org/ns/1.0/" xmlns:MicrosoftPhoto="http://ns.microsoft.com/photo/1.0/" xmlns:lr="http://ns.adobe.com/lightroom/1.0/" xmlns:mediapro="http://ns.iview-multimedia.com/mediapro/1.0/" xmlns:photoshop="http://ns.adobe.com/photoshop/1.0/" xmlns:dc="http://purl.org/dc/elements/1.1/" video:duration="22522" video:MaxBitRate="194447326" video:StreamCount="3" video:Codec="hevc" video:CodecDescription="H.265 / HEVC (High Efficiency Video Coding)" video:Format="yuv420p10le" video:ColorMode="bt709" video:ColorSpace="CCIR-709" video:Width="3840" video:FrameWidth="3840" video:SourceImageWidth="3840" video:Height="2160" video:FrameHeight="2160" video:SourceImageHeight="2160" video:FrameSize="w:3840, h:2160, unit:pixels" video:AspectRatio="16/9" video:FrameRate="59.9401" video:BitDepth="24" video:Language="eng" video:TrackCreateDate="3761817978" video:MajorBrand="qt " video:CompatibleBrands="qt pana" video:MinorVersion="537986816" video:DateTimeOriginal="2023-03-16T12:26:18" video:DateUTC="2023-03-16T12:26:18" video:ModificationDate="2023-03-16T12:26:18" video:DateTimeDigitized="2023-03-16T12:26:18" video:FileName="A001C192_230316_DJ0B.MOV" video:FileSize="522" video:FileType="MOV" video:MimeType="video/quicktime" xmpDM:duration="22522" xmpDM:videoColorSpace="CCIR-709" xmpDM:videoFrameSize="w:3840, h:2160, unit:pixels" xmpDM:videoPixelAspectRatio="16/9" xmpDM:videoFrameRate="Other" xmpDM:videoPixelDepth="Other" xmpDM:shotDate="Thu Mar 16 13:26:18 2023" xmpDM:audioSampleRate="48000" xmpDM:audioChannelType="Stereo" xmpDM:audioSampleType="32Int" audio:Codec="pcm_s24be" audio:CodecDescription="PCM signed 24-bit big-endian" audio:SampleRate="48000" audio:ChannelType="Stereo" audio:Format="s32" audio:SampleType="32Int" audio:TrackLang="eng" audio:TrackCreateDate="3761817978" exif:DateTimeOriginal="2023-03-16T12:26:18" exif:DateTimeDigitized="2023-03-16T12:26:18" exif:ExifVersion="0232" exif:FlashpixVersion="0100" exif:ColorSpace="65535" exif:PixelXDimension="3840" exif:PixelYDimension="2160" tiff:DateTime="2023-03-16T12:26:18" tiff:ImageWidth="3840" tiff:ImageLength="2160" tiff:YCbCrPositioning="1" tiff:XResolution="72/1" tiff:YResolution="72/1" tiff:ResolutionUnit="2" tiff:Model="HC-X1500" xmp:MetadataDate="2023-03-16T12:26:18" xmp:Label="Red" xmp:ModifyDate="2023-03-16T12:26:18" xmp:CreateDate="2023-03-16T12:26:18" acdsee:categories="<Categories><Category Assigned="0">Projects<Category Assigned="0">HCC-ZOB Videogroep Helmond<Category Assigned="1">2023-01 - Kleine Dommel<Category Assigned="1">316</Category><Category Assigned="1">315</Category><Category Assigned="1">314</Category></Category></Category></Category><Category Assigned="0">Locatie<Category Assigned="1">Nederland<Category Assigned="1">Eindhoven</Category></Category></Category><Category Assigned="0">Rivier<Category Assigned="1">Dommel</Category><Category Assigned="1">Kleine Dommel</Category></Category><Category Assigned="0">Camera<Category Assigned="1">Panasonic HC-X1500<Category Assigned="1">Cine-V</Category></Category></Category></Categories>" digiKam:ColorLabel="1" digiKam:PickLabel="1" photoshop:DateCreated="2023-03-16T12:26:18" photoshop:Urgency="1"> <exif:ComponentsConfiguration> <rdf:Seq> <rdf:li>1</rdf:li> <rdf:li>2</rdf:li> <rdf:li>3</rdf:li> <rdf:li>0</rdf:li> </rdf:Seq> </exif:ComponentsConfiguration> <digiKam:TagsList> <rdf:Seq> <rdf:li>Projects/HCC-ZOB Videogroep Helmond/2023-01 - Kleine Dommel/314</rdf:li> <rdf:li>Locatie/Nederland/Eindhoven</rdf:li> <rdf:li>Rivier/Kleine Dommel</rdf:li> <rdf:li>Projects/HCC-ZOB Videogroep Helmond/2023-01 - Kleine Dommel/315</rdf:li> <rdf:li>Rivier/Dommel</rdf:li> <rdf:li>Camera/Panasonic HC-X1500</rdf:li> <rdf:li>Projects/HCC-ZOB Videogroep Helmond/2023-01 - Kleine Dommel</rdf:li> <rdf:li>Projects/HCC-ZOB Videogroep Helmond/2023-01 - Kleine Dommel/316</rdf:li> <rdf:li>Camera/Panasonic HC-X1500/Cine-V</rdf:li> <rdf:li>Locatie/Nederland</rdf:li> </rdf:Seq> </digiKam:TagsList> <MicrosoftPhoto:LastKeywordXMP> <rdf:Bag> <rdf:li>Projects/HCC-ZOB Videogroep Helmond/2023-01 - Kleine Dommel/314</rdf:li> <rdf:li>Locatie/Nederland/Eindhoven</rdf:li> <rdf:li>Rivier/Kleine Dommel</rdf:li> <rdf:li>Projects/HCC-ZOB Videogroep Helmond/2023-01 - Kleine Dommel/315</rdf:li> <rdf:li>Rivier/Dommel</rdf:li> <rdf:li>Camera/Panasonic HC-X1500</rdf:li> <rdf:li>Projects/HCC-ZOB Videogroep Helmond/2023-01 - Kleine Dommel</rdf:li> <rdf:li>Projects/HCC-ZOB Videogroep Helmond/2023-01 - Kleine Dommel/316</rdf:li> <rdf:li>Camera/Panasonic HC-X1500/Cine-V</rdf:li> <rdf:li>Locatie/Nederland</rdf:li> </rdf:Bag> </MicrosoftPhoto:LastKeywordXMP> <lr:hierarchicalSubject> <rdf:Bag> <rdf:li>Projects|HCC-ZOB Videogroep Helmond|2023-01 - Kleine Dommel|314</rdf:li> <rdf:li>Locatie|Nederland|Eindhoven</rdf:li> <rdf:li>Rivier|Kleine Dommel</rdf:li> <rdf:li>Projects|HCC-ZOB Videogroep Helmond|2023-01 - Kleine Dommel|315</rdf:li> <rdf:li>Rivier|Dommel</rdf:li> <rdf:li>Camera|Panasonic HC-X1500</rdf:li> <rdf:li>Projects|HCC-ZOB Videogroep Helmond|2023-01 - Kleine Dommel</rdf:li> <rdf:li>Projects|HCC-ZOB Videogroep Helmond|2023-01 - Kleine Dommel|316</rdf:li> <rdf:li>Camera|Panasonic HC-X1500|Cine-V</rdf:li> <rdf:li>Locatie|Nederland</rdf:li> </rdf:Bag> </lr:hierarchicalSubject> <mediapro:CatalogSets> <rdf:Bag> <rdf:li>Projects|HCC-ZOB Videogroep Helmond|2023-01 - Kleine Dommel|314</rdf:li> <rdf:li>Locatie|Nederland|Eindhoven</rdf:li> <rdf:li>Rivier|Kleine Dommel</rdf:li> <rdf:li>Projects|HCC-ZOB Videogroep Helmond|2023-01 - Kleine Dommel|315</rdf:li> <rdf:li>Rivier|Dommel</rdf:li> <rdf:li>Camera|Panasonic HC-X1500</rdf:li> <rdf:li>Projects|HCC-ZOB Videogroep Helmond|2023-01 - Kleine Dommel</rdf:li> <rdf:li>Projects|HCC-ZOB Videogroep Helmond|2023-01 - Kleine Dommel|316</rdf:li> <rdf:li>Camera|Panasonic HC-X1500|Cine-V</rdf:li> <rdf:li>Locatie|Nederland</rdf:li> </rdf:Bag> </mediapro:CatalogSets> <dc:subject> <rdf:Bag> <rdf:li>314</rdf:li> <rdf:li>Eindhoven</rdf:li> <rdf:li>Kleine Dommel</rdf:li> <rdf:li>315</rdf:li> <rdf:li>Dommel</rdf:li> <rdf:li>Panasonic HC-X1500</rdf:li> <rdf:li>2023-01 - Kleine Dommel</rdf:li> <rdf:li>316</rdf:li> <rdf:li>Cine-V</rdf:li> <rdf:li>Nederland</rdf:li> </rdf:Bag> </dc:subject> </rdf:Description> </rdf:RDF> </x:xmpmeta> <?xpacket end="w"?>
Hi Mike, The ones for which I did a reread on computer A before export, correctly show tags and labels on computer B, but also the 5 stars that appeared on computer A after the reread. Jan
The 5 stars come from reading "Iptc.Application2.Urgency". These are interpreted by "photoshop:Urgency" via the Exiv2 mapping of the metadata (IPTC <=> XMP). The value 1 corresponds to 5 stars. You can deactivate "Iptc.Application2.Urgency" in the advanced metadata settings under Rating. Bug 467713 https://bugs.kde.org/show_bug.cgi?id=467713#c5 Maik
Thanks for that. If a do a reread of metadata on computer B I het all tags and labels correctly (+ the stars).
Ok, so we're back to the problem of not always reading all the metadata during the first scan on Windows. Which antivirus program are you using? What we urgently need would be a DebugView log from such a first scan if not all metadata is read. Maik
I am using the standard Windows 10 anti-virus. I also use the free version of Malwarebytes. This version must be started manually to scan. I understand you need a DebugView log of computer B. I may need a bit of time to set it up, but I will send the log as soon as I have it.
Created attachment 159721 [details] DebugView log
The normal debug messages are missing in the log. You forgot to set the Qt debug environment variable. This can either be done in the digiKam setup under Miscellaneous-> System-> [x] internal debugging (restart digiKam). Or by setting the variable in the Windows environment variable editor, it is described here: https://www.digikam.org/contribute/ Maik
Created attachment 159731 [details] Debug log with env. variable set Next attempt :-)
The log shows that video files (MOV) with Exiv2 are scanned first. This can't be, since we're testing on video using QMimeDatabase. I can't reproduce it here in my Windows10 installation. But the fact is that the file "mime/packages/freedesktop.org.xml" required by QMimeDatabase is missing. It is present in the MSVC build. @Gilles, we need to copy this file into the install media. Maik
Ok, i will take a look about this xml file. Where it's installed in MSVC build hierarchy exactly ? Gilles
From the MXE build i can see this directory: gilles@gilles-MXE-Build:~/Documents/8.x/project/bundles/mxe/build.win64/build.win64/usr/x86_64-w64-mingw32.shared/share/mime/packages$ pwd /home/gilles/Documents/8.x/project/bundles/mxe/build.win64/build.win64/usr/x86_64-w64-mingw32.shared/share/mime/packages gilles@gilles-MXE-Build:~/Documents/8.x/project/bundles/mxe/build.win64/build.win64/usr/x86_64-w64-mingw32.shared/share/mime/packages$ ll total 16 drwxrwxr-x 2 gilles gilles 4096 mai 17 07:00 . drwxrwxr-x 4 gilles gilles 4096 mai 17 07:00 .. -rw-r--r-- 1 gilles gilles 6503 mai 6 10:17 geo.xml But there is no freedesktop.org.xml file here Gilles
Under Linux, the shared-mime-info package provide this xml file, but it do not exists under MXE Gilles
Git commit f9df44a866b86d46c30963a623d91d0eb8e51f07 by Gilles Caulier. Committed on 18/06/2023 at 16:17. Pushed by cgilles into branch 'master'. add freedesktop.org XML database from host to MXE bundle M +35 -30 project/bundles/mxe/04-build-installer.sh https://invent.kde.org/graphics/digikam/-/commit/f9df44a866b86d46c30963a623d91d0eb8e51f07
It's definitely good if the file is there. I see a fallback to an internal database in the QMimeDatabase code, but it doesn't necessarily always have to be there. I'm surprised that Jan doesn't recognize a MOV file as a video, but here with me with both Windows builds, the problem doesn't occur. Maik
I had the issue with MOV as well as MP4.
(In reply to Jan van Bekkum from comment #16) > Thanks for that. > > If a do a reread of metadata on computer B I het all tags and labels > correctly (+ the stars). Apparently the reread doesn't always work. I had all tags and labels (except stars) showing correctly on computer B. The files were on a portable disk linked to computer B (disk 1). I connected disk 1 to computer C running Windows 10/digiKam 8.0 and copied the entire content of disk 1 to a portable disk 2. I added the media folder to the library. Also after a reread I did not see the tags of the files on disk 2 on computer C . At a second place I connected disk 1 to computer D running Windows 10/digiKam 8.0 and added the media folder of disk 1 to the library. Also here I did not see the tags after a reread. Computers C and D are not mine and are not at my place. Unfortunately that means that I cannot easily do additional tests.
I tried this again with 8.1.0 running on computer A, B and C. Result was the same as before. On computer B I saw all tags as soon as I started to scan the external disk, on computer C I didn't manage to see tags of the video files. I tried a rewrite from files to database and I tried an import instead of a folder scan, but the result remained the same: images handled correctly, but videos not.
Send me the digikamrc configuration files from computers B and C. It would be good to have a video sample with sidecars (if used) whose metadata is not read on computer C. Maik
Created attachment 161726 [details] digikamrc computer B
Created attachment 161727 [details] digikamrc computer C
Video files are too large for an attachment. I uploaded them to WeTransfer. This is the link: https://we.tl/t-gK6yPCoTUQ. The tags and labels of both are not visible on computer C.
Your problem is that you haven't enabled reading sidecar metadata on Computer C. By the way, neither does writing sidecars is enabled, but this is not relevant for reading metadata. However, I still see a problem that needs to be solved immediately. We save the names section of the extended metadata setting translated. Maik
Git commit 4092a40ccc24603414b91cd8c0126b500b6bd6a7 by Maik Qualmann. Committed on 19/09/2023 at 21:33. Pushed by mqualmann into branch 'master'. fix translated metadata group names in the configuration M +87 -6 core/libs/metadataengine/dmetadata/dmetadatasettingscontainer.cpp M +2 -0 core/libs/metadataengine/dmetadata/dmetadatasettingscontainer.h M +1 -1 core/utilities/setup/metadata/advancedmetadatatab.cpp https://invent.kde.org/graphics/digikam/-/commit/4092a40ccc24603414b91cd8c0126b500b6bd6a7
Git commit 4e193bd2afdcb12ace9a98f6285b597457de899e by Maik Qualmann. Committed on 19/09/2023 at 22:06. Pushed by mqualmann into branch 'master'. delete also possible orphaned metadata group entries M +9 -7 core/libs/metadataengine/dmetadata/dmetadatasettingscontainer.cpp https://invent.kde.org/graphics/digikam/-/commit/4e193bd2afdcb12ace9a98f6285b597457de899e
Thanks for your quick response and sorry for not setting up computer C correctly. It was a fresh install and I left all defaults in place. Any reason why sidecar reading and writing is not enabled by default?
We have enabled read and write sidecar on computer C, but the we still don't see tags and labels. Do I understand correctly that the bug that you reported yesterday has to be resolved first. You probably discovered already from the logs that computer A and B have English as system language and computer C (and also D as reported earlier in this chain) use Dutch.
In principle, the translated metadata groups play no role if you use standard settings and have not imported or exported any metadata profiles. But was the metadata re-read from the video files (via item menu or similar) after reading from sidecars was activated? By the way, I have color and rating metadata imported with the sample videos. Maik
Ik realized that we should have done the reread after I sent my last comment. It now works! Sorry for the confusion. After all it was a configuration error, not a bug.