Bug 370631

Summary: Converting Sony STL-A58 ARW to DNG fails - Update to DNG SDK 1.5
Product: [Applications] digikam Reporter: christian.pietzsch
Component: Plugin-Bqm-DngConverterAssignee: Digikam Developers <digikam-bugs-null>
Status: RESOLVED FIXED    
Severity: major CC: caulier.gilles, metzpinguin
Priority: NOR    
Version: 5.2.0   
Target Milestone: ---   
Platform: Arch Linux   
OS: Linux   
Latest Commit: Version Fixed In: 7.3.0
Sentry Crash Report:

Description christian.pietzsch 2016-10-13 09:41:35 UTC
Converting ARW files to DNG fails.
History of the batch queue says "Failed to process item ..." but still creates an unreadable file.

In additional Information you can see the terminal output during the convertion.


Reproducible: Always

Steps to Reproduce:
1. add RW file to batch queue
2. assign tool "Convert RAW to DNG" (default settings)
3. run batch process

Actual Results:  
process fails but creates an unreadable DNG file

Expected Results:  
functioning DNG file

digikam.general: Using  1  CPU core to run threads
digikam.general: Action Thread run  1  new jobs
digikam.general: Tool : index=  1  :: name=  "Convert2DNG"  :: group=  7  :: wurl=  QUrl("file:///home/christian/Bilder/Island 2016/")
digikam.general: path:  "/home/christian/Bilder/Island 2016/BatchTool-TJ1930.digikamtempfile.dng"
digikam.general: Tool:        "Convert RAW To DNG"
digikam.general: Input url:   QUrl("file:///home/christian/Bilder/Island 2016/DSC01774.ARW")
digikam.general: Output url:  QUrl("file:///home/christian/Bilder/Island 2016/BatchTool-TJ1930.digikamtempfile.dng")
digikam.general: DNGWriter: Loading RAW data from  "DSC01774.ARW"
...Sony black: 512 cblack: 0 0 0 0
 Sony matrix:
1,261719 -0,175781 -0,085938
-0,042969 1,308594 -0,265625
-0,023438 -0,105469 1,128906
...Sony black: 512 cblack: 0 0 0 0
 Sony matrix:
1,261719 -0,175781 -0,085938
-0,042969 1,308594 -0,265625
-0,023438 -0,105469 1,128906
digikam.rawengine: LibRaw progress:  Reading metadata  pass  1  of  2
digikam.rawengine: LibRaw progress:  Reading RAW data  pass  0  of  2
digikam.general: Detected change, triggering rescan of "/home/christian/Bilder/Island 2016/"
digikam.rawengine: LibRaw progress:  Reading RAW data  pass  1  of  2
digikam.database: Starting scan!
digikam.general: DNGWriter: Raw data loaded:
digikam.general: --- Data Size:      40011264  bytes
digikam.general: --- Date:           "2016-09-01T04:07:47"
digikam.general: --- Make:           "Sony"
digikam.general: --- Model:          "SLT-A58"
digikam.general: --- ImageSize:      5472 x 3656
digikam.general: --- FullSize:       5504 x 3656
digikam.general: --- OutputSize:     5472 x 3656
digikam.general: --- Orientation:    0
digikam.general: --- Top margin:     0
digikam.general: --- Left margin:    0
digikam.general: --- Filter:         "RGGBRGGBRGGBRGGB"
digikam.general: --- Colors:         3
digikam.general: --- Black:          512
digikam.general: --- White:          17220
digikam.general: --- CAM->XYZ:
digikam.general:                     "0.5991  -0.1456  -0.0455"
digikam.general:                     "-0.4764  1.2135  0.2980"
digikam.general:                     "-0.0707  0.1425  0.6701"
digikam.general:                     "0.0000  0.0000  0.0000"
digikam.general: DNGWriter: DNG memory allocation and initialization
digikam.general: DNGWriter: DNG Negative structure creation
digikam.general: DNGWriter: Updating metadata to DNG Negative
digikam.metaengine: DateTime => Exif.Photo.DateTimeOriginal =>  QDateTime(2016-09-01 04:07:47.000 CEST Qt::TimeSpec(LocalTime))
digikam.metaengine: DateTime (Exif digitalized):  Do. Sep. 1 04:07:47 2016
digikam.general: DNGWriter: Backup Makernote ( 35675  bytes)
digikam.general: DNGWriter: Build DNG Negative
digikam.general: DNGWriter: DNG preview image creation
digikam.general: DNGWriter: Cannot load TIFF preview data in memory. Aborted...
digikam.metaengine: Cannot load metadata from file   (Error # 11 :  /home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an unknown image type
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : RAW file identified
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : QIMAGE file identified
digikam.dimg.qimage: Can not load " "/home/christian/Bilder/Island 2016/DSC01774.dng" " using DImg::QImageLoader!
digikam.database: Adding new item "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.database: Scanning took 1 ms
digikam.general: Detected change, triggering rescan of "/home/christian/Bilder/Island 2016/"
digikam.general: Detected change, triggering rescan of "/home/christian/Bilder//"
digikam.database: Finishing took 156 ms
digikam.database: Copying properties from 5035 to 5479
digikam.general: Using  1  CPU core to run threads
digikam.metaengine: Cannot load metadata from file   (Error # 11 :  /home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an unknown image type
digikam.general: Action Thread run  1  new jobs
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.metaengine: Cannot load metadata from file   (Error # 11 :  /home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an unknown image type
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : RAW file identified
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : QIMAGE file identified
digikam.dimg.qimage: Can not load " "/home/christian/Bilder/Island 2016/DSC01774.dng" " using DImg::QImageLoader!
digikam.general: Trying to load Embedded preview with libraw
digikam.database: Scanning took 3 ms
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.rawengine: Failed to load embedded RAW preview
digikam.general: Trying to load half preview with libraw
digikam.rawengine: Try to use reduced RAW picture extraction
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.general: Trying to load Embedded preview with Exiv2
digikam.metaengine: Cannot load metadata using Exiv2   (Error # 11 :  /home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an unknown image type
digikam.database: Starting scan!
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : RAW file identified
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : QIMAGE file identified
digikam.dimg.qimage: Can not load " "/home/christian/Bilder/Island 2016/DSC01774.dng" " using DImg::QImageLoader!
digikam.general: mimetype =  ""  ext =  "DNG"
digikam.general: Cannot create thumbnail for  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: Thumbnail is null for  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: Request to get thumbnail for  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.database: Finishing took 128 ms
digikam.general: Mime type is not video from  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: Failed to extract video thumbnail for  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: One job is done
digikam.general: Cancel Main Thread
digikam.general: One job is done
digikam.metaengine: Cannot load metadata from file   (Error # 11 :  /home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an unknown image type
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.general: Trying to load Embedded preview with libraw
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.rawengine: Failed to load embedded RAW preview
digikam.general: Trying to load half preview with libraw
digikam.rawengine: Try to use reduced RAW picture extraction
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.general: Trying to load Embedded preview with Exiv2
digikam.metaengine: Cannot load metadata using Exiv2   (Error # 11 :  /home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an unknown image type
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : RAW file identified
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : QIMAGE file identified
digikam.dimg.qimage: Can not load " "/home/christian/Bilder/Island 2016/DSC01774.dng" " using DImg::QImageLoader!
digikam.general: mimetype =  ""  ext =  "DNG"
digikam.general: Cannot create thumbnail for  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: Thumbnail is null for  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: List of Pending Jobs is empty
digikam.general: Event is dispatched to desktop notifier through DBUS
digikam.general: Request to get thumbnail for  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: Mime type is not video from  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: Failed to extract video thumbnail for  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.metaengine: Cannot load metadata from file   (Error # 11 :  /home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an unknown image type
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.general: Trying to load Embedded preview with libraw
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.rawengine: Failed to load embedded RAW preview
digikam.general: Trying to load half preview with libraw
digikam.rawengine: Try to use reduced RAW picture extraction
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.general: Trying to load Embedded preview with Exiv2
digikam.metaengine: Cannot load metadata using Exiv2   (Error # 11 :  /home/christian/Bilder/Island 2016/DSC01774.dng: The file contains data of an unknown image type
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : RAW file identified
digikam.rawengine: LibRaw: failed to run open_file:  Unsupported file format or not RAW file
digikam.dimg: "/home/christian/Bilder/Island 2016/DSC01774.dng"  : QIMAGE file identified
digikam.dimg.qimage: Can not load " "/home/christian/Bilder/Island 2016/DSC01774.dng" " using DImg::QImageLoader!
digikam.general: mimetype =  ""  ext =  "DNG"
digikam.general: Cannot create thumbnail for  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: Thumbnail is null for  "/home/christian/Bilder/Island 2016/DSC01774.dng"
digikam.general: Using  1  CPU core to run threads
digikam.general: Action Thread run  1  new jobs
digikam.general: One job is done
Comment 1 caulier.gilles 2016-10-13 09:51:13 UTC
digikam.general: DNGWriter: Cannot load TIFF preview data in memory. Aborted...

The DNG preview image cannot be created from ARW file. The image format is not recognized after extraction.

Strange. Please share the ARW file into the cloud to investiguate.

Gilles Caulier
Comment 2 christian.pietzsch 2016-10-13 09:58:31 UTC
I tried a few different ones and they all failed. 
Here is one of them: 
https://dl.dropboxusercontent.com/u/70882424/DSC01774.ARW
Comment 3 Maik Qualmann 2016-10-13 18:51:10 UTC
Problem is not reproducible here. The ARW file is converted without errors to a DNG. No TIFF memory error.

Maik
Comment 4 caulier.gilles 2016-10-13 19:11:52 UTC
Probably, it miss a tiff codec for Qt in your install, as one provided by KImageIO component from KDE.

Gilles Caulier
Comment 5 christian.pietzsch 2016-10-14 00:11:25 UTC
Okay that helped to solve the problem.
Forgot to mention that I'm using Manjaro Linux.

I manually installed the package qt5-imageformats and now it works.
The digikam package dependencies shows qt5-imageformats only as additional dependecny. (iike hugin formwhich it's okay since Digkam checks if it's installed when you try to to panaoramas.)
Tryed to find if you can report that somewhere, but didn't find anything. So if you know I can report it to the package maintainer.

Thanks
Christian
Comment 6 caulier.gilles 2016-10-14 05:49:46 UTC
Yes, please report this problem as DOWSTREAM, to your Linux distro team.

Gilles Caulier
Comment 7 caulier.gilles 2021-05-11 05:22:13 UTC
After upgrading DNG SDK to 1.65 and libraw to snapshot 20210504, converting STL-A58 to DNG wit digiKam 7.3.0 work as expected...

Sample image : http://www.rawsamples.ch/raws/sony/RAW_SONY_SLT-A58.ARW

Screenshot : https://i.imgur.com/YZAjH1W.png

I close this file now.

Gilles Caulier