Version: 2.4.0 (using KDE 4.6.0) OS: Linux When updating my collection, amarok only finds only 34 tracks... my folder structure contains 757 mp3 files though. Amarok before 2.4.0 was able to handle those all right. Reproducible: Always Steps to Reproduce: - delete all amarok related files from ~/.kde4 - start amarok - point amarok at ~/Documents/Music - see the local collection contain about 5% of the content of ~/Documents/Music Actual Results: see above, collection contains a small percentage of what it should be Expected Results: amarok should be able to scan the collection properly OS: Linux (i686) release 2.6.34.7-0.7-pae Compiler: gcc this bug has the same effects on a collection database that was already filled with data from before, hence "Major: data loss".
Are you using the default MySQL embedded or do you use an external database server? Which MySQL version do you use?
the problem exists both with external mysql database and local mysqlle database... with some help from the folks on #amarok@freenode i got a workaround that helped... using amarok 2.4.1 from GIT, and strip the UFID tag from all mp3 files that iTunes jammed in at some point.
Right, non-standard tags are a pain indeed. UFID is used by iTunes only AFAIK, closing for now.
then maybe amarok should be cleanly ignoring the unused tags, instead of getting major problems?
Amarok has fixes now for this problem.
Closing as fixed, then.
actually, at home after a full scan I'm still missing about 50 titles (judging by a find -iname \*mp3 -type f|wc -l compared to how many titles are in the amarok collection). Any suggestions for a small shell script that would access the amarok database on my mysql server to find the mp3 files that weren't scanned properly, so that we can make some more progress here?
I've written a small perl script that traverses a folder tree and reports all files in it that match *.mp3 but are not in the database: http://linux.eregion.de/2011/02/09/how-to-verify-your-amarok-2-collection-database/ the result suggests that the collection scanner chokes on files with non-plain-ascii pathnames, here's a snip from the output when I run it on my server: lemmy@kotoko:~/Work/Perl/Amarok> ./verifydb.pl /eregion/mp3/Enya/Only Time: The Collection/cd 4/09 - Deora Ar Mo Chroí (Tears on My Heart).mp3 /eregion/mp3/Enya/Only Time: The Collection/cd 4/14 - Oíche Chiúin (Silent Night).mp3 /eregion/mp3/Enya/Only Time: The Collection/cd 2/02 - Ebudæ.mp3 /eregion/mp3/Enya/Only Time: The Collection/cd 2/05 - Na Laetha Geal M'Óige.mp3 /eregion/mp3/Enya/Only Time: The Collection/cd 2/11 - Lothlórien [Instrumental].mp3 /eregion/mp3/Die Toten Hosen/Die Toten Hosen - Zehn Kleine Jägermeister.mp3 /eregion/mp3/Die Toten Hosen/Ein kleines bisschen Horrorshow/02 - 1000 Gute Gründe.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/01 - Die Glocken Notre Dames.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/02 - Zuflucht.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/04 - Tanz auf dem Seil.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/05 - Ein bisschen Freude.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/09 - Das Licht des Himmels.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/11 - Esmeralda.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/12 - Trommeln in der Nacht.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/13 - Ein Mann wie Du.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/14 - Weil Du liebst.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/15 - Tanz der Zigeuner.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/16 - Weil Du liebst (Reprise).mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/17 - Wie aus Stein.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/18 - Einmal.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/19 - Finale Ultimo.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/03 - Draußen.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/06 - Drunter - Drüber.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/07 - Hilf den Verstoß'nen.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/08 - Hoch über der Welt.mp3 /eregion/mp3/Disney's/Der Glöckner von Notre Dame/10 - Das Feuer der Hölle.mp3
Please make sure you have your system set to UTF-8, as well as your id3 tags, you can change that easily with an editor like easytag or kid3
what exactly do you mean by "set your system to utf-8"? there's a bit more involved here, since that path /eregion/mp3 is a nfs share...
As I also have files with non-ascii characters in the filenames I would like to have more information. Please do "amarokcollectionscanner -r "/eregion/mp3/Disney's/Der Glöckner von Notre Dame/" " If you see the tags from all the files everything is OK for now. Then please do a "printenv | grep LC" and give me the result (LC is the language encoding) What Linux distribution are you using?
here's some output: lemmy@sai:~> amarokcollectionscanner -r /eregion/mp3/Disney\'s/Der\ Glöckner\ von\ Notre\ Dame/ > /tmp/scan.xml TagLib: MPEG::Header::parse() -- Invalid sample rate. TagLib: MPEG::Header::parse() -- Invalid sample rate. TagLib: MPEG::Header::parse() -- Invalid sample rate. lemmy@sai:~> printenv|grep LC lemmy@sai:~> locale LANG=de_DE.UTF-8 LC_CTYPE="de_DE.UTF-8" LC_NUMERIC="de_DE.UTF-8" LC_TIME="de_DE.UTF-8" LC_COLLATE="de_DE.UTF-8" LC_MONETARY="de_DE.UTF-8" LC_MESSAGES="de_DE.UTF-8" LC_PAPER="de_DE.UTF-8" LC_NAME="de_DE.UTF-8" LC_ADDRESS="de_DE.UTF-8" LC_TELEPHONE="de_DE.UTF-8" LC_MEASUREMENT="de_DE.UTF-8" LC_IDENTIFICATION="de_DE.UTF-8" LC_ALL= the result of the scan is attached.
Created attachment 57064 [details] result of requested collection scan
see previous comment & attachment.
Sorry for coming back so late. I've found a lengthly discussion about filenames and why Qt just won't see them. https://bugs.kde.org/show_bug.cgi?id=165044 Mathias, could you please also start Amarok from the command line to ensure that you are using the same unicode settings for Amarok and the scanner. Also you could use dolphin to check if it's a kde problem and rename the files. Actually rename them to the same name (just press F2 or whatever and then return).
Same problem for me : amarok is unable to detect files with non-ascii characters here. Undiscovered FLAC files have been created using built-in KDE audiocd:// utility. If I rename a file in a ASCII way, the amarok scanner finds it.
I confirm the same problem with amarok-2.4.0 on FreeBSD-8.2. If I force amarok to play a file with a name containing non-ASCII chars, it seg fault: Application: Amarok (amarok), signal: Segmentation fault: 11 [Current thread is 1 (Thread 42296040 (LWP 100664))] Thread 7 (Thread 3b201140 (LWP 100465)): [KCrash Handler] #7 0x3da5f117 in Phonon::Gstreamer::Backend::debugLevel () from /usr/local/kde4/lib/kde4/plugins/phonon_backend/phonon_gstreamer.so #8 0x3da6d466 in Phonon::Gstreamer::MediaObject::changeState () from /usr/local/kde4/lib/kde4/plugins/phonon_backend/phonon_gstreamer.so #9 0x3da6d884 in Phonon::Gstreamer::MediaObject::setError () from /usr/local/kde4/lib/kde4/plugins/phonon_backend/phonon_gstreamer.so #10 0x3da72f3f in Phonon::Gstreamer::MediaObject::handleBusMessage () from /usr/local/kde4/lib/kde4/plugins/phonon_backend/phonon_gstreamer.so #11 0x3da5f23e in Phonon::Gstreamer::Backend::handleBusMessage () from /usr/local/kde4/lib/kde4/plugins/phonon_backend/phonon_gstreamer.so #12 0x3da5f2e8 in Phonon::Gstreamer::Backend::qt_metacall () from /usr/local/kde4/lib/kde4/plugins/phonon_backend/phonon_gstreamer.so #13 0x35f68dd3 in QMetaObject::metacall () from /usr/local/lib/qt4/libQtCore.so.4 #14 0x35f73e76 in QMetaCallEvent::placeMetaCall () from /usr/local/lib/qt4/libQtCore.so.4 #15 0x35f7544c in QObject::event () from /usr/local/lib/qt4/libQtCore.so.4 #16 0x3500b2fc in QApplicationPrivate::notify_helper () from /usr/local/lib/qt4/libQtGui.so.4 #17 0x35012154 in QApplication::notify () from /usr/local/lib/qt4/libQtGui.so.4 #18 0x33ed1a93 in KApplication::notify () from /usr/local/kde4/lib/libkdeui.so.7 #19 0x35f6257b in QCoreApplication::notifyInternal () from /usr/local/lib/qt4/libQtCore.so.4 #20 0x35f6380f in QCoreApplicationPrivate::sendPostedEvents () from /usr/local/lib/qt4/libQtCore.so.4 #21 0x35f63a2d in QCoreApplication::sendPostedEvents () from /usr/local/lib/qt4/libQtCore.so.4 #22 0x35f92774 in postEventSourceDispatch () from /usr/local/lib/qt4/libQtCore.so.4 #23 0x3a28d969 in g_main_context_dispatch () from /usr/local/lib/libglib-2.0.so.0 #24 0x3a290ee6 in g_main_context_prepare () from /usr/local/lib/libglib-2.0.so.0 #25 0x3a29139c in g_main_context_iteration () from /usr/local/lib/libglib-2.0.so.0 #26 0x35f92b9b in QEventDispatcherGlib::processEvents () from /usr/local/lib/qt4/libQtCore.so.4 #27 0x350cafe5 in QGuiEventDispatcherGlib::processEvents () from /usr/local/lib/qt4/libQtGui.so.4 #28 0x35f61753 in QEventLoop::processEvents () from /usr/local/lib/qt4/libQtCore.so.4 #29 0x35f619ea in QEventLoop::exec () from /usr/local/lib/qt4/libQtCore.so.4 #30 0x35f63af6 in QCoreApplication::exec () from /usr/local/lib/qt4/libQtCore.so.4 #31 0x3500a907 in QApplication::exec () from /usr/local/lib/qt4/libQtGui.so.4 #32 0x08050a7a in ?? () #33 0x08049499 in ?? () #34 0x00000001 in ?? () #35 0xbfbfe414 in ?? () #36 0xbfbfe41c in ?? () #37 0x00000000 in ?? () #38 0x33c5e010 in dlclose () from /libexec/ld-elf.so.1 #39 0x00000001 in ?? () Thread 6 (Thread 4229ca80 (LWP 100411)): #0 0x362a24ab in kevent () from /lib/libc.so.7 #1 0x35f42c68 in QKqueueFileSystemWatcherEngine::run () from /usr/local/lib/qt4/libQtCore.so.4 #2 0x35e57e08 in QThreadPrivate::start () from /usr/local/lib/qt4/libQtCore.so.4 #3 0x361bf73d in pthread_getprio () from /lib/libthr.so.3 #4 0x00000000 in ?? () Thread 5 (Thread 4229b2c0 (LWP 100651)): #0 0x361ca2cf in __error () from /lib/libthr.so.3 #1 0x361c9e89 in __error () from /lib/libthr.so.3 #2 0x405e1ae0 in ?? () #3 0x00000008 in ?? () #4 0x00000001 in ?? () #5 0x405e1ac0 in ?? () #6 0x00000000 in ?? () #7 0x0000000c in ?? () #8 0x405e2100 in ?? () #9 0x361c881f in pthread_setcancelstate () from /lib/libthr.so.3 #10 0x361c80f1 in pthread_cond_signal () from /lib/libthr.so.3 #11 0x35e58966 in QWaitCondition::wait () from /usr/local/lib/qt4/libQtCore.so.4 #12 0x36a7cc30 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #13 0x36a7fd4c in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #14 0x36a7afeb in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #15 0x36a7feb2 in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #16 0x36a7ba93 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #17 0x36a7fed1 in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #18 0x36a7ba93 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #19 0x36a7d91e in ThreadWeaver::Thread::id () from /usr/local/kde4/lib/libthreadweaver.so.5 #20 0x36a7dfeb in ThreadWeaver::Thread::run () from /usr/local/kde4/lib/libthreadweaver.so.5 #21 0x35e57e08 in QThreadPrivate::start () from /usr/local/lib/qt4/libQtCore.so.4 #22 0x361bf73d in pthread_getprio () from /lib/libthr.so.3 #23 0x00000000 in ?? () Thread 4 (Thread 4229a3c0 (LWP 100660)): #0 0x361ca2cf in __error () from /lib/libthr.so.3 #1 0x361c9e89 in __error () from /lib/libthr.so.3 #2 0x405e1ae0 in ?? () #3 0x00000008 in ?? () #4 0x00000001 in ?? () #5 0x405e1ac0 in ?? () #6 0x00000000 in ?? () #7 0x0000000c in ?? () #8 0x405e2100 in ?? () #9 0x361c881f in pthread_setcancelstate () from /lib/libthr.so.3 #10 0x361c80f1 in pthread_cond_signal () from /lib/libthr.so.3 #11 0x35e58966 in QWaitCondition::wait () from /usr/local/lib/qt4/libQtCore.so.4 #12 0x36a7cc30 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #13 0x36a7fd4c in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #14 0x36a7afeb in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #15 0x36a7feb2 in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #16 0x36a7ba93 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #17 0x36a7fed1 in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #18 0x36a7ba93 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #19 0x36a7fed1 in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #20 0x36a7ba93 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #21 0x36a7d91e in ThreadWeaver::Thread::id () from /usr/local/kde4/lib/libthreadweaver.so.5 #22 0x36a7dfeb in ThreadWeaver::Thread::run () from /usr/local/kde4/lib/libthreadweaver.so.5 #23 0x35e57e08 in QThreadPrivate::start () from /usr/local/lib/qt4/libQtCore.so.4 #24 0x361bf73d in pthread_getprio () from /lib/libthr.so.3 #25 0x00000000 in ?? () Thread 3 (Thread 4229a280 (LWP 100662)): #0 0x361ca2cf in __error () from /lib/libthr.so.3 #1 0x361c9e89 in __error () from /lib/libthr.so.3 #2 0x405e1ae0 in ?? () #3 0x00000008 in ?? () #4 0x00000001 in ?? () #5 0x405e1ac0 in ?? () #6 0x00000000 in ?? () #7 0x0000000c in ?? () #8 0x405e2100 in ?? () #9 0x361c881f in pthread_setcancelstate () from /lib/libthr.so.3 #10 0x361c80f1 in pthread_cond_signal () from /lib/libthr.so.3 #11 0x35e58966 in QWaitCondition::wait () from /usr/local/lib/qt4/libQtCore.so.4 #12 0x36a7cc30 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #13 0x36a7fd4c in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #14 0x36a7afeb in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #15 0x36a7feb2 in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #16 0x36a7ba93 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #17 0x36a7fed1 in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #18 0x36a7ba93 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #19 0x36a7fed1 in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #20 0x36a7ba93 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #21 0x36a7d91e in ThreadWeaver::Thread::id () from /usr/local/kde4/lib/libthreadweaver.so.5 #22 0x36a7dfeb in ThreadWeaver::Thread::run () from /usr/local/kde4/lib/libthreadweaver.so.5 #23 0x35e57e08 in QThreadPrivate::start () from /usr/local/lib/qt4/libQtCore.so.4 #24 0x361bf73d in pthread_getprio () from /lib/libthr.so.3 #25 0x00000000 in ?? () Thread 2 (Thread 42298200 (LWP 100663)): #0 0x361ca2cf in __error () from /lib/libthr.so.3 #1 0x361c9e89 in __error () from /lib/libthr.so.3 #2 0x40ba5f20 in ?? () #3 0x00000008 in ?? () #4 0x00000001 in ?? () #5 0x40ba5f00 in ?? () #6 0x00000000 in ?? () #7 0xbf4f9ee4 in ?? () #8 0x361c41f1 in pthread_rwlock_trywrlock () from /lib/libthr.so.3 #9 0x361c80f1 in pthread_cond_signal () from /lib/libthr.so.3 #10 0x3797e625 in QTWTF::TCMalloc_PageHeap::scavengerThread () from /usr/local/lib/qt4/libQtScript.so.4 #11 0x3797e671 in QTWTF::TCMalloc_PageHeap::runScavengerThread () from /usr/local/lib/qt4/libQtScript.so.4 #12 0x361bf73d in pthread_getprio () from /lib/libthr.so.3 #13 0x00000000 in ?? () Thread 1 (Thread 42296040 (LWP 100664)): #0 0x361ca2cf in __error () from /lib/libthr.so.3 #1 0x361c9e89 in __error () from /lib/libthr.so.3 #2 0x405e1ae0 in ?? () #3 0x00000008 in ?? () #4 0x00000001 in ?? () #5 0x405e1ac0 in ?? () #6 0x00000000 in ?? () #7 0x0000000c in ?? () #8 0x405e2100 in ?? () #9 0x361c881f in pthread_setcancelstate () from /lib/libthr.so.3 #10 0x361c80f1 in pthread_cond_signal () from /lib/libthr.so.3 #11 0x35e58966 in QWaitCondition::wait () from /usr/local/lib/qt4/libQtCore.so.4 #12 0x36a7cc30 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #13 0x36a7fd4c in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #14 0x36a7afeb in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #15 0x36a7feb2 in ThreadWeaver::State::State () from /usr/local/kde4/lib/libthreadweaver.so.5 #16 0x36a7ba93 in ThreadWeaver::Weaver::~Weaver () from /usr/local/kde4/lib/libthreadweaver.so.5 #17 0x36a7d91e in ThreadWeaver::Thread::id () from /usr/local/kde4/lib/libthreadweaver.so.5 #18 0x36a7dfeb in ThreadWeaver::Thread::run () from /usr/local/kde4/lib/libthreadweaver.so.5 #19 0x35e57e08 in QThreadPrivate::start () from /usr/local/lib/qt4/libQtCore.so.4 #20 0x361bf73d in pthread_getprio () from /lib/libthr.so.3 #21 0x00000000 in ?? () Regards, -- Th. Thomas
Ralf, didn't you say it was fixed in post 2.4.0? I think all the reporters still talk about 2.4.0, not 2.4.0.90 aka Amarok 2.3.1 beta1
This is an automated message from the triager: Amarok 2.4.1 has been released on May 8 already. Could you please upgrade and test if you can still reproduce this bug? Without feedback within a month we will close this bug as resolved. Thank you for your understanding.
I think this is fixed now... at least the missing files are in the database now.
Thank you for the fast feedback :)
Confirmed on FreeBSD: v. 2.4.1 from the ports tree fixed the error. Thanks!