Version:           git commit ef258b9bcf78fafae303c3c135831f6693c7fca9 (using KDE 4.3.1)
Compiler:          gcc-4.3.4 CFLAGS="-O2 -pipe -march=core2 "
OS:                Linux
Installed from:    Compiled From Sources

The random playing mode does not seem to be functional. Here's how it works for me currently: I select (manually) a song and let amarok play it. Then click the "next" button (or ctrl+B). Regardless of the selected random mode ("off", "tracks" or "album"), the track that starts playing is the track that is directly below the currently playing track. The different favorings do not have any effect either.

For example, I have the following tracks next to each other in the playlist:
1. AC/DC - "Who made who"
1. Children Of Bodom - "Are you dead yet"
2. Chimaira - "Order of the falling sun"
When playing "Are you dead yet" and clicking "next", the song by Chimaira will always start playing.

I expected the random mode to work like it used to in Amarok 1.4 - in the sense that it should really have some randomness.

The playlist I use consists of a few thousand tracks. Most of the tracks haven't been played yet (play count and score are 0, no ratings).

Below you will find a part of the debug log (acquired with executing amarok with the --debug parameter, then exiting amarok and executing it with the --debug parameter again). The log shows events between clicking the "next" button and starting to load the next track. The log excerpt ends at the point when it's clear that the next track is the one that is the next in the playlist. In this case the tracks were "Darkness and Hope" and "Firewalking", tracks 1 and 2 (respectively) from an album by Moonspell.

amarok: BEGIN: virtual void TextScrollingWidget::hoverEnterEvent(QGraphicsSceneHoverEvent*)
amarok: END__: virtual void TextScrollingWidget::hoverEnterEvent(QGraphicsSceneHoverEvent*) - Took 0.00011s
amarok: [Playlist::Actions] Dynamic mode:    false
amarok: [Playlist::Actions] Repeat enabled:  true
amarok: [Playlist::Actions] Random enabled:  true
amarok: [Playlist::Actions] Track mode:      true
amarok: [Playlist::Actions] Album mode:      false
amarok: BEGIN: virtual void TextScrollingWidget::hoverEnterEvent(QGraphicsSceneHoverEvent*)
amarok: END__: virtual void TextScrollingWidget::hoverEnterEvent(QGraphicsSceneHoverEvent*) - Took 0.00017s
amarok: BEGIN: virtual void TextScrollingWidget::hoverEnterEvent(QGraphicsSceneHoverEvent*)
amarok: END__: virtual void TextScrollingWidget::hoverEnterEvent(QGraphicsSceneHoverEvent*) - Took 0.00015s
amarok: BEGIN: void Playlist::Actions::play(quint64, bool)
amarok:   [Playlist::Actions] Manually advancing to the next track, calculating previous statistics for track here.  Finished % is:  0.0433519
amarok:    returning bookmarkcurrenttrack action
amarok:   [Playlist::Model] Metadata updated for track "Darkness and Hope"
amarok:    returning bookmarkcurrenttrack action
amarok:   [Playlist::Model] Metadata updated for track "Darkness and Hope"
amarok:   BEGIN: void EngineController::play(const Meta::TrackPtr&, uint)
amarok:     [EngineController] Just a normal, boring track... :-P
amarok:     BEGIN: void EngineController::playUrl(const KUrl&, uint)
amarok:       [EngineController] URL:  "file:///fatman/mUSs/mETAl/m/Moonspell/Moonspell%20-%20Darkness%20and%20hope/02_Firewalking.mp3"