Bug 489035 - 24.05.1: test suite fails in 3 units
Summary: 24.05.1: test suite fails in 3 units
Status: RESOLVED NOT A BUG
Alias: None
Product: kpat
Classification: Applications
Component: general (show other bugs)
Version: 24.05.1
Platform: Other Other
: NOR normal
Target Milestone: ---
Assignee: Stephan Kulow
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2024-06-23 10:48 UTC by kloczek
Modified: 2024-06-24 11:09 UTC (History)
2 users (show)

See Also:
Latest Commit:
Version Fixed In:
Sentry Crash Report:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description kloczek 2024-06-23 10:48:34 UTC
cmake -L output

-- Cache values
APPSTREAMCLI:FILEPATH=APPSTREAMCLI-NOTFOUND
BUILD_COVERAGE:BOOL=OFF
BUILD_SHARED_LIBS:BOOL=OFF
BUILD_TESTING:BOOL=ON
BUILD_WITH_QT6:BOOL=ON
CMAKE_BUILD_TYPE:STRING=RelWithDebInfo
CMAKE_INSTALL_PREFIX:PATH=/usr
ECM_DIR:PATH=/usr/share/ECM/cmake
ENABLE_BSYMBOLICFUNCTIONS:BOOL=OFF
FISH_EXECUTABLE:FILEPATH=FISH_EXECUTABLE-NOTFOUND
GETTEXT_MSGFMT_EXECUTABLE:FILEPATH=/usr/bin/msgfmt
GETTEXT_MSGMERGE_EXECUTABLE:FILEPATH=/usr/bin/msgmerge
GTK_UPDATE_ICON_CACHE_EXECUTABLE:FILEPATH=/usr/bin/gtk-update-icon-cache
KDEGames6_DIR:PATH=/usr/lib64/cmake/KDEGames6
KDE_CHECK_JSONSCHEMA_EXECUTABLE:FILEPATH=KDE_CHECK_JSONSCHEMA_EXECUTABLE-NOTFOUND
KDE_CLANG_FORMAT_EXECUTABLE:FILEPATH=/usr/bin/clang-format
KDE_INSTALL_PREFIX_SCRIPT:BOOL=OFF
KDE_INSTALL_USE_QT_SYS_PATHS:BOOL=ON
KDE_SKIP_UNINSTALL_TARGET:BOOL=OFF
KDOCTOOLS_SERIALIZE_TOOL:STRING=
KF6Attica_DIR:PATH=/usr/lib64/cmake/KF6Attica
KF6Bookmarks_DIR:PATH=/usr/lib64/cmake/KF6Bookmarks
KF6Codecs_DIR:PATH=/usr/lib64/cmake/KF6Codecs
KF6ColorScheme_DIR:PATH=/usr/lib64/cmake/KF6ColorScheme
KF6Completion_DIR:PATH=/usr/lib64/cmake/KF6Completion
KF6ConfigWidgets_DIR:PATH=/usr/lib64/cmake/KF6ConfigWidgets
KF6Config_DIR:PATH=/usr/lib64/cmake/KF6Config
KF6CoreAddons_DIR:PATH=/usr/lib64/cmake/KF6CoreAddons
KF6Crash_DIR:PATH=/usr/lib64/cmake/KF6Crash
KF6DBusAddons_DIR:PATH=/usr/lib64/cmake/KF6DBusAddons
KF6DocTools_DIR:PATH=/usr/lib64/cmake/KF6DocTools
KF6GuiAddons_DIR:PATH=/usr/lib64/cmake/KF6GuiAddons
KF6I18n_DIR:PATH=/usr/lib64/cmake/KF6I18n
KF6ItemViews_DIR:PATH=/usr/lib64/cmake/KF6ItemViews
KF6JobWidgets_DIR:PATH=/usr/lib64/cmake/KF6JobWidgets
KF6KIO_DIR:PATH=/usr/lib64/cmake/KF6KIO
KF6NewStuffCore_DIR:PATH=/usr/lib64/cmake/KF6NewStuffCore
KF6NewStuff_DIR:PATH=/usr/lib64/cmake/KF6NewStuff
KF6Service_DIR:PATH=/usr/lib64/cmake/KF6Service
KF6Solid_DIR:PATH=/usr/lib64/cmake/KF6Solid
KF6WidgetsAddons_DIR:PATH=/usr/lib64/cmake/KF6WidgetsAddons
KF6WindowSystem_DIR:PATH=/usr/lib64/cmake/KF6WindowSystem
KF6XmlGui_DIR:PATH=/usr/lib64/cmake/KF6XmlGui
KF_SKIP_PO_PROCESSING:BOOL=OFF
KI18N_PYTHON_EXECUTABLE:FILEPATH=/usr/bin/python3
QT_ADDITIONAL_HOST_PACKAGES_PREFIX_PATH:STRING=
QT_ADDITIONAL_PACKAGES_PREFIX_PATH:STRING=
QUERY_EXECUTABLE:FILEPATH=/usr/bin/qtpaths
Qt6CoreTools_DIR:PATH=/usr/lib64/cmake/Qt6CoreTools
Qt6Core_DIR:PATH=/usr/lib64/cmake/Qt6Core
Qt6DBusTools_DIR:PATH=/usr/lib64/cmake/Qt6DBusTools
Qt6DBus_DIR:PATH=/usr/lib64/cmake/Qt6DBus
Qt6GuiTools_DIR:PATH=/usr/lib64/cmake/Qt6GuiTools
Qt6Gui_DIR:PATH=/usr/lib64/cmake/Qt6Gui
Qt6Network_DIR:PATH=/usr/lib64/cmake/Qt6Network
Qt6QmlBuiltins_DIR:PATH=/usr/lib64/cmake/Qt6QmlBuiltins
Qt6QmlCompilerPlusPrivate_DIR:PATH=Qt6QmlCompilerPlusPrivate_DIR-NOTFOUND
Qt6QmlIntegration_DIR:PATH=/usr/lib64/cmake/Qt6QmlIntegration
Qt6QmlTools_DIR:PATH=/usr/lib64/cmake/Qt6QmlTools
Qt6Qml_DIR:PATH=/usr/lib64/cmake/Qt6Qml
Qt6Svg_DIR:PATH=/usr/lib64/cmake/Qt6Svg
Qt6Test_DIR:PATH=/usr/lib64/cmake/Qt6Test
Qt6WidgetsTools_DIR:PATH=/usr/lib64/cmake/Qt6WidgetsTools
Qt6Widgets_DIR:PATH=/usr/lib64/cmake/Qt6Widgets
Qt6Xml_DIR:PATH=/usr/lib64/cmake/Qt6Xml
Qt6_DIR:PATH=/usr/lib64/cmake/Qt6
WITH_BH_SOLVER:BOOL=ON
X11_xcb_xkb_INCLUDE_PATH:PATH=/usr/include
XKB_INCLUDE_DIR:PATH=/usr/include
XKB_LIBRARY:FILEPATH=/usr/lib64/libxkbcommon.so

And test suite fails in 3 units

+ cd kpat-24.05.1
+ xvfb-run -a /usr/bin/ctest --test-dir x86_64-redhat-linux-gnu --output-on-failure --force-new-ctest-process -j48
Internal ctest changing into directory: /home/tkloczko/rpmbuild/BUILD/kpat-24.05.1/x86_64-redhat-linux-gnu
Test project /home/tkloczko/rpmbuild/BUILD/kpat-24.05.1/x86_64-redhat-linux-gnu
    Start 1: kpat-ShuffleTest
    Start 2: kpat-FcSolveTest
    Start 3: kpat-SolveByVariantName
    Start 4: kpat-GolfSolveTest
    Start 5: kpat-SolverFormatTest
1/5 Test #1: kpat-ShuffleTest .................   Passed    0.01 sec
2/5 Test #5: kpat-SolverFormatTest ............   Passed    0.11 sec
3/5 Test #4: kpat-GolfSolveTest ...............***Failed    0.33 sec
********* Start testing of TestSolver *********
Config: Using QtTest library 6.7.2, Qt 6.7.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 14.1.1 20240607 (Red Hat 14.1.1-5)), fedora 41
PASS   : TestSolver::initTestCase()
FAIL!  : TestSolver::runSolver() Compared values are not the same
   Actual   (kpat.exitStatus())   : CrashExit
   Expected (QProcess::NormalExit): NormalExit
   Loc: [/home/tkloczko/rpmbuild/BUILD/kpat-24.05.1/autotests/golf_solver_wins.cpp(40)]
PASS   : TestSolver::cleanupTestCase()
Totals: 2 passed, 1 failed, 0 skipped, 0 blacklisted, 316ms
********* Finished testing of TestSolver *********

4/5 Test #3: kpat-SolveByVariantName ..........***Failed    0.35 sec
********* Start testing of TestSolver *********
Config: Using QtTest library 6.7.2, Qt 6.7.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 14.1.1 20240607 (Red Hat 14.1.1-5)), fedora 41
PASS   : TestSolver::initTestCase()
FAIL!  : TestSolver::runSolver() Compared values are not the same
   Actual   (kpat.exitStatus())   : CrashExit
   Expected (QProcess::NormalExit): NormalExit
   Loc: [/home/tkloczko/rpmbuild/BUILD/kpat-24.05.1/autotests/solve_by_name.cpp(39)]
PASS   : TestSolver::cleanupTestCase()
Totals: 2 passed, 1 failed, 0 skipped, 0 blacklisted, 338ms
********* Finished testing of TestSolver *********

5/5 Test #2: kpat-FcSolveTest .................***Failed    0.41 sec
********* Start testing of TestSolver *********
Config: Using QtTest library 6.7.2, Qt 6.7.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 14.1.1 20240607 (Red Hat 14.1.1-5)), fedora 41
PASS   : TestSolver::initTestCase()
FAIL!  : TestSolver::runSolver() Compared values are not the same
   Actual   (kpat.exitStatus())   : CrashExit
   Expected (QProcess::NormalExit): NormalExit
   Loc: [/home/tkloczko/rpmbuild/BUILD/kpat-24.05.1/autotests/freecell_solver.cpp(40)]
PASS   : TestSolver::cleanupTestCase()
Totals: 2 passed, 1 failed, 0 skipped, 0 blacklisted, 397ms
********* Finished testing of TestSolver *********


40% tests passed, 3 tests failed out of 5

Total Test time (real) =   0.41 sec

The following tests FAILED:
          2 - kpat-FcSolveTest (Failed)
          3 - kpat-SolveByVariantName (Failed)
          4 - kpat-GolfSolveTest (Failed)
Errors while running CTest
Comment 1 Albert Astals Cid 2024-06-24 08:30:06 UTC
Works for me and works on invent CI so I would say this is most likely a "your distribution" problem.
Comment 2 kloczek 2024-06-24 09:34:29 UTC
(In reply to Albert Astals Cid from comment #1)
> Works for me and works on invent CI so I would say this is most likely a
> "your distribution" problem.

Any advice hat I can try to do to diagnose this issue?🤔
Is it anything specific who9ch needs to be preset/running in test env?
Comment 3 Albert Astals Cid 2024-06-24 09:47:48 UTC
Read what the test does, it's almost a 1 liner

https://invent.kde.org/games/kpat/-/blob/master/autotests/golf_solver_wins.cpp?ref_type=heads

It starts kpat and waits for it to finish. For you seems to be crashing, figure out why starting kpat with those arguments crashes in your setup.

If you were debian/ubuntu i would suggest you have splitted freecell-solver beyond your habilities and the fc-solve binary is in a different package than the libfreecell-solver.so library and they don't depend on eachother.

Oh well, it seems fedora also did that splitting mistake :shrug:
Comment 4 kloczek 2024-06-24 09:59:59 UTC
(In reply to Albert Astals Cid from comment #3)
[..]
> If you were debian/ubuntu i would suggest you have splitted freecell-solver
> beyond your habilities and the fc-solve binary is in a different package
> than the libfreecell-solver.so library and they don't depend on eachother.
> 
> Oh well, it seems fedora also did that splitting mistake :shrug:

Tested and after add missing package to build env test suite is OK.

First: it is a not a bit odd that it is not printed clear message that some binary is missing?
Second:: do you want to say that it is not possible to use libfreecell-solver without executable in bindir?🤔
Comment 5 Albert Astals Cid 2024-06-24 10:17:10 UTC
> First: it is a not a bit odd that it is not printed clear message that some binary is missing?

I'm pretty sure it is (when you run kpat)

> Second:: do you want to say that it is not possible to use libfreecell-solver without executable in bindir?🤔
You should ask the libfreecell-solver not me, but my understanding is that the library is just a wrapper on top of the binary.


Closing since this is a setup problem, not a kpat problem.
Comment 6 kloczek 2024-06-24 11:09:12 UTC
Thank you for the help :)