Bug 468286 - 5.105: test suite is failing in 3 units
Summary: 5.105: test suite is failing in 3 units
Status: REPORTED
Alias: None
Product: frameworks-networkmanager-qt
Classification: Frameworks and Libraries
Component: general (show other bugs)
Version: 5.105.0
Platform: Other Other
: NOR normal
Target Milestone: ---
Assignee: Plasma Bugs List
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2023-04-08 13:38 UTC by kloczek
Modified: 2024-06-15 11:13 UTC (History)
2 users (show)

See Also:
Latest Commit:
Version Fixed In:
Sentry Crash Report:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description kloczek 2023-04-08 13:38:25 UTC
Looks like something is wrong because test suite is failing in 3 units

+ cd networkmanager-qt-5.105.0
+ /usr/bin/ctest --test-dir x86_64-redhat-linux-gnu --output-on-failure --force-new-ctest-process -j48 ' '
Internal ctest changing into directory: /home/tkloczko/rpmbuild/BUILD/networkmanager-qt-5.105.0/x86_64-redhat-linux-gnu
Test project /home/tkloczko/rpmbuild/BUILD/networkmanager-qt-5.105.0/x86_64-redhat-linux-gnu
      Start  1: managertest
      Start  2: settingstest
      Start  3: activeconnectiontest
      Start  4: 8021xsettingtest
      Start  5: adslsettingtest
      Start  6: bluetoothsettingtest
      Start  7: bondsettingtest
      Start  8: bridgesettingtest
      Start  9: bridgeportsettingtest
      Start 10: cdmasettingtest
      Start 11: connectionsettingtest
      Start 12: dcbsettingtest
      Start 13: gsmsettingtest
      Start 14: infinibandsettingtest
      Start 15: iptunnelsettingtest
      Start 16: ipv4settingtest
      Start 17: ipv6settingtest
      Start 18: matchsettingtest
      Start 19: macsecsettingtest
      Start 20: olpcmeshsettingtest
      Start 21: ovsbridgesettingtest
      Start 22: ovsinterfacesettingtest
      Start 23: ovspatchsettingtest
      Start 24: ovsportsettingtest
      Start 25: pppsettingtest
      Start 26: pppoesettingtest
      Start 27: proxysettingtest
      Start 28: serialsettingtest
      Start 29: teamportsettingtest
      Start 30: tunsettingtest
      Start 31: tcsettingtest
      Start 32: usersettingtest
      Start 33: vlansettingtest
      Start 34: vxlansettingtest
      Start 35: vpnsettingtest
      Start 36: wimaxsettingtest
      Start 37: wiredsettingtest
      Start 38: wireguardsettingtest
      Start 39: wirelesssettingtest
      Start 40: wirelesssecuritysettingtest
 1/40 Test  #4: 8021xsettingtest .................   Passed    0.06 sec
 2/40 Test  #5: adslsettingtest ..................   Passed    0.06 sec
 3/40 Test  #6: bluetoothsettingtest .............   Passed    0.05 sec
 4/40 Test  #7: bondsettingtest ..................   Passed    0.05 sec
 5/40 Test  #8: bridgesettingtest ................   Passed    0.05 sec
 6/40 Test  #9: bridgeportsettingtest ............   Passed    0.05 sec
 7/40 Test #10: cdmasettingtest ..................   Passed    0.05 sec
 8/40 Test #11: connectionsettingtest ............   Passed    0.05 sec
 9/40 Test #12: dcbsettingtest ...................   Passed    0.05 sec
10/40 Test #13: gsmsettingtest ...................   Passed    0.04 sec
11/40 Test #14: infinibandsettingtest ............   Passed    0.04 sec
12/40 Test #15: iptunnelsettingtest ..............   Passed    0.04 sec
13/40 Test #16: ipv4settingtest ..................   Passed    0.04 sec
14/40 Test #17: ipv6settingtest ..................   Passed    0.04 sec
15/40 Test #18: matchsettingtest .................   Passed    0.04 sec
16/40 Test #19: macsecsettingtest ................   Passed    0.04 sec
17/40 Test #20: olpcmeshsettingtest ..............   Passed    0.04 sec
18/40 Test #21: ovsbridgesettingtest .............   Passed    0.03 sec
19/40 Test #22: ovsinterfacesettingtest ..........   Passed    0.03 sec
20/40 Test #23: ovspatchsettingtest ..............   Passed    0.03 sec
21/40 Test #24: ovsportsettingtest ...............   Passed    0.03 sec
22/40 Test #25: pppsettingtest ...................   Passed    0.03 sec
23/40 Test #26: pppoesettingtest .................   Passed    0.03 sec
24/40 Test #27: proxysettingtest .................   Passed    0.03 sec
25/40 Test #28: serialsettingtest ................   Passed    0.03 sec
26/40 Test #29: teamportsettingtest ..............   Passed    0.02 sec
27/40 Test #30: tunsettingtest ...................   Passed    0.02 sec
28/40 Test #31: tcsettingtest ....................   Passed    0.02 sec
29/40 Test #32: usersettingtest ..................   Passed    0.02 sec
30/40 Test #33: vlansettingtest ..................   Passed    0.02 sec
31/40 Test #34: vxlansettingtest .................   Passed    0.02 sec
32/40 Test #35: vpnsettingtest ...................   Passed    0.02 sec
33/40 Test #36: wimaxsettingtest .................   Passed    0.02 sec
34/40 Test #38: wireguardsettingtest .............   Passed    0.01 sec
35/40 Test #39: wirelesssettingtest ..............   Passed    0.01 sec
36/40 Test #37: wiredsettingtest .................   Passed    0.01 sec
37/40 Test #40: wirelesssecuritysettingtest ......   Passed    0.01 sec
38/40 Test  #3: activeconnectiontest .............Subprocess aborted***Exception:   0.11 sec
********* Start testing of ActiveConnectionTest *********
Config: Using QtTest library 5.15.8, Qt 5.15.8 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 13.0.1 20230324 (Red Hat 13.0.1-0)), fedora 39
QFATAL : ActiveConnectionTest::initTestCase() ASSERT: "!isEmpty()" in file /usr/include/qt5/QtCore/qlist.h, line 361
FAIL!  : ActiveConnectionTest::initTestCase() Received a fatal error.
   Loc: [Unknown file(0)]
Totals: 0 passed, 1 failed, 0 skipped, 0 blacklisted, 1ms
********* Finished testing of ActiveConnectionTest *********

39/40 Test  #1: managertest ......................***Failed    5.00 sec
********* Start testing of ManagerTest *********
Config: Using QtTest library 5.15.8, Qt 5.15.8 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 13.0.1 20230324 (Red Hat 13.0.1-0)), fedora 39
PASS   : ManagerTest::initTestCase()
FAIL!  : ManagerTest::testDevices() 'addDeviceSpy.wait()' returned FALSE. ()
   Loc: [/home/tkloczko/rpmbuild/BUILD/networkmanager-qt-5.105.0/autotests/managertest.cpp(45)]
FAIL!  : ManagerTest::testManager() Compared values are not the same
   Actual   (NetworkManager::connectivity()): UnknownConnectivity
   Expected (NetworkManager::NoConnectivity): NoConnectivity
   Loc: [/home/tkloczko/rpmbuild/BUILD/networkmanager-qt-5.105.0/autotests/managertest.cpp(103)]
PASS   : ManagerTest::cleanupTestCase()
Totals: 2 passed, 2 failed, 0 skipped, 0 blacklisted, 4983ms
********* Finished testing of ManagerTest *********

40/40 Test  #2: settingstest .....................***Failed    5.00 sec
********* Start testing of SettingsTest *********
Config: Using QtTest library 5.15.8, Qt 5.15.8 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 13.0.1 20230324 (Red Hat 13.0.1-0)), fedora 39
PASS   : SettingsTest::initTestCase()
FAIL!  : SettingsTest::testConnections() 'connectionAddedSpy.wait()' returned FALSE. ()
   Loc: [/home/tkloczko/rpmbuild/BUILD/networkmanager-qt-5.105.0/autotests/settingstest.cpp(46)]
PASS   : SettingsTest::cleanupTestCase()
Totals: 2 passed, 1 failed, 0 skipped, 0 blacklisted, 4982ms
********* Finished testing of SettingsTest *********


93% tests passed, 3 tests failed out of 40

Total Test time (real) =   5.00 sec

The following tests FAILED:
          1 - managertest (Failed)
          2 - settingstest (Failed)
          3 - activeconnectiontest (Subprocess aborted)
Errors while running CTest
Comment 1 kloczek 2024-06-15 11:13:09 UTC
After exclude those two failing units another on popped out

+ cd networkmanager-qt-6.3.0
+ /usr/bin/ctest --test-dir x86_64-redhat-linux-gnu --output-on-failure --force-new-ctest-process -j48 ' ' -E '^(settingstest|activeconnectiontest)'
Internal ctest changing into directory: /home/tkloczko/rpmbuild/BUILD/networkmanager-qt-6.3.0/x86_64-redhat-linux-gnu
Test project /home/tkloczko/rpmbuild/BUILD/networkmanager-qt-6.3.0/x86_64-redhat-linux-gnu
      Start  1: managertest
      Start  2: 8021xsettingtest
      Start  3: adslsettingtest
      Start  4: bluetoothsettingtest
      Start  5: bondsettingtest
      Start  6: bridgesettingtest
      Start  7: bridgeportsettingtest
      Start  8: cdmasettingtest
      Start  9: connectionsettingtest
      Start 10: dcbsettingtest
      Start 11: gsmsettingtest
      Start 12: infinibandsettingtest
      Start 13: iptunnelsettingtest
      Start 14: ipv4settingtest
      Start 15: ipv6settingtest
      Start 16: matchsettingtest
      Start 17: macsecsettingtest
      Start 18: olpcmeshsettingtest
      Start 19: ovsbridgesettingtest
      Start 20: ovsinterfacesettingtest
      Start 21: ovspatchsettingtest
      Start 22: ovsportsettingtest
      Start 23: pppsettingtest
      Start 24: pppoesettingtest
      Start 25: proxysettingtest
      Start 26: serialsettingtest
      Start 27: teamportsettingtest
      Start 28: tunsettingtest
      Start 29: tcsettingtest
      Start 30: usersettingtest
      Start 31: vlansettingtest
      Start 32: vxlansettingtest
      Start 33: vpnsettingtest
      Start 34: wimaxsettingtest
      Start 35: wiredsettingtest
      Start 36: wireguardsettingtest
      Start 37: wirelesssettingtest
      Start 38: wirelesssecuritysettingtest
 1/38 Test  #2: 8021xsettingtest .................   Passed    0.06 sec
 2/38 Test  #3: adslsettingtest ..................   Passed    0.06 sec
 3/38 Test  #4: bluetoothsettingtest .............   Passed    0.06 sec
 4/38 Test  #5: bondsettingtest ..................   Passed    0.05 sec
 5/38 Test  #6: bridgesettingtest ................   Passed    0.05 sec
 6/38 Test  #7: bridgeportsettingtest ............   Passed    0.05 sec
 7/38 Test  #8: cdmasettingtest ..................   Passed    0.05 sec
 8/38 Test  #9: connectionsettingtest ............   Passed    0.05 sec
 9/38 Test #10: dcbsettingtest ...................   Passed    0.05 sec
10/38 Test #11: gsmsettingtest ...................   Passed    0.05 sec
11/38 Test #12: infinibandsettingtest ............   Passed    0.05 sec
12/38 Test #13: iptunnelsettingtest ..............   Passed    0.04 sec
13/38 Test #14: ipv4settingtest ..................   Passed    0.04 sec
14/38 Test #15: ipv6settingtest ..................   Passed    0.04 sec
15/38 Test #16: matchsettingtest .................   Passed    0.04 sec
16/38 Test #17: macsecsettingtest ................   Passed    0.04 sec
17/38 Test #18: olpcmeshsettingtest ..............   Passed    0.04 sec
18/38 Test #19: ovsbridgesettingtest .............   Passed    0.04 sec
19/38 Test #20: ovsinterfacesettingtest ..........   Passed    0.03 sec
20/38 Test #21: ovspatchsettingtest ..............   Passed    0.03 sec
21/38 Test #22: ovsportsettingtest ...............   Passed    0.03 sec
22/38 Test #23: pppsettingtest ...................   Passed    0.03 sec
23/38 Test #24: pppoesettingtest .................   Passed    0.03 sec
24/38 Test #25: proxysettingtest .................   Passed    0.03 sec
25/38 Test #26: serialsettingtest ................   Passed    0.03 sec
26/38 Test #27: teamportsettingtest ..............   Passed    0.03 sec
27/38 Test #28: tunsettingtest ...................   Passed    0.02 sec
28/38 Test #29: tcsettingtest ....................   Passed    0.02 sec
29/38 Test #30: usersettingtest ..................   Passed    0.02 sec
30/38 Test #31: vlansettingtest ..................   Passed    0.02 sec
31/38 Test #32: vxlansettingtest .................   Passed    0.02 sec
32/38 Test #33: vpnsettingtest ...................   Passed    0.02 sec
33/38 Test #34: wimaxsettingtest .................   Passed    0.02 sec
34/38 Test #36: wireguardsettingtest .............   Passed    0.01 sec
35/38 Test #37: wirelesssettingtest ..............   Passed    0.01 sec
36/38 Test #38: wirelesssecuritysettingtest ......   Passed    0.01 sec
37/38 Test #35: wiredsettingtest .................   Passed    0.02 sec
38/38 Test  #1: managertest ......................***Failed    4.78 sec
********* Start testing of ManagerTest *********
Config: Using QtTest library 6.7.1, Qt 6.7.1 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 14.1.1 20240522 (Red Hat 14.1.1-4)), fedora 41
PASS   : ManagerTest::initTestCase()
FAIL!  : ManagerTest::testDevices() 'addDeviceSpy.wait()' returned FALSE. ()
   Loc: [/home/tkloczko/rpmbuild/BUILD/networkmanager-qt-6.3.0/autotests/managertest.cpp(46)]
FAIL!  : ManagerTest::testManager() Compared values are not the same
   Actual   (NetworkManager::connectivity()): UnknownConnectivity
   Expected (NetworkManager::NoConnectivity): NoConnectivity
   Loc: [/home/tkloczko/rpmbuild/BUILD/networkmanager-qt-6.3.0/autotests/managertest.cpp(105)]
PASS   : ManagerTest::cleanupTestCase()
Totals: 2 passed, 2 failed, 0 skipped, 0 blacklisted, 4757ms
********* Finished testing of ManagerTest *********


97% tests passed, 1 tests failed out of 38

Total Test time (real) =   4.78 sec

The following tests FAILED:
          1 - managertest (Failed)
Errors while running CTest