Bug 468290

Summary:	6.3.0: test suite is failing in one unit
Product:	[Frameworks and Libraries] frameworks-ki18n	Reporter:	kloczek <kloczko.tomasz>
Component:	general	Assignee:	Chusslove Illich <caslav.ilic>
Status:	REPORTED ---
Severity:	normal	CC:	awilfox, kdelibs-bugs-null
Priority:	NOR
Version First Reported In:	6.3.0
Target Milestone:	---
Platform:	Other
OS:	Other
Latest Commit:		Version Fixed/Implemented In:
Sentry Crash Report:

Description kloczek 2023-04-08 13:56:02 UTC

Looks like test suite is failing in one unit

+ cd ki18n-5.105.0
+ /usr/bin/ctest --test-dir x86_64-redhat-linux-gnu --output-on-failure --force-new-ctest-process -j48 ' '
Internal ctest changing into directory: /home/tkloczko/rpmbuild/BUILD/ki18n-5.105.0/x86_64-redhat-linux-gnu
Test project /home/tkloczko/rpmbuild/BUILD/ki18n-5.105.0/x86_64-redhat-linux-gnu
      Start  1: ki18n-declarativetest
      Start  2: ki18n-klocalizedstringtest
      Start  3: ki18n-klazylocalizedstringtest
      Start  4: ki18n-ktranscripttest
      Start  5: ki18n-ktranscriptcleantest
      Start  6: ki18n_install
      Start  7: kcatalogtest
      Start  8: kcountrytest
      Start  9: kcountrysubdivisiontest
      Start 10: ktimezonetest
 1/10 Test  #3: ki18n-klazylocalizedstringtest ...   Passed    0.01 sec
 2/10 Test  #7: kcatalogtest .....................***Failed    0.01 sec
********* Start testing of KCatalogTest *********
Config: Using QtTest library 5.15.8, Qt 5.15.8 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 13.0.1 20230324 (Red Hat 13.0.1-0)), fedora 39
PASS   : KCatalogTest::initTestCase()
QWARN  : KCatalogTest::testLookup() kf.i18n: The value of the LANGUAGE environment variable: "fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH:fr_CH" ( size: 95 ),
 was longer than (and consequently truncated to) the max. length of: 54
FAIL!  : KCatalogTest::testLookup() Compared values are not the same
   Actual   (c.name()):        "New Zealand"
   Expected (QStringLiteral("Nouvelle-Zélande")): "Nouvelle-Z\u00E9lande"
   Loc: [/home/tkloczko/rpmbuild/BUILD/ki18n-5.105.0/autotests/kcatalogtest.cpp(40)]
PASS   : KCatalogTest::cleanupTestCase()
Totals: 2 passed, 1 failed, 0 skipped, 0 blacklisted, 2ms
********* Finished testing of KCatalogTest *********

 3/10 Test  #5: ki18n-ktranscriptcleantest .......   Passed    0.02 sec
 4/10 Test #10: ktimezonetest ....................   Passed    0.01 sec
 5/10 Test  #2: ki18n-klocalizedstringtest .......   Passed    0.03 sec
 6/10 Test  #1: ki18n-declarativetest ............   Passed    0.04 sec
 7/10 Test  #4: ki18n-ktranscripttest ............   Passed    0.04 sec
 8/10 Test  #9: kcountrysubdivisiontest ..........   Passed    0.04 sec
 9/10 Test  #8: kcountrytest .....................   Passed    0.91 sec
10/10 Test  #6: ki18n_install ....................   Passed    1.10 sec

90% tests passed, 1 tests failed out of 10

Total Test time (real) =   1.12 sec

The following tests FAILED:
          7 - kcatalogtest (Failed)
Errors while running CTest

Comment 1 kloczek 2024-06-17 10:52:27 UTC

Looks like 6.3.0 has exactly the same issue

+ cd ki18n-6.3.0
+ /usr/bin/ctest --test-dir x86_64-redhat-linux-gnu --output-on-failure --force-new-ctest-process -j48 ' '
Internal ctest changing into directory: /home/tkloczko/rpmbuild/BUILD/ki18n-6.3.0/x86_64-redhat-linux-gnu
Test project /home/tkloczko/rpmbuild/BUILD/ki18n-6.3.0/x86_64-redhat-linux-gnu
      Start  7: kcatalogtest
      Start  8: kcountrytest
      Start  9: kcountrysubdivisiontest
      Start  6: ki18n_install
      Start  1: ki18n-declarativetest
      Start  4: ki18n-ktranscripttest
      Start 10: ktimezonetest
      Start  5: ki18n-ktranscriptcleantest
      Start  2: ki18n-klocalizedstringtest
      Start  3: ki18n-klazylocalizedstringtest
 1/10 Test  #7: kcatalogtest .....................***Failed    0.02 sec
********* Start testing of KCatalogTest *********
Config: Using QtTest library 6.7.1, Qt 6.7.1 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 14.1.1 20240522 (Red Hat 14.1.1-4)), fedora 41
PASS   : KCatalogTest::initTestCase()
FAIL!  : KCatalogTest::testLookup() Compared values are not the same
   Actual   (c.name())                          : "New Zealand"
   Expected (QStringLiteral("Nouvelle-Zélande")): "Nouvelle-Z\u00E9lande"
   Loc: [/home/tkloczko/rpmbuild/BUILD/ki18n-6.3.0/autotests/kcatalogtest.cpp(40)]
PASS   : KCatalogTest::cleanupTestCase()
Totals: 2 passed, 1 failed, 0 skipped, 0 blacklisted, 1ms
********* Finished testing of KCatalogTest *********

 2/10 Test  #9: kcountrysubdivisiontest ..........***Failed    0.01 sec
Detected locale "C" with character encoding "ANSI_X3.4-1968", which is not UTF-8.
Qt depends on a UTF-8 locale, and has switched to "C.UTF-8" instead.
If this causes problems, reconfigure your locale. See the locale(1) manual
for more information.
********* Start testing of KCountrySubdivisionTest *********
Config: Using QtTest library 6.7.1, Qt 6.7.1 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 14.1.1 20240522 (Red Hat 14.1.1-4)), fedora 41
PASS   : KCountrySubdivisionTest::initTestCase()
PASS   : KCountrySubdivisionTest::testEmpty()
FAIL!  : KCountrySubdivisionTest::testLookup() Compared values are not the same
   Actual   (s.name())                : "Wien"
   Expected (QStringLiteral("Vienne")): "Vienne"
   Loc: [/home/tkloczko/rpmbuild/BUILD/ki18n-6.3.0/autotests/kcountrysubdivisiontest.cpp(50)]
PASS   : KCountrySubdivisionTest::testSubList()
PASS   : KCountrySubdivisionTest::testTopList()
PASS   : KCountrySubdivisionTest::testTimezone()
PASS   : KCountrySubdivisionTest::testFromLocation(invalid)
PASS   : KCountrySubdivisionTest::testFromLocation(out-of-coverage)
PASS   : KCountrySubdivisionTest::testFromLocation(US-AK)
PASS   : KCountrySubdivisionTest::testFromLocation(US-CA)
PASS   : KCountrySubdivisionTest::testFromLocation(FR-IDF)
PASS   : KCountrySubdivisionTest::testFromLocation(DE-BW)
PASS   : KCountrySubdivisionTest::cleanupTestCase()
Totals: 12 passed, 1 failed, 0 skipped, 0 blacklisted, 1ms
********* Finished testing of KCountrySubdivisionTest *********

 3/10 Test  #3: ki18n-klazylocalizedstringtest ...   Passed    0.01 sec
 4/10 Test  #2: ki18n-klocalizedstringtest .......   Passed    0.02 sec
 5/10 Test #10: ktimezonetest ....................   Passed    0.02 sec
 6/10 Test  #5: ki18n-ktranscriptcleantest .......   Passed    0.02 sec
 7/10 Test  #4: ki18n-ktranscripttest ............   Passed    0.05 sec
 8/10 Test  #1: ki18n-declarativetest ............   Passed    0.06 sec
 9/10 Test  #8: kcountrytest .....................***Failed    0.32 sec
Detected locale "C" with character encoding "ANSI_X3.4-1968", which is not UTF-8.
Qt depends on a UTF-8 locale, and has switched to "C.UTF-8" instead.
If this causes problems, reconfigure your locale. See the locale(1) manual
for more information.
********* Start testing of KCountryTest *********
Config: Using QtTest library 6.7.1, Qt 6.7.1 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 14.1.1 20240522 (Red Hat 14.1.1-4)), fedora 41
PASS   : KCountryTest::initTestCase()
PASS   : KCountryTest::testEmpty()
FAIL!  : KCountryTest::testLookup() Compared values are not the same
   Actual   (c.name())                          : "New Zealand"
   Expected (QStringLiteral("Nouvelle-Zélande")): "Nouvelle-Z\u00E9lande"
   Loc: [/home/tkloczko/rpmbuild/BUILD/ki18n-6.3.0/autotests/kcountrytest.cpp(46)]
PASS   : KCountryTest::benchmarkLookup()
RESULT : KCountryTest::benchmarkLookup():
     0.000034 msecs per iteration (total: 72, iterations: 2097152)
PASS   : KCountryTest::testList()
PASS   : KCountryTest::testTimezone()
PASS   : KCountryTest::testFromLocation(invalid)
PASS   : KCountryTest::testFromLocation(out-of-coverage)
PASS   : KCountryTest::testFromLocation(BR)
PASS   : KCountryTest::testFromLocation(CA)
PASS   : KCountryTest::testFromLocation(DE)
PASS   : KCountryTest::testFromLocation(NZ)
PASS   : KCountryTest::testFromLocation(Randa)
PASS   : KCountryTest::testFromLocation(Maastricht)
PASS   : KCountryTest::testFromLocation(Aachen)
PASS   : KCountryTest::testFromLocation(Geneva)
PASS   : KCountryTest::testFromLocation(Busingen)
PASS   : KCountryTest::testFromLocation(Tijuana)
PASS   : KCountryTest::testFromLocation(you-got-to-be-kidding-me)
FAIL!  : KCountryTest::testFromName() Compared values are not the same
   Actual   (KCountry::fromName(u"Nouvelle-Zélande").alpha2()): ""
   Expected (QLatin1String("NZ"))                             : "NZ"
   Loc: [/home/tkloczko/rpmbuild/BUILD/ki18n-6.3.0/autotests/kcountrytest.cpp(184)]
FAIL!  : KCountryTest::benchmarkFromName() Compared values are not the same
   Actual   (KCountry::fromName(u"Nouvelle-Zélande").alpha2()): ""
   Expected (QLatin1String("NZ"))                             : "NZ"
   Loc: [/home/tkloczko/rpmbuild/BUILD/ki18n-6.3.0/autotests/kcountrytest.cpp(207)]
PASS   : KCountryTest::cleanupTestCase()
Totals: 19 passed, 3 failed, 0 skipped, 0 blacklisted, 308ms
********* Finished testing of KCountryTest *********

10/10 Test  #6: ki18n_install ....................   Passed    0.36 sec

70% tests passed, 3 tests failed out of 10

Total Test time (real) =   0.37 sec

The following tests FAILED:
          7 - kcatalogtest (Failed)
          8 - kcountrytest (Failed)
          9 - kcountrysubdivisiontest (Failed)
Errors while running CTest

Comment 2 A. Wilcox (awilfox) 2025-06-30 07:28:00 UTC

I'm seeing the same behaviour with ki18n 5.116.0 building on Adélie Linux (with musl libc 1.2.5, gcc 13.3.0, and iso-codes 4.5.0), so it doesn't seem to be specific to the Fedora environment.  I think "Wien" vs "Vienne" may be changed in the source data and the test itself may need updating.