Tests failures on various platforms and GitLab CI
Open, Needs TriagePublic

Description

Linux / CI:

  • libs-ui-kis_shape_layer_test: seems to randomly be stuck in a deadlock on AppImage docker and CI.
  • plugins-generators-kis_seexpr_generator_test: currently failing on suse_tumbleweed_qt515 CI.
********* Start testing of KisSeExprGeneratorTest *********
Config: Using QtTest library 5.15.2, Qt 5.15.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 12.1.0), opensuse-tumbleweed 20220515
QWARN  : KisSeExprGeneratorTest::initTestCase() Loading plugin "/builds/graphics/krita/_install/lib64/kritaplugins/kritaseexprgenerator.so" failed,  "Cannot load library /builds/graphics/krita/_install/lib64/kritaplugins/kritaseexprgenerator.so: (libasan.so.6: cannot open shared object file: No such file or directory)"
PASS   : KisSeExprGeneratorTest::initTestCase()
FAIL!  : KisSeExprGeneratorTest::testGenerationFromScript() 'generator' returned FALSE. ()
   Loc: [/builds/graphics/krita/plugins/generators/seexpr/tests/kis_seexpr_generator_test.cpp(44)]
FAIL!  : KisSeExprGeneratorTest::testGenerationFromKoResource() 'generator' returned FALSE. ()
   Loc: [/builds/graphics/krita/plugins/generators/seexpr/tests/kis_seexpr_generator_test.cpp(74)]
PASS   : KisSeExprGeneratorTest::cleanupTestCase()
Totals: 2 passed, 2 failed, 0 skipped, 0 blacklisted, 98ms
********* Finished testing of KisSeExprGeneratorTest *********
  • plugins-impex-kis_exr_test: seems to be failing randomly.
********* Start testing of KisExrTest *********
Config: Using QtTest library 5.15.2, Qt 5.15.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 12.1.0), opensuse-tumbleweed 20220515
PASS   : KisExrTest::initTestCase()
QDEBUG : KisExrTest::testFiles() "."
QDEBUG : KisExrTest::testFiles() ".."
QDEBUG : KisExrTest::testFiles() "memorial.exr"
QWARN  : KisExrTest::testFiles() KoColor debug runtime checks are active.
PASS   : KisExrTest::testFiles()
SKIP   : KisExrTest::testImportFromWriteonly() Test is being run as root; removing read permission has no effect.
   Loc: [/builds/graphics/krita/sdk/tests/filestest.h(186)]
SKIP   : KisExrTest::testExportToReadonly() Test is being run as root; removing write permission has no effect.
   Loc: [/builds/graphics/krita/sdk/tests/filestest.h(238)]
QDEBUG : KisExrTest::testImportIncorrectFormat() import result =  Error code =  3   "Error occurred while reading from the file."
PASS   : KisExrTest::testImportIncorrectFormat()
QWARN  : KisExrTest::testRoundTrip() krita.general: WARNING: "The image contains pixels with zero alpha channel and non-zero color channels. Krita has modified those pixels to have at least some alpha. The initial values will <i>not</i> be reverted on saving the image back.<br/><br/>This will hardly make any visual difference just keep it in mind."
FAIL!  : KisExrTest::testRoundTrip() 'r' returned FALSE. ()
   Loc: [/builds/graphics/krita/plugins/impex/exr/tests/kis_exr_test.cpp(67)]
PASS   : KisExrTest::cleanupTestCase()
Totals: 4 passed, 1 failed, 2 skipped, 0 blacklisted, 3175ms
********* Finished testing of KisExrTest *********
krita.general: Warning: some tiles have leaked:
krita.general: 	Tiles in memory: 210 
 	Total tiles: 210
  • plugins-impex-KisHeifTest: failing on suse_tumbleweed_qt515 CI
********* Start testing of KisHeifTest *********
Config: Using QtTest library 5.15.2, Qt 5.15.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 12.1.0), opensuse-tumbleweed 20220515
PASS   : KisHeifTest::initTestCase()
SKIP   : KisHeifTest::testImportFromWriteonly() Test is being run as root; removing read permission has no effect.
   Loc: [/builds/graphics/krita/sdk/tests/filestest.h(186)]
SKIP   : KisHeifTest::testImportFromWriteonly() Test is being run as root; removing read permission has no effect.
   Loc: [/builds/graphics/krita/sdk/tests/filestest.h(186)]
SKIP   : KisHeifTest::testExportToReadonly() Test is being run as root; removing write permission has no effect.
   Loc: [/builds/graphics/krita/sdk/tests/filestest.h(238)]
SKIP   : KisHeifTest::testExportToReadonly() Test is being run as root; removing write permission has no effect.
   Loc: [/builds/graphics/krita/sdk/tests/filestest.h(238)]
QWARN  : KisHeifTest::testImportIncorrectFormat() KoColor debug runtime checks are active.
QDEBUG : KisHeifTest::testImportIncorrectFormat() import result =  Error code =  4   "The file format cannot be parsed."
QDEBUG : KisHeifTest::testImportIncorrectFormat() Entering "TestUtil::prepareFile()" QFlags(0x4|0x40|0x200|0x400|0x2000|0x4000)
QDEBUG : KisHeifTest::testImportIncorrectFormat() import result =  Error code =  4   "The file format cannot be parsed."
PASS   : KisHeifTest::testImportIncorrectFormat()
QDEBUG : KisHeifTest::testSaveHDR() Saving HDR PNG
QWARN  : KisHeifTest::testSaveHDR() Loading plugin "/builds/graphics/krita/_install/lib64/kritaplugins/kritaseexprgenerator.so" failed,  "Cannot load library /builds/graphics/krita/_install/lib64/kritaplugins/kritaseexprgenerator.so: (libasan.so.6: cannot open shared object file: No such file or directory)"
QDEBUG : KisHeifTest::testSaveHDR() Saving HDR heif and avif for PQ
QDEBUG : KisHeifTest::testSaveHDR() Saving HDR heif and avif for HLG
QDEBUG : KisHeifTest::testSaveHDR() Saving HDR heif and avif for SMPTE 428
PASS   : KisHeifTest::testSaveHDR()
QDEBUG : KisHeifTest::testLoadHDR() Loading test for PQ files
QDEBUG : KisHeifTest::testLoadHDR() Loading test for HLG files
QDEBUG : KisHeifTest::testLoadHDR() Loading test for smpte428 files
QSYSTEM: KisHeifTest::testLoadHDR() krita.general: [
	0: /lib64/libasan.so.8(+0x55951) [0x7f3f59ce3951]
	1: /builds/graphics/krita/_install/lib64/libkritaglobal.so.18(kisBacktrace()+0x189) [0x7f3f4044c1b4]
	2: /builds/graphics/krita/_build/plugins/impex/heif/tests/KisHeifTest() [0x4895c8]
	3: /builds/graphics/krita/_build/plugins/impex/heif/tests/KisHeifTest() [0x466644]
	4: /builds/graphics/krita/_build/plugins/impex/heif/tests/KisHeifTest() [0x4147de]
	5: /lib64/libQt5Core.so.5(QMetaMethod::invoke(QObject*, Qt::ConnectionType, QGenericReturnArgument, QGenericArgument, QGenericArgument, QGenericArgument, QGenericArgument, QGenericArgument, QGenericArgument, QGenericArgument, QGenericArgument, QGenericArgument, QGenericArgument) const+0x59e) [0x7f3f3d746aee]
	6: /lib64/libQt5Test.so.5(+0x1d4c1) [0x7f3f51aeb4c1]
	7: /lib64/libQt5Test.so.5(+0x1df28) [0x7f3f51aebf28]
	8: /lib64/libQt5Test.so.5(+0x1e489) [0x7f3f51aec489]
	9: /lib64/libQt5Test.so.5(QTest::qRun()+0x232) [0x7f3f51aec952]
	10: /lib64/libQt5Test.so.5(QTest::qExec(QObject*, int, char**)+0xb) [0x7f3f51aeccfb]
	11: /builds/graphics/krita/_build/plugins/impex/heif/tests/KisHeifTest() [0x47c0bc]
	12: /lib64/libc.so.6(+0x405b0) [0x7f3f3cf3d5b0]
	13: /lib64/libc.so.6(__libc_start_main+0x8b) [0x7f3f3cf3d679]
	14: /builds/graphics/krita/_build/plugins/impex/heif/tests/KisHeifTest() [0x40a2f5]
]

QFATAL : KisHeifTest::testLoadHDR() ASSERT: "d" in file /builds/graphics/krita/libs/global/kis_shared_ptr.h, line 168
FAIL!  : KisHeifTest::testLoadHDR() Received a fatal error.
   Loc: [Unknown file(0)]
Totals: 3 passed, 1 failed, 4 skipped, 0 blacklisted, 2393ms
********* Finished testing of KisHeifTest *********
  • plugins-impex-psd-kis_psd_test: https://bugs.kde.org/show_bug.cgi?id=453340, Tiar is fixing this
  • libs-image-kis_strokes_queue_test and libs-image-kis_update_scheduler_test: failing on freebsd_qt515 CI in similar ways
********* Start testing of KisStrokesQueueTest *********
Config: Using QtTest library 5.15.2, Qt 5.15.2 (x86_64-little_endian-lp64 shared (dynamic) debug build; by Clang 11.0.1 (git@github.com:llvm/llvm-project.git llvmorg-11.0.1-0-g43ff75f2c3fe)), freebsd 13.0
PASS   : KisStrokesQueueTest::initTestCase()
QSYSTEM: KisStrokesQueueTest::testSequentialJobs() krita.general: 
QFATAL : KisStrokesQueueTest::testSequentialJobs() ASSERT: "job" in file /var/tmp/gitlab_runner/builds/uiKp2rAD/0/graphics/krita/libs/image/kis_update_job_item.h, line 229
FAIL!  : KisStrokesQueueTest::testSequentialJobs() Received a fatal error.
   Loc: [Unknown file(0)]
Totals: 1 passed, 1 failed, 0 skipped, 0 blacklisted, 1ms
********* Finished testing of KisStrokesQueueTest *********
********* Start testing of KisUpdateSchedulerTest *********
Config: Using QtTest library 5.15.2, Qt 5.15.2 (x86_64-little_endian-lp64 shared (dynamic) debug build; by Clang 11.0.1 (git@github.com:llvm/llvm-project.git llvmorg-11.0.1-0-g43ff75f2c3fe)), freebsd 13.0
PASS   : KisUpdateSchedulerTest::initTestCase()
QWARN  : KisUpdateSchedulerTest::testMerge() KoColor debug runtime checks are active.
PASS   : KisUpdateSchedulerTest::testMerge()
PASS   : KisUpdateSchedulerTest::benchmarkOverlappedMerge()
RESULT : KisUpdateSchedulerTest::benchmarkOverlappedMerge():
     330 msecs per iteration (total: 330, iterations: 1)
PASS   : KisUpdateSchedulerTest::testLocking()
QSYSTEM: KisUpdateSchedulerTest::testExclusiveStrokes() krita.general: 
QFATAL : KisUpdateSchedulerTest::testExclusiveStrokes() ASSERT: "job" in file /var/tmp/gitlab_runner/builds/uiKp2rAD/0/graphics/krita/libs/image/kis_update_job_item.h, line 229
FAIL!  : KisUpdateSchedulerTest::testExclusiveStrokes() Received a fatal error.
   Loc: [Unknown file(0)]
Totals: 4 passed, 1 failed, 0 skipped, 0 blacklisted, 2847ms
********* Finished testing of KisUpdateSchedulerTest *********
QFATAL : StoryboardTimelineSyncTest::testAddKeyframeExtendsDuration() ASSERT: "d" in file /var/tmp/gitlab_runner/builds/HCBYDm67/0/graphics/krita/libs/global/kis_shared_ptr.h, line 168
FAIL!  : StoryboardTimelineSyncTest::testAddKeyframeExtendsDuration()

Windows:

The following tests FAILED:
         43 - libs-flake-TestSvgParser (Failed)
         44 - libs-flake-TestSvgParserCloned (Failed)
         45 - libs-flake-TestSvgParserRoundTrip (Failed)