Create Task
Maniphest T11858

ECM tests seem not to be run despite having a "Running Tests" stage
Closed, ResolvedPublic
Actions

Description

It seems unit tests for ECM are not run on CI, despite there being a stage.
With ECMGenerateExportHeader I have added some longer running tests (totally up to 1 min locally) but wondered when CI passed the stage in a few secs, with no result logging, e.g.

[Pipeline] stage
[Pipeline] { (Running Tests)
[Pipeline] sh
18:02:25  + python3 -u ci-tooling/helpers/run-tests.py --product Frameworks --project extra-cmake-modules --branchGroup kf5-qt5 --platform SUSEQt5.12 --usingInstall /home/jenkins//install-prefix/
[Pipeline] junit
18:02:25  Recording test results
18:02:26  None of the test reports contained any result
[Pipeline] }
[Pipeline] // stage

From https://build.kde.org/job/Frameworks/job/extra-cmake-modules/job/kf5-qt5%20SUSEQt5.12/58/console

Is that on purpose, or did something break?

Related Objects

kossebau created this task.Oct 11 2019, 4:13 PM
Restricted Application added a subscriber: sysadmin. · View Herald TranscriptOct 11 2019, 4:13 PM
bcooksley moved this task from Backlog to Awaiting Response on the build.kde.org board.Oct 11 2019, 7:25 PM
bcooksley added a subscriber: bcooksley.

This is intentional, please see https://cgit.kde.org/sysadmin/ci-tooling.git/commit/build-specs/Frameworks/extra-cmake-modules.yaml?id=45ff1bc4ecb18ad71ad0570f7e838d1ae7cab2e2

This was raised on in a thread titled 'ECM tests not run by CI (Re: KDE Frameworks 5.55.0)' on the kde-buildsystem and release-team lists back in February this year, but there was no response to me providing the details on what exactly was broken.

vonreth added a subscriber: vonreth.EditedOct 23 2019, 5:37 PM

Lol (windows)

`49% tests passed, 42 tests failed out of 82

Total Test time (real) = 492.31 sec

The following tests FAILED:
          4 - KDEInstallDirsTest.relative_or_absolute (Failed)
         11 - KDEInstallDirsTest.relative_or_absolute_qt (Failed)
         20 - ecm_add_tests-single_tests (Failed)
         21 - ecm_add_tests_did_run-single_tests (Failed)
         22 - ecm_add_tests-multi_tests (Failed)
         23 - ecm_add_tests_did_run-multi_tests (Failed)
         30 - ecm_generate_export_header-consumer-0-0-GROUPLESS (Failed)
         31 - ecm_generate_export_header-consumer-2.0.0-0-GROUPLESS (Failed)
         32 - ecm_generate_export_header-consumer-CURRENT-0-GROUPLESS (Failed)
         33 - ecm_generate_export_header-consumer-2.0.0-2.0.0-GROUPLESS (Failed)
         34 - ecm_generate_export_header-consumer-CURRENT-2.0.0-GROUPLESS (Failed)
         35 - ecm_generate_export_header-consumer-CURRENT-CURRENT-GROUPLESS (Failed)
         36 - ecm_generate_export_header-consumer-0-0-GROUP_USE_DIRECT (Failed)
         37 - ecm_generate_export_header-consumer-2.0.0-0-GROUP_USE_DIRECT (Failed)
         38 - ecm_generate_export_header-consumer-CURRENT-0-GROUP_USE_DIRECT (Failed)
         39 - ecm_generate_export_header-consumer-2.0.0-2.0.0-GROUP_USE_DIRECT (Failed)
         40 - ecm_generate_export_header-consumer-CURRENT-2.0.0-GROUP_USE_DIRECT (Failed)
         41 - ecm_generate_export_header-consumer-CURRENT-CURRENT-GROUP_USE_DIRECT (Failed)
         42 - ecm_generate_export_header-consumer-0-0-GROUP_USE_GROUP (Failed)
         43 - ecm_generate_export_header-consumer-2.0.0-0-GROUP_USE_GROUP (Failed)
         44 - ecm_generate_export_header-consumer-CURRENT-0-GROUP_USE_GROUP (Failed)
         45 - ecm_generate_export_header-consumer-2.0.0-2.0.0-GROUP_USE_GROUP (Failed)
         46 - ecm_generate_export_header-consumer-CURRENT-2.0.0-GROUP_USE_GROUP (Failed)
         47 - ecm_generate_export_header-consumer-CURRENT-CURRENT-GROUP_USE_GROUP (Failed)
         48 - ecm_generate_export_header-consumer-NO-DEPRECATED-0-GROUPLESS (Failed)
         49 - ecm_generate_export_header-consumer-NO-DEPRECATED-2.0.0-GROUPLESS (Failed)
         50 - ecm_generate_export_header-consumer-NO-DEPRECATED-CURRENT-GROUPLESS (Failed)
         51 - ecm_generate_export_header-consumer-NO-DEPRECATED-0-GROUP_USE_DIRECT (Failed)
         52 - ecm_generate_export_header-consumer-NO-DEPRECATED-2.0.0-GROUP_USE_DIRECT (Failed)
         53 - ecm_generate_export_header-consumer-NO-DEPRECATED-CURRENT-GROUP_USE_DIRECT (Failed)
         54 - ecm_generate_export_header-consumer-NO-DEPRECATED-0-GROUP_USE_GROUP (Failed)
         55 - ecm_generate_export_header-consumer-NO-DEPRECATED-2.0.0-GROUP_USE_GROUP (Failed)
         56 - ecm_generate_export_header-consumer-NO-DEPRECATED-CURRENT-GROUP_USE_GROUP (Failed)
         58 - ecm_setup_version-old_simple (Failed)
         59 - ecm_setup_version-old_soversion (Failed)
         60 - ecm_setup_version-old_version_file (Failed)
         61 - ecm_setup_version-old_version_file_abspath (Failed)
         62 - ecm_setup_version-old_version_file_anynewer (Failed)
         63 - ecm_setup_version-old_version_file_exact (Failed)
         64 - ecm_setup_version-old_version_file_samemajor (Failed)
         65 - ecm_setup_version-old_header (Failed)
         66 - ecm_setup_version-old_header_abspath (Failed)
kossebau closed this task as Resolved.Nov 4 2019, 10:23 AM
kossebau claimed this task.

Tests are run again now, thanks to 811c7544490031e1faeb4a1597c4d11afbf68eb9