How do I see an overview of the test run?

Table of Contents

Part of the Compass recipes collection.

Question

How do I see a summary of the last test run — pass/fail counts, failure details, and any ERROR/WARN log lines?

Answer

  1. Use the preset from .env (auto-detected):

    ./projects/ores.compass/compass.sh test results
    
  2. Specify a preset explicitly:

    ./projects/ores.compass/compass.sh test results --preset linux-clang-debug
    

    compass test results reads ORES_PRESET from .env when --preset is omitted. It finds all test-results*.xml files under build/output/<preset>/publish/bin/, prints per-suite statistics (total, passed, failed, skipped, duration), details of each failure (name, location, exception text), and any ERROR=/=WARN lines from the matching log files.

  3. If you see no log output — test logging is disabled by default. To enable it, reconfigure CMake:

    cmake --preset linux-clang-debug -DORES_TEST_LOG_LEVEL=debug
    cmake --build --preset linux-clang-debug --target rat
    ./projects/ores.compass/compass.sh test results
    

    For trace-level output also printed to the console:

    cmake --preset linux-clang-debug \
      -DORES_TEST_LOG_LEVEL=trace \
      -DORES_TEST_LOG_CONSOLE=ON
    

Script

compass test results lives in projects/ores.compass/src/compass.py (cmd_test + _cmd_test_results + _tr_* helpers).

Tested by

Manual: build and run tests with --target rat, then run compass test results and verify suite stats and failure details appear.

See also

Emacs 29.1 (Org mode 9.6.6)