Bug #19869: Mark skipped test somehow

• Status: Open
• Assignee: -
• Target version: -
• ruby -v: ruby 3.3.0dev (2023-09-05 master 7c8932365f) [x86_64-linux]
• Backport: 3.0: UNKNOWN, 3.1: UNKNOWN, 3.2: UNKNOWN

[vo.x (Vit Ondruch)]

When Minitest was used to execute the Ruby test suite, skipped test were cleanly marked, e.g.:

[14036/25715] TestGemExtCmakeBuilder#test_self_build_has_makefile = s

However, with the test-unit the output is:

[14036/25715] TestGemExtCmakeBuilder#test_self_build_has_makefile = 0.01 s

This is problematic, because running test suite, I can see that some test were skipped:

25705 tests, 6108213 assertions, 0 failures, 0 errors, 99 skips

But I can't tell which. Is there a chance to fix this?

[vo.x (Vit Ondruch)]

Ok, adding TESTS="--show-skip" makes the difference. Such tests are reported at the end of the run of test suite, e.g.:

 70) Skipped:
TestGemExtCmakeBuilder#test_self_build_fail [/builddir/build/BUILD/ruby-3.3.0-7c8932365f/test/rubygems/test_gem_ext_cmake_builder.rb:19]:

That is nice, but I wonder why is it not default? As I can see, this is enabled just for MinGW.

Please note that I cannot enable this option via $TESTOPTS, which would be probably the right way, because runnint make check, this is then feed to bootstrap runner, which does not handle this option :/