https://redmine.ruby-lang.org/https://redmine.ruby-lang.org/favicon.ico?17113305112017-11-03T22:54:14ZRuby Issue Tracking SystemRuby master - Bug #14064: test-all with and without -j - incorrect assertions and missing test methodshttps://redmine.ruby-lang.org/issues/14064?journal_id=676892017-11-03T22:54:14ZMSP-Greg (Greg L)
<ul></ul><p>While looking for a solution to the 'tests' variance, as mentioned above, there were test classes that were missing, especially when running with <code>-j</code>. Also, these missing classes varied from build to build.</p>
<p>I then noticed that the string test class in test/ruby was named TestString, and the string class in test-ext-\string was named Test_String. Proceeded to do similar renames for several classes.</p>
<p>I've posted <a href="https://github.com/ruby/ruby/pull/1739" class="external">GitHub PR #1739</a>, and it seems to result in higher test numbers for both Appveyor mswin (two tests on my fork) and Travis. I also saw an increase in my ruby-loco MinGW numbers. I suspect these tests were not consistently being run previously. Summary below:</p>
<pre><code>Appveyor
PR a 16835 tests, 2183934 assertions, 0 failures, 0 errors, 312 skips
PR b 16836 tests, 2182259 assertions, 0 failures, 0 errors, 320 skips
PR c 16842 tests, 2184360 assertions, 0 failures, 0 errors, 320 skips
60628 16565 tests, 2174808 assertions, 0 failures, 0 errors, 312 skips
60625 16314 tests, 2162820 assertions, 0 failures, 0 errors, 317 skips
Travis
PR 1739 17455 tests, 2191876 assertions, 0 failures, 5 errors, 114 skips
60630 17048 tests, 2185008 assertions, 0 failures, 5 errors, 112 skips
60628 17044 tests, 2183920 assertions, 0 failures, 5 errors, 112 skips
60625 16853 tests, 2172202 assertions, 0 failures, 5 errors, 112 skips
</code></pre>
<p>I did try to locate the issue in code, but I couldn't find the cause...</p>
<p>Thanks, Greg</p> Ruby master - Bug #14064: test-all with and without -j - incorrect assertions and missing test methodshttps://redmine.ruby-lang.org/issues/14064?journal_id=1042402023-08-23T19:28:12Zjeremyevans0 (Jeremy Evans)merch-redmine@jeremyevans.net
<ul><li><strong>Status</strong> changed from <i>Open</i> to <i>Closed</i></li></ul><p>It looks like a fix for this was committed in <a class="changeset" title="Rename test classes to allow stable test count when running test-all -j [Fix GH-1763] From: MSP..." href="https://redmine.ruby-lang.org/projects/ruby-master/repository/git/revisions/dd3851d2786412de019350a11e749c56fa5a07cc">dd3851d2786412de019350a11e749c56fa5a07cc</a></p>