I'm a software engineer at Launchable, and I'd like to propose the mechanism to detect potential flaky tests. ## Background In the current Ruby CI, it's easy for flaky tests to be unintentionally merged into the master branch. Even...ono-max (Naoto Ono)
I've enabled the [Predictive Test Selection](https://www.launchableinc.com/docs/features/predictive-test-selection/) feature, which let machine-learning model selects the appropriate tests to reduce CI execution time in https://github.co...ono-max (Naoto Ono)
Launchable: Temporarily remove Launchable integration from Compilations workflow Currently, Launchable is unstable, which occationally causes workflow issues. Until this problem is fixed, we'll temporary disable Launchable in the Compil...ono-max (Naoto Ono)
Launchable: Terminate Launchable CLI process quickly by sending singals to a process group Sometimes, the timeout errors occurred in Compilations workflow, this is because Launchable CLI process was not terminated correctly. To address ...ono-max (Naoto Ono)
When Launchable in unstable, the round trip time takes a long time, which slows down CI execution. In this PR I configured the environment variable `LAUNCHABLE_COMMIT_TIMEOUT` to configure the timeout. https://github.com/launchableinc/c...ono-max (Naoto Ono)
Applied in changeset commit:git|a671b25525279706d1fa2ee3b25ef45e3ec0eb89. ---------- [Bug #21203] Skip TestGc#test_gc_parameter_init_slots since it is flaky (#13025) https://bugs.ruby-lang.org/issues/21203 TestGc#test_gc_parameter_ini...ono-max (Naoto Ono)
https://bugs.ruby-lang.org/issues/21203 TestGc#test_gc_parameter_init_slots is a flaky test that fails intermittently. Until the issue with flakiness is resolved, I will skip it.ono-max (Naoto Ono)
(https://github.com/ruby/etc/pull/55) https://bugs.ruby-lang.org/issues/21204 TestEtc#test_ractor_parallel is only failing intermittently on ModGC workflow after 87fb0c4. So, we'll skip this test on ModGC workflow. https://github.com/...ono-max (Naoto Ono)
TestThreadInstrumentation#test_sleeping_inside_ractor is a flaky and failing intermittently. Additionally, Launchable reported this test as a top flaky test. (Link: https://app.launchableinc.com/organizations/ruby/workspaces/ruby/insight...ono-max (Naoto Ono)