Investigate automatic quarantining of flaky tests

Context

Update Gitaly version MRs can get blocked for hours or days due to a failing CI pipeline. Most of these failures are not due to regressions in Gitaly, but are caused by flaky tests in Rails or other components.

Engineering Productivity have developed an experimental tool that attempts to automatically quarantine flaky tests, opening an MR and altering the team responsible for the fix.

The tool appears to be built on https://gitlab.com/gitlab-org/gitlab/-/tree/master/gems/gitlab-housekeeper and targets gitlab-org/gitlab specs.

Proposal

Investigate the extent to which the tool is used. Determine if it assists or can be modified to assist in improving Gitaly's deployment process.

See if a similar approach can be applied to Gitaly's own tests written in Go.