For some reason, these tests are only running on `test_non_bootstrapped` which is not even run on the PRs. We need to re-enable these tests. This lead to the failure in #14416