My own #3870 introduced a bug - running `./runtests.py eval` or `./runtests cmd` does not work correctly.