Closed
Description
right now pip is downloading and installing requirements each time which takes about 2 minutes, we could speed it up https://docs.github.com/en/actions/using-workflows/caching-dependencies-to-speed-up-workflows
more importantly, if we want to use models and datasets in our tests, we should cache them as well
see here for how it can be done https://github.com/neelnanda-io/TransformerLens/blob/53c95f3f154b2933dcc84647bd80bf29a9e4e2d2/.github/workflows/checks.yml#L58-L65