[tests] reorganize cache tests and clean memory between tests #37684
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
#37394 introduces a cache change, but there are several cache test issues at the moment, preventing a clean merge.
This PR:
@slowdecorator from a few tests (change pulled from [Cache] Support compilable cache reuse with smaller batch sizes #37394)test_static_cache_greedy_decoding_pad_right, as it doesn't make sense to generate with right padding (change pulled from [Cache] Support compilable cache reuse with smaller batch sizes #37394)torch.export()cache tests to its own classFollow-up PR, before retesting #37394:
@slowtests into fast tests as possible