Windows CI has MemoryError

[justinchuby]

First seen: https://github.com/microsoft/onnx-script/actions/runs/4641478064/jobs/8214491813,
Also https://github.com/microsoft/onnx-script/actions/runs/4642961358/jobs/8217281756

[justinchuby]

I wonder if the cache for the eager ort evaluator needs to be purged

[justinchuby]

Windows is now consistently running out of memory https://github.com/microsoft/onnx-script/actions/runs/4726705836/jobs/8386557760?pr=643