### Description    ### Reproduction Steps I currently suspect that it is because the resources are cleared every time before inference.  ### Known Workarounds _No response_ ### Configuration and Other Information _No response_