[Tests] reduce the model sizes in the SD fast tests#7580

yiyixuxu merged 9 commits intomainhuggingface/diffusers:mainfrom

tests/reduce-block-sizes-in-pipelineshuggingface/diffusers:tests/reduce-block-sizes-in-pipelinesCopy head branch name to clipboard