Support IP Adapter for AnimateDiffPipeline

[vladmandic]

Like title says, request is to support newly IP adapter (via PR #5713) for existing AnimateDiffPipeline
as AnimateDiff would greatly benefit from style stabilization brought by IP adapter

CC @yiyixuxu @DN6 @sayakpaul @patrickvonplaten

[DN6]

@yiyixuxu I believe you were already working on this right?

[yiyixuxu]

yep yep @sayakpaul is here to prove

[yiyixuxu]

face model will be supported soon I think will works better for animatediff

[yiyixuxu]

@vladmandic

we haven't done any comms about it and I guess very easy to miss in our doc but here it is
https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters?model=AnimateDiff

[vladmandic]

right :)
i used diffusers from main branch from two days ago and AnimateDiffPipeline did not have load_ip_adapter method.
just checked out latest diffusers main and it works fine! thanks!

[sayakpaul]

Thanks for checking! If you have a cool example to share with us, that would be great!

[vladmandic]

basic animatediff plus ip-adapter and with sdnext built-in rife interpolation to boost frame count from 16 to 120

00021-lyriel-v16-beautiful.wearing.a.tight.dress.in.a.city.mp4