Quatered image produced, StableDiffusionPanoramaPipeline

[inkyusa]

Describe the bug

Hi,
Anyone experienced the following when running the multidifussion tutorial?
It generates a quater dolomites with the default setup but, correct one with height=1024

Reproduction

Just did as shown in https://huggingface.co/docs/diffusers/main/en/api/pipelines/panorama

import torch
from diffusers import StableDiffusionPanoramaPipeline, DDIMScheduler

model_ckpt = "stabilityai/stable-diffusion-2-base"
scheduler = DDIMScheduler.from_pretrained(model_ckpt, subfolder="scheduler")
pipe = StableDiffusionPanoramaPipeline.from_pretrained(model_ckpt, scheduler=scheduler, torch_dtype=torch.float16)

pipe = pipe.to("cuda")

prompt = "a photo of the dolomites"
image = pipe(prompt).images[0]  #1/4
#image = pipe(prompt, height=1024).images[0] #looks ok.
image.save("dolomites.png")

Logs

No response

System Info

• diffusers version: 0.18.0.dev0
• Platform: Linux-5.15.0-69-generic-x86_64-with-glibc2.27
• Python version: 3.9.16
• PyTorch version (GPU?): 1.13.0 (True)
• Huggingface_hub version: 0.15.1
• Transformers version: 4.29.2
• Accelerate version: 0.18.0
• xFormers version: not installed
• Using GPU in script?: yes
• Using distributed or parallel set-up in script?: no

[patrickvonplaten]

cc @sayakpaul

[sayakpaul]

I can reproduce this on Colab. However installing from this commit 2f997f3, fixes the issue.

!pip install -q git+https://github.com/huggingface/diffusers@2f997f30ab660472561f5e1b5232d4f116315b1b

So, my gut says it was likely introduced in #3546.

Cc: @Isotr0py. Could you look into it once?

[Isotr0py]

I tested a94977b on Colab, and it works normally.

!pip install git+https://github.com/huggingface/diffusers@a94977b8b32b94ccd00d2f8f812aadb46764baba

And this issue also appeared in DPMSolverMultistepScheduler, it seems that it's not about the schedulers but the blocks split.

So I think it was introduced in #3632, because we make some small changes to blocks split to support batched denoise. I may miss something in this PR.

I will check it out once I have spare time.

[Isotr0py]

OK, I found it caused by a typo because of mistake... I will fix it soon.

[sayakpaul]

@inkyusa could you install diffusers from source (i.e., pip install git+https://github.com/huggingface/diffusers/) and retry once?

@Isotr0py helped fixed in #3800. Thank you!

[inkyusa]

Thanks for the response and hotfix.
I tested with d49e2dd and confirmed that it worked as it should.
Cheers,