Skip to content

VAE config mismatch when using StableDiffusionInpainting  #7334

@sayakpaul

Description

@sayakpaul

Currently, we have got a failing test:

tests/pipelines/stable_diffusion/test_stable_diffusion_inpaint.py::StableDiffusionInpaintPipelineSlowTests::test_single_file_component_configs

And it fails for the right reason! You will notice that the assertion doesn't pass for sample_size. For the diffusers checkpoint, this value is 256 and the inferred value from the single-file checkpoint is 512.

This is a bit of an issue because the sample_size param in the VAE influences the tiling factors:

self.tile_sample_min_size = self.config.sample_size

So, for the VAE loaded from the diffusers checkpoint will have a different tiling configuration from the one loaded from the single-file checkpoint.

Cc: @DN6 @yiyixuxu

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions