[Tests] Improve transformers model test suite coverage

[sayakpaul]

Currently, we have different variants of transformers: https://github.com/huggingface/diffusers/tree/main/src/diffusers/models/transformers/. However, we don't have test suites for each of them: https://github.com/huggingface/diffusers/tree/main/tests/models/transformers/.

We are seeking contributions from the community to improve this situation. Below is a list of the model for which we would really appreciate test suites for:

• Hunyuan DiT
• Latte
• Lumina
• Temporal Transformer

How to approach the process?

• Take the configuration object for each of these models from their respective pipeline tests suites. For example, for the Latte Transformer, it would be here:

  diffusers/tests/pipelines/latte/test_latte.py

  Line 57 in 3f14117

  transformer = LatteTransformer3DModel(

• Derive the expected inputs. You can do so by adding print statements to the corresponding pipeline file. For example, for the Latte Transformer, you could add print statements right here:

  diffusers/src/diffusers/pipelines/latte/pipeline_latte.py

  Line 801 in 3f14117

  # predict noise model_output

  to investigate the shapes of the outputs and then use that information accordingly.
• Then it should be just about defining the test suite like so: https://github.com/huggingface/diffusers/blob/main/tests/models/transformers/test_models_transformer_sd3.py.

Points to keep in mind when opening PRs

• Mention this issue and tag @DN6 and myself.
• Target only one modeling test at a time.

[chiral-carbon]

hi @sayakpaul! Could I pick up Lumina?

[MnCSSJ4x]

Hi @sayakpaul Could I pick up Hunyuan DiT?

[sayakpaul]

It’s here #8916

[MnCSSJ4x]

I had a look at the PR. I wanted to know if its still open for contribution or the PR mentioned handled it?

[saqlain2204]

Hey @sayakpaul . I would like to take a shot on Lumina

[sayakpaul]

We successfully completed the test suite coverage. Great work every one!