`FlaxEncoder` receives it [here](https://github.com/huggingface/diffusers/blob/main/src/diffusers/models/vae_flax.py#L326), but then it's ignored. `FlaxResnetBlock2D` uses a [hardcoded value](https://github.com/huggingface/diffusers/blob/main/src/diffusers/models/vae_flax.py#L99). Discovered by @younesbelkada in https://github.com/huggingface/diffusers/pull/589#discussion_r975796548