[SPARK-53509] Publish Apache Spark 4.0.1 to docker registry

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to Publish Apache Spark 4.0.1 to docker registry.

Why are the changes needed?

To provide the latest docker images.

Does this PR introduce any user-facing change?

Yes, the latest tags are changed to 4.0.1 from 4.0.0. These are expected changes.

How was this patch tested?

Pass the CIs.

[dongjoon-hyun]

Thank you, @viirya .

[captify-dpawlowski]

@dongjoon-hyun Looks like version 4.0.1 is not available in docker registry. Do you mind checking this, please?

[dongjoon-hyun]

To @captify-dpawlowski , this ASF repository handles only the following ASF Docker Hub repository.

• https://hub.docker.com/r/apache/spark/tags

$ docker pull apache/spark:4.0.1
4.0.1: Pulling from apache/spark
Digest: sha256:acfe7e06e95dd13aa32ee03c464766900d52fba15f58e421f8e1213ec041bb94
Status: Image is up to date for apache/spark:4.0.1
docker.io/apache/spark:4.0.1

$ docker pull apache/spark:4.1.0-preview2
4.1.0-preview2: Pulling from apache/spark
Digest: sha256:c679d551432aa446278bbc0fb62af020c96bfec74fe76ba7aac4a261525e71d4
Status: Image is up to date for apache/spark:4.1.0-preview2
docker.io/apache/spark:4.1.0-preview2