Buildx missing

[pfuhrmann]

Because the base docker version was upgraded out of nowhere to v24 from V20, buildx has to be installed separately. That's a rather huge breaking change.

https://docs.docker.com/build/architecture/#install-buildx

Docker Engine version 23.0 and later requires that you install Buildx from a separate package.

To Reproduce
Steps to reproduce the behavior:

Add a new build project and set the image to cloud-sdk:432.0.0-slim

use the following to try and build any docker image:

export DOCKER_BUILDKIT=1
docker build .

See error:

ERROR: BuildKit is enabled but the buildx component is missing or broken.
       Install the buildx component to build images with BuildKit:
       https://docs.docker.com/go/buildx/

EDIT: Added the steps to reproduce the issue.

[OsamaNabih]

Getting the same issue here.
All of our builds are now failing since the last image rolled out https://console.cloud.google.com/gcr/images/google.com:cloudsdktool/global/cloud-sdk (432.0.0-slim)
Please provide a fix.

[pfuhrmann]

It seems it was reverted now: 373fae0

However, it's concerning what is the development process here, seems there is no process.

I believe someone still needs to release a reverted change to Docker Hub (last update 17 hours ago): https://hub.docker.com/layers/google/cloud-sdk/432.0.0/images/sha256-7b8d98c4507fb46d12e20f415d341bf5a11e8b3c1dc6874267fc3c2228ada430?context=explore

[cloudsdkdocker]

The images have been rebuilt and launched. The initial fixes introduced errors into the build process that weren't identified until this morning.

The impetus of this update are a number of CVEs within the (now) current version of docker engine, including a Critical CVE blocking some customers. Since no breakages in the CLI itself or its Packaged Components were identified the change was launched. This obviously lead to breakages in workstreams outside the the direct scope of the CLI or its packaged components.

The Cloud CLI team currently operates within the scope defined in our Support section and any usecases beyond that scope are not currently reviewed and tested prior to release.

All of this is being considered as we're looking towards what the future of these images looks like. What would be valuable input to this planning process would be an high level explanation of what workflows these changes broke for you all if you don't mind providing it. We'll be doing further outreach to users beyond this github issue, but for now any input is valuable.

[pfuhrmann]

Hi, thank you for your reply.

I think I have provided sufficient info in the initial issue description. Buildx is a very common part of many build systems. For example, without buildx, there is no way to handle build time secrets securely inside container images. I do fully agree that Docker v20 is outdated and would prefer v24, however not the way it was done yesterday.

For more context, the same thing happened to your counterparts at AWS [1]. The way they solved it, is they added buildx tool into their image [2]. Could you do the same to prevent this breaking change for many users of your base image?

[1] aws/aws-codebuild-docker-images#625
[2] https://github.com/aws/aws-codebuild-docker-images/pull/626/files

[bobidle]

@pfuhrmann opened a pull request with Docker v24.0.1 including buildx. Could you build the docker image and check if docker and docker buildx work as expected?

e.g.

docker build -t local/cloud-sdk:alpine --build-arg CLOUD_SDK_VERSION=430.0.0 .

included buildx version

$ docker run --rm -it local/cloud-sdk:alpine docker buildx version
github.com/docker/buildx v0.10.5 86bdced7766639d56baa4c7c449a4f6468490f87

[pfuhrmann]

Can confirm, it seems to work! Tested with the following command:

docker run -v "/var/run/docker.sock:/var/run/docker.sock:rw" \
  -v .:/tmp/build \
  --rm -it \
  local/cloud-sdk:alpine sh -c "export DOCKER_BUILDKIT=1 && docker build /tmp/build"

---

 => [internal] load build definition from Dockerfile                                                                                                                                                                                                                                                                                                          0.0s
 => => transferring dockerfile: 1.03kB                                                                                                                                                                                                                                                                                                                        0.0s
 => [internal] load .dockerignore                                                                                                                                                                                                                                                                                                                             0.0s
 => => transferring context: 203B                                                                                                                                                                                                                                                                                                                             0.0s
 => [internal] load metadata for docker.io/library/alpine:3.18.0                                                                                                                                                                                                                                                                                              
...

The same command fails when using the "broken" digest instead, i.e.:

docker run -v "/var/run/docker.sock:/var/run/docker.sock:rw" \
  -v .:/tmp/build \
  --rm -it \
  google/cloud-sdk@sha256:0c0c557139ba6a3e00bab3ebdcbf0012d130c5dcc3411e903ea387679137e79b sh -c "export DOCKER_BUILDKIT=1 && docker build /tmp/build"

---

ERROR: BuildKit is enabled but the buildx component is missing or broken.
       Install the buildx component to build images with BuildKit:
       https://docs.docker.com/go/buildx/