Unable to locate package intel-oneapi-mkl-devel

[mneedham]

System Info

I'm trying to build the Docker image as I can't use any of the pre-built ones since they don't work on Mac M1. I'm running the build locally.

Information

• Docker
• The CLI directly

Tasks

• An officially supported command
• My own modifications

Reproduction

docker build .

And it fails with the following error:

=> ERROR [builder  2/11] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommend  3.3s
------
 > [builder  2/11] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends     intel-oneapi-mkl-devel     build-essential     && rm -rf /var/lib/apt/lists/*:
0.484 Get:1 http://deb.debian.org/debian bookworm InRelease [151 kB]
0.586 Get:2 http://deb.debian.org/debian bookworm-updates InRelease [52.1 kB]
0.624 Get:3 http://deb.debian.org/debian-security bookworm-security InRelease [48.0 kB]
0.673 Get:4 http://deb.debian.org/debian bookworm/main arm64 Packages [8681 kB]
1.263 Get:5 https://apt.repos.intel.com/oneapi all InRelease [4451 B]
1.397 Get:6 https://apt.repos.intel.com/oneapi all/main all Packages [83.1 kB]
1.840 Get:7 http://deb.debian.org/debian bookworm-updates/main arm64 Packages [6408 B]
1.844 Get:8 http://deb.debian.org/debian-security bookworm-security/main arm64 Packages [86.1 kB]
2.535 Fetched 9112 kB in 2s (4147 kB/s)
2.535 Reading package lists...
2.864 Reading package lists...
3.175 Building dependency tree...
3.262 Reading state information...
3.270 E: Unable to locate package intel-oneapi-mkl-devel
------
Dockerfile:36
--------------------
  35 |
  36 | >>> RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends \
  37 | >>>     intel-oneapi-mkl-devel \
  38 | >>>     build-essential \
  39 | >>>     && rm -rf /var/lib/apt/lists/*
  40 |
--------------------
ERROR: failed to solve: process "/bin/sh -c apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends     intel-oneapi-mkl-devel     build-essential     && rm -rf /var/lib/apt/lists/*" did not complete successfully: exit code: 100

Expected behavior

It should continue building the image.

[OlivierDehaene]

The problem with M1/M2 builds (and the reason why we do not have a Dockerfile for them) is that docker does not have a specific M1/M2 target.
This is very problematic here because it means that we cannot build an image with Accelerate support which leads to the final image being way slower than it should be.

I can only advise you to build the project with cargo install --path router -F candle -F accelerate instead.

If you have another solution feel free to open a PR or comment here, I'm very interested in solving this.

If you still want to build an image (without accelerate support), you can build an ARM image with:

FROM lukemathwalker/cargo-chef:latest-rust-1.73-bookworm AS chef
WORKDIR /usr/src

FROM chef AS planner

COPY backends backends
COPY core core
COPY router router
COPY Cargo.toml ./
COPY Cargo.lock ./

RUN cargo chef prepare  --recipe-path recipe.json

FROM chef AS builder

ARG GIT_SHA
ARG DOCKER_LABEL

COPY --from=planner /usr/src/recipe.json recipe.json

RUN cargo chef cook --release --features candle --no-default-features --recipe-path recipe.json

COPY backends backends
COPY core core
COPY router router
COPY Cargo.toml ./
COPY Cargo.lock ./

RUN cargo build --release --bin text-embeddings-router -F candle --no-default-features

FROM debian:bookworm-slim

ENV HUGGINGFACE_HUB_CACHE=/data \
    PORT=80

RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends \
    ca-certificates \
    libssl-dev \
    && rm -rf /var/lib/apt/lists/*

COPY --from=builder /usr/src/target/release/text-embeddings-router /usr/local/bin/text-embeddings-router

ENTRYPOINT ["text-embeddings-router"]
CMD ["--json-output"]