Skip to content

Commit cc763f5

Browse files
authored
Update the Gaudi container example in the README (#1885)
1 parent 1f58f02 commit cc763f5

File tree

1 file changed

+2
-7
lines changed

1 file changed

+2
-7
lines changed

README.md

Lines changed: 2 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -46,18 +46,13 @@ pip install "neural-compressor>=2.3" "transformers>=4.34.0" torch torchvision
4646
After successfully installing these packages, try your first quantization program.
4747

4848
### Weight-Only Quantization (LLMs)
49-
Following example code demonstrates Weight-Only Quantization on LLMs, it supports Intel CPU, Intel Gauid2 AI Accelerator, Nvidia GPU, best device will be selected automatically.
49+
Following example code demonstrates Weight-Only Quantization on LLMs, it supports Intel CPU, Intel Gaudi2 AI Accelerator, Nvidia GPU, best device will be selected automatically.
5050

5151
To try on Intel Gaudi2, docker image with Gaudi Software Stack is recommended, please refer to following script for environment setup. More details can be found in [Gaudi Guide](https://docs.habana.ai/en/latest/Installation_Guide/Bare_Metal_Fresh_OS.html#launch-docker-image-that-was-built).
5252
```bash
53+
# Run a container with an interactive shell
5354
docker run -it --runtime=habana -e HABANA_VISIBLE_DEVICES=all -e OMPI_MCA_btl_vader_single_copy_mechanism=none --cap-add=sys_nice --net=host --ipc=host vault.habana.ai/gaudi-docker/1.14.0/ubuntu22.04/habanalabs/pytorch-installer-2.1.1:latest
5455

55-
# Check the container ID
56-
docker ps
57-
58-
# Login into container
59-
docker exec -it <container_id> bash
60-
6156
# Install the optimum-habana
6257
pip install --upgrade-strategy eager optimum[habana]
6358

0 commit comments

Comments
 (0)