We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 1d76f48 commit 12cecfdCopy full SHA for 12cecfd
README.md
@@ -34,6 +34,8 @@ python3 -m tests.bench_all_to_all
34
35
## Multi-node Testing and Benchmarking
36
37
+To run an all-to-all test across multiple nodes:
38
+
39
```bash
40
export NODE_RANK= # 0, 1, ..., num_nodes-1
41
export WORLD_SIZE= # num_nodes * 8
@@ -43,7 +45,11 @@ export MASTER_PORT=29500
43
45
export NVSHMEM_IB_ENABLE_IBGDA=1
44
46
```
47
-After settings these environment variables, commands to run the tests and benchmarks are the same as the single-node case.
48
+An then run the tests normally:
49
50
+```bash
51
+pytest -svx tests/test_all_to_all.py
52
+```
53
54
## Benchmark Results
55
0 commit comments