Commit 7c8a560
authored
Add HELION_DEV_LOW_VRAM env var for low GPU memory machines (#325)
Some dev machine (e.g. gpu laptop) has low VRAM which causes some
tritonbench inputs to OOM. This PR adds HELION_DEV_LOW_VRAM env var and
uses smaller inputs if the env var is set. User can choose to opt
into this mode by setting the env var, instead of passively having
smaller inputs due to low VRAM.1 parent 11b49c6 commit 7c8a560
2 files changed
+4
-38
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
| 3 | + | |
| 4 | + | |
3 | 5 | | |
4 | 6 | | |
5 | 7 | | |
6 | 8 | | |
7 | 9 | | |
8 | | - | |
9 | 10 | | |
10 | | - | |
11 | | - | |
| 11 | + | |
| 12 | + | |
12 | 13 | | |
13 | 14 | | |
14 | 15 | | |
| |||
This file was deleted.
0 commit comments