Skip to content

Commit a1651f7

Browse files
author
Sanket Jayant Purandare
committed
Update on "Re-enable FSDP2 Mem Tracker integration tests"
When `run_llama_train.sh` was simplified, we moved the launch of memory estimation and tracking to `run_memory_estimation.sh`. But changing the `test_runner.py ` was missed which in-turn caused the integration test to be a no-op. This PR re-enables integration tests for the `FSDP2MemTracker`. [ghstack-poisoned]
1 parent e740543 commit a1651f7

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

estimation.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,6 @@
1414
from torch._subclasses.fake_tensor import FakeTensorMode
1515
from torch.distributed import destroy_process_group
1616
from torch.distributed._tools.fsdp2_mem_tracker import FSDPMemTracker
17-
from torch.distributed.tensor.parallel import loss_parallel
1817
from torch.testing._internal.distributed.fake_pg import FakeStore
1918

2019
from torchtitan.config_manager import JobConfig

0 commit comments

Comments
 (0)