Skip to content

Commit baabec4

Browse files
authored
fix comment in fsdp_tp_example.py
1 parent 37a1866 commit baabec4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

distributed/tensor_parallelism/fsdp_tp_example.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -87,7 +87,7 @@
8787
dp_mesh = device_mesh["dp"]
8888

8989
# For TP, input needs to be same across all TP ranks.
90-
# while for SP, input can be different across all ranks.
90+
# while for DP, input can be different across all ranks.
9191
# We will use dp_rank for setting the random seed
9292
# to mimic the behavior of the dataloader.
9393
dp_rank = dp_mesh.get_local_rank()

0 commit comments

Comments
 (0)