[distributed][elastic/rendezvous] FileNotFoundError: [Errno 2] No such file or directory: 'etcd'

[zxd1997066]

🐛 Describe the bug

please get wheels from https://github.com/intel/torch-xpu-ops/actions/runs/18029979174 or use gh download

gh run download 18029979174 --repo intel/torch-xpu-ops --name Torch-XPU-Wheel-1826 --dir path --pattern "*.zip"
git clone -b distributed_2.9 https://github.com/daisyden/pytorch.git
cd pytorch
pip install -r requirements.txt
pip install python-etcd
cd test/distributed/elastic/rendezvous/
python -m unittest etcd_rendezvous_backend_test
python -m unittest etcd_rendezvous_test
python -m unittest etcd_server_test

======================================================================
ERROR: setUpClass (etcd_rendezvous_backend_test.EtcdRendezvousBackendTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/sdp/xiangdong/pytorch/test/distributed/elastic/rendezvous/etcd_rendezvous_backend_test.py", line 38, in setUpClass
    cls._server.start(stderr=subprocess.DEVNULL)
  File "/home/sdp/miniforge-pypy3/envs/xccl_ww27/lib/python3.10/site-packages/torch/distributed/elastic/rendezvous/etcd_server.py", line 175, in start
    return self._start(data_dir, timeout, stderr)
  File "/home/sdp/miniforge-pypy3/envs/xccl_ww27/lib/python3.10/site-packages/torch/distributed/elastic/rendezvous/etcd_server.py", line 216, in _start
    self._etcd_proc = subprocess.Popen(etcd_cmd, close_fds=True, stderr=stderr)
  File "/home/sdp/miniforge-pypy3/envs/xccl_ww27/lib/python3.10/subprocess.py", line 971, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/home/sdp/miniforge-pypy3/envs/xccl_ww27/lib/python3.10/subprocess.py", line 1863, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: 'etcd'

----------------------------------------------------------------------
Ran 0 tests in 0.005s

Versions

pytorch: https://github.com/daisyden/pytorch/tree/distributed_2.9

[Chao1Han]

sudo apt install -y etcd-server etcd-client

[zxd1997066]

python -m unittest etcd_server_test.EtcdServerTest.test_etcd_server_with_rendezvous still failed

======================================================================
ERROR: test_etcd_server_with_rendezvous (etcd_server_test.EtcdServerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/sdp/xiangdong/pytorch/test/distributed/elastic/rendezvous/etcd_server_test.py", line 58, in test_etcd_server_with_rendezvous
    rdzv_handler = EtcdRendezvousHandler(rdzv)
TypeError: EtcdRendezvousHandler.__init__() missing 1 required positional argument: 'local_addr'

----------------------------------------------------------------------
Ran 1 test in 1.016s

FAILED (errors=1)

[siju-samuel]

The following two tests can be fixed by installing the required packages:

python -m unittest etcd_rendezvous_backend_test
python -m unittest etcd_rendezvous_test

Fix
sudo apt install -y etcd-server etcd-client

For the test below:
python -m unittest etcd_server_test The issue is resolved by the following Pytorch PR: 165431