RuntimeError: Address already in use

夜淡

于 2020-08-03 21:52:50 发布

阅读量1.2w

点赞数 11

CC 4.0 BY-SA版权

分类专栏：环境配置与使用文章标签： pytorch python 深度学习

本文链接：https://blog.youkuaiyun.com/j___t/article/details/107774289

环境配置与使用专栏收录该内容

49 篇文章

订阅专栏

当同时运行两个PyTorch DDP程序时，可能会遇到“Address already in use”的错误。本文介绍了一种解决方案，即通过指定一个未被使用的端口来避免此问题。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

同时跑两个pytorch DDP程序时，会出现下列错误：

Traceback (most recent call last):
  File "train_tasks.py", line 471, in <module>
    main()
  File "train_tasks.py", line 211, in main
    torch.distributed.init_process_group(backend="nccl")
  File ".../anaconda3/envs/vilbert/lib/python3.6/site-packages/torch/distributed/distributed_c10d.py", line 406, in init_process_group
    store, rank, world_size = next(rendezvous(url))
  File ".../anaconda3/envs/vilbert/lib/python3.6/site-packages/torch/distributed/rendezvous.py", line 143, in _env_rendezvous_handler
    store = TCPStore(master_addr, master_port, world_size, start_daemon)
RuntimeError: Address already in use

解决方案：

在python -m torch.distributed.launch后指定一个未被使用的端口--master_port 9999。