Failed to connect to server: :8032: retries get failed due to exceeded maximum allowed retries numbe

科学的N次方

于 2020-01-14 17:20:16 发布

阅读量4.7k

点赞数

CC 4.0 BY-SA版权

本文链接：https://blog.youkuaiyun.com/chenshijie2011/article/details/103976700

本文探讨了Spark-shell在尝试连接YARN集群时遇到的警告信息，详细分析了连接失败的原因，即配置文件中指向备用资源管理器的设置导致首次连接尝试错误。文章进一步解释了当主动资源管理器处于活动状态时，此警告不会出现，因为首次连接尝试成功。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

spark-shell 报 WARN ipc.Client: Failed to connect to server: xxx/xxx.xxx.xx.xx:8032: retries get failed due to exceeded maximum allowed retries number: 0
java.net.ConnectException: Connection refused

CAUSE:
In Yarn configs -> custom yarn-site.xml, you might have configuration for rm1 as resource-manager-A. This is the reason first attempt to connect was made to this server and then got connection refused. Then it goes to active resource manager which is resource-manager-B. This warning is not seen when resource-manager-A is active, because the property rm1 pointing to this server, first connect attempt is successful. First connection attempt is always made to the resource manager which is specified in rm1.