Failed to connect to server: :8032: retries get failed due to exceeded maximum allowed retries numbe

最新推荐文章于 2023-12-13 17:58:01 发布

原创最新推荐文章于 2023-12-13 17:58:01 发布 · 4.8k 阅读

2 ·

CC 4.0 BY-SA版权

本文探讨了Spark-shell在尝试连接YARN集群时遇到的警告信息，详细分析了连接失败的原因，即配置文件中指向备用资源管理器的设置导致首次连接尝试错误。文章进一步解释了当主动资源管理器处于活动状态时，此警告不会出现，因为首次连接尝试成功。

spark-shell 报 WARN ipc.Client: Failed to connect to server: xxx/xxx.xxx.xx.xx:8032: retries get failed due to exceeded maximum allowed retries number: 0
java.net.ConnectException: Connection refused

CAUSE:
In Yarn configs -> custom yarn-site.xml, you might have configuration for rm1 as resource-manager-A. This is the reason first attempt to connect was made to this server and then got connection refused. Then it goes to active resource manager which is resource-manager-B. This warning is not seen when resource-manager-A is active, because the property rm1 pointing to this server, first connect attempt is successful. First connection attempt is always made to the resource manager which is specified in rm1.

首先连了备用机器了。导致报警。
在这里插入图片描述
切换主备。