Exception in thread "main" java.net.BindException: 无法指定被请求的地址: Service 'sparkMaster' failed 错误处理

最新推荐文章于 2023-05-15 11:45:44 发布

原创

最新推荐文章于 2023-05-15 11:45:44 发布 · 3.7k 阅读

1 ·

CC 4.0 BY-SA版权

在搭建Spark高可用(HA)环境时遇到'Exception in thread "main" java.net.BindException: 无法指定被请求的地址: Service 'sparkMaster' failed'错误。解决方法是注释掉spark-env.sh配置文件中的SPARK_MASTER_HOST和SPARK_MASTER_PORT，然后重启服务。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

1、搭建 Spark 的HA环境时报如下错误

Spark Command: /root/training/jdk1.8.0_144/bin/java -cp /root/training/spark-2.1.0-bin-hadoop2.7/conf/:/root/training/spark-2.1.0-bin-hadoop2.7/jars/* -Xmx1g org.apache.spark.deploy.master.Master --host bigdata12 --port 7077 --webui-port 8080
========================================
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
18/05/13 21:17:54 INFO Master: Started daemon with process name: 2696@bigdata13
18/05/13 21:17:54 INFO SignalUtils: Registered signal handler for TERM
18/05/13 21:17:54 INFO SignalUtils: Registered signal handler for HUP
18/05/13 21:17:54 INFO SignalUtils: Registered signal handler for INT
18/05/13 21:17:55 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
18/05/13 21:17:55 INFO SecurityManager: Changing view acls to: root
18/05/13 21:17:55 INFO SecurityManager: Changing modify acls