【error】SparkUI端口被占用

drl_blogs

于 2019-07-02 14:35:00 发布

阅读量1.8k

点赞数

CC 4.0 BY-SA版权

分类专栏： # Spark # Error

本文链接：https://blog.youkuaiyun.com/drl_blogs/article/details/94441210

当Spark任务启动时，SparkUI默认使用4040端口，若被占用会尝试递增端口，最多重试16次。超过次数会导致任务失败。解决办法是在创建SparkConf时设置`spark.port.maxRetries`参数为更高值，如100，以增加重试连接端口的次数。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

 ERROR ui.SparkUI: Failed to bind SparkUI
java.net.BindException: Address already in use: bind: Service 'SparkUI' failed after 16 retries (starting from 4040)! Consider explicitly setting the appropriate port for the service 'SparkUI' (for example spark.ui.port for SparkUI) to an available port or increasing spark.port.maxRetries.
	at sun.nio.ch.Net.bind0(Native Method)
	at sun.nio.ch.Net.bind(Net.java:433)
	at sun.nio.ch.Net.bind(Net.java:425)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
	at org.spark_project.jetty.server.ServerConnector.open(ServerConnector.java:317)
	at org.spark_project.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
	at org.spark_project.jetty.server.ServerConnector.doStart(ServerConnector.java:235)
	at org.spark_project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
	at org.apache.spark.ui.JettyU