idea报错ERROR SparkUI: Failed to bind SparkUI

在尝试绑定多个端口(4048至4056)后,SparkUI服务无法成功绑定到任何端口,导致服务启动失败。错误信息提示可能需要设置特定的SparkUI端口或增加spark.port.maxRetries的重试次数。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4048. Attempting port 4049.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4049. Attempting port 4050.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4050. Attempting port 4051.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4051. Attempting port 4052.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4052. Attempting port 4053.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4053. Attempting port 4054.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4054. Attempting port 4055.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4055. Attempting port 4056.
23/05/08 12:19:25 ERROR SparkUI: Failed to bind SparkUI
java.net.BindException: Failed to bind to /0.0.0.0:4056: Service 'SparkUI' failed after 16 retries (starting from 4040)! Consider explicitly setting the appropriate port for the service 'SparkUI' (for example spark.ui.port for SparkUI) to an available port or increasing spark.port.maxRetries.
    at org.sparkproject.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:349)
    at org.sparkproject.jetty.server.ServerConnector.open(ServerConnector.java:310)
    at org.sparkproject.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
    at org.sparkproject.jetty.server.ServerConnector.doStart(ServerConnector.java:234)
    at org.sparkproject.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
    at org.apache.spark.ui.JettyUtils$.newConnector$1(JettyUtils.scala:302)
    at org.apache.spark.ui.JettyUtils$.httpConnect$1(JettyUtils.scala:333)
    at org.apache.spark.ui.JettyUtils$.$anonfun$startJettyServer$5(JettyUtils.scala:336)
    at org.apache.spark.ui.JettyUtils$.$anonfun$startJettyServer$5$adapted(JettyUtils.scala:336)
    at org.apache.spark.util.Utils$.$anonfun$startServiceOnPort$2(Utils.scala:2331)
    at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:158)
    at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:2323)
    at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:337)
    at org.apache.spark.ui.WebUI.bind(WebUI.scala:146)
    at org.apache.spark.SparkContext.$anonfun$new$11(SparkContext.scala:486)
    at org.apache.spark.SparkContext.$anonfun$new$11$adapted(SparkContext.scala:486)
    at scala.Option.foreach(Option.scala:407)
    at org.apache.spark.SparkContext.<init>(SparkContext.scala:486)
    at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2672)
    at org.apache.spark.sql.SparkSession$Builder.$anonfun$getOrCreate$2(SparkSession.scala:945)
    at scala.Option.getOrElse(Option.scala:189)
    at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:939)
    at com.mm.rdd.WordCount$.main(WordCount.scala:6)
    at com.mm.rdd.WordCount.main(WordCount.scala)
23/05/08 12:19:25 INFO DiskBlockManager: Shutdown hook called
23/05/08 12:19:25 INFO ShutdownHookManager: Shutdown hook called
23/05/08 12:19:25 INFO ShutdownHookManager: Deleting directory C:\Users\刘淦\AppData\Local\Temp\spark-07efe499-e628-4782-8975-da3eabc9fefe\userFiles-fd1732b6-af48-4d65-a451-9ca531500da6
23/05/08 12:19:25 INFO ShutdownHookManager: Deleting directory C:\Users\刘淦\AppData\Local\Temp\spark-07efe499-e628-4782-8975-da3eabc9fefe

Process finished with exit code 1

评论 2
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值