idea报错ERROR SparkUI: Failed to bind SparkUI

原创已于 2023-05-08 15:35:58 修改 · 674 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#intellij-idea #java #jvm

于 2023-05-08 15:35:10 首次发布

在尝试绑定多个端口（4048至4056）后，SparkUI服务无法成功绑定到任何端口，导致服务启动失败。错误信息提示可能需要设置特定的SparkUI端口或增加spark.port.maxRetries的重试次数。

23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4048. Attempting port 4049.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4049. Attempting port 4050.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4050. Attempting port 4051.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4051. Attempting port 4052.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4052. Attempting port 4053.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4053. Attempting port 4054.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4054. Attempting port 4055.
23/05/08 12:19:25 WARN Utils: Service 'SparkUI' could not bind on port 4055. Attempting port 4056.
23/05/08 12:19:25 ERROR SparkUI: Failed to bind SparkUI
java.net.BindException: Failed to bind to /0.0.0.0:4056: Service 'SparkUI' failed after 16 retries (starting from 4040)! Consider explicitly setting the appropriate port for the service 'SparkUI' (for example spark.ui.port for SparkUI) to an available port or increasing spark.port.maxRetries.
   at org.sparkproject.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:349)
   at org.sparkproject.jetty.server.ServerConnector.open(ServerConnector.java:310)
   at org.sparkproject.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
   at org.sparkproject.jetty.server.ServerConnector.doStart(ServerConnector.java:234)
   at org.sparkproject.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
   at org.apache.spark.ui.JettyUtils$.newConnector$1(JettyUtils.scala:302)
   at org.apache.spark.ui.JettyUtils$.httpConnect$1(JettyUtils.scala:333)
   at org.apache.spark.ui.JettyUtils$.$anonfun$startJettyServer$5(JettyUtils.scala:336)
   at org.apache.spark.ui.JettyUtils$.$anonfun$startJettyServer$5$adapted(JettyUtils.scala:336)
   at org.apache.spark.util.Utils$.$anonfun$startServiceOnPort$2(Utils.scala:2331)
   at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:158)
   at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:2323)
   at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:337)
   at org.apache.spark.ui.WebUI.bind(WebUI.scala:146)
   at org.apache.spark.SparkContext.$anonfun$new$11(SparkContext.scala:486)
   at org.apache.spark.SparkContext.$anonfun$new$11$adapted(SparkContext.scala:486)
   at scala.Option.foreach(Option.scala:407)
   at org.apache.spark.SparkContext.<init>(SparkContext.scala:486)
   at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2672)
   at org.apache.spark.sql.SparkSession$Builder.$anonfun$getOrCreate$2(SparkSession.scala:945)
   at scala.Option.getOrElse(Option.scala:189)
   at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:939)
   at com.mm.rdd.WordCount$.main(WordCount.scala:6)
   at com.mm.rdd.WordCount.main(WordCount.scala)
23/05/08 12:19:25 INFO DiskBlockManager: Shutdown hook called
23/05/08 12:19:25 INFO ShutdownHookManager: Shutdown hook called
23/05/08 12:19:25 INFO ShutdownHookManager: Deleting directory C:\Users\刘淦\AppData\Local\Temp\spark-07efe499-e628-4782-8975-da3eabc9fefe\userFiles-fd1732b6-af48-4d65-a451-9ca531500da6
23/05/08 12:19:25 INFO ShutdownHookManager: Deleting directory C:\Users\刘淦\AppData\Local\Temp\spark-07efe499-e628-4782-8975-da3eabc9fefe

Process finished with exit code 1