启动spark-shell报错

最新推荐文章于 2025-03-07 09:23:56 发布

Please_Forgive

最新推荐文章于 2025-03-07 09:23:56 发布

阅读量1.2k

点赞数

文章标签： spark spark-shell 大数据

本文链接：https://blog.youkuaiyun.com/Please_Forgive/article/details/95209170

版权

当使用JDK11尝试启动Spark-Shell时遇到错误。错误信息表明JDK版本过高，需降级到JDK8。通过执行卸载命令移除JDK11，然后安装JDK8，成功解决启动问题。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

错误信息：

[root@HadoopStudy bin]# ./spark-shell 
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.hadoop.security.authentication.util.KerberosUtil (file:/home/zhanghaiping/HadoopApp/hadoop-2.9.2/share/hadoop/common/lib/hadoop-auth-2.9.2.jar) to method sun.security.krb5.Config.getInstance()
WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.security.authentication.util.KerberosUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
2019-07-09 15:31:10 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).

Failed to initialize compiler: object java.lang.Object in compiler mirror not found.
** Note that as of 2.8 scala does not assume use of the java classpath.
** For the old behavior pass -usejavacp to scala, or if using a Settings
** object programmatically, settings.usejavacp.value = true.

Failed to initialize compiler: object java.lang.Object in compiler mirror not found.
** Note that as of 2.8 scala does n

最低0.47元/天解锁文章