Spark报错-java.lang.SecurityException: Invalid signature file digest for Manifest main attributesrk

最新推荐文章于 2024-03-20 13:47:29 发布

原创最新推荐文章于 2024-03-20 13:47:29 发布 · 417 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#Spark报错 #java.lang.SecurityException #Invalid signature file digest for #Manifest main attributesrk

报错专栏收录该内容

21 篇文章

订阅专栏

本文探讨了在使用Java和Apache Spark进行应用部署时遇到的安全异常问题，详细解析了SecurityException错误及其根源——无效的签名文件摘要。文章提供了具体解决方案，包括如何定位并移除引起异常的META-INF目录下的特定文件。

Issue

Exception in thread "main" java.lang.SecurityException: Invalid signature file digest for Manifest main attributes
	at sun.security.util.SignatureFileVerifier.processImpl(SignatureFileVerifier.java:284)
	at sun.security.util.SignatureFileVerifier.process(SignatureFileVerifier.java:238)
	at java.util.jar.JarVerifier.processEntry(JarVerifier.java:316)
	at java.util.jar.JarVerifier.update(JarVerifier.java:228)
	at java.util.jar.JarFile.initializeVerifier(JarFile.java:383)
	at java.util.jar.JarFile.getInputStream(JarFile.java:450)
	at sun.misc.JarIndex.getJarIndex(JarIndex.java:137)
	at sun.misc.URLClassPath$JarLoader$1.run(URLClassPath.java:675)
	at sun.misc.URLClassPath$JarLoader$1.run(URLClassPath.java:667)
	at java.security.AccessController.doPrivileged(Native Method)
	at sun.misc.URLClassPath$JarLoader.ensureOpen(URLClassPath.java:666)
	at sun.misc.URLClassPath$JarLoader.<init>(URLClassPath.java:639)
	at sun.misc.URLClassPath$3.run(URLClassPath.java:366)
	at sun.misc.URLClassPath$3.run(URLClassPath.java:356)
	at java.security.AccessController.doPrivileged(Native Method)
	at sun.misc.URLClassPath.getLoader(URLClassPath.java:355)
	at sun.misc.URLClassPath.getLoader(URLClassPath.java:332)
	at sun.misc.URLClassPath.getResource(URLClassPath.java:198)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:364)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:340)
	at org.apache.spark.util.Utils$.classForName(Utils.scala:238)
	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:810)
	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

Answer

原因：打成jar包时存在META-INF/*.RSA META-INF/*.DSA META-INF/*.SF 文件

解决办法：删除META-INF/*.RSA META-INF/*.DSA META-INF/*.SF 文件

zip -d XXX.jar META-INF/*.RSA META-INF/*.DSA META-INF/*.SF

结果
在这里插入图片描述