运行程序遇到的问题

最新推荐文章于 2024-12-05 10:01:51 发布

原创

最新推荐文章于 2024-12-05 10:01:51 发布 · 1.2k 阅读

0 ·

CC 4.0 BY-SA版权

在尝试运行Spark程序时，遇到了org.apache.spark.SparkException，具体错误为无法创建数据库default，因为未能创建其目录/user/hive/warehouse。错误的根本原因是权限问题，用户lenovo没有写入权限。这个问题涉及到HDFS的权限管理和Ranger的访问控制。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

py4j.protocol.Py4JJavaError: An error occurred while calling o36.load.

org.apache.spark.SparkException: Unable to create database default as failed to create its directory /user/hive/warehouse
at org.apache.spark.sql.catalyst.catalog.InMemoryCatalog.liftedTree1 $1 (I n M e m o r y C a t a l o g . s c a l a : 115) a t o r g . a p a c h e . s p a r k . s q l . c a t a l y s t . c a t a l o g . I n M e m o r y C a t a l o g . d o C r e a t e D a t a b a s e (I n M e m o r y C a t a l o g . s c a l a : 109) a t o r g . a p a c h e . s p a r k . s q l . c a t a l y s t . c a t a l o g . E x t e r n a l C a t a l o g . c r e a t e D a t a b a s e (E x t e r n a l C a t a l o g . s c a l a : 69) a t o r g . a p a c h e . s p a r k . s q l . i n t e r n a l . S h a r e d S t a t e . e x t e r n a l C a t a l o g$ lzycompute(SharedState.scala:117)
at org.apache.spark.sql.internal.SharedState.externalCatalog(SharedState.scala:102)
at org.apache.spark.sql.internal.BaseSessionStateBuilder.catalog $l z y c o m p u t e (B a s e S e s s i o n S t a t e B u i l d e r . s c a l a : 133) a t o r g . a p a c h e . s p a r k . s q l . i n t e r n a l . B a s e S e s s i o n S t a t e B u i l d e r . c a t a l o g (B a s e S e s s i o n S t a t e B u i l d e r . s c a l a : 131) a t o r g . a p a c h e . s p a r k . s q l . i n t e r n a l . B a s e S e s s i o n S t a t e B u i l d e r$ $anon $1 . < i n i t > (B a s e S e s s i o n S t a t e B u i l d e r . s c a l a : 157) a t o r g . a p a c h e . s p a r k . s q l . i n t e r n a l . B a s e S e s s i o n S t a t e B u i l d e r . a n a l y z e r (B a s e S e s s i o n S t a t e B u i l d e r . s c a l a : 157) a t o r g . a p a c h e . s p a r k . s q l . i n t e r n a l . B a s e$