Requested user hdfs is not whitelisted and has id 993,which is below the minimum allowed 1000

最新推荐文章于 2023-12-09 11:10:41 发布

原创最新推荐文章于 2023-12-09 11:10:41 发布 · 1k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#mysql #hadoop #spark

sqoop 专栏收录该内容

2 篇文章

订阅专栏

本文介绍了一种在将数据从MySQL导入到HDFS时遇到的错误情况，该错误与Yarn用户id有关，并给出了相应的解决方案，即修改Yarn配置。

将数据从mysql往hdfs导入的时候报错

ailing this attempt.Diagnostics: [2020-11-05 23:11:56.466]Application application_1604581963944_0008 initialization failed (exitCode=255) with output: main : command provided 0
main : run as user is hdfs
main : requested yarn user is hdfs
Requested user hdfs is not whitelisted and has id 993,which is below the minimum allowed 1000

解决方法：是由于Yarn限制了用户id小于1000的用户提交作业
修改yarn配置
在这里插入图片描述
将其修改为0即可