首页 > 其他 > 详细

【原创】大叔经验分享(46)用户提交任务到yarn报错

时间:2019-03-30 18:12:04      阅读:539      评论:0      收藏:0      [点我收藏+]

用户提交任务到yarn时有可能遇到下面的错误:

Requested user anything is not whitelisted and has id 980,which is below the minimum allowed 1000

这是因为yarn中配置min.user.id=1000,yarn认为id小于1000的是超级用户,yarn禁止超级用户提交任务;

Each account must have a user ID that is greater than or equal to 1000. In the /etc/hadoop/conf/taskcontroller.cfg file, the default setting for the banned.users property is mapred, hdfs, and bin to prevent jobs from being submitted via those user accounts. The default setting for the min.user.id property is 1000 to prevent jobs from being submitted with a user ID less than 1000, which are conventionally Unix super users.

改为更小即可

技术分享图片

然后重启yarn

 

参考:https://community.hortonworks.com/questions/23914/requested-user-hive-is-not-whitelisted-and-has-id.html

 

【原创】大叔经验分享(46)用户提交任务到yarn报错

原文:https://www.cnblogs.com/barneywill/p/10628108.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!