首页 > 其他 > 详细

is running 221518336B beyond the 'VIRTUAL' memory limit. Current usage: 74.0 MB of 1 GB physical memory used; 2.3 GB of 2.1 GB virtual memory used. Killing container.

时间:2021-04-28 14:28:05      阅读:123      评论:0      收藏:0      [点我收藏+]

在编写myjob时,报错:is running 221518336B beyond the ‘VIRTUAL‘ memory limit. Current usage: 74.0 MB of 1 GB physical memory used; 2.3 GB of 2.1 GB virtual memory used. Killing container.
此问题原因是container在申请多余的内存时,被resouremanager杀掉了,
此处可修改hadoop/etc/mapred-site.xml
添加配置信息
<property>
  <name>mapreduce.map.memory.mb</name>
  <value>1536</value>
</property>
<property>
  <name>mapreduce.map.java.opts</name>
  <value>-Xmx1024M</value>
</property>
<property>
  <name>mapreduce.reduce.memory.mb</name>
  <value>3072</value>
</property>
<property>
  <name>mapreduce.reduce.java.opts</name>
  <value>-Xmx2560M</value>
</property>

然后重启整个haodoop模块
重新提交任务

is running 221518336B beyond the 'VIRTUAL' memory limit. Current usage: 74.0 MB of 1 GB physical memory used; 2.3 GB of 2.1 GB virtual memory used. Killing container.

原文:https://www.cnblogs.com/hhaahh/p/14713502.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!