yarn集群配置
yarn集群中有两个角色:
主节点:Resource Manager 1台
从节点:Node Manager N台
Resource Manager一般安装在一台专门的机器上
Node Manager应该与HDFS中的data node重叠在一起
1.vim yarn-site.xml
<property>
<name>yarn.resourcemanager.hostname</name>
<value>pengyy22</value>
</property>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>2048</value>
</property>
<property>
<name>yarn.nodemanager.resource.cpu-vcores</name>
<value>2</value>
</property>
2.远程复制
scp yarn-site.xml pengyy42:$PWD
scp yarn-site.xml pengyy43:$PWD
scp yarn-site.xml pengyy44:$PWD
3.启动、停止 yarn (yarn启动要在 resourcemanager 服务器上开启)
start-yarn.sh
stop-yarn.sh
原文:https://www.cnblogs.com/pengyy/p/11318256.html