首页 > 其他 > 详细

使用ambari离线安装Hadoop集群

时间:2015-12-02 02:08:47      阅读:594      评论:0      收藏:0      [点我收藏+]

准备工作:(系统centos6) (推荐java1.7以上版本)

?

每台机器安装:

? #yum install -y mesa-libGL.i686

? #yum install openssl

???? [安装时遇到openssl问题# rpm -qa|grep openssl

???? # rpm -e openssl-1.0.1e-15.el6.x86_64

???? # rpm -Uvh openssl-devel-1.0.0-27.z.2.ec1.gf.el6.x86_64.rpm]

#yum install nc

#yum install redhat-lsb

#yum install gcc

#yum install python-devel

#yum install python-libs

? 关闭?Linux??THP?服务(#centos6)

? # echo transparent_hugepage=never >> /etc/grub.conf

? #echo never > /sys/kernel/mm/redhat_transparent_hugepage/enabled

? #yum install ntp

? # chkconfig ntpd on && service ntpd start

? (失败vim /etc/ntp.conf? 添加ntpd_enable="YES")

关闭?SELinux?服务,关闭防火墙,

#chkconfig iptables off && service iptables stop && setenforce 0

修改/etc/selinux/config文件中的SELINUX="" disabled

? # mkdir -p /var/lib/ambari-agent/data

? #date –s 2015-12-01 17:36校准时间

? #/etc/init.d/sshd restart

? #yum clean all && yum makecache

?

?

第一台机器安装:

? #yum install createrepo (安装??createrepo?,用于制作本地源)

?

? 配置环境:httpd?服务

? #vi /etc/httpd/conf/httpd.conf

? ??#ServerName??www.example.com?:80??修改为?ServerName?hostname:80

修改访问权限:

<Directory />

? Options FollowSymLinks

? AllowOverride None

</Directory>

启动?httpd?服务

#chkconfig httpd on && service httpd start

?

下载?HDP???HDP-UTILS??

#wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.0.0/hdp.repo -O /etc/yum.repos.d/hdp.repo

#同步

#Yum repolist

???? #reposync -r HDP-2.3.2.0

#reposync -r HDP-UTILS-1.1.0.20

下载?Amabri?

# wget -nv http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.1.2.1/ambari.repo -O /etc/yum.repos.d/ambari.repo

#同步

#yum repolist

? # reposync -r Updates-ambari-2.1.2.1

/etc/yum.repo.d文件夹中添加一个 ambari.repo文件,内容如下:

[ambari]

name=ambari repo

baseurl=http://192.168.145.138/ambari

gpgcheck=0

enabled=1

# mkdir /var/www/html/ambari

把上面下载的文件夹移动到abmari

#createrepo /var/www/html/ambari

#yum clean all && yum makecache

# yum install ambari-server

#ambari-server setup

# ambari-server start

?

1.准备至少3台机器, 依次配置每台机器的主机名,第一台机器同时作为yum本地源

配置主机名3

1.#hostname hdp1

2.# vim /etc/sysconfig/network

? HOSTNAME=hdp1

3.# vim /etc/hosts

192.168.144.63 hdp1

192.168.144.64 hdp2

192.168.144.70 hdp3

2.设置hdp1免密码登陆hdp2,hdp3

? hdp1上执行:

? #ssh-keygen?-t?rsa 3次回车)

? # scp?~/.ssh/id_rsa.pub?root@hyj1:~/

? # scp?~/.ssh/id_rsa.pub?root@hyj2:~/

? # scp?~/.ssh/id_rsa.pub?root@hyj3:~/

? 每台机器上执行:

? #vim /etc/ssh/sshd_config? (打开下面3行的注释)

???? ? RSAAuthentication?yes

PubkeyAuthentication?yes

AuthorizedKeysFile??????.ssh/authorized_keys

? # cat?~/id_rsa.pub?>>?~/.ssh/authorized_keys??

?

3.访问hdp1:8080安装

注意:

Select Stack> Advanced Repository Options指定本地源

? 安装ambari-agent选择的sshkeyid_rsa

? #mkdir /var/lib/ambari-agent/data

? 安装agent报错

? vi /etc/ambari-agent/conf/ambari-agent.ini

[server]

hostname=<your.ambari.server.hostname>

url_port=8440

secured_url_port=8441

?

ambari重新部署hadoop删除脚本

#!/bin/sh

?

echo "start del dir"

?

rm -rf /var/lib/hadoop-yarn

rm -rf /var/lib/hadoop-mapreduce

rm -rf /etc/hadoop

rm -rf /etc/hbase

rm -rf /etc/zookeeper

rm -rf /var/run/hadoop

rm -rf /var/run/hbase

rm -rf /var/run/zookeeper

rm -rf /var/log/hadoop

rm -rf /var/log/hbase

rm -rf /var/log/zookeeper

rm -rf /usr/lib/flume

rm -rf /usr/lib/storm

rm -rf /var/lib/hadoop-hdfs

rm -rf /tmp/hadoop-hdfs

rm -rf /hadoop/hbase

?

echo "start del user"

?

userdel hadoop

userdel hbase

userdel ambari-qa

userdel zookeeper

userdel hdfs

userdel ams

userdel yarn

userdel mapred

?

echo "complete"

?

使用ambari离线安装Hadoop集群

原文:http://wuneng94zui.iteye.com/blog/2260788

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!