首页 > 系统服务 > 详细

linux上安装hive

时间:2017-02-13 21:48:09      阅读:346      评论:0      收藏:0      [点我收藏+]

安装版本: 1.2.1

安装机器:baseline01

安装过程:

1.登陆baseline01,并登陆mysql,创建hive元数据库及hive用户,并设置字符集为latin1:

# mysql -u root -p

mysql>create database hive_metastore;

mysql>GRANT ALL PRIVILEGES ON hive_metastore.* TO ‘hive‘@‘%‘ IDENTIFIED BY ‘hive‘;

mysql>GRANT ALL PRIVILEGES ON hive_metastore.* TO ‘hive‘@baseline01 IDENTIFIED BY ‘hive‘;

mysql>flush privileges;

mysql>alter database hive_metastore character set latin1;

2.创建hadoop目录,并修改权限:

# su - hadoop

$ hadoop fs -mkdir -p /user/hive/warehouse

$ hadoop fs -chmod 777 /tmp

$ hadoop fs -chmod 777 /user/hive/warehouse

3.将apache-hive-${version}-bin.tar.gz通过tar -zxvf命令解压缩至目的安装目录,并设置软连接:

$ tar -zxvf apache-hive-${version}-bin.tar.gz -C /opt/hadoop

$ ln -s /opt/hadoop/apache-hive-${version}-bin   /opt/hadoop/hive

4.删除hadoop目录中的jline-0.9.94.jar,防止jar冲突(若存在):

$ rm -r /opt/hadoop/hadoop/share/hadoop/yarn/lib/jline-0.9.94.jar

5.在/opt/hadoop/hive/conf目录下添加hive-site.xml,并修改hive-site.xml配置文件:

$ cp hive-default.xml.template hive-site.xml

$ vim hive-site.xml

添加下面内容:(可以将里面的内容全部删除只添加以下内容,我的是追加的形式,不过要修改里面的配置内容。${system-user.name}的值改为hive,${java.io.tmpdir }改为/tmp)

<configuration>

    <property>

        <name>javax.jdo.option.ConnectionURL</name>

        <value>jdbc:mysql://baseline01:3306/hive_metastore?createDatabaseIfNotExist=true</value>

    </property>

    <property>

        <name>javax.jdo.option.ConnectionDriverName</name>

        <value>com.mysql.jdbc.Driver</value>

    </property>

    <property>

        <name>javax.jdo.option.ConnectionUserName</name>

        <value>hive</value>

    </property>

    <property>

        <name>javax.jdo.option.ConnectionPassword</name>

        <value>hive</value>

    </property>

    <property>

        <name>hive.metastore.warehouse.dir</name>

        <value>/user/hive/warehouse</value>

    </property>

    <property>

        <name>hive.querylog.location</name>

        <value>/tmp/hive</value>

    </property>

    <property>

        <name>hive.server2.logging.operation.log.location</name>

        <value>/tmp/hive/operation_logs</value>

    </property>

    <property>

        <name>hive.exec.scratchdir</name>

        <value>/tmp/hive</value>

    </property>

</configuration>

6.确保启动hadoop集群的情况下,切换到hadoop账户

在baseline01上启动hive:

$ nohup /opt/hadoop/hive/bin/hive &

7.启动hiveserver2:

$ nohup /opt/hadoop/hive/bin/hive --service hiveserver2 &

使用beeline工具连接到thrift server

$ /opt/hadoop/hive/bin/beeline -u jdbc:hive2://baseline01:10000

如果连接失败需要拷贝一个jar包到lib目录下mysql-connector-java-5.1.35-bin.jar

8.测试hive基本命令是否正常运行:

hive> create table test(a int);

OK

Time taken: 0.55 seconds

hive> show tables;

OK

Test

Time taken: 0.031 seconds, Fetched: 1 row(s)

hive> desc test;

OK

a                       int                                         

Time taken: 0.157 seconds, Fetched: 1 row(s)

hive> select a from test;

OK

Time taken: 0.14 seconds

hive> drop table test;

OK

Time taken: 0.671 seconds

hive> show tables;

OK

Time taken: 0.032 seconds

如果测试同上,则说明hive安装成功,能够正常运行。

如果报错,

 技术分享

需要修改conf目录下的hive-site.xml文件,将${system:user.name} 换成hive即可

linux上安装hive

原文:http://www.cnblogs.com/wyl9527/p/6395387.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!