首页 > 编程语言 > 详细

python 读取hive数据

时间:2019-03-31 16:51:20      阅读:2174      评论:0      收藏:0      [点我收藏+]

话不多说,直接上代码

from pyhive import hive
import datetime as dt
def pyhive(hql):
    conn = hive.Connection(host=‘HiveServer2 host, port=10000, database=ods)
    cursor = conn.cursor()
    cursor.execute(hql)
    for result in cursor.fetchall():
        return result

 

部署时遇到一个问题:

Traceback (most recent call last):
  File "test_pyhive.py", line 7, in <module>
    from pyhive import hive
  File "/usr/lib/python2.7/site-packages/pyhive/hive.py", line 15, in <module>
    from TCLIService import TCLIService
  File "/usr/lib/python2.7/site-packages/TCLIService/TCLIService.py", line 9, in <module>
    from thrift.Thrift import TType, TMessageType, TFrozenDict, TException, TApplicationException
ImportError: cannot import name TFrozenDict

解决方法是:

原因是某些包没有关联上,装包时,加上[hive]后缀

pip install pyhive[hive]

 

python 读取hive数据

原文:https://www.cnblogs.com/drjava/p/10631975.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!