您好,登錄后才能下訂單哦!
這篇文章主要介紹了如何使用Python Impyla客戶端連接Hive和Impala,具有一定借鑒價值,感興趣的朋友可以參考下,希望大家閱讀完這篇文章之后大有收獲,下面讓小編帶著大家一起了解一下。
使用hive模塊
pip install sasl
pip install thrift
pip install thrift-sasl
pip install PyHive
[root@ip-172-31-40-242 ~]#
more testpyhive.py
from pyhive import hive
conn
=
hive.Connection(host='xxxxxxx',
port=10000,
database='collection',username='')
cursor=conn.cursor()
cursor.execute('select * from tb_partition limit 10')
for
result
in
cursor.fetchall():
print result
[root@ip-172-31-40-242 ~]# python testpyhive.py
(u'1', u'2', u'201707')
(u'1', u'2', u'201707')
(u'123', None, u'201709')
(u'123', u'456', u'201709')
(u'45678', u'456', u'201709')
(u'123', None, u'201709')
(u'123', u'456', u'201709')
(u'45678', u'456', u'201709')
(u'123', None, u'201709')
(u'123', u'456', u'201709')
官方API:
https://pypi.org/project/PyHive/
# -*- coding:utf-8 -*- from impala.dbapi import connect conn = connect(host='172.31.46.109',port=10000,database='collection',auth_mechanism='PLAIN') print(conn) cursor = conn.cursor() # param = '''SET hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; SET hive.support.concurrency=true; ''' cursor.execute(param) cursor.execute('SELECT uid FROM redefine_collection where uid=4028 limit 10') print cursor.description # prints the result set's schema results = cursor.fetchall() print results # # Python連接Impala(ImpalaTest.py) # # from impala.dbapi importconnect # # conn = connect(host='ip-172-31-26-80.ap-southeast-1.compute.internal',port=21050) # # print(conn) # # cursor = conn.cursor() # # cursor.execute('show databases') # # print cursor.description # prints the result set's schema # # results = cursor.fetchall() # # print(results) # # cursor.execute('SELECT * FROM test limit 10') # # print cursor.description # prints the result set's schema # # results = cursor.fetchall() # # print(results)
感謝你能夠認(rèn)真閱讀完這篇文章,希望小編分享的“如何使用Python Impyla客戶端連接Hive和Impala”這篇文章對大家有幫助,同時也希望大家多多支持億速云,關(guān)注億速云行業(yè)資訊頻道,更多相關(guān)知識等著你來學(xué)習(xí)!
免責(zé)聲明:本站發(fā)布的內(nèi)容(圖片、視頻和文字)以原創(chuàng)、轉(zhuǎn)載和分享為主,文章觀點(diǎn)不代表本網(wǎng)站立場,如果涉及侵權(quán)請聯(lián)系站長郵箱:is@yisu.com進(jìn)行舉報,并提供相關(guān)證據(jù),一經(jīng)查實,將立刻刪除涉嫌侵權(quán)內(nèi)容。