您好,登錄后才能下訂單哦!
這篇文章主要介紹Hive如何安裝、配置及基礎(chǔ)使用,文中介紹的非常詳細(xì),具有一定的參考價(jià)值,感興趣的小伙伴們一定要看完!
此主題介紹Hive的安裝、配置及基礎(chǔ)使用。
Hive基本信息
官網(wǎng):http://hive.apache.org/
# 切換到工作空間 cd /opt/workspaces # 創(chuàng)建Hive數(shù)據(jù)目錄 mkdir data/hive # 創(chuàng)建Hive日志目錄 mkdir logs/hive
wget http://mirrors.cnnic.cn/apache/hive/hive-1.2.1/apache-hive-1.2.1-bin.tar.gz tar -zxf apache-hive-1.2.1-bin.tar.gz rm -rf apache-hive-1.2.1-bin.tar.gz mv apache-hive-1.2.1-bin ./frameworks/hive
vi ~/.profile
export HIVE_HOME=/opt/workspaces/frameworks/hive export PATH=$PATH:$HIVE_HOME/bin
source ~/.profile
配置Mysql
mysql -u root -p create database hive; grant all on *.* to'hive'@'%' identified by 'hive'; #賬號(hào)hive,密碼hive,所有IP都可以訪問(%) flush privileges; exit;
創(chuàng)建HDFS目錄
./frameworks/hadoop/bin/hadoop fs -mkdir /tmp ./frameworks/hadoop/bin/hadoop fs -mkdir -p /user/hive/warehouse ./frameworks/hadoop/bin/hadoop fs -chmod 777 /tmp ./frameworks/hadoop/bin/hadoop fs -chmod 777 /user/hive/warehouse
修改Hive配置
cat>./frameworks/hive/conf/hive-env.sh<<EOF export HADOOP_HEAPSIZE=1024 HADOOP_HOME=/opt/workspaces/frameworks/hadoop export HIVE_CONF_DIR=/opt/workspaces/frameworks/hive/conf export HIVE_AUX_JARS_PATH=/opt/workspaces/frameworks/hive/lib EOF cat>./frameworks/hive/conf/hive-site.xml<<EOF <configuration> <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://`<Docker Host IP>`:3306/hive</value> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>hive</value> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>hive</value> </property> <property> <name>hive.metastore.uris</name> <value>thrift://bd:9083</value> </property> <property> <name>hive.exec.local.scratchdir</name> <value>/opt/workspaces/data/hive</value> </property> <property> <name>hive.downloaded.resources.dir</name> <value>/opt/workspaces/data/hive</value> </property> <property> <name>hive.querylog.location</name> <value>/opt/workspaces/data/hive</value> </property> <property> <name>hive.server2.logging.operation.log.location</name> <value>/opt/workspaces/data/hive</value> </property> <property> <name>hive.querylog.location</name> <value>/opt/workspaces/frameworks/logs/hive</value> </property> <property> <name>hive.metastore.schema.verification</name> <value>false</value> </property> </configuration> EOF
cp ./frameworks/hive/conf/hive-log4j.properties.template ./frameworks/hive/conf/hive-log4j.properties
vi ./frameworks/hive/conf/hive-log4j.properties
hive.log.dir=/opt/workspaces/frameworks/logs/hive
下載mysql驅(qū)動(dòng)
wget -P ./frameworks/hive/lib http://central.maven.org/maven2/mysql/mysql-connector-java/5.1.36/mysql-connector-java-5.1.36.jar
測(cè)試發(fā)現(xiàn)5.1.38 需要使用SSL連接,可設(shè)置jdbc://…&userSSL=false 禁用 |
nohup ./frameworks/hive/bin/hive --service metastore >/dev/null 2>&1 &
cat>test_person.txt<<EOF tom 20 jack 24 nestor 29 EOF ./frameworks/hadoop/bin/hdfs dfs -mkdir /tmp/hivetest/ ./frameworks/hadoop/bin/hdfs dfs -put ./test_person.txt /tmp/hivetest/ ./frameworks/hive/bin/hive CREATE EXTERNAL TABLE test_person(name STRING,age INT)ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' LOCATION '/tmp/hivetest'; select * from test_person;
以上是“Hive如何安裝、配置及基礎(chǔ)使用”這篇文章的所有內(nèi)容,感謝各位的閱讀!希望分享的內(nèi)容對(duì)大家有幫助,更多相關(guān)知識(shí),歡迎關(guān)注億速云行業(yè)資訊頻道!
免責(zé)聲明:本站發(fā)布的內(nèi)容(圖片、視頻和文字)以原創(chuàng)、轉(zhuǎn)載和分享為主,文章觀點(diǎn)不代表本網(wǎng)站立場(chǎng),如果涉及侵權(quán)請(qǐng)聯(lián)系站長(zhǎng)郵箱:is@yisu.com進(jìn)行舉報(bào),并提供相關(guān)證據(jù),一經(jīng)查實(shí),將立刻刪除涉嫌侵權(quán)內(nèi)容。