您好,登錄后才能下訂單哦!
centos8中怎么構(gòu)建一個(gè)hadoop集群,針對(duì)這個(gè)問(wèn)題,這篇文章詳細(xì)介紹了相對(duì)應(yīng)的分析和解答,希望可以幫助更多想解決這個(gè)問(wèn)題的小伙伴找到更簡(jiǎn)單易行的方法。
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.1.107 dsj2020master 192.168.1.108 dsj2020slave1 192.168.1.109 dsj2020slave2
NETWORKING=yes HOSTNAME=master
BOOTPROTO=static ONBOOT=yes IPADDR=192.168.1.101 NETMASK=255.255.255.0 GATEWAY=192.168.1.1
nmcli c reload
wget https://repo.huaweicloud.com/java/jdk/8u201-b09/jdk-8u201-linux-x64.rpm
rpm -ivh jdk-8u201-linux-x64.rpm
wget https://mirrors.tuna.tsinghua.edu.cn/apache/hadoop/common/hadoop-2.9.2/hadoop-2.9.2.tar.gz
tar -zxvf hadoop-2.9.2.tar.gz
mv hadoop-2.9.2.tar.gz hadoop
##########
export HADOOP_HOME=/home/user1/software/hadoop export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
cd /soft/hadoop/etc/hadoop/ -- 編輯core-site.xml <configuration> <property> <name>fs.defaultFS</name> <value>hdfs://master:9000</value> </property> </configuration> -- 編輯hdfs-site.xml <configuration> <property> <name>dfs.replication</name> <value>3</value> </property> </configuration>
-- 編輯 slaves 文件 dsj2020master dsj2020slave1 dsj2020slave2 -- 復(fù)制 mapred-site.xml.template cp mapred-site.xml.template mapred-site.xml -- 編輯mapred-site.xml <configuration> <property> <name>mapreduce.framework.name</name> <value>yarn</value> </property> </configuration> -- 編輯yarn-site.xml <configuration> <property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property> <property> <name>yarn.resourcemanager.resource-tracker.address</name> <value>master</value> </property> </configuration>
JAVA_HOME=/soft/bin
scp -r hadoop user2@slave1:~/software/
ssh-keygen -t rsa ssh-copy-id user@master ssh-copy-id user@slave1 ssh-copy-id user@slave2
JAVA_HOME=/root/jdk JRE_HOME=/root/jdk/jre CLASSPATH=.:$JAVA_HOME/lib:/dt.jar:$JAVA_HOME/lib/tools.jar PATH=$PATH:$JAVA_HOME/bin
server.1=dsj2020master:2888:3888 server.2=dsj2020slave1:2888:3888 server.3=dsj2020slave2:2888:3888
關(guān)于centos8中怎么構(gòu)建一個(gè)hadoop集群?jiǎn)栴}的解答就分享到這里了,希望以上內(nèi)容可以對(duì)大家有一定的幫助,如果你還有很多疑惑沒(méi)有解開(kāi),可以關(guān)注億速云行業(yè)資訊頻道了解更多相關(guān)知識(shí)。
免責(zé)聲明:本站發(fā)布的內(nèi)容(圖片、視頻和文字)以原創(chuàng)、轉(zhuǎn)載和分享為主,文章觀點(diǎn)不代表本網(wǎng)站立場(chǎng),如果涉及侵權(quán)請(qǐng)聯(lián)系站長(zhǎng)郵箱:is@yisu.com進(jìn)行舉報(bào),并提供相關(guān)證據(jù),一經(jīng)查實(shí),將立刻刪除涉嫌侵權(quán)內(nèi)容。