【Hadoop HA】搭建Hadoop HA的详细教程

【Hadoop HA】搭建Hadoop HA的详细教程

搭建Hadoop HA的详细教程

​​前置工作​​

​​配置host文件​​​​ssh免密登录​​​​JDK的配置​​

​​ZooKeeper配置​​​​Hadoop HA配置文件​​

​​core-site.xml​​​​hdfs-site.xml​​​​mapred-site.xml​​​​yarn-site.xml​​​​启动与测试​​

前置工作

配置host文件

在每个节点的​​/etc/hosts​​文件下加入

192.168.3.73 master192.168.3.66 slave1192.168.3.61 slave2

确保可以相互​​ping​​通

[root@host-192-168-3-73 ~]# ping slave1PING slave1 (192.168.3.66) 56(84) bytes of data.64 bytes from slave1 (192.168.3.66): icmp_seq=1 ttl=64 time=0.589 ms64 bytes from slave1 (192.168.3.66): icmp_seq=2 ttl=64 time=0.476 ms64 bytes from slave1 (192.168.3.66): icmp_seq=3 ttl=64 time=0.490 ms64 bytes from slave1 (192.168.3.66): icmp_seq=4 ttl=64 time=0.528 ms^C--- slave1 ping statistics ---4 packets transmitted, 4 received, 0% packet loss, time 3001msrtt min/avg/max/mdev = 0.476/0.520/0.589/0.051 ms

​​跳转顶部​​

ssh免密登录

执行命令​​ssh-keygen -t rsa -P ''​​，然后回车即可

[root@host-192-168-3-73 ~]# ssh-keygen -t rsa -P ''Generating public/private rsa key pair.Enter file in which to save the key (/root/.ssh/id_rsa): Created directory '/root/.ssh'.Your identification has been saved in /root/.ssh/id_rsa.Your public key has been saved in /root/.ssh/id_rsa.pub.The key fingerprint is:SHA256:MtzaPUXxJdLDLcvwLxQqWH7HQkr20m7rUgL48IF9f/U root@host-192-168-3-73The key's randomart image is:+---[RSA 2048]----+| oo...|| + o+*o.|| + * =.*.= || .+.= *.* B .|| ++S+ *.+ o.|| =o...= o E|| . . o+ o . || ... || o. |+----[SHA256]-----+

查看​​/root​​下是否有"​​.ssh​​"文件夹，且"​​.ssh​​"文件下是否有两个刚生产的无密码密钥对。,因为我是使用​​root​​用户来配置的，所以在这目录下，若你使用的时其他用户，则需要在​​/home/User​​目录下寻找​​.ssh​​目录

[root@master .ssh]# pwd/root/.ssh[root@master .ssh]# lltotal 8-rw-------. 1 root root 1675 Mar 16 16:02 id_rsa-rw-r--r--. 1 root root 393 Mar 16 16:02 id_rsa.pub

将 ​​id_rsa.pub ​​追加到授权​​key​​文件中

cat id_rsa.pub >> authorized_keys

修改文件权限，若使用的时管理员用户则不需要

chmod 600 authorized_keys

修改​​SSH​​ 配置文件"​​/etc/ssh/sshd_config​​"的下列内容，需要将该配置字段前面的​​#​​号删除，启用公钥私钥配对认证方式。

PubkeyAuthentication yes

重启服务

systemctl restart sshd

尝试本机嵌套登录，如能不输入密码就表示本机通过密钥登陆验证成功

[root@master .ssh]# ssh localhostThe authenticity of host 'localhost (::1)' can't be established.ECDSA key fingerprint is SHA256:Hr69gEn5JbaH3pZPvyJ9qhzyCzPYIyleYQyqA+vPz3U.ECDSA key fingerprint is MD5:f6:f4:9e:7d:c5:b1:8f:68:db:a3:49:66:05:6e:e4:c4.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added 'localhost' (ECDSA) to the list of known hosts.Last login: Wed Mar 16 15:41:55 2022 from 192.168.0.1

将 ​​Master​​ 节点的公钥​​ id_rsa.pub​​ 复制到每个 ​​Slave ​​点，注意不要复制到相同目录下，否则会直接覆盖，建议放到前一个目录

scp id_rsa.pub root@slave1:/root/

[root@master .ssh]# scp id_rsa.pub root@slave1:/root/The authenticity of host 'slave1 (192.168.0.163)' can't be established.ECDSA key fingerprint is SHA256:HCyXDBNPToF3n/6WgB/Sj8M9z3IHaGy8CRVTJY6YqQs.ECDSA key fingerprint is MD5:2e:16:4d:94:00:05:ff:c5:8e:13:08:6a:6a:a9:02:f8.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added 'slave1,192.168.0.163' (ECDSA) to the list of known hosts.root@slave1's password: id_rsa.pub 100% 393 314.0KB/s 00:00

在每个​​Slave ​​点把 ​​Master​​ 节点复制的公钥复制到 ​​authorized_keys ​​文件

cat id_rsa.pub >> .ssh/authorized_keys

删除文件

rm -fr id_rsa.pub

将​​slave1​​的公钥发送到​​master​​

scp .ssh/id_rsa.pub root@master:/root/

The authenticity of host 'master (192.168.0.162)' can't be established.ECDSA key fingerprint is SHA256:Hr69gEn5JbaH3pZPvyJ9qhzyCzPYIyleYQyqA+vPz3U.ECDSA key fingerprint is MD5:f6:f4:9e:7d:c5:b1:8f:68:db:a3:49:66:05:6e:e4:c4.Are you sure you want to continue connecting (yes/no)? yesWarning: Permanently added 'master,192.168.0.162' (ECDSA) to the list of known hosts.root@master's password: id_rsa.pub 100% 393 493.3KB/s 00:00

在 ​​Master​​ 节点把从 ​​Slave​​ 节点复制的公钥复制到 ​​authorized_keys ​​文件

cat id_rsa.pub >> .ssh/authorized_keys

删除文件

rm -fr id_rsa.pub

查看​​master​​节点的​​authorized_keys​​文件,可以发现有两个公钥

[root@master ~]# cat .ssh/authorized_keys ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIgiraYbUS+wal7gSzx/kpuZ+ZPnE1Tc+u1QVi25i3ZgoBTOFqjTv973xy3ueExn1udYGmhDDB+vXFxNs2AIgXZEoEpgZAz2kcAEJBjkXT0p8sYXgaliMMFNP8dwiJTCs/YIDol+KIIkIwa3WbQoVEc1zQH1+Xr1Rto1IgLXPRgXO3IMfmX7nqc2ZMdBt0OaPDf2NtBI3e/QDEa59f6J+ge4r8MPuc9C51MeU6NPr20A99Psy1Jbvrr7/Fb2pLxnfne50+4DYjsGPztOgHuQFWoAQ+LDUW6Xhbs5Ig8bUEHt1AILwyNwagJvcsGIvp3wOQt+HRHxJCoAjgPeFsFwJF root@masterssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoPA9uCf/PmUgbpmbPF13VvIwJiSHqAVIpffylbk2g+mEJQMnLxmYv4AVsdc3Wjul2rUMoQh4RPeMFFFincrYFN88DA6SF0F9ZNQOy+6p7CWxLd24hrsn7J69Pab0HxIlMAng8zKjAxZKAOBWyih1nJzqf3UHNdAeZkoe8MbNf6jTXM67vGa0V0FUFU/GvX6st8fLDbROKB8kh1N2X/qLNFiDgxY3Vm1rgN4cDGhs/UqugOHgwnvUScUkjoDQyGn/vYfgHxThHoF+Dv57Xa+bjyUbMmIQYgH7xR/V25F3iU6no3P0LmWsVc4uTTZwdcsPpxMcAfDFL+u5cnivtKrdj root@slave1

这时可以从​​master​​节点来登录​​slave​​

[root@master ~]# ssh slave1Last login: Tue Mar 15 12:18:56 2022 from ::1[root@slave1 ~]#

需要将每一个节点的公钥都交换

​​跳转顶部​​

JDK的配置

将文件解压到指定目录:​​tar -zxvf jdk-8u162-linux-x64.tar.gz -C /home/​​

重命名​​mv jdk1.8.0_162/ jdk​​

配置环境变量:​​vi /etc/profile​​

export JAVA_HOME=/home/jdkexport PATH=$PATH:$JAVA_HOME/bin

使其立即生效

source /etc/profile

测试

[root@host-192-168-3-73 home]# java -versionjava version "1.8.0_162"Java(TM) SE Runtime Environment (build 1.8.0_162-b12)Java HotSpot(TM) 64-Bit Server VM (build 25.162-b12, mixed mode)

将jdk转发

scp -r /home/jdk slave1:/homescp -r /home/jdk slave2:/home

[root@host-192-168-3-73 home]# scp /etc/profile slave1:/etc/profile 100% 1880 1.2MB/s 00:00 [root@host-192-168-3-73 home]# scp /etc/profile slave2:/etc/profile 100% 1880 1.2MB/s 00:00

​​跳转顶部​​

ZooKeeper配置

解压缩:​​tar -zxvf zookeeper-3.4.5.tar.gz -C /home/​​

重命名:​​mv zookeeper-3.4.5/ zookeeper​​

在根目录下创建两个文件夹

mkdir logsmkdir data

加入conf目录，生成文件:​​cp zoo_sample.cfg zoo.cfg​​

并且修改文件

tickTime=2000initLimit=10syncLimit=5dataDir=/home/zookeeper/datadataLogDir=/home/zookeeper/logsclientPort=2181server.1=master:2888:3888server.2=slave1:2889:3889server.3=slave2:2890:3890

分发

scp -r /home/zookeeper/ slave1:/home/scp -r /home/zookeeper/ slave2:/home/

在每个节点的​​zookeeper/data​​目录下写入

echo '1' > data/myidecho '2' > data/myidecho '3' > data/myid

启动:​​bin/zkServer.sh start​​

查看状态

[root@host-192-168-3-73 zookeeper]# bin/zkServer.sh statusJMX enabled by defaultUsing config: /home/zookeeper/bin/../conf/zoo.cfgMode: follower

​​跳转顶部​​

Hadoop HA配置文件

解压缩:​​tar -zxvf hadoop-2.7.7.tar.gz -C /home/​​

创建目录

mkdir logsmkdir tmpmkdir -p dfs/namemkdir -p dfs/data

修改slaves文件

slave1slave2

修改hadoop-env.sh文件

export JAVA_HOME=/home/jdk

core-site.xml

fs.defaultFS hdfs://mycluster hadoop.tmp.dir /home/hadoop/tmp ha.zookeeper.quorum master,slave1,slave2 ha.zookeeper.session-timeout.ms 30000 fs.trash.interval 1440

​​跳转顶部​​

hdfs-site.xml

dfs.replication 1 dfs.namenode.name.dir /home/hadoop/dfs/name dfs.datanode.data.dir /home/hadoop/dfs/data dfs.nameservices mycluster dfs.ha.namenodes.mycluster n1,n2 dfs.namenode.rpc-address.mycluster.n1 master:8020 dfs.namenode.rpc-address.mycluster.n2 slave1:8020 dfs.namenode. master:50070 dfs.namenode. slave1:50070 dfs.namenode.shared.edits.dir qjournal://master:8485;slave1:8485;slave2:8485/mycluster dfs.journalnode.edits.dir /home/hadoop/jn dfs.client.failover.proxy.provider.mycluster org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider dfs.ha.fencing.methods sshfenceshell(/bin/true) dfs.ha.fencing.ssh.private-key-files /root/.ssh/id_rsa dfs.ha.automatic-failover.enabled.mycluster true dfs.ha.fencing.ssh.connect-timeout 30000 ha.failover-controller.cli-check.rpc-timeout.ms 60000 dfs.qjournal.start-segment.timeout.ms 60000

​​跳转顶部​​

mapred-site.xml

mapreduce.framework.name yarn mapreduce.jobhistory.address master:10020 mapreduce.jobhistory.webapp.address master:19888

​​跳转顶部​​

yarn-site.xml

yarn.nodemanager.aux-services mapreduce_shuffle yarn.resourcemanager.ha.enabled true yarn.resourcemanager.cluster-id cluster1 yarn.resourcemanager.ha.rm-ids r1,r2 yarn.resourcemanager.hostname.r1 master yarn.resourcemanager.hostname.r2 slave1 yarn.resourcemanager.webapp.address.r1 master:8088 yarn.resourcemanager.webapp.address.r2 slave1:8088 yarn.resourcemanager.zk-address master,slave1,slave2 yarn.resourcemanager.recovery.enabled true yarn.resourcemanager.store.class org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore yarn.log-aggregation.retain-seconds 86400

​​跳转顶部​​

启动与测试

分发

scp -r /home/hadoop slave1:/homescp -r /home/hadoop slave2:/home

每个节点需要先启动​​journalnode​​

sbin/hadoop-daemon.sh start journalnode

格式化​​namenode​​

bin/hadoop namenode -format

将已格式化的​​namenode​​tmp目录传给另一个​​namenode​​

[root@host-192-168-3-73 hadoop]# scp -r dfs/ slave1:/home/hadoop/VERSION 100% 205 130.7KB/s 00:00 seen_txid 100% 2 1.6KB/s 00:00 fsimage_0000000000000000000.md5 100% 62 68.6KB/s 00:00 fsimage_0000000000000000000 100% 321 270.9KB/s 00:00

或者使用命令:​​bin/namenode -bootstrapStandby​​

格式化zkfc

bin/hdfs zkfc -formatZK

在每个​​namenode​​节点上启动​​zkfc​​

sbin/hadoop-daemon.sh start zkfc

启动集群

sbin/start-all.sh

查看集群的进程

# namenode12752 NameNode2326 JournalNode2568 DFSZKFailoverController1897 QuorumPeerMain3035 ResourceManager3182 Jps# namenode22080 NodeManager2194 Jps1763 JournalNode1861 DFSZKFailoverController1656 QuorumPeerMain1992 DataNode1933 NameNode# datanode1953 NodeManager1866 DataNode1659 QuorumPeerMain2107 Jps1773 JournalNode

查看​​webui​​

杀死活跃的主节点

kill -9 2752

一些命令

# 强制切换成等待bin/hdfs haadmin -transitionToStandby -forcemanual nn1# 强制切换成活跃bin/hdfs haadmin -transitionToActive -forcemanual nn1

​​跳转顶部​​

版权声明：本文内容由网络用户投稿，版权归原作者所有，本站不拥有其著作权，亦不承担相应法律责任。如果您发现本站中有涉嫌抄袭或描述失实的内容，请联系我们jiasou666@gmail.com 处理，核实后本网站将在24小时内删除侵权内容。