Hadoop之——hadoop下配置文件说明

Hadoop之——hadoop下配置文件说明

1、文件coer-site.xml

fs.defaultFS hdfs://cluster1 hadoop.tmp.dir /home/tom/yarn/yarn_data/tmp ha.zookeeper.quorum hadoop1:2181,hadoop2:2181,hadoop3:2181,hadoop4:2181,hadoop5:2181

2、文件hdfs-site.xml(重点核心文件)

dfs.replication 2 dfs.permissions false dfs.permissions.enabled false dfs.nameservices cluster1 dfs.ha.namenodes.cluster1 hadoop1,hadoop2 dfs.namenode.rpc-address.cluster1.hadoop1 hadoop1:9000 dfs.ha.automatic-failover.enabled.cluster1 true dfs.namenode.shared.edits.dir qjournal://hadoop1:8485;hadoop2:8485;hadoop3:8485;hadoop4:8485;hadoop5:8485/cluster1 dfs.client.failover.proxy.provider.cluster1 org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider dfs.journalnode.edits.dir /home/tom/yarn/yarn_data/tmp/journal dfs.ha.fencing.methods sshfence dfs.ha.fencing.ssh.private-key-files /home/tom/.ssh/id_rsa dfs.ha.fencing.ssh.connect-timeout 10000 dfs.namenode.handler.count 100

3、文件mapred-site.xml

mapreduce.framework.name yarn

4、文件yarn-site.xml

yarn.resourcemanager.hostname hadoop1 yarn.nodemanager.aux-services mapreduce.shuffle

版权声明：本文内容由网络用户投稿，版权归原作者所有，本站不拥有其著作权，亦不承担相应法律责任。如果您发现本站中有涉嫌抄袭或描述失实的内容，请联系我们jiasou666@gmail.com 处理，核实后本网站将在24小时内删除侵权内容。