flume 搜集A 服务器 的日志到B 服务器

flume 搜集A 服务器 的日志到B 服务器

就是服务器A的Sink 类型是AVRO， 而 服务器 B的Source 是AVRO

1.服务器A的配置

# Define a memory channel called ch1 on agent1agent1.channels.ch1.type = memoryagent1.channels.ch1.capacity = 1000agent1.channels.ch1.transactionCapacity = 100 agent1.sources.exec-source1.channels = ch1agent1.sources.exec-source1.type = execagent1.sources.exec-source1.command = tail -F /Users/walle/Documents/D2/testflume.log # Define a logger sink that simply logs all events it receives# and connect it to the other end of the same channel.agent1.sinks.avro-sink1.channel = ch1agent1.sinks.avro-sink1.type = avroagent1.sinks.avro-sink1.hostname = localhostagent1.sinks.avro-sink1.port = 44445 # Finally, now that we've defined all of our components, tell# agent1 which ones we want to activate.agent1.channels = ch1agent1.sources = exec-source1agent1.sinks = avro-sink1

2.服务器B的配置

# Define a memory channel called ch1 on agent1agent2.channels.ch2.type = memoryagent2.channels.ch2.capacity = 1000agent2.channels.ch2.transactionCapacity = 100 # Define an Avro source called avro-source1 on agent1 and tell it# to bind to 0.0.0.0:41414. Connect it to channel ch1.agent2.sources.avro-source1.channels = ch2agent2.sources.avro-source1.type = avroagent2.sources.avro-source1.bind = localhostagent2.sources.avro-source1.port = 44445 # Define a logger sink that simply logs all events it receives# and connect it to the other end of the same channel.agent2.sinks.log-sink1.channel = ch2agent2.sinks.log-sink1.type = logger # Finally, now that we've defined all of our components, tell# agent1 which ones we want to activate.agent2.channels = ch2agent2.sources = avro-source1agent2.sinks = log-sink1

版权声明：本文内容由网络用户投稿，版权归原作者所有，本站不拥有其著作权，亦不承担相应法律责任。如果您发现本站中有涉嫌抄袭或描述失实的内容，请联系我们jiasou666@gmail.com 处理，核实后本网站将在24小时内删除侵权内容。