本文共 810 字，大约阅读时间需要 2 分钟。

Flume配置文件

a1.sources = r1a1.sinks = k1a1.channels = c1a1.sources.r1.type = avroa1.sources.r1.bind = hadoopa1.sources.r1.port = 44444a1.sinks.k1.type = org.apache.flume.sink.kafka.KafkaSinka1.sinks.k1.topic = enda1.sinks.k1.brokerList = hadoop:9092a1.sinks.k1.batchSize = 20a1.sinks.k1.requiredAcks = 1a1.channels.c1.type = memorya1.sources.r1.channels = c1a1.sinks.k1.channel = c1

启动Flume

flume-ng agent --name a1 --conf $FLUME_HOME/conf --conf-file /opt/flume/flume/conf/avro-memory-kafka.conf -Dflume.root.logger=INFO,console

启动Kafka

kafka-server-start.sh /opt/kafka/kafka/config/server.properties

创建Topic

kafka-topics.sh  --create --zookeeper hadoop:2181 --replication-factor 1 --partitions 1 --topic demo

查看Topic

kafka-topics.sh  --list --zookeeper hadoop:2181

Pom文件，log4j.properties， IDEA application与上篇一致

转载地址：http://sxazi.baihongyu.com/