配置Flume的Avro sink

最新推荐文章于 2024-05-19 18:23:00 发布

原创

最新推荐文章于 2024-05-19 18:23:00 发布 · 3.8k 阅读

4 ·

CC 4.0 BY-SA版权

文章标签：

#flume

一配置拓扑

二配置k_avro.conf

#########a1 agent#####
a1.sources = r1
a1.sinks = k1
a1.channels = c1

a1.sources.r1.type = netcat
a1.sources.r1.bind=master
a1.sources.r1.port=8888

a1.channels.c1.type = memory

a1.sinks.k1.type = avro
a1.sinks.k1.hostname = master
a1.sinks.k1.port = 4444

a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

#########a2 agent#####
a2.sources = r1
a2.sinks = k1
a2.channels = c1

a2.sources.r1.type = avro
a2.sources.r1.bind=master
a2.sources.r1.port=4444

a2.channels.c1.type = memory

a2.sinks.k1.type = logger

a2.sources.r1.channels = c1
a2.sinks.k1.channel = c1

三启动a2代理