Flume 1.6.0 cdh 环境搭建

最新推荐文章于 2020-11-30 22:21:55 发布

梦想小镇的书

最新推荐文章于 2020-11-30 22:21:55 发布

阅读量268

点赞数

文章标签： flume cdh flume config

本文链接：https://blog.youkuaiyun.com/u010412629/article/details/106891309

版权

本文详细介绍了如何在本地环境中部署Flume日志收集系统，包括下载安装包、配置环境变量、设置启动文件等步骤，并提供了启动Flume的命令示例。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

localhost:software hadoop$ wget http://archive.cloudera.com/cdh5/cdh/5/flume-ng-1.6.0-cdh5.7.0.tar.gz
localhost:software hadoop$ tar -zxvf flume-ng-1.6.0-cdh5.7.0.tar.gz -C ../app/
localhost:conf hadoop$ cp flume-env.sh.template flume-env.sh

localhost:conf hadoop$ vi flume-env.sh
export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_212.jdk/Contents/Home

启动flume

1：配置启动文件
localhost:conf hadoop$ vi example.conf

# example.conf: A single-node Flume configuration
# Name the components on this agent
a1.sources = r1
a1.sinks = k1
a1.channels = c1

# Describe/configure the source
a1.sources.r1.type = netcat
a1.sources.r1.bind = localhost
a1.sources.r1.port = 44444

# Describe the sink
a1.sinks.k1.type = logger

# Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

# Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

启动命令：
flume-ng agent --name a1 --conf $FLUME_HOME/conf --conf-file $FLUME_HOME/conf/example.conf -Dflume.root.logger=INFO,console

localhost:sbin hadoop$ telnet localhost 44444
Trying ::1...
telnet: connect to address ::1: Connection refused
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
d= e%= flume
OK
hello flume
OK