多个flume agent启动接收kafka下的不同的topic注意事项

lvtula

于 2019-06-04 10:43:33 发布

阅读量1.5k

点赞数 1

CC 4.0 BY-SA版权

分类专栏： Flume 文章标签： flume

本文链接：https://blog.youkuaiyun.com/lvtula/article/details/90764658

Flume 专栏收录该内容

11 篇文章

订阅专栏

本文探讨了在使用多个FileChannel实例时可能遇到的问题，即目录锁定冲突导致的初始化失败。为了避免这一问题，建议为每个FileChannel实例提供独立的路径，并尽可能地将它们配置在不同的磁盘上。此外，由于FileChannel会在每次提交时同步到磁盘，因此将其与批处理源或接收器结合使用可能是必要的，以提高性能。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Note

By default the File Channel uses paths for checkpoint and data directories that are within the user home as specified above. As a result if you have more than one File Channel instances active within the agent, only one will be able to lock the directories and cause the other channel initialization to fail. It is therefore necessary that you provide explicit paths to all the configured channels, preferably on different disks. Furthermore, as file channel will sync to disk after every commit, coupling it with a sink/source that batches events together may be necessary to provide good performance where multiple disks are not available for checkpoint and data directories.

file channel需设置为不同！！！

官网：http://flume.apache.org/releases/content/1.7.0/FlumeUserGuide.html#file-channel