Flume usage list - How 2 submit shell command from Java API

最新推荐文章于 2025-11-25 16:48:30 发布

最新推荐文章于 2025-11-25 16:48:30 发布 · 109 阅读

文章标签：

#shell #java #大数据

软件综合同时被 2 个专栏收录

39 篇文章

订阅专栏

java

25 篇文章

订阅专栏

本文介绍了使用FlumeShell进行连接配置、数据映射及逻辑节点提交等操作，并提供了Flume优化的相关链接，探讨了Flume与其他日志系统的对比及在大数据环境中遇到的问题。



FlumeShell shell = new FlumeShell();
int aPort = FlumeConfiguration.get().getConfigAdminPort();			
shell.executeLine("connect " + masters.get(0) + ":" + aPort);
shell.executeLine(unmapCmdLine(clientData, logicalNodeName));
shell.executeLine(mapCmdLine(clientData, logicalNodeName));			shell.executeLine(submitLogicalNodeLine(clientData, logicalNodeName));
shell.executeLine("quit");

flume 优化

http://www.ipinyou.com.cn/technicalnews/201112/Technical_6.html

开源日志比较
http://dongxicheng.org/search-engine/log-systems/

flume和hbase的数据不一致假象
http://blog.youkuaiyun.com/rzhzhz/article/details/7502018

海量日志收集问题
http://blog.youkuaiyun.com/v_JULY_v/article/details/6279498