strom打造日志处理系统

最新推荐文章于 2022-05-10 15:31:51 发布

转载最新推荐文章于 2022-05-10 15:31:51 发布 · 1.2k 阅读

使用Storm和Kafka组合实现高效的日志处理方案。Kafka提供高吞吐量且可靠的消息持久化及重播能力，而Storm则能够对这些消息进行复杂处理。

Storm + Kafka is a very effective log processing solution. A number of users of Storm use this combination, including us at Twitter in a few instances. Kafka gives you a high throughput, reliable way to persist/replay log messages, and Storm gives you the ability to process those messages in arbitrarily complex ways.

http://www.drdobbs.com/open-source/easy-real-time-big-data-analysis-using-s/240143874

http://bigdataprocessing.wordpress.com/2013/01/04/storm-a-real-time-log-processing-framework-real-time-hadoop/