Flume
关注
分享
扫一扫
ylzhjlinux
这个作者很懒，什么都没留下…
展开
专栏收录文章
- 默认排序
- 最新发布
- 最早发布
- 最多阅读
- 最少阅读
-
Flume: flume-ng-sql-source
1. download#git clone https://github.com/mvalleavila/flume-ng-sql-source.git 2. compile#cd flume-ng-sql-source#mvn package error : source 1.3 (use -source 5 or higher to enable generic...原创 2014-12-19 17:02:06 · 1506 阅读 · 0 评论 -
Flume: compile source code and install
1. download source code#git clone https://git-wip-us.apache.org/repos/asf/flume.git 2. compile#export MAVEN_OPTS="-Xms512m -Xmx1024m -XX:PermSize=256m -XX:MaxPermSize=512m"#mvn clean insta...原创 2014-12-18 11:44:31 · 141 阅读 · 0 评论 -
Flume: high qulity blogs
基于Flume的美团日志收集系统(一)架构和设计http://blog.newitfarmer.com/big_data/big-data_integration/flume-big-data-production/15472/repost-%E5%9F%BA%E4%BA%8Eflume%E7%9A%84%E7%BE%8E%E5%9B%A2%E6%97%A5%E5%BF%97%E6%94%B...原创 2014-12-17 18:02:03 · 127 阅读 · 0 评论 -
Flume: books
Using Flume Flexible, Scalable, and Reliable Data Streaming By Hari Shreedharan Apache Flume: Distributed Log Collection for Hadoop原创 2014-12-09 15:54:40 · 103 阅读 · 0 评论 -
flume-interceptor-analytics
https://github.com/jrkinley/flume-interceptor-analytics原创 2014-12-09 15:23:19 · 119 阅读 · 0 评论 -
Architecture of Flume NG
https://blogs.apache.org/flume/entry/flume_ng_architectureApache Flume - Architecture of Flume NG Apache Flume is a distributed, reliable, and available system for efficiently collecting...原创 2014-12-05 12:29:22 · 545 阅读 · 0 评论 -
Flume: morphline sink with solr 5.1.0
1. down flume 1.5.2 source code and change solr version to 5.1.0 2. compile and install3. cp solr 4.10.1 related jars to lib dir to sove this errorCloudSolrServer' (current frame, stack[2])...原创 2015-05-21 16:38:37 · 212 阅读 · 0 评论 -
Flume: avro source and sink
In order to flow the data across multiple agents or hops, the sink of the previous agent and source of the current hop need to be avro type with the sink pointing to the hostname (or IP address) and ...原创 2015-04-17 11:12:42 · 143 阅读 · 0 评论 -
Flume: hbase sink
flume.confa1.sinks.hbase-sink1.channel = ch1a1.sinks.hbase-sink1.type = hbasea1.sinks.hbase-sink1.table = usersa1.sinks.hbase-sink1.columnFamily= infoa1.sinks.hbase-sink1.serializer=org.ap...原创 2015-04-16 17:04:38 · 256 阅读 · 0 评论 -
Kafka: compile source code
#tar xzf kafka-0.8.1.1-src.tgz#cd kafka-0.8.1.1-src#./gradlew build error:Cannot perform signing task ':clients:signArchives' because it has no configured signat #./gradlew releaseTarGzAl...原创 2015-01-10 17:40:30 · 247 阅读 · 0 评论 -
Real-time Clickstream Analytics using Flume, Avro, Kite Morphlines and Impala
http://techkites.blogspot.com/2014/06/real-time-clickstream-analytics-using.html原创 2014-12-30 14:16:20 · 127 阅读 · 0 评论 -
Data ETL tools for hadoop ecosystem Morphlines
when i usethere is a errorjava.lang.NoClassDefFoundError: org/kitesdk/morphline/api/MorphlineCompilationException at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Cla...原创 2014-12-25 11:39:45 · 346 阅读 · 0 评论 -
open replicator
http://blog.youkuaiyun.com/menergy/article/details/17583823原创 2014-12-22 20:35:00 · 209 阅读 · 0 评论 -
data replication from different databases
tungsten-replicator-3.0.0-524-src原创 2014-12-22 10:22:15 · 155 阅读 · 0 评论 -
flume source using mysql-replication-listener to realtime copy data from mysql
https://bitbucket.org/winebarrel/mysql-replication-listener http://flume.apache.org/FlumeUserGuide.html#a-simple-examplehttps://www.cyberagent.co.jp/recruit/techreport/report/id=7474https://do...原创 2014-12-18 11:46:06 · 188 阅读 · 0 评论