喜上眉梢

flume+spark(一) 一、flume代码 #exec source + memory channel + hdfs sink # Name the components on this agent a2.sources = r1 a2.sinks = k1 a2.channels = c1 # Describe/configure the source a

kafka_spark集成 kafka创建话题、消费者、生产者 1、话题 bin/kafka-topics.sh --create --zookeeper 192.168.20.10:2181 --replication-factor 1 --partitions 1 --topic test  2、生产者  bin/kafka-console-producer.sh --broke