Load 数据1

Druid 的load 数据分为两类 ：批量load(历史数据) 和实时load(新数据) ，本文介绍批量load 数据

indexing 服务

批量load 数据需要用到indexing 服务，它是一个独立的服务，,接受任务的形式为POST请求。The output of most tasks are segments.

 

运行overlord 节点

启动命令

java -Xmx2g -Duser.timezone=UTC -Dfile.encoding=UTF-8 -classpath lib/*:config/overlord io.druid.cli.Main server overlord

 

配置文件

druid.host=localhost
druid.port=8087
druid.service=overlord

druid.zk.service.host=localhost

druid.extensions.coordinates=["io.druid.extensions:druid-kafka-seven:0.6.143"]

druid.db.connector.connectURI=jdbc:mysql://localhost:3306/druid
druid.db.connector.user=druid
druid.db.connector.password=diurd

druid.selectors.indexing.serviceName=overlord
druid.indexer.queue.startDelay=PT0M
druid.indexer.runner.javaOpts="-server -Xmx256m"
druid.indexer.fork.property.druid.processing.numThreads=1
druid.indexer.fork.property.druid.computation.buffer.size=100000000

转载于:https://www.cnblogs.com/hanchanghong/p/4409465.html