
大数据开发
文章平均质量分 65
大数据-陈礼佳
这个作者很懒,什么都没留下…
展开
-
Hbase technology explanation
Directory1 Introduce2 Schema Design2.1 General Concepts2.2 Size Limit2.3 Row Key Design2.3.1 Reverse Domain Names2.3.2 Hashing2.3.3 Timestamps2.3.4 Combines Row Key2.4 Architecture Components2.4.1 Client2.4.2 Zookeeper2.4.3 HMaster2.4.4 HRegionServer2.4.5原创 2022-03-22 20:48:10 · 15168 阅读 · 0 评论 -
Kafka technology explanation
DirectoryKafka OverviewKafka ProducerKafka ConsumerOffset ManagementKafka Group CoordinatorKafka Group LeaderKafka OverviewApache Kafka is an open-source distributed event streaming platform.A Kafka cluster consists of one or more brokers. A Kafka broke原创 2022-02-22 16:40:29 · 13837 阅读 · 0 评论 -
flink-1.12.0消费kafka写入clickhouse-20.8.20.1
方案一 DataStream方式写入clickhouse方法主入口public class DataClean { public static void main(String[] args) throws Exception { StreamExecutionEnvironment bsEnv = StreamExecutionEnvironment.getExecutionEnvironment(); Properties properties = new P原创 2021-09-11 15:22:59 · 13116 阅读 · 0 评论 -
flink-1.14.3 集群部署
1 资源准备4台服务器:1个master、3个workerjdk环境flink二进制包:flink-1.14.3-bin-scala_2.11.tgz2 基础环境准备2.1 jdk安装2.1 ssh免密ssh-keygen -t rsa一路按回车即可cd ~/.sshcp id_rsa.pub authorized_keysssh-copy-id yq-ai-001ssh-copy-id yq-ai-002ssh-copy-id yq-ai-003ssh-copy-id yq-a原创 2022-02-16 15:07:59 · 14321 阅读 · 1 评论 -
DataX部署及使用
DataX部署及使用原创 2021-10-08 20:33:21 · 13152 阅读 · 0 评论