docsz的博客

Java执行Datax脚本-MySQL写入Doris。

1、脚本{ "job": { "content": [{ "reader": { "name": "hdfsreader", "parameter": { "column": [ { "index": 0, "type": "STRING" }, { "index": 1, "type": "STRING" }, { "index": 2,

1、脚本{ "core": { "transport": { "channel": { "speed": { "byte": 10485760, "record": 100000 } } } }, "job": { "content": [{ "reader": { "name": "oraclereader", "parameter": { "column": [ "BJBH", "

DataX从Hive将数据写入Oracle

DataX从MySQL写入MongoDB

datax

1、下载源码git clone git@github.com:alibaba/DataX.git2、修改TSDBWriter类2.1、修改pom依赖 <!-- tsdb --> <dependency> <groupId>com.aliyun</groupId> <artifactId>hitsdb-client</artifactId><

1、Hive建表CREATE TABLE `rcdn_ads.ads_rcdn_zc_xq`( `qybm` varchar(25) COMMENT '区域编码', `csbm` varchar(25) COMMENT '城市编码', `shengbm` varchar(25) COMMENT '省份编码', `cybm` varchar(25) COMMENT '产业编码', `zclxbm` varchar(25) COMMENT '政策类型编码', `zcztbm`

1、脚本 { "job": { "content":[ { "reader":{ "name":"mysqlreader", "parameter":{ "connection":[ { "jdbcUrl":[ "jdbc:mysql://node03:3306/metadata" ], "querySql":[ "select * from t_dat

1、脚本{ "setting": {}, "job": { "setting": { "speed": { "channel": 2 } }, "content": [ { "reader": { "name": "mysqlreader", "para

1、脚本{ "job": { "setting": { "speed": { "channel": 3 } }, "content": [ { "reader": { "name": "hdfsreader", "parameter":

1、脚本{ "job": { "setting": { "speed": { "channel": 3 } }, "content": [ { "reader": { "name": "hdfsreader", "parameter":

1、json脚本{ "job": { "setting": { "speed": { "channel": 3 }, "cipher": { "sfjm": "Y", "instance": "AES128" }, "errorLimit": { "record": "-1" } }, "content": [{ "reader":

1、mysql-to-hive.json{ "setting": {}, "job": { "setting": { "speed": { "channel": 2 } }, "content": [ { "reader": { "name": "mysqlreader", "parameter": { "username": "root", "password": "123456", "connec

1、编写read-mysql.json脚本{“job”: {“setting”: {“speed”: {“channel”:1}},“content”: [{“reader”: {“name”: “mysqlreader”,“parameter”: {“username”: “用户名”,“password”: “密码”,“connection”: [{“querySql”: [“select * from emp_base_info where emp_city_code

1、编写脚本read-oracle.json{“job”: {“setting”: {“speed”: {“byte”: 1048576},“errorLimit”: {“record”: 0,“percentage”: 0.02}},“content”: [{“reader”: {“name”: “oraclereader”,“parameter”: {“username”: “用户名”,“password”: “密码”,“column”: [“ID”,“DYLYL

1、编写脚本mysql-to-hive.json{ "job": { "setting": { "speed": { "channel": 3 }, "errorLimit": { "record": 0, "percentage": 0.02 } }, "c

1、编写脚本oracle-to-oracle.json{ "job": { "setting": { "speed": { "channel": 1 } }, "content": [ { "reader": { "name": "oraclereader",