Java大数据-DataX读取 MySQL 中的数据存放到 HDFS、读取 HDFS 数据写入 MySQL

最新推荐文章于 2025-01-18 14:09:43 发布

godkzz

最新推荐文章于 2025-01-18 14:09:43 发布

阅读量2.2k

点赞数 2

分类专栏：大数据文章标签： hdfs mysql java

本文链接：https://blog.youkuaiyun.com/godkzz/article/details/122306096

版权

一、读取 MySQL 中的数据存放到 HDFS官方模板

[atguigu@hadoop102 ~]$ python /opt/module/datax/bin/datax.py -r mysqlreader -w 
hdfswriter
{
 "job": {
 "content": [
 {
 "reader": {
 "name": "mysqlreader", 
 "parameter": {
 "column": [], 
 "connection": [
 {
 "jdbcUrl": [], 
 "table": []
 }
 ], 
 "password": "", 
 "username": "", 
 "where": ""
}
 }, 
 "writer": {
 "name": "hdfswriter", 
 "parameter": {
 "column": [], 
 "compress": "", 
 "defaultFS": "", 
 "fieldDelimiter": "", 
 "fileName": "", 
 "fileType": "", 
 "path": "", 
 "writeMode": ""
 }
 }
 }
 ], 
 "setting": {
 "speed": {
 "channel": ""
 }
 }
 } }

mysqlreader 参数解析：