DataX从MySQL写入MongoDB

docsz

已于 2023-04-13 15:05:33 修改

阅读量2k

点赞数

分类专栏： datax 文章标签： datax

于 2022-04-08 17:20:53 首次发布

本文链接：https://blog.youkuaiyun.com/docsz/article/details/124046508

版权

datax 专栏收录该内容

19 篇文章

订阅专栏

这是一个使用DataX实现的数据迁移任务，它将MySQL数据库中的`dm_mysql`表数据迁移到MongoDB。脚本配置包括设置读取和写入通道，定义了源数据库的用户名、密码、表名和连接，以及目标MongoDB的地址、数据库名、集合名及字段映射。迁移过程中，如果目标表存在相同ID的数据，则会被替换。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

1、datax脚本

{
	"job": {
		"setting": {
			"speed": {
				"channel": 2
			}
		},
		"content": [{
			"reader": {
				"name": "mysqlreader",
				"parameter": {
					"username": "root",
					"password": "123456",
					"column": ["*"],
					"connection": [{
						"table": [
							"dm_mysql"
						],
						"jdbcUrl": [
							"jdbc:mysql://ip:3306/test"
						]
					}]
				}
			},
			"writer": {
				"name": "mongodbwriter",
				"parameter": {
					"address": [
						"ip:port"
					],
					"userName": "admin",
					"userPassword": "xxxx",
					"dbName": "bdcp",
					"collectionName": "dm",
					"column": [{
							"name": "id",
							"type": "int"
						},
						{
							"name": "name",
							"type": "string"
						},
						{
							"name": "price",
							"type": "double"
						},
						{
							"name": "t_char",
							"type": "string"
						},
						{
							"name": "t_date",
							"type": "date"
						},
						{
							"name": "t_time",
							"type": "date"
						},
						{
							"name": "t_datetime",
							"type": "date"
						},
						{
							"name": "t_number",
							"type": "double"
						},
						{
							"name": "t_text",
							"type": "string"
						}
					],
					"writeMode": {
						"isReplace": "true",
						"replaceKey": "id"
					}
				}
			}
		}]
	}
}