DataX 数据迁移

最新推荐文章于 2025-03-05 17:56:15 发布

时光下的旅途

最新推荐文章于 2025-03-05 17:56:15 发布

阅读量402

点赞数

分类专栏： # DB 文章标签： 1024程序员节 DataX 数据迁移 MongoDB SQL Server 数据迁移到MongoDB

本文链接：https://blog.youkuaiyun.com/mc_linfen/article/details/134015798

版权

DB 专栏收录该内容

1 篇文章

订阅专栏

1、前期准备

   Linux系统
   Python（最好是2）
   Jdk 1.8以上

2、安装Python2

--更新软件包

sudo apt update

--安装python2
sudo apt install python2

--查看python版本
python2 --version

3、下载DataX

Linux下载DataX

wget http://datax-opensource.oss-cn-hangzhou.aliyuncs.com/datax.tar.gz

解压

tar -zxvf datax.tar.gz

4、增加DataX Job（DataX数据迁移任务）

读取库：SQL Server

写入库：MongoDB

SqlServerToMongodb.json内容如下

{
	"job": {
		"setting": {
			"speed": {
				"channel": 5
			}
		},
		"content": [{
			"reader": {
				"name": "sqlserverreader",
				"parameter": {
					"username": "用户名",
					"password": "密码",
					"column": [
						"id",
						"version",
						"created",
						"modified",
						"code",
						"name"
					],
					"splitPk": "pk",
					"where": "",
					"connection": [{
						"table": ["EMPLOYEE"],
						"jdbcUrl": ["jdbc:sqlserver://127.0.0.1:1433;DatabaseName=TEST"]
					}]
				}
			},
			"writer": {
				"name": "mongodbwriter",
				"parameter": {
					"address": ["127.0.0.1:27017"],
					"userName": "datax",
					"userPassword": "datax",
					"dbName": "TEST",
					"collectionName": "employee",
					"column": [{
						"name": "id",
						"type": "string"
					}, {
						"name": "version",
						"type": "int"
					}, {

						"name": "created",
						"type": "date"
					}, {
						"name": "modified",
						"type": "date"
					}, {
						"name": "code",
						"type": "string"
					}, {
						"name": "name",
						"type": "string"
					}]
				}
			}
		}]
	}
}