otter
是基于数据库增量日志解析,准实时同步到本机房或异地机房的mysql/oracle
数据库. 一个分布式数据库同步系统。
搭建otter
请先搭建zookeeper
、mysql
(开启binlog
)
Otter Manager
安装
管理后台需要一些基础数据表,需要先创建一个库,sql
位置:
https://github.com/alibaba/otter/tree/master/manager/deployer/src/main/resources/sql
安装包地址: https://github.com/alibaba/otter/releases
解压可见conf
文件夹下otter.properties
文件,修改以下配置
## otter manager domain name
otter.domainName = 172.30.60.129
## manager服务端口
otter.port = 8181
## jetty web config xml
otter.jetty = jetty.xml
## outer需要数据库配置,管理后台
otter.database.driver.class.name = com.mysql.jdbc.Driver
otter.database.driver.url = jdbc:mysql://172.30.1.74:3306/otter
otter.database.driver.username = root
otter.database.driver.password = root
## 和node节点之间的通信节点
otter.communication.manager.port = 1099
## otter communication payload size (default = 8388608)
otter.communication.payload = 8388608
## otter communication pool size
otter.communication.pool.size = 10
## default zookeeper address
otter.zookeeper.cluster.default = 172.30.60.129:2181
## default zookeeper sesstion timeout = 60s
otter.zookeeper.sessionTimeout = 60000
## otter arbitrate connect manager config
otter.manager.address = ${otter.domainName}:${otter.communication.manager.port}
## should run in product mode , true/false
otter.manager.productionMode = true
## self-monitor enable or disable
otter.manager.monitor.self.enable = true
## self-montir interval , default 120s
otter.manager.monitor.self.interval = 120
## auto-recovery paused enable or disable
otter.manager.monitor.recovery.paused = true
# manager email user config
otter.manager.monitor.email.host = smtp.gmail.com
otter.manager.monitor.email.username =
otter.manager.monitor.email.password =
otter.manager.monitor.email.stmp.port = 465
启动,配置node
进入Otter Manager
下的bin
目录执行startup.sh
就可以了
然后访问http://172.30.60.129:8181/
,ip
和端口
都是上面配置的。
然后添加zookeeper
的配置
然后配置node
节点的信息,端口可以自己配置,但是序号是自动生成的,需要保证唯一性,启动node
的时候需要配置
node 安装启动
安装包地址 https://github.com/alibaba/otter/releases
解压可见conf
文件夹下otter.properties
文件,修改以下配置
# otter node root dir
otter.nodeHome = ${user.dir}/../
## otter node dir
otter.htdocs.dir = ${otter.nodeHome}/htdocs
otter.download.dir = ${otter.nodeHome}/download
otter.extend.dir= ${otter.nodeHome}/extend
## default zookeeper sesstion timeout = 60s
otter.zookeeper.sessionTimeout = 60000
## otter communication payload size (default = 8388608)
otter.communication.payload = 8388608
## otter communication pool size
otter.communication.pool.size = 10
## otter arbitrate & node connect manager config 端口是outter manager配置的通讯端口
otter.manager.address = 172.30.60.129:1099
然后进入bin目录
下直接启动,启动成功后,查看manager
可以看到启动状态
配置数据同步
-
配置需要同步的
cancal
配置 -
配置需要的数据源
-
配置数据表,配置的时候,最好验证一下库和数据表有没有访问权限
-
添加一个
channel
-
点击
channel
配置具体的管道
-
管道建立好后进入管道,配置数据迁移的表映射关系
配置完后,启动channel
,测试数据就可以了