此文档描述daolinet在CentOS7和最新Fedora系统中的安装过程,对于Ubuntu和Debian发行版系统,需要将以下文档中所有使用yum包管理工具的地方替换为apt-get。
1. 安装环境准备
DaoliNet依赖的软件:
- Docker Version 1.9 or later
- Golang Version 1.5 or later
- Git
- Python 2.7
DaoliNet使用docker swarm原生集群工具进行容器管理,集群中所有节点必须安装以上环境.
以上软件环境详细安装过程如下.
Docker环境
执行以下命令安装docker,详细安装过程请参考Install Docker Engine on Linux
curl -fsSL https://get.docker.com/ | sh
Golang环境
执行以下命令安装Golang,详细安装请参考Go Getting Started
wget https://storage.googleapis.com/golang/go1.5.3.linux-amd64.tar.gz
tar xzvf go1.5.3.linux-amd64.tar.gz -C /usr/local/
export PATH=$PATH:/usr/local/go/bin
Git环境
执行以下命令安装git环境
yum install -y gcc git epel-release
Python环境
执行以下命令安装Python环境
yum install -y python-devel python-pip
注意:
文档中所有export命令都可以配置到profile文件中永久生效
所有节点添加如下iptables规则允许内网其它节点可以访问:
iptables -I INPUT -s <SUBNET>/<PREFIX> -j ACCEPT
2. DaoliNet安装
DaoliNet安装过程包括manager节点安装和agent节点安装过程, 在所有swarm manager节点上安装daolinet api service, 所有swarm agent节点安装daolinet agent服务.
2.1 部署manager节点
部署manager节点需要以下步骤:
- 安装Etcd
- 安装Swarm Manager
- 安装ryu (OpenFlow框架)
- 安装daolinet (DaoliNet API服务)
- 安装daolictl (DaoliNet命令行工具)
- 安装Daolicontroller (OpenFlow控制器)
以下详细说明manager节点安装过程
2.1.1. 安装Etcd
docker pull microbox/etcd
docker run -ti -d -p 4001:4001 -p 7001:7001 --restart=always --name discovery microbox/etcd -addr <SWARM-MANAGER-IP>:4001 -peer-addr <SWARM-MANAGER-IP>:7001
2.1.2. 安装Swarm Manager
docker pull swarm
docker run -ti -d -p 3376:3376 --restart=always --name swarm-manager --link discovery:discovery swarm m --addr <SWARM-MANAGER-IP>:3376 --host tcp://0.0.0.0:3376 etcd://discovery:4001
2.1.3. 安装Ryu
# Install openflow framework
pip install ryu
2.1.4. 编译安装DaoliNet API Service
mkdir $HOME/daolinet
cd $HOME/daolinet
export GOPATH=$HOME/daolinet
go get github.com/tools/godep
export PATH=$PATH:$GOPATH/bin
mkdir -p src/github.com/daolinet
cd src/github.com/daolinet
git clone https://github.com/daolinet/daolinet.git
cd daolinet
godep go build -ldflags "-s -w"
mv daolinet ../../../../bin/
# Run api server
daolinet server --swarm tcp://<SWARM-MANAGER-IP>:3376 etcd://<ETCD-IP>:4001
2.1.5. 安装DaoliCtl命令行工具
**注意: **如果没有安装Golang环境,请先执行2.1.4步骤再执行如下操作
cd $HOME/daolinet/src/github.com/daolinet
git clone https://github.com/daolinet/daolictl.git
cd daolictl
godep go build -ldflags "-s -w"
mv daolictl ../../../../bin/
2.1.6. 安装openflow控制器
# Install depend packages
yum install -y python-requests python-docker-py
# Install openflow controller
git clone https://github.com/daolinet/daolicontroller.git
cd daolicontroller; python ./setup.py install
# Run daolicontroller
systemctl start daolicontroller.service
2.2. 部署agent节点
部署agent节点需要以下步骤
- 配置Docker启动参数
- 安装Swarm Agent
- 配置和安装OpenvSwitch
- 安装OpenvSwitch Plugin
- 安装DaoliNet Agent
- 连接OpenFlow控制器
以下详细说明agent节点安装步骤
2.2.1. 配置docker启动参数
1.修改docker daemon启动参数,添加swarm管理和etcd支持。例如在CentOS7下修改/usr/lib/systemd/system/docker.service文件中如下ExecStart参数:
ExecStart=/usr/bin/dockerd -H unix:///var/run/docker.sock -H tcp://0.0.0.0:2375 --cluster-store=etcd://<ETCD-IP>:4001
旧版本配置如下:
ExecStart=/usr/bin/docker daemon -H fd:// -H tcp://0.0.0.0:2375 --cluster-store=etcd://<ETCD-IP>:4001
2.然后重启服务:
systemctl daemon-reload
systemctl restart docker.service
2.2.2. 安装Swarm Agent
docker pull swarm
docker run -ti -d --restart=always --name swarm-agent swarm j --addr <SWARM-AGENT-IP>:2375 etcd://<ETCD-IP>:4001
2.2.3. 配置和安装openvswitch
执行以下命令安装OpenvSwitch,详细安装请参考How to Install Open vSwitch on Linux, FreeBSD and NetBSD
# 编译openvswitch源码
yum install -y openssl-devel rpm-build
wget http://openvswitch.org/releases/openvswitch-2.5.0.tar.gz
mkdir -p ~/rpmbuild/SOURCES
cp openvswitch-2.5.0.tar.gz ~/rpmbuild/SOURCES/
tar xzf openvswitch-2.5.0.tar.gz
rpmbuild -bb --without check openvswitch-2.5.0/rhel/openvswitch.spec
# 安装生成的软件包
yum localinstall -y rpmbuild/RPMS/x86_64/openvswitch-2.5.0-1.x86_64.rpm
/etc/init.d/openvswitch start
# 执行OpenvSwitch脚本配置网卡
curl -sSL https://github.com/daolinet/toolset/raw/master/scripts/ovsconf | bash -s
# 如果有多个网卡,可以指定一个
curl -sSL https://github.com/daolinet/toolset/raw/master/scripts/ovsconf | bash -s -- <DEVNAME>
2.2.4. 安装OpenvSwitch Plugin
pip install gunicorn flask netaddr
git clone https://github.com/daolinet/ovsplugin.git
cd ovsplugin/
./start.sh
2.2.5. 安装DaoliNet Agent Service
# Install daolinet
mkdir $HOME/daolinet
cd $HOME/daolinet
export GOPATH=$HOME/daolinet
go get github.com/tools/godep
export PATH=$PATH:$GOPATH/bin
mkdir -p src/github.com/daolinet
cd src/github.com/daolinet
git clone https://github.com/daolinet/daolinet.git
cd daolinet
godep go build -ldflags "-s -w"
mv daolinet ../../../../bin/
# Run agent service
daolinet agent --iface <DEVNAME:DEVIP> etcd://<ETCD-IP>:4001
2.2.6. 连接OpenFlow控制器
在agent节点完成以上步骤,最后配置ovs连接到daolicontroller控制器:
ovs-vsctl set-controller daolinet tcp:<CONTROLLER-IP>:6633
注意:为了提高系统可用性,集群中可以启动多个daolicontroller控制器,同时在配置ovs时指定多个控制器地址:
ovs-vsctl set-controller daolinet tcp:<CONTROLLER-IP1>:6633,tcp:<CONTROLLER-IP2>:6633