基于keystone的swift搭建

最新推荐文章于 2022-11-21 15:59:59 发布

转载最新推荐文章于 2022-11-21 15:59:59 发布 · 1.3k 阅读

文章标签：

#openstack #ubuntu #swift

linux 同时被 3 个专栏收录

7 篇文章

订阅专栏

云计算

2 篇文章

订阅专栏

openstack

1 篇文章

订阅专栏

本文档详细介绍了如何在Ubuntu 16.04环境下完成OpenStack Swift单机部署的过程，包括安装所需的服务如数据库、消息队列、缓存服务等，并配置Keystone及Swift服务。

OpenStack组件Swift单机搭建（基于Keystone）

该博客是我们班的张大神写的，在此借用一下。

安装环境：Ubuntu 16.04

需要有两块硬盘（一块为系统盘，一块用于安装SWIFT）

需要有IP地址

环境准备

修改hosts文件
安装相关服务

修改hosts

编辑 /etc/hosts，添加

IP地址 controller

安装Openstack源并更新和安装

apt install software-properties-common
add-apt-repository cloud-archive:newton
apt update && apt dist-upgrade

安装完成后重启

安装Openstack客户端

apt install python-openstackclient

安装数据库

1、安装数据库服务

apt install mariadb-server python-pymysql

2、创建或修改/etc/mysql/mariadb.conf.d/99-openstack.cnf文件

（若文件存在则修改，不存在则创建，存在的文件中若未提及的选项则保持不变，下同）

[mysqld]
bind-address = 你的IP地址

default-storage-engine = innodb
innodb_file_per_table
max_connections = 4096
collation-server = utf8_general_ci
character-set-server = utf8

3、将/etc/mysql/mariadb.conf.d/下所有的文件中所有utf8mb4改为utf8
4、进入数据库，设置root密码，添加远程登录权限

# mysql -u root
mysql> GRANT ALL PRIVILEGES ON *.* TO 'root'@'localhost' \
  IDENTIFIED BY 'root密码';
mysql> GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' \
  IDENTIFIED BY 'root密码';
mysql> flush privileges;
mysql> exit;

5、重启数据库

 service mysql restart

安装消息队列服务(Message Queue)

1、安装服务

apt install rabbitmq-server

2、添加openstack用户并添加权限

rabbitmqctl add_user openstack 设置一个密码
rabbitmqctl set_permissions openstack ".*" ".*" ".*"

安装分布式缓存服务(Memcached)

1、安装服务

apt install memcached python-memcache

2、修改配置文件/etc/memcached.conf

-l 你的IP地址

3、重启服务

service memcached restart

安装配置Keystone，并添加域、项目、用户和角色

准备

1、添加Keystone数据库和相关用户

# mysql -u root -p
Create the keystone database:
mysql> CREATE DATABASE keystone;
mysql> GRANT ALL PRIVILEGES ON keystone.* TO 'keystone'@'localhost' \
  IDENTIFIED BY 'Keystone密码';
mysql> GRANT ALL PRIVILEGES ON keystone.* TO 'keystone'@'%' \
  IDENTIFIED BY 'Keystone密码';

2、安装服务

apt install keystone

配置Keystone

1、编辑/etc/keystone/keystone.conf

[database]
connection = mysql+pymysql://keystone:keystone用户的密码@controller/keystone
[token]
provider = fernet

2、填充keystone数据库

su -s /bin/sh -c "keystone-manage db_sync" keystone

3、初始化Fernet key repositories（似乎是个专有名词不知道咋翻译）

keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone
keystone-manage credential_setup --keystone-user keystone --keystone-group keystone

4、对认证服务进行引导

keystone-manage bootstrap --bootstrap-password 设置一个鹳狸猿密码 \
  --bootstrap-admin-url http://controller:35357/v3/ \
  --bootstrap-internal-url http://controller:35357/v3/ \
  --bootstrap-public-url http://controller:5000/v3/ \
  --bootstrap-region-id RegionOne

配置Apache HTTP服务

1、编辑/etc/apache2/apache2.conf

ServerName controller

2、重启apache服务，并且删除SQLite数据库

service apache2 restart
rm -f /var/lib/keystone/keystone.db

3、添加一些环境变量（临时的哦）

export OS_USERNAME=admin
export OS_PASSWORD=这里写你刚才设置的admin的密码
export OS_PROJECT_NAME=admin
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_DOMAIN_NAME=default
export OS_AUTH_URL=http://controller:35357/v3
export OS_IDENTITY_API_VERSION=3

创建域、项目、用户和角色

1、创建一个service项目

openstack project create --domain default \
  --description "Service Project" service

2、创建一个demo项目和user
创建demo项目

创建demo用户

openstack project create --domain default \
  --description "Demo Project" demo
openstack user create --domain default \
  --password-prompt demo(输入此句后会需要设置demo的密码)

创建user角色

openstack role create user

添加user角色到demo项目和用户中

openstack role add --project demo --user demo user

验证操作

1、基于安全的考虑在/etc/keystone/keystone-paste.ini中移除

[pipeline:public_api], [pipeline:admin_api],[pipeline:api_v3] 中的admin_token_auth

2、移除掉一些环境变量

unset OS_AUTH_URL OS_PASSWORD

3、以admin用户的身份请求一个认证令牌

openstack --os-auth-url http://controller:35357/v3 \
  --os-project-domain-name default --os-user-domain-name default \
  --os-project-name admin --os-username admin token issue
(会要求输入admin的密码)

如果出现类似于以下的信息则表示成功

+------------+-----------------------------------------------------------------+
| Field      | Value                                                           |
+------------+-----------------------------------------------------------------+
| expires    | 2016-02-12T20:14:07.056119Z                                     |
| id         | gAAAAABWvi7_B8kKQD9wdXac8MoZiQldmjEO643d-e_j-XXq9AmIegIbA7UHGPv |
|            | atnN21qtOMjCFWX7BReJEQnVOAj3nclRQgAYRsfSU_MrsuWb4EDtnjU7HEpoBb4 |
|            | o6ozsA_NmFWEpLeKy0uNn_WeKbAhYygrsmQGA49dclHVnz-OMVLiyM9ws       |
| project_id | 343d245e850143a096806dfaefa9afdc                                |
| user_id    | ac3377633149401296f6c0d92d79dc16                                |
+------------+-----------------------------------------------------------------+

3、以demo用户的身份请求一个认证令牌

openstack --os-auth-url http://controller:5000/v3 \
  --os-project-domain-name default --os-user-domain-name default \
  --os-project-name demo --os-username demo token issue
(会要求输入demo的密码)

如果出现类似于以下的信息则表示成功

+------------+-----------------------------------------------------------------+
| Field      | Value                                                           |
+------------+-----------------------------------------------------------------+
| expires    | 2016-02-12T20:14:07.056119Z                                     |
| id         | gAAAAABWvi7_B8kKQD9wdXac8MoZiQldmjEO643d-e_j-XXq9AmIegIbA7UHGPv |
|            | atnN21qtOMjCFWX7BReJEQnVOAj3nclRQgAYRsfSU_MrsuWb4EDtnjU7HEpoBb4 |
|            | o6ozsA_NmFWEpLeKy0uNn_WeKbAhYygrsmQGA49dclHVnz-OMVLiyM9ws       |
| project_id | 343d245e850143a096806dfaefa9afdc                                |
| user_id    | ac3377633149401296f6c0d92d79dc16                                |
+------------+-----------------------------------------------------------------+

写♂脚♂本

由于环境变量会失效（除非你设置在bashrc里面去了，不过这不利于更换用户身份）为了方便,可以创建一些脚本
1、创建admin-openrc文件

export OS_PROJECT_DOMAIN_NAME=default
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_NAME=admin
export OS_USERNAME=admin
export OS_PASSWORD=你的admin密码
export OS_AUTH_URL=http://controller:35357/v3
export OS_IDENTITY_API_VERSION=3
export OS_IMAGE_API_VERSION=2

2、创建demo-openrc文件

export OS_PROJECT_DOMAIN_NAME=default
export OS_USER_DOMAIN_NAME=default
export OS_PROJECT_NAME=demo
export OS_USERNAME=demo
export OS_PASSWORD=你的demo密码
export OS_AUTH_URL=http://controller:5000/v3
export OS_IDENTITY_API_VERSION=3
export OS_IMAGE_API_VERSION=2

3、验证一下

sh admin-openrc
openstack token issue

如果出现类似于以下的信息则表示成功

+------------+-----------------------------------------------------------------+
| Field      | Value                                                           |
+------------+-----------------------------------------------------------------+
| expires    | 2016-02-12T20:14:07.056119Z                                     |
| id         | gAAAAABWvi7_B8kKQD9wdXac8MoZiQldmjEO643d-e_j-XXq9AmIegIbA7UHGPv |
|            | atnN21qtOMjCFWX7BReJEQnVOAj3nclRQgAYRsfSU_MrsuWb4EDtnjU7HEpoBb4 |
|            | o6ozsA_NmFWEpLeKy0uNn_WeKbAhYygrsmQGA49dclHVnz-OMVLiyM9ws       |
| project_id | 343d245e850143a096806dfaefa9afdc                                |
| user_id    | ac3377633149401296f6c0d92d79dc16                                |
+------------+-----------------------------------------------------------------+

安装并配置Swift服务

环境准备

1、运行脚本

sh admin-openrc

2、向Keystone添加swift相关信息

添加swift用户

openstack user create --domain default --password-prompt swift(此处要设置密码)

将admin角色加入到swift用户中

openstack role add --project service --user swift admin

添加swift服务实体

openstack service create --name swift \
  --description "OpenStack Object Storage" object-store

添加对象存储服务API的端点(endpoints)

openstack endpoint create --region RegionOne \
  object-store public http://controller:8080/v1/AUTH_%\(tenant_id\)s


openstack endpoint create --region RegionOne \
  object-store internal http://controller:8080/v1/AUTH_%\(tenant_id\)s


openstack endpoint create --region RegionOne \
  object-store admin http://controller:8080/v1

3、安装相关服务

apt install swift swift-proxy python-swiftclient \
  python-keystoneclient python-keystonemiddleware \
  memcached \
  swift swift-account swift-container swift-object

配置proxy服务

1、创建并进入/etc/swift文件夹
2、下载proxy-server.conf

curl -o /etc/swift/proxy-server.conf https://git.openstack.org/cgit/openstack/swift/plain/etc/proxy-server.conf-sample?h=stable/newton

3、编辑proxy-server.conf

[DEFAULT]
bind_port = 8080
user = swift
swift_dir = /etc/swift

[pipeline:main]
pipeline = catch_errors gatekeeper healthcheck proxy-logging cache container_sync bulk ratelimit authtoken keystoneauth container-quotas account-quotas slo dlo versioned_writes proxy-logging proxy-server
[app:proxy-server]
use = egg:swift#proxy
account_autocreate = True

[filter:keystoneauth]
use = egg:swift#keystoneauth
operator_roles = admin,user

[filter:authtoken]
paste.filter_factory = keystonemiddleware.auth_token:filter_factory
auth_uri = http://controller:5000
auth_url = http://controller:35357
memcached_servers = controller:11211
auth_type = password
project_domain_name = default
user_domain_name = default
project_name = service
username = swift
password = 你设置的swift密码
delay_auth_decision = True

[filter:cache]
use = egg:swift#memcache
memcache_servers = controller:11211

配置存储相关服务

1、安装服务

apt install xfsprogs rsync

2、格式化硬盘为XFS格式

(如果不知道硬盘名，可使用fdisk -l查看)

mkfs.xfs /dev/硬盘

3、创建挂载节点的文件目录

mkdir -p /srv/node/硬盘

4、在/etc/fstab中添加

/dev/硬盘 /srv/node/硬盘 xfs noatime,nodiratime,nobarrier,logbufs=8 0 2

5、挂载硬盘

mount /srv/node/硬盘

6、创建并编辑文件 /etc/rsyncd.conf

mkdir /etc/rsyncd.conf 
uid = swift
gid = swift
log file = /var/log/rsyncd.log
pid file = /var/run/rsyncd.pid
address = 你的IP

[account]
max connections = 2
path = /srv/node/
read only = False
lock file = /var/lock/account.lock

[container]
max connections = 2
path = /srv/node/
read only = False
lock file = /var/lock/container.lock

[object]
max connections = 2
path = /srv/node/
read only = False
lock file = /var/lock/object.lock

7、编辑/etc/default/rsync

RSYNC_ENABLE=true

8、启动rsync服务

service rsync start

9、下载配置文件

curl -o /etc/swift/account-server.conf https://git.openstack.org/cgit/openstack/swift/plain/etc/account-server.conf-sample?h=stable/newton
curl -o /etc/swift/container-server.conf https://git.openstack.org/cgit/openstack/swift/plain/etc/container-server.conf-sample?h=stable/newton
curl -o /etc/swift/object-server.conf https://git.openstack.org/cgit/openstack/swift/plain/etc/object-server.conf-sample?h=stable/newton

10、编辑/etc/swift/account-server.conf

[DEFAULT]
bind_ip = 你的IP
bind_port = 6002
user = swift
swift_dir = /etc/swift
devices = /srv/node
mount_check = True
[pipeline:main]
pipeline = healthcheck recon account-server
[filter:recon]
use = egg:swift#recon
recon_cache_path = /var/cache/swift

11、编辑/etc/swift/container-server.conf

[DEFAULT]
bind_ip = 你的IP
bind_port = 6001(2.conf为6011)
user = swift
swift_dir = /etc/swift
devices = /srv/node
mount_check = True
[pipeline:main]
pipeline = healthcheck recon container-server
[filter:recon]
use = egg:swift#recon
recon_cache_path = /var/cache/swift

12、编辑/etc/swift/object-server.conf

[DEFAULT]
bind_ip = 你的IP
bind_port = 6000
user = swift
swift_dir = /etc/swift
devices = /srv/node
mount_check = True
[pipeline:main]
pipeline = healthcheck recon object-server
[filter:recon]
use = egg:swift#recon
recon_cache_path = /var/cache/swift
recon_lock_path = /var/lock

13、修改权限

chown -R swift:swift /srv/node/*
mkdir -p /var/cache/swift/1 /var/cache/swift/2
chown -R root:swift /var/cache/swift/*
chmod -R 775 /var/cache/swift/*

创建并分配初始化环

1、在/etc/swift中执行以下命令

swift-ring-builder account.builder create 10 1 1

swift-ring-builder account.builder add \
  --region 1 --zone 1 --ip 你的IP地址 --port 6002 --device 你的硬盘 --weight 100

swift-ring-builder account.builder rebalance

swift-ring-builder container.builder create 10 1 1

swift-ring-builder container.builder add \
  --region 1 --zone 1 --ip 你的IP地址 --port 6001 --device 你的硬盘 --weight 100

swift-ring-builder container.builder rebalance

swift-ring-builder object.builder create 10 1 1

swift-ring-builder object.builder add \
  --region 1 --zone 1 --ip 你的IP地址 --port 6000 --device 你的硬盘 --weight 100

swift-ring-builder object.builder rebalance

2、在/etc/swift下下载文件

curl -o /etc/swift/swift.conf \
  https://git.openstack.org/cgit/openstack/swift/plain/etc/swift.conf-sample?h=stable/newton

3、执行以下命令两次获得两个字符串

openssl rand -hex 10

4、编辑/etc/swift/swift.conf

[swift-hash]
swift_hash_path_suffix = 第一个字符串
swift_hash_path_prefix = 第二个字符串
[storage-policy:0]
name = Policy-0
default = yes

5、修改权限

chown -R root:swift /etc/swift/*

6、重启服务

service memcached restart
service swift-proxy restart

7、启动对象存储服务

swift-init all start

验证swift

1、运行脚本

sh demo-openrc

2、获得服务状态

swift stat

显示类似以下信息即成功

                        Account: AUTH_ed0b60bf607743088218b0a533d5943f
                     Containers: 0
                        Objects: 0
                          Bytes: 0
Containers in policy "policy-0": 0
   Objects in policy "policy-0": 0
     Bytes in policy "policy-0": 0
    X-Account-Project-Domain-Id: default
                    X-Timestamp: 1444143887.71539
                     X-Trans-Id: tx1396aeaf17254e94beb34-0056143bde
                   Content-Type: text/plain; charset=utf-8
                  Accept-Ranges: bytes

3、创建一个容器

openstack container create 容器名

4、上传一个对象

openstack object create 容器名 对象名

5、获得对象列表

openstack object list 容器名字

6、下载对象

 openstack object save 容器名 对象名

也可以用curl或postman验证