ceph部署

原创 已于 2023-06-06 09:24:15 修改 · 417 阅读 · 0 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
文章标签：

#ceph

于 2023-06-05 09:38:39 首次发布

前期准备

系统要求

Python 3
Systemd
Podman or Docker for running containers
Time synchronization (such as chrony or NTP)
LVM2 for provisioning storage devices

配置主机名

10.10.101.10 ceph-01
10.10.101.11 ceph-02
10.10.101.12 ceph-03

更新到最新

yum update -y

关闭selinux

setenforce 0
sed -i 's#SELINUX=enforcing#SELINUX=disabled#g' /etc/selinux/config

关闭防火墙

systemctl disable --now firewalld

配置免密

ssh-keygen -f /root/.ssh/id_rsa -P ''
ssh-copy-id -o StrictHostKeyChecking=no root@10.10.101.10
ssh-copy-id -o StrictHostKeyChecking=no root@10.10.101.11
ssh-copy-id -o StrictHostKeyChecking=no root@10.10.101.12

安装python3.6

 yum install -y python3

基于 CURL 的安装

使用 curl 获取最新版本的独立脚本

curl --silent --remote-name --location https://github.com/ceph/ceph/raw/quincy/src/cephadm/cephadm

我执行死活下载不下来，直接copy的

添加可执行权限

chmod +x cephadm

要安装提供 cephadm 命令的软件包

[root@ceph-01 ~]# ./cephadm  add-repo --release octopus
[root@ceph-01 ~]# cat /etc/yum.repos.d/ceph.repo 
[Ceph]
name=Ceph $basearch
baseurl=https://download.ceph.com/rpm-octopus/el7/$basearch
enabled=1
gpgcheck=1
gpgkey=https://download.ceph.com/keys/release.asc

[Ceph-noarch]
name=Ceph noarch
baseurl=https://download.ceph.com/rpm-octopus/el7/noarch
enabled=1
gpgcheck=1
gpgkey=https://download.ceph.com/keys/release.asc

[Ceph-source]
name=Ceph SRPMS
baseurl=https://download.ceph.com/rpm-octopus/el7/SRPMS
enabled=1
gpgcheck=1
gpgkey=https://download.ceph.com/keys/release.asc

# 修改下载源
[root@ceph-01 ~]# sed -i 's#download.ceph.com#mirrors.aliyun.com/ceph#' /etc/yum.repos.d/ceph.repo
[root@ceph-01 ~]# ./cephadm install
[root@ceph-01 ~]# which cephadm 
/usr/sbin/cephadm

引导新的集群

[root@ceph-01 ~]#  cephadm bootstrap --mon-ip 10.10.101.10
Verifying podman|docker is present...
Verifying lvm2 is present...
Verifying time synchronization is in place...
Unit chronyd.service is enabled and running
Repeating the final host check...
podman|docker (/usr/bin/docker) is present
systemctl is present
lvcreate is present
Unit chronyd.service is enabled and running
Host looks OK
Cluster fsid: 5a0ef854-fb8c-11ed-b60e-005056b5e7bd
Verifying IP 10.10.101.10 port 3300 ...
Verifying IP 10.10.101.10 port 6789 ...
Mon IP 10.10.101.10 is in CIDR network 10.10.101.0/24
Pulling container image quay.io/ceph/ceph:v15...
Extracting ceph user uid/gid from container image...
Creating initial keys...
Creating initial monmap...
Creating mon...
Waiting for mon to start...
Waiting for mon...
mon is available
Assimilating anything we can from ceph.conf...
Generating new minimal ceph.conf...
Restarting the monitor...
Setting mon public_network...
Creating mgr...
Verifying port 9283 ...
Wrote keyring to /etc/ceph/ceph.client.admin.keyring
Wrote config to /etc/ceph/ceph.conf
Waiting for mgr to start...
Waiting for mgr...
mgr not available, waiting (1/10)...
mgr not available, waiting (2/10)...
mgr not available, waiting (3/10)...
mgr not available, waiting (4/10)...
mgr is available
Enabling cephadm module...
Waiting for the mgr to restart...
Waiting for Mgr epoch 5...
Mgr epoch 5 is available
Setting orchestrator backend to cephadm...
Generating ssh key...
Wrote public SSH key to to /etc/ceph/ceph.pub
Adding key to root@localhost's authorized_keys...
Adding host ceph-01...
Deploying mon service with default placement...
Deploying mgr service with default placement...
Deploying crash service with default placement...
Enabling mgr prometheus module...
Deploying prometheus service with default placement...
Deploying grafana service with default placement...
Deploying node-exporter service with default placement...
Deploying alertmanager service with default placement...
Enabling the dashboard module...
Waiting for the mgr to restart...
Waiting for Mgr epoch 13...
Mgr epoch 13 is available
Generating a dashboard self-signed certificate...
Creating initial admin user...
Fetching dashboard port number...
Ceph Dashboard is now available at:

	     URL: https://ceph-01:8443/
	    User: admin
	Password: pv56q6l7pe

You can access the Ceph CLI with:

	sudo /usr/sbin/cephadm shell --fsid 5a0ef854-fb8c-11ed-b60e-005056b5e7bd -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring

Please consider enabling telemetry to help improve Ceph:

	ceph telemetry on

For more information see:

	https://docs.ceph.com/docs/master/mgr/telemetry/

Bootstrap complete.

查看状态

[root@ceph-01 ~]# cephadm shell
Inferring fsid 5a0ef854-fb8c-11ed-b60e-005056b5e7bd
Inferring config /var/lib/ceph/5a0ef854-fb8c-11ed-b60e-005056b5e7bd/mon.ceph-01/config
Using recent ceph image quay.io/ceph/ceph@sha256:c08064dde4bba4e72a1f55d90ca32df9ef5aafab82efe2e0a0722444a5aaacca
[ceph: root@ceph-01 /]# ceph -s
  cluster:
    id:     5a0ef854-fb8c-11ed-b60e-005056b5e7bd
    health: HEALTH_WARN
            OSD count 0 < osd_pool_default_size 3
 
  services:
    mon: 1 daemons, quorum ceph-01 (age 5m)
    mgr: ceph-01.tvpflp(active, since 4m)
    osd: 0 osds: 0 up, 0 in
 
  data:
    pools:   0 pools, 0 pgs
    objects: 0 objects, 0 B
    usage:   0 B used, 0 B / 0 B avail
    pgs:     
 
[ceph: root@ceph-01 /]# ceph orch ps 
NAME                   HOST     STATUS        REFRESHED  AGE  VERSION  IMAGE NAME                                IMAGE ID      CONTAINER ID  
alertmanager.ceph-01   ceph-01  running (2m)  40s ago    4m   0.20.0   quay.io/prometheus/alertmanager:v0.20.0   0881eb8f169f  8e1e36854d97  
crash.ceph-01          ceph-01  running (4m)  40s ago    4m   15.2.17  quay.io/ceph/ceph:v15                     93146564743f  593abfc7e78c  
grafana.ceph-01        ceph-01  running (2m)  40s ago    3m   6.7.4    quay.io/ceph/ceph-grafana:6.7.4           557c83e11646  724b4e757e92  
mgr.ceph-01.tvpflp     ceph-01  running (5m)  40s ago    5m   15.2.17  quay.io/ceph/ceph:v15                     93146564743f  52e36aeac870  
mon.ceph-01            ceph-01  running (5m)  40s ago    6m   15.2.17  quay.io/ceph/ceph:v15                     93146564743f  ba8833732dd1  
node-exporter.ceph-01  ceph-01  running (2m)  40s ago    3m   0.18.1   quay.io/prometheus/node-exporter:v0.18.1  e5a616e4b9cf  344d820ca236  
prometheus.ceph-01     ceph-01  running (2m)  40s ago    2m   2.18.1   quay.io/prometheus/prometheus:v2.18.1     de242295e225  7fa3f4c02b18  
[ceph: root@ceph-01 /]# ceph orch ps --daemon-type mon 
NAME         HOST     STATUS        REFRESHED  AGE  VERSION  IMAGE NAME             IMAGE ID      CONTAINER ID  
mon.ceph-01  ceph-01  running (6m)  52s ago    6m   15.2.17  quay.io/ceph/ceph:v15  93146564743f  ba8833732dd1  

[root@ceph-01 ~]# 
[root@ceph-01 ~]# ceph -v 
ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)
[root@ceph-01 ~]# ssh-copy-id -f -i /etc/ceph/ceph.pub root@ceph-02
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/etc/ceph/ceph.pub"

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@ceph-02'"
and check to make sure that only the key(s) you wanted were added.

[root@ceph-01 ~]# ssh-copy-id -f -i /etc/ceph/ceph.pub root@ceph-03
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/etc/ceph/ceph.pub"

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@ceph-03'"
and check to make sure that only the key(s) you wanted were added.

[root@ceph-01 ~]# ssh-copy-id -f -i /etc/ceph/ceph.pub root@ceph-01
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/etc/ceph/ceph.pub"

Number of key(s) added: 1

Now try logging into the machine, with:   "ssh 'root@ceph-01'"
and check to make sure that only the key(s) you wanted were added.

[root@ceph-01 ~]# cephadm shell
Inferring fsid 5a0ef854-fb8c-11ed-b60e-005056b5e7bd
Inferring config /var/lib/ceph/5a0ef854-fb8c-11ed-b60e-005056b5e7bd/mon.ceph-01/config
Using recent ceph image quay.io/ceph/ceph@sha256:c08064dde4bba4e72a1f55d90ca32df9ef5aafab82efe2e0a0722444a5aaacca
# # 创建mon和mgr
[ceph: root@ceph-01 /]# ceph orch host add  ceph-02
Added host 'ceph-02'
[ceph: root@ceph-01 /]# ceph orch host add  ceph-03
Added host 'ceph-03'
[ceph: root@ceph-01 /]# ceph orch ls 
NAME           RUNNING  REFRESHED  AGE  PLACEMENT  IMAGE NAME                                IMAGE ID      
alertmanager       1/1  9s ago     9m   count:1    quay.io/prometheus/alertmanager:v0.20.0   0881eb8f169f  
crash              1/3  9s ago     9m   *          quay.io/ceph/ceph:v15                     93146564743f  
grafana            1/1  9s ago     9m   count:1    quay.io/ceph/ceph-grafana:6.7.4           557c83e11646  
mgr                1/2  9s ago     9m   count:2    quay.io/ceph/ceph:v15                     93146564743f  
mon                1/5  9s ago     9m   count:5    quay.io/ceph/ceph:v15                     93146564743f  
node-exporter      1/3  9s ago     9m   *          quay.io/prometheus/node-exporter:v0.18.1  e5a616e4b9cf  
prometheus         1/1  9s ago     9m   count:1    quay.io/prometheus/prometheus:v2.18.1     de242295e225  

# 查看目前集群纳管的节点
[ceph: root@ceph-01 /]# ceph orch host ls  
HOST     ADDR     LABELS  STATUS  
ceph-01  ceph-01                  
ceph-02  ceph-02                  
ceph-03  ceph-03

创建mon和mgr

[ceph: root@ceph-01 /]# ceph orch apply mon 3
Scheduled mon update...
[ceph: root@ceph-01 /]# ceph orch apply mon ceph-01,ceph-02,ceph-03
Scheduled mon update...
[ceph: root@ceph-01 /]# ceph mon dump
dumped monmap epoch 1
epoch 1
fsid 5a0ef854-fb8c-11ed-b60e-005056b5e7bd
last_changed 2023-05-26T06:17:00.155294+0000
created 2023-05-26T06:17:00.155294+0000
min_mon_release 15 (octopus)
0: [v2:10.10.101.10:3300/0,v1:10.10.101.10:6789/0] mon.ceph-01
[ceph: root@ceph-01 /]# ceph mon dump
dumped monmap epoch 1
epoch 1
fsid 5a0ef854-fb8c-11ed-b60e-005056b5e7bd
last_changed 2023-05-26T06:17:00.155294+0000
created 2023-05-26T06:17:00.155294+0000
min_mon_release 15 (octopus)
0: [v2:10.10.101.10:3300/0,v1:10.10.101.10:6789/0] mon.ceph-01
[ceph: root@ceph-01 /]# 
[ceph: root@ceph-01 /]# ceph mon dump
dumped monmap epoch 1
epoch 1
fsid 5a0ef854-fb8c-11ed-b60e-005056b5e7bd
last_changed 2023-05-26T06:17:00.155294+0000
created 2023-05-26T06:17:00.155294+0000
min_mon_release 15 (octopus)
0: [v2:10.10.101.10:3300/0,v1:10.10.101.10:6789/0] mon.ceph-01

创建osd

[ceph: root@ceph-01 /]# ceph orch daemon add osd ceph-01:/dev/sdb
Created osd(s) 0 on host 'ceph-01'
[ceph: root@ceph-01 /]# ceph orch daemon add osd ceph-02:/dev/sdb
Created osd(s) 1 on host 'ceph-02'
[ceph: root@ceph-01 /]# ceph orch daemon add osd ceph-03:/dev/sdb
Created osd(s) 2 on host 'ceph-03'

创建mds

[ceph: root@ceph-01 /]# ceph osd pool create cephfs_data
pool 'cephfs_data' created
[ceph: root@ceph-01 /]# ceph osd pool create cephfs_metadata
pool 'cephfs_metadata' created
[ceph: root@ceph-01 /]# ceph fs new cephfs cephfs_metadata cephfs_data
new fs with metadata pool 3 and data pool 2
[ceph: root@ceph-01 /]# ceph orch apply mds cephfs --placement="3 ceph-01 ceph-02 ceph-03"
Scheduled mds.cephfs update...
[ceph: root@ceph-01 /]# ceph orch ps --daemon-type mds
NAME                       HOST     STATUS         REFRESHED  AGE  VERSION  IMAGE NAME             IMAGE ID      CONTAINER ID  
mds.cephfs.ceph-01.lvzpgk  ceph-01  running (59s)  55s ago    59s  15.2.17  quay.io/ceph/ceph:v15  93146564743f  33256c710a97  
mds.cephfs.ceph-02.ohhfia  ceph-02  running (61s)  55s ago    61s  15.2.17  quay.io/ceph/ceph:v15  93146564743f  37dee2bc1e20  
mds.cephfs.ceph-03.fguquy  ceph-03  running (63s)  55s ago    63s  15.2.17  quay.io/ceph/ceph:v15  93146564743f  237f93101298

创建rgw

# 首先创建一个领域
[ceph: root@ceph-01 /]# radosgw-admin realm create --rgw-realm=myorg --default
{
    "id": "11b167f7-3a4b-48cb-80a3-a4c3f396049e",
    "name": "myorg",
    "current_period": "009302d5-14fb-493c-877e-4586d0c5f017",
    "epoch": 1
}
# 创建区域组
[ceph: root@ceph-01 /]# radosgw-admin zonegroup create --rgw-zonegroup=default --master --default
{
    "id": "bdc088f7-1f2a-4af1-96c6-7f2fb027bc1b",
    "name": "default",
    "api_name": "default",
    "is_master": "true",
    "endpoints": [],
    "hostnames": [],
    "hostnames_s3website": [],
    "master_zone": "",
    "zones": [],
    "placement_targets": [],
    "default_placement": "",
    "realm_id": "11b167f7-3a4b-48cb-80a3-a4c3f396049e",
    "sync_policy": {
        "groups": []
    }
}
# 创建区域
[ceph: root@ceph-01 /]# radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=cn-east-1 --master --default
{
    "id": "59935956-4617-47f8-8cca-086890d844ac",
    "name": "cn-east-1",
    "domain_root": "cn-east-1.rgw.meta:root",
    "control_pool": "cn-east-1.rgw.control",
    "gc_pool": "cn-east-1.rgw.log:gc",
    "lc_pool": "cn-east-1.rgw.log:lc",
    "log_pool": "cn-east-1.rgw.log",
    "intent_log_pool": "cn-east-1.rgw.log:intent",
    "usage_log_pool": "cn-east-1.rgw.log:usage",
    "roles_pool": "cn-east-1.rgw.meta:roles",
    "reshard_pool": "cn-east-1.rgw.log:reshard",
    "user_keys_pool": "cn-east-1.rgw.meta:users.keys",
    "user_email_pool": "cn-east-1.rgw.meta:users.email",
    "user_swift_pool": "cn-east-1.rgw.meta:users.swift",
    "user_uid_pool": "cn-east-1.rgw.meta:users.uid",
    "otp_pool": "cn-east-1.rgw.otp",
    "system_key": {
        "access_key": "",
        "secret_key": ""
    },
    "placement_pools": [
        {
            "key": "default-placement",
            "val": {
                "index_pool": "cn-east-1.rgw.buckets.index",
                "storage_classes": {
                    "STANDARD": {
                        "data_pool": "cn-east-1.rgw.buckets.data"
                    }
                },
                "data_extra_pool": "cn-east-1.rgw.buckets.non-ec",
                "index_type": 0
            }
        }
    ],
    "realm_id": "11b167f7-3a4b-48cb-80a3-a4c3f396049e"
}
[ceph: root@ceph-01 /]# ceph orch apply rgw myorg cn-east-1 --placement="3 ceph-01 ceph-02 ceph-03"
Scheduled rgw.myorg.cn-east-1 update...
[ceph: root@ceph-01 /]# ceph orch ps --daemon-type rgw
NAME                                HOST     STATUS    REFRESHED  AGE  VERSION    IMAGE NAME  IMAGE ID   
rgw.myorg.cn-east-1.ceph-03.qeiawx  ceph-03  starting  -          -    <unknown>  <unknown>   <unknown>  
[ceph: root@ceph-01 /]# ceph orch daemon add osd ceph-03:/dev/sdc
Created osd(s) 3 on host 'ceph-03'
[ceph: root@ceph-01 /]# ceph orch daemon add osd ceph-02:/dev/sdc
^[[ACreated osd(s) 4 on host 'ceph-02'
[ceph: root@ceph-01 /]# ceph orch daemon add osd ceph-01:/dev/sdc
Created osd(s) 5 on host 'ceph-01'

查看磁盘分配情况

[ceph: root@ceph-01 /]# exit
[root@ceph-01 ~]# lsblk 
NAME                                                                                                  MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
sda                                                                                                     8:0    0   40G  0 disk 
├─sda1                                                                                                  8:1    0    1G  0 part /boot
└─sda2                                                                                                  8:2    0   39G  0 part 
  ├─centos-root                                                                                       253:0    0   35G  0 lvm  /
  └─centos-swap                                                                                       253:1    0    4G  0 lvm  [SWAP]
sdb                                                                                                     8:16   0  500G  0 disk 
└─ceph--e1455cf0--714c--4c9a--a5f8--18521631de08-osd--block--53c70dee--5829--4aa4--82c3--d408b44ae079 253:2    0  500G  0 lvm  
sdc                                                                                                     8:32   0  500G  0 disk 
└─ceph--7cef9e9e--c432--41ee--9f56--2069a18baf44-osd--block--7b22409b--ff2b--4e89--ab1a--d9373086e145 253:3    0  500G  0 lvm  
sr0                                                                                                    11:0    1 1024M  0 rom

创建RBD

[root@ceph-01 ~]# ceph osd pool create rbd 16
pool 'rbd' created
[root@ceph-01 ~]# ceph osd pool application enable rbd rbd
enabled application 'rbd' on pool 'rbd'
[root@ceph-01 ~]# rbd create rbd1 --size 204800
[root@ceph-01 ~]# rbd --image rbd1 info
rbd image 'rbd1':
	size 200 GiB in 51200 objects
	order 22 (4 MiB objects)
	snapshot_count: 0
	id: 3933e86757f8
	block_name_prefix: rbd_data.3933e86757f8
	format: 2
	features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
	op_features: 
	flags: 
	create_timestamp: Fri May 26 15:01:09 2023
	access_timestamp: Fri May 26 15:01:09 2023
	modify_timestamp: Fri May 26 15:01:09 2023
[root@ceph-01 ~]# radosgw-admin user create --uid="admin" --display-name="admin user"
{
    "user_id": "admin",
    "display_name": "admin user",
    "email": "",
    "suspended": 0,
    "max_buckets": 1000,
    "subusers": [],
    "keys": [
        {
            "user": "admin",
            "access_key": "4UDRE994TNPSF00C6ZVO",
            "secret_key": "q1l3fOugHCJy9mDwYDao0Ssl6ewHnXQj7PNlUZqx"
        }
    ],
    "swift_keys": [],
    "caps": [],
    "op_mask": "read, write, delete",
    "default_placement": "",
    "default_storage_class": "",
    "placement_tags": [],
    "bucket_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    },
    "user_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    },
    "temp_url_keys": [],
    "type": "rgw",
    "mfa_ids": []
}

[root@ceph-01 ~]# radosgw-admin user info --uid=admin
{
    "user_id": "admin",
    "display_name": "admin user",
    "email": "",
    "suspended": 0,
    "max_buckets": 1000,
    "subusers": [],
    "keys": [
        {
            "user": "admin",
            "access_key": "4UDRE994TNPSF00C6ZVO",
            "secret_key": "q1l3fOugHCJy9mDwYDao0Ssl6ewHnXQj7PNlUZqx"
        }
    ],
    "swift_keys": [],
    "caps": [],
    "op_mask": "read, write, delete",
    "default_placement": "",
    "default_storage_class": "",
    "placement_tags": [],
    "bucket_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    },
    "user_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    },
    "temp_url_keys": [],
    "type": "rgw",
    "mfa_ids": []
}

[root@ceph-01 ~]# yum install s3cmd -y
已加载插件：fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirrors.aliyun.com
 * epel: mirror.lzu.edu.cn
 * extras: mirrors.aliyun.com
 * updates: mirrors.aliyun.com
正在解决依赖关系
--> 正在检查事务
---> 软件包 s3cmd.noarch.0.2.3.0-4.el7 将被 安装
--> 正在处理依赖关系 python-dateutil，它被软件包 s3cmd-2.3.0-4.el7.noarch 需要
--> 正在处理依赖关系 python-magic，它被软件包 s3cmd-2.3.0-4.el7.noarch 需要
--> 正在检查事务
---> 软件包 python-dateutil.noarch.0.1.5-7.el7 将被 安装
---> 软件包 python-magic.noarch.0.5.11-37.el7 将被 安装
--> 解决依赖关系完成

依赖关系解决

======================================================================================================================================================================================
 Package                                          架构                                    版本                                            源                                     大小
======================================================================================================================================================================================
正在安装:
 s3cmd                                            noarch                                  2.3.0-4.el7                                     epel                                  208 k
为依赖而安装:
 python-dateutil                                  noarch                                  1.5-7.el7                                       base                                   85 k
 python-magic                                     noarch                                  5.11-37.el7                                     base                                   34 k

事务概要
======================================================================================================================================================================================
安装  1 软件包 (+2 依赖软件包)

总下载量：326 k
安装大小：1.1 M
Downloading packages:
(1/3): python-magic-5.11-37.el7.noarch.rpm                                                                                                                     |  34 kB  00:00:00     
(2/3): python-dateutil-1.5-7.el7.noarch.rpm                                                                                                                    |  85 kB  00:00:00     
(3/3): s3cmd-2.3.0-4.el7.noarch.rpm                                                                                                                            | 208 kB  00:00:00     
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
总计                                                                                                                                                  446 kB/s | 326 kB  00:00:00     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  正在安装    : python-magic-5.11-37.el7.noarch                                                                                                                                   1/3 
  正在安装    : python-dateutil-1.5-7.el7.noarch                                                                                                                                  2/3 
  正在安装    : s3cmd-2.3.0-4.el7.noarch                                                                                                                                          3/3 
  验证中      : python-dateutil-1.5-7.el7.noarch                                                                                                                                  1/3 
  验证中      : python-magic-5.11-37.el7.noarch                                                                                                                                   2/3 
  验证中      : s3cmd-2.3.0-4.el7.noarch                                                                                                                                          3/3 

已安装:
  s3cmd.noarch 0:2.3.0-4.el7                                                                                                                                                          

作为依赖被安装:
  python-dateutil.noarch 0:1.5-7.el7                                                         python-magic.noarch 0:5.11-37.el7                                                        

完毕！
[root@ceph-01 ~]# s3cmd --configure

Enter new values or accept defaults in brackets with Enter.
Refer to user manual for detailed description of all options.

Access key and Secret key are your identifiers for Amazon S3. Leave them empty for using the env variables.
Access Key [4UDRE994TNPSF00C6ZVO]: 
Secret Key [q1l3fOugHCJy9mDwYDao0Ssl6ewHnXQj7PNlUZqx]: 
Default Region [US]: 

Use "s3.amazonaws.com" for S3 Endpoint and not modify it to the target Amazon S3.
S3 Endpoint [10.10.101.10]: 

Use "%(bucket)s.s3.amazonaws.com" to the target Amazon S3. "%(bucket)s" and "%(location)s" vars can be used
if the target S3 system supports dns based buckets.
DNS-style bucket+hostname:port template for accessing a bucket [%(bucket)s.s3.amazonaws.com]: 10.10.101.10

Encryption password is used to protect your files from reading
by unauthorized persons while in transfer to S3
Encryption password: 
Path to GPG program [/usr/bin/gpg]: 

When using secure HTTPS protocol all communication with Amazon S3
servers is protected from 3rd party eavesdropping. This method is
slower than plain HTTP, and can only be proxied with Python 2.7 or newer
Use HTTPS protocol [No]: 

On some networks all internet access must go through a HTTP proxy.
Try setting it here if you can't connect to S3 directly
HTTP Proxy server name: 

New settings:
  Access Key: 4UDRE994TNPSF00C6ZVO
  Secret Key: q1l3fOugHCJy9mDwYDao0Ssl6ewHnXQj7PNlUZqx
  Default Region: US
  S3 Endpoint: 10.10.101.10
  DNS-style bucket+hostname:port template for accessing a bucket: 10.10.101.10
  Encryption password: 
  Path to GPG program: /usr/bin/gpg
  Use HTTPS protocol: False
  HTTP Proxy server name: 
  HTTP Proxy server port: 0

Test access with supplied credentials? [Y/n] y
Please wait, attempting to list all buckets...
Success. Your access key and secret key worked fine :-)

Now verifying that encryption works...
Not configured. Never mind.

Save settings? [y/N] y
Configuration saved to '/root/.s3cfg'
[root@ceph-01 ~]# s3cmd mb s3://mybucket
Bucket 's3://mybucket/' created
[root@ceph-01 ~]# s3cmd ls
2023-05-26 07:20  s3://mybucket
[root@ceph-01 ~]# s3cmd put /etc/hosts s3://mybucket
upload: '/etc/hosts' -> 's3://mybucket/hosts'  [1 of 1]
 222 of 222   100% in    0s   354.24 KB/s
 222 of 222   100% in    3s    63.56 B/s  done
[root@ceph-01 ~]# 
[root@ceph-01 ~]# s3cmd ls
2023-05-26 07:20  s3://mybucket
[root@ceph-01 ~]# s3cmd ls s3://mybucket
2023-05-26 07:21          222  s3://mybucket/hosts

[root@ceph-01 ~]# radosgw-admin user info --uid=admin
{
    "user_id": "admin",
    "display_name": "admin user",
    "email": "",
    "suspended": 0,
    "max_buckets": 1000,
    "subusers": [],
    "keys": [
        {
            "user": "admin",
            "access_key": "4UDRE994TNPSF00C6ZVO",
            "secret_key": "q1l3fOugHCJy9mDwYDao0Ssl6ewHnXQj7PNlUZqx"
        }
    ],
    "swift_keys": [],
    "caps": [],
    "op_mask": "read, write, delete",
    "default_placement": "",
    "default_storage_class": "",
    "placement_tags": [],
    "bucket_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    },
    "user_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    },
    "temp_url_keys": [],
    "type": "rgw",
    "mfa_ids": []
}
[root@ceph-01 ~]# echo "4UDRE994TNPSF00C6ZVO" > access_key
[root@ceph-01 ~]# echo "q1l3fOugHCJy9mDwYDao0Ssl6ewHnXQj7PNlUZqx" > secret_key
[root@ceph-01 ~]# ceph dashboard set-rgw-api-access-key -i access_key
Option RGW_API_ACCESS_KEY updated
[root@ceph-01 ~]# ceph dashboard set-rgw-api-secret-key -i secret_key
Option RGW_API_SECRET_KEY updated
Ceph入门到精通- ceph orch daemon add osd ceph03:/dev/sdb
隔壁老瓦的专栏
04-21 1790
ceph 添加osd 错误
Ceph实战（十一）：重磅！！！一键部署集群的脚本
码农飞哥
01-05 3663
本文对ceph集群部署的脚本进行了整合，对启动步骤进行了简化，可以大大的提高部署效率。
ceph一键部署python脚本
12-22
ceph一键部署python脚本
centos7.9一键部署ceph-v15.2.17集群（cephadm方式）
Student_xx的博客
05-21 1500
磁盘：2T*3=6T（共30T）查看登录地址、用户、密码。
ceph集群一键部署脚本
anqunluo5527的博客
06-12 359
脚本后续更新及迭代将由kkitDeploy项目代替 https://github.com/luckman666/kkitdeploy_server 请大家持续关注kkitDeploy 分布式存储ceph相信大家比较熟悉了。某项目临时要做一个40个节点的存储集群。所以写了这个脚本。 一键部署脚本如下： git clone https://github.com/l...
脚本部署Ceph分布式存储服务
运维@小兵的博客
06-08 628
函数库链接：https://blog.youkuaiyun.com/anqixiang/article/details/89964048 配置文件链接：https://blog.youkuaiyun.com/anqixiang/article/details/91347369 部署Ceph集群 #!/bin/bash #AUTHOR:AN #VERSION:1.1.0 #DATE:2019-06-08 #MODIFY: ...
精选资源
03 Ceph 部署文档.docx
04-16
Ceph 部署文档 本文档详细介绍了 Ceph 存储平台的部署过程，包括安装环境、配置 Ceph 源、做免密码认证、修改sudo配置、创建集群、安装软件包、初始化 mon 服务和准备 OSD 存储挂载目录等步骤。 知识点1：Ceph ...
CEPH部署文档V1.0.docx
05-12
CEPH 部署文档 V1.0 CEPH 是一个开源的分布式对象存储和文件系统，提供高可用性、可扩展性和高性能的存储解决方案。下面是 CEPH 部署文档 V1.0 中的重要知识点： 硬件配置 在部署 CEPH 之前，需要准备合适的硬件...
【分布式系统】ceph部署（命令+截图巨详细版）
F12138X的博客
07-09 1万+
每个人都想把手伸向夜空，去捕捉那属于自己的星星，但极少有人能真正地知道自己的星星在哪个位置
ceph 部署
lxplxplike的博客
07-14 1578
【1】DAS（直接附加存储，是直接接到计算机的主板总线上去的存储）IDE、SATA、SCSI、SAS、USB 接口的磁盘所谓接口就是一种存储设备驱动下的磁盘设备，提供块级别的存储【2】NAS（网络附加存储，是通过网络附加到当前主机文件系统之上的存储）文件系统级别的存储，本身就是一个做好的文件系统，通过nfs接口在用户空间输出后，客户端基于内核模块与远程主机进行网络通信，把它转为好像本地文件系统一样来使用，这种存储服务是没办法对它再一次格式化创建文件系统块的【3】SAN（存储区域网络）
Ceph部署
2302_76824193的博客
07-17 1179
ceph部署
Ceph集群自动化部署脚本
北城半夏
02-06 1082
Ceph 介绍 使用ansible进行自动化ceph集群的部署 环境准备 准备至少三台服务器，其中一台用于安装ansible，用于管理其他节点 另外两台服务器用于安装一下相应的服务，注意：需要ceph集群需要准备多块数据盘用于创建OSD、RBD（块存储） 本次部署测试的时候使用的是块存储，其他存储方式尚未调研，需要自行寻找 代码仓库 地址：https://gitee.com/yuanhuanliang/ceph 软件架构 使用ansible统一管理及部署，使用方式相对便携，离线环境的相关依赖包尚未准备
脚本在线部署ceph
啊酒弟弟的博客
12-04 426
hostnamectl set-hostname ceph01    hostnamectl set-hostname ceph02    hostnamectl set-hostname ceph03 systemctl stop firewalld && systemctl disable firewalld && setenforce 0 [root@ceph01 ~]# cd /etc/yum.repos.d/ [root@ce
Ceph集群存储部署
最新发布
m_2076的博客
06-23 1489
Ceph是一种可靠的、可扩展的、统一的、分布式的存储系统。Ceph高度可靠、易于管理且免费。Ceph提供了非凡的可扩展性——数以千计的客户端访问PB到EB的数据。Ceph存储集群相互通信以动态复制和重新分配数据。目前众多云厂商都在使用Ceph，应用广泛。如：华为、阿里、腾讯等等。目前火热的云技术OpenStack、Kubernetes都支持后端整合Ceph，从而提高数据的可用性、扩展性、容错等能力。 本文主要介绍使用3台云主机搭建Ceph分布式集群存储系统和使用Ceph分布式集群存储系统。
Ceph集群生产环境安装部署
热门推荐
ywq935的博客
09-11 1万+
一、配置规划： 二、部署 1. ntp-server开启ntp服务： apt-get install ntp ntpdate ntp-doc systemctl enable ntp systemctl start ntp 2. ceph node 三台node全部执行如下操作： 磁盘分区规划如顶部表格，按照规划写的磁盘划分脚本，分别在3台node上执行脚本： # cat ~...
openEuler 22.03 LTS x86_64 cephadm 部署ceph16.2.14【3】添加osd失败 Created no osd(s) on host already created
hknaruto的专栏
11-27 1851
可手动添加osd节点，自动初始化/dev/sdb，但是ceph orch device ls没有数据显示，看不到磁盘健康状态。不理解。参考。
Cephadm部署ceph15集群
你说亮不亮的博客
01-30 1648
使用cephadm搭建ceph分布式存储
openEuler 通过 手工方式 安装 ceph 步骤
gs80140的专栏
12-01 3668
这个错误是python 从3.9升到3.10的初期阶段产生的, 在 3.10.6版本修复了, 但是 openEuler 22.09没有升到 3.10.6以上版本, 所以使用 openEuler 22.03 LTS 版本 , 此版本使用的python 是3.9.9。我的服务器重启后遇到sda,sdb磁盘互换的问题, 至于此问题咋解决,网上搜关键词 sda sdb 被互换 解决 , 修改 /etc/fstab 为UUID 好像只有部分服务器起作用, 有台服务器又重启了一下才好。
评论 1
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值