视频完整文档，请下载后查看

分布式存储Ceph部署及对接Openstack      

目录

1 Ceph集群部署. PAGEREF _Toc5574155 \h 4 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100350035000000

1.1 集群部署架构. PAGEREF _Toc5574156 \h 4 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100350036000000

1.2 网络规划. PAGEREF _Toc5574157 \h 4 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100350037000000

1.3 存储规划. PAGEREF _Toc5574158 \h 4 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100350038000000

1.4 节点准备. PAGEREF _Toc5574159 \h 5 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100350039000000

1.4.1 系统安装. PAGEREF _Toc5574160 \h 5 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100360030000000

1.4.2 系统配置. PAGEREF _Toc5574161 \h 5 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100360031000000

1.4.3 Disabled selinux PAGEREF _Toc5574162 \h 5 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100360032000000

1.4.4 配置主机名. PAGEREF _Toc5574163 \h 5 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100360033000000

1.4.5 配置网卡. PAGEREF _Toc5574164 \h 5 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100360034000000

1.4.6 配置hosts PAGEREF _Toc5574165 \h 8 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100360035000000

1.4.7 系统重启. PAGEREF _Toc5574166 \h 8 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100360036000000

1.5 安装ansible PAGEREF _Toc5574167 \h 8 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100360037000000

1.5.1 辅助工具安装. PAGEREF _Toc5574168 \h 8 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100360038000000

1.5.2 添加ansible repo源. PAGEREF _Toc5574169 \h 8 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100360039000000

1.5.3 安装ansible PAGEREF _Toc5574170 \h 8 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100370030000000

1.5.4 配置inventory PAGEREF _Toc5574171 \h 9 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100370031000000

1.5.5 修改ansible.cfg PAGEREF _Toc5574172 \h 9 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100370032000000

1.5.6 Ansible测试连通性. PAGEREF _Toc5574173 \h 9 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100370033000000

1.6 修改部署脚本. PAGEREF _Toc5574174 \h 10 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100370034000000

1.6.1 下载ceph-ansible源码. PAGEREF _Toc5574175 \h 10 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100370035000000

1.6.2 入口文件site.yml PAGEREF _Toc5574176 \h 10 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100370036000000

1.6.3 配置all.yml PAGEREF _Toc5574177 \h 10 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100370037000000

1.6.4 配置mons.yml PAGEREF _Toc5574178 \h 11 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100370038000000

1.6.5 配置osds.yml PAGEREF _Toc5574179 \h 11 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100370039000000

1.6.6 配置mgrs.yml PAGEREF _Toc5574180 \h 11 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100380030000000

1.7 部署集群. PAGEREF _Toc5574181 \h 11 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100380031000000

1.8 修改三个节点的ceph.conf PAGEREF _Toc5574182 \h 11 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100380032000000

1.9 dashboard部署. PAGEREF _Toc5574183 \h 12 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100380033000000

1.10 集群检查. PAGEREF _Toc5574184 \h 12 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100380034000000

2 对接Openstack PAGEREF _Toc5574185 \h 12 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100380035000000

2.1 在openstack节点配置ceph hosts PAGEREF _Toc5574186 \h 12 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100380036000000

2.2 创建pools PAGEREF _Toc5574187 \h 12 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100380037000000

2.3 初始化pool PAGEREF _Toc5574188 \h 13 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100380038000000

2.4 将ceph.conf拷贝至openstack节点. PAGEREF _Toc5574189 \h 13 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100380039000000

2.5 openstack节点安装ceph client包. PAGEREF _Toc5574190 \h 13 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100390030000000

2.6 设置客户端auth PAGEREF _Toc5574191 \h 13 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100390031000000

2.7 添加keyring到openstack server PAGEREF _Toc5574192 \h 13 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100390032000000

2.8 计算节点生成secret uuid PAGEREF _Toc5574193 \h 14 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100390033000000

2.9 对接nova PAGEREF _Toc5574194 \h 14 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100390034000000

2.10 对接cinder PAGEREF _Toc5574195 \h 15 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100390035000000

2.11 对接glance PAGEREF _Toc5574196 \h 15 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100390036000000

2.12 服务重启. PAGEREF _Toc5574197 \h 15 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100390037000000

3 对接功能验证. PAGEREF _Toc5574198 \h 16 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100390038000000

3.1 计算-创建虚拟机. PAGEREF _Toc5574199 \h 16 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003100390039000000

3.2 镜像-上传镜像. PAGEREF _Toc5574200 \h 16 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003200300030000000

3.3 存储-创建云硬盘及挂载. PAGEREF _Toc5574201 \h 16 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003200300031000000

4 附：. PAGEREF _Toc5574202 \h 16 08D0C9EA79F9BACE118C8200AA004BA90B02000000080000000C0000005F0054006F00630035003500370034003200300032000000

1 Ceph集群部署

本次文档的内容，存储部分是针对块存储，但是ceph也提供文件系统和对象存储。

1.1 集群部署架构

 3 OSD节点

3 MON节点

3 MGR节点

存储集群： node1 node2 node3

node1 : 安装ansible，作为server端

客户端：node2和 node3作为客户端

1.1 网络规划

每个节点配置两个网卡，一内一外

网络我们还用之前的openstack网络，原来的20网段的管理网，在这里我们用ceph的三个节点外网，以和openstack管理网相连

原来的10网段的租户网，在这里我们用作ceph的三个节点的内网。

3个节点上网网卡都为ens33，对应VMnet8, dhcp获得IP地址，具体配置见1.4.5网卡配置 

Node1、Node2 、Node3虚拟网段设置

其中3个节点的硬盘2，添加时如下

...

视频完整文档，请下载后查看