ceph 集群安裝

集群規(guī)模: 1個monitor , 2個osd 機器

monitor—|??????????????????? _172.16.x.x (ip2,10.1.x.x/24)??? ceph01
????????????????? |---- osd1???? _172.16.x.x? (ip2,10.1.x.x/24)? ceph02
????????????????? |---- osd2???? _172.16.x.x? (ip2,10.1.x.x/24)? ceph03
?
１、準(zhǔn)備工作
所有節(jié)點更新系統(tǒng)，安裝ceph-deploy
sudo yum update && sudo yum install ceph-deploy
所有節(jié)點安裝ntp,ssh
sudo yum install ntp ntpdate ntp-doc
sudo yum install openssh-server

ceph管理機必須以普通用戶登陸所有權(quán)限，所以ceph用戶要擁有無密碼的sudo權(quán)限
1>創(chuàng)建ceph普通用戶
ansible all-m shell? -a 'useradd ceph && echo "ceph" | passwd --stdin ceph'
2>確保節(jié)點擁有sudo權(quán)限
echo "ceph ALL = (root) NOPASSWD:ALL" | sudo tee /etc/sudoers.d/ceph
sudo chmod 0440 /etc/sudoers.d/ceph
3>生成Ceph用戶的key,并到各機器免密
ssh-copy-id ceph@ceph01
ssh-copy-id ceph@ceph02
ssh-copy-id ceph@ceph03

4>ceph的 config文件，保證config 權(quán)限為600，保證可以ssh ceph01 ceph02 ceph03
/home/ceph/.ssh && touch config && chmod 600 ./config

?

5>所有防火墻全部關(guān)掉
ansible all -m shell -a "systemctl disabled firewalld && systemctl stop firewalld && setenforce 0"
6>centos上安裝yum-plugin
yum install yum-plugin-priorities

2、ceph-cluster安裝
1>創(chuàng)建目錄，進(jìn)入到實施目錄my-cluster
su ceph && cd? && mkdir my-cluster && cd my-cluster
2>創(chuàng)建集群，執(zhí)行以下命令會生成三個文件(ceph配置文件、monitor 密鑰、日志文件)
ceph-deploy new ceph01
3>修改默認(rèn)復(fù)本數(shù)量\網(wǎng)卡
osd pool default size = 2
public network = 172.16.x.0/24??? 對外提供訪問
cluster network = 10.1.x.0/24???????? 內(nèi)部心跳線
4>安裝ceph
ceph-deploy install ceph01 ceph02 ceph03
5>配置初始 monitor(s)、并收集所有密鑰,并收集
ceph-deploy mon create-initial
ceph-deploy gatherkeys ceph01
6>查看節(jié)點磁盤,并初始化所有節(jié)點磁盤
ceph-deploy disk list ceph02
ceph-deploy disk zap cehp02:sdb
7、激活osd
ceph-disk activate-all
或者在部署機上執(zhí)行,所有osd 節(jié)點都要執(zhí)行，保證可以正常加入集群

ceph-deploy osd prepare ceph02:/dev/sdb:/dev/sdc
ceph-deploy osd activate ceph02:/dev/sdb1:/dev/sdc1

8、集群狀態(tài)