Kubernetes部署（七）：Node節(jié)點(diǎn)部署

相關(guān)內(nèi)容：

Kubernetes部署（一）：架構(gòu)及功能說(shuō)明
Kubernetes部署（二）：系統(tǒng)環(huán)境初始化
Kubernetes部署（三）：CA證書(shū)制作
Kubernetes部署（四）：ETCD集群部署
Kubernetes部署（五）：Haproxy、Keppalived部署
Kubernetes部署（六）：Master節(jié)點(diǎn)部署
Kubernetes部署（七）：Node節(jié)點(diǎn)部署
Kubernetes部署（八）：Flannel網(wǎng)絡(luò)部署
Kubernetes部署（九）：CoreDNS、Dashboard、Ingress部署
Kubernetes部署（十）：儲(chǔ)存之glusterfs和heketi部署
Kubernetes部署（十一）：管理之Helm和Rancher部署
Kubernetes部署（十二）：helm部署harbor企業(yè)級(jí)鏡像倉(cāng)庫(kù)

node只需安裝kubelet服務(wù)，所有節(jié)點(diǎn)都需要安裝kube-proxy

部署kubelet

1.二進(jìn)制包準(zhǔn)備
將軟件包從復(fù)制到所有node中去。

[root@node-01 ~]# cd /usr/local/src/kubernetes/server/bin/
[root@node-01 bin]# for n in `seq 204 206`;do scp kubelet 10.31.90.$n:/data/kubernetes/bin/ ;done
[root@node-01 bin]# for n in `seq 201 206`;do scp  kube-proxy 10.31.90.$n:/data/kubernetes/bin/ ;done

2.創(chuàng)建角色綁定

[root@node-01 ~]# kubectl create clusterrolebinding kubelet-bootstrap --clusterrole=system:node-bootstrapper --user=kubelet-bootstrap
clusterrolebinding.rbac.authorization.k8s.io/kubelet-bootstrap created

3.創(chuàng)建 kubelet bootstrapping kubeconfig 文件
設(shè)置集群參數(shù)

[root@node-01 ~]# kubectl config set-cluster kubernetes \
   --certificate-authority=/data/kubernetes/ssl/ca.pem \
   --embed-certs=true \
   --server=https://10.31.90.200:6443 \
   --kubeconfig=bootstrap.kubeconfig
Cluster "kubernetes" set.

設(shè)置客戶端認(rèn)證參數(shù),token要使用之前那個(gè)

[root@node-01 ~]# kubectl config set-credentials kubelet-bootstrap \
   --token=cf25becebf64e3fffd7f3890a60ac16d \
   --kubeconfig=bootstrap.kubeconfig   
User "kubelet-bootstrap" set.

設(shè)置上下文參數(shù)

[root@node-01 ~]# kubectl config set-context default \
   --cluster=kubernetes \
   --user=kubelet-bootstrap \
   --kubeconfig=bootstrap.kubeconfig
Context "default" created.

選擇默認(rèn)上下文

[root@node-01 ~]# kubectl config use-context default --kubeconfig=bootstrap.kubeconfig
Switched to context "default".
#拷貝到3個(gè)node節(jié)點(diǎn)
for n in `seq 204 206`;do scp bootstrap.kubeconfig 10.31.90.$n:/data/kubernetes/cfg/;done

部署kubelet(node節(jié)點(diǎn))

1. 設(shè)置CNI支持(所有節(jié)點(diǎn))

   [root@node-01 ~]# mkdir -p /etc/cni/net.d
   [root@node-01 ~]# cat >>/etc/cni/net.d/10-default.conf<<EOF
   {
       "name": "flannel",
       "type": "flannel",
       "delegate": {
           "bridge": "docker0",
           "isDefaultGateway": true,
           "mtu": 1400
       }
   }
   EOF

2.創(chuàng)建kubelet目錄

[root@node-04 ~]# mkdir /var/lib/kubelet

3.創(chuàng)建kubelet服務(wù)配置

[root@node-04 ~]# vim /usr/lib/systemd/system/kubelet.service
[Unit]
Description=Kubernetes Kubelet
Documentation=https://github.com/GoogleCloudPlatform/kubernetes
After=docker.service
Requires=docker.service

[Service]
WorkingDirectory=/var/lib/kubelet
ExecStart=/data/kubernetes/bin/kubelet \
  --address=10.31.90.204 \
  --hostname-override=10.31.90.204 \
  --pod-infra-container-image=mirrorgooglecontainers/pause-amd64:3.0 \
  --experimental-bootstrap-kubeconfig=/data/kubernetes/cfg/bootstrap.kubeconfig \
  --kubeconfig=/data/kubernetes/cfg/kubelet.kubeconfig \
  --cert-dir=/data/kubernetes/ssl \
  --network-plugin=cni \
  --cni-conf-dir=/etc/cni/net.d \
  --cni-bin-dir=/data/kubernetes/bin/cni \
  --cluster-dns=10.1.0.2 \
  --cluster-domain=cluster.local. \
  --hairpin-mode hairpin-veth \
  --allow-privileged=true \
  --fail-swap-on=false \
  --logtostderr=true \
  --v=2 \
  --logtostderr=false \
  --log-dir=/data/kubernetes/log
Restart=on-failure
RestartSec=5

[Install]
WantedBy=multi-user.target

4.啟動(dòng)Kubelet

[root@node-04 ~]# systemctl daemon-reload
[root@node-04 ~]# systemctl enable kubelet
[root@node-04 ~]# systemctl start kubelet

5.查看服務(wù)狀態(tài)

[root@node-04 kubernetes]# systemctl status kubelet

6.查看csr請(qǐng)求
注意是在linux-node1上執(zhí)行。

[root@node-01 ssl]# kubectl get csr
NAME                                                   AGE       REQUESTOR           CONDITION
node-csr-NqH7J1OuDM_jGtQM_VuABiBcAqgDlT_MfJiVS_qWCbg   1m        kubelet-bootstrap   Pending
node-csr-jy10bYvow5hYQ2sKWfCuBlUNIPit54dhQfzRUd5E6dc   4m        kubelet-bootstrap   Pending
node-csr-zPPE5g4d1PtbKo-lQWNNC0bbngttC2bdZtwqBBvjrVM   1m        kubelet-bootstrap   Pending

7.批準(zhǔn)kubelet 的 TLS 證書(shū)請(qǐng)求

[root@node-01 ~]# kubectl get csr|grep 'Pending' | awk 'NR>0{print $1}'| xargs kubectl certificate approve

執(zhí)行完畢后，查看節(jié)點(diǎn)狀態(tài)已經(jīng)是Ready的狀態(tài)了

[root@node-01 ~]# kubectl get csr
NAME                                                   AGE       REQUESTOR           CONDITION
node-csr-NqH7J1OuDM_jGtQM_VuABiBcAqgDlT_MfJiVS_qWCbg   1m        kubelet-bootstrap   Approved,Issued
node-csr-jy10bYvow5hYQ2sKWfCuBlUNIPit54dhQfzRUd5E6dc   5m        kubelet-bootstrap   Approved,Issued
node-csr-zPPE5g4d1PtbKo-lQWNNC0bbngttC2bdZtwqBBvjrVM   2m        kubelet-bootstrap   Approved,Issued

部署Kubernetes Proxy

kube-proxy master和node節(jié)點(diǎn)都安裝
1.配置kube-proxy使用LVS

[root@node-01 ~]# yum install -y ipvsadm ipset conntrack

2.創(chuàng)建 kube-proxy 證書(shū)請(qǐng)求

[root@node-01 ssl]# cd /usr/local/src/ssl/
[root@node-01 ssl]# vim kube-proxy-csr.json
{
  "CN": "system:kube-proxy",
  "hosts": [],
  "key": {
    "algo": "rsa",
    "size": 2048
  },
  "names": [
    {
      "C": "CN",
      "ST": "BeiJing",
      "L": "BeiJing",
      "O": "k8s",
      "OU": "System"
    }
  ]
}

3.生成證書(shū)

[root@node-01 ssl]# cfssl gencert -ca=/data/kubernetes/ssl/ca.pem \
   -ca-key=/data/kubernetes/ssl/ca-key.pem \
   -config=/data/kubernetes/ssl/ca-config.json \
   -profile=kubernetes  kube-proxy-csr.json | cfssljson -bare kube-proxy

4.分發(fā)證書(shū)到所有node節(jié)點(diǎn)

[root@node-01 ssl]# for n in `seq 201 206`;do scp kube-proxy*.pem root@10.31.90.$n:/data/kubernetes/ssl;done

5.創(chuàng)建kube-proxy配置文件

[root@node-01 ~]# kubectl config set-cluster kubernetes \
   --certificate-authority=/data/kubernetes/ssl/ca.pem \
   --embed-certs=true \
   --server=https://10.31.90.200:6443 \
   --kubeconfig=kube-proxy.kubeconfig
Cluster "kubernetes" set.

[root@node-01 ~]# kubectl config set-credentials kube-proxy \
   --client-certificate=/data/kubernetes/ssl/kube-proxy.pem \
   --client-key=/data/kubernetes/ssl/kube-proxy-key.pem \
   --embed-certs=true \
   --kubeconfig=kube-proxy.kubeconfig
User "kube-proxy" set.

[root@node-01 ~]# kubectl config set-context default \
   --cluster=kubernetes \
   --user=kube-proxy \
   --kubeconfig=kube-proxy.kubeconfig
Context "default" created.

[root@node-01 ~]# kubectl config use-context default --kubeconfig=kube-proxy.kubeconfig
Switched to context "default".

6.分發(fā)kubeconfig配置文件

[root@node-01 ssl]# for n in `seq 201 206 `;do scp kube-proxy.kubeconfig 10.31.90.$n:/data/kubernetes/cfg/;done   

7.創(chuàng)建kube-proxy服務(wù)配置

[root@node-04 ~]# mkdir /var/lib/kube-proxy

[root@node-04 ~]# vim /usr/lib/systemd/system/kube-proxy.service
[Unit]
Description=Kubernetes Kube-Proxy Server
Documentation=https://github.com/GoogleCloudPlatform/kubernetes
After=network.target

[Service]
WorkingDirectory=/var/lib/kube-proxy
ExecStart=/data/kubernetes/bin/kube-proxy \
  --bind-address=10.31.90.204 \
  --hostname-override=10.31.90.204 \
  --kubeconfig=/data/kubernetes/cfg/kube-proxy.kubeconfig \
  --masquerade-all \
  --feature-gates=SupportIPVSProxyMode=true \
  --proxy-mode=ipvs \
  --ipvs-min-sync-period=5s \
  --ipvs-sync-period=5s \
  --ipvs-scheduler=rr \
  --logtostderr=true \
  --v=2 \
  --logtostderr=false \
  --log-dir=/data/kubernetes/log

Restart=on-failure
RestartSec=5
LimitNOFILE=65536

[Install]
WantedBy=multi-user.target

8.啟動(dòng)Kubernetes Proxy
[root@node-04 ~]# systemctl daemon-reload
[root@node-04 ~]# systemctl enable kube-proxy
[root@node-04 ~]# systemctl start kube-proxy

9.查看服務(wù)狀態(tài)
查看kube-proxy服務(wù)狀態(tài)

[root@node-04 scripts]# systemctl status kube-proxy

檢查L(zhǎng)VS狀態(tài)
[root@node-04 ~]# ipvsadm -L -n
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
  -> RemoteAddress:Port           Forward Weight ActiveConn InActConn
TCP  10.1.0.1:443 rr
  -> 10.31.90.201:6443            Masq    1      0          0  

如果都安裝了kubelet和proxy服務(wù)，使用下面的命令可以檢查狀態(tài)：

[root@node-01 ~]# kubectl get node
NAME           STATUS    ROLES     AGE       VERSION
10.31.90.204   Ready     <none>    40m       v1.11.5
10.31.90.205   Ready     <none>    40m       v1.11.5
10.31.90.206   Ready     <none>    40m       v1.11.5

node-05,node-06節(jié)點(diǎn)請(qǐng)自行部署。
后續(xù)會(huì)陸續(xù)更新所有的安裝文檔，如果你覺(jué)得我寫(xiě)的不錯(cuò)，希望大家多多關(guān)注點(diǎn)贊，非常感謝！