V0.10.0新问题来了

minliacom · 2018 年10 月 21 日 03:24

Success of install Choerodon register server.

[Step 18]: install Choerodon manager service …
Error: Job failed: BackoffLimitExceeded
Success of install Choerodon manager service.
➜ config-server not ready,sleep 5s,check it.
➜ config-server not ready,sleep 5s,check it.
➜ config-server not ready,sleep 5s,check it.
➜ config-server not ready,sleep 5s,check it.
Choerodon config server is ready.
Error from server (NotFound): deployments.extensions “manager-service” not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions “manager-service” not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions “manager-service” not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions “manager-service” not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions “manager-service” not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions “manager-service” not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions “manager-service” not found

minliacom · 2018 年10 月 21 日 03:26

看起来有问题的也显示启动容器正常

kubectl get po -n c7n-system -w
NAME                                         READY     STATUS      RESTARTS   AGE
c7n-mysql-64746b49cf-6qkpv                   1/1       Running     0          12m
c7n-redis-5cf967b4b7-k8n48                   1/1       Running     0          12m
chartmuseum-chartmuseum-864cb9cc5d-r5xc6     1/1       Running     0          12m
config-server-665bffc98b-qsd8v               1/1       Running     0          5m
create-c7ntest-db-rkds4                      0/1       Completed   0          11m
dnsmasq-5f5777c999-t2m89                     1/1       Running     0          15m
gitlab-756b757d79-knzss                      1/1       Running     0          12m
gitlab-mysql-7f9df57f66-vkvjx                1/1       Running     0          12m
gitlab-redis-6c6cd6c7f-rhvml                 1/1       Running     0          12m
harbor-harbor-adminserver-848698c4cb-5l2mv   1/1       Running     1          12m
harbor-harbor-database-0                     1/1       Running     0          12m
harbor-harbor-jobservice-8789bb4b-gfv9w      1/1       Running     1          12m
harbor-harbor-registry-786bc87b47-n4fhq      1/1       Running     0          12m
harbor-harbor-ui-59df9446f8-xg6gr            1/1       Running     2          12m
harbor-redis-master-0                        1/1       Running     0          12m
kafka-0                                      1/1       Running     0          11m
kafka-1                                      1/1       Running     0          7m
kafka-2                                      1/1       Running     0          6m
manager-service-init-db-5r77q                0/1       Error       0          5m
manager-service-init-db-tmnkl                0/1       Error       0          4m
minio-c4c85b847-9g2wv                        1/1       Running     0          12m
nfs-provisioner-6767bdd874-dhr8f             1/1       Running     0          24m
register-server-5c9977ff4-4kj2b              1/1       Running     0          6m
zookeeper-0                                  1/1       Running     0          12m
zookeeper-1                                  1/1       Running     0          12m
zookeeper-2                                  1/1       Running     0          12m

 kubectl describe po -n c7n-system manager-service-init-db-tmnkl
Name:           manager-service-init-db-tmnkl
Namespace:      c7n-system
Node:           node1/172.26.38.24
Start Time:     Sun, 21 Oct 2018 11:21:21 +0800
Labels:         controller-uid=40a047b6-d4e0-11e8-b70f-00163e020b19
                job-name=manager-service-init-db
Annotations:    kubernetes.io/created-by={"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"Job","namespace":"c7n-system","name":"manager-service-init-db","uid":"40a047b6-d4e0-11e8-b70f-00163e020b19...
Status:         Failed
IP:             10.233.64.42
Created By:     Job/manager-service-init-db
Controlled By:  Job/manager-service-init-db
Init Containers:
  tools:
    Container ID:  docker://bb7250f1e79940047987a24cd8c9e161c742bd144bc0f42a0d45582da890d43b
    Image:         registry.cn-hangzhou.aliyuncs.com/choerodon-tools/dbtool:0.5.6
    Image ID:      docker-pullable://registry.cn-hangzhou.aliyuncs.com/choerodon-tools/dbtool@sha256:eeb475996d4c066bacd0f76ce77cb6d675dd9236240b4285ea7e741aea81dd84
    Port:          <none>
    Command:
      sh
      -c
      cp -rf /var/choerodon/* /tools
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Sun, 21 Oct 2018 11:21:23 +0800
      Finished:     Sun, 21 Oct 2018 11:21:23 +0800
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /tools from tools-jar (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-4bmm6 (ro)
Containers:
  manager-service-init-db:
    Container ID:  docker://a4beb39ee1596632e902f4311c060942e475058dc33f1819929a10e6eca0c16f
    Image:         registry.cn-shanghai.aliyuncs.com/choerodon/manager-service:0.10.0
    Image ID:      docker-pullable://registry.cn-shanghai.aliyuncs.com/choerodon/manager-service@sha256:54c6fd427f2e8c8457fce724ef6e9b305bac37beb0f6ba33daf4f62bbc2e71c0
    Port:          <none>
    Command:
      /bin/sh
      -c
       java -Dspring.datasource.url="jdbc:mysql://c7n-mysql.c7n-system.svc:3306/manager_service?useUnicode=true&characterEncoding=utf-8&useSSL=false" -Dspring.datasource.username=choerodon -Dspring.datasource.password=password -Ddata.init=true -Ddata.jar=/manager-service.jar -jar /var/choerodon/choerodon-tool-liquibase.jar;
    State:          Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Sun, 21 Oct 2018 11:21:24 +0800
      Finished:     Sun, 21 Oct 2018 11:21:29 +0800
    Ready:          False
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /var/choerodon from tools-jar (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-4bmm6 (ro)
Conditions:
  Type           Status
  Initialized    True
  Ready          False
  PodScheduled   True
Volumes:
  tools-jar:
    Type:    EmptyDir (a temporary directory that shares a pod's lifetime)
    Medium:
  default-token-4bmm6:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-4bmm6
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  <none>
Tolerations:     <none>
Events:
  Type    Reason                 Age   From               Message
  ----    ------                 ----  ----               -------
  Normal  Scheduled              4m    default-scheduler  Successfully assigned manager-service-init-db-tmnkl to node1
  Normal  SuccessfulMountVolume  4m    kubelet, node1     MountVolume.SetUp succeeded for volume "tools-jar"
  Normal  SuccessfulMountVolume  4m    kubelet, node1     MountVolume.SetUp succeeded for volume "default-token-4bmm6"
  Normal  Pulling                4m    kubelet, node1     pulling image "registry.cn-hangzhou.aliyuncs.com/choerodon-tools/dbtool:0.5.6"
  Normal  Pulled                 4m    kubelet, node1     Successfully pulled image "registry.cn-hangzhou.aliyuncs.com/choerodon-tools/dbtool:0.5.6"
  Normal  Created                4m    kubelet, node1     Created container
  Normal  Started                4m    kubelet, node1     Started container
  Normal  Pulled                 4m    kubelet, node1     Container image "registry.cn-shanghai.aliyuncs.com/choerodon/manager-service:0.10.0" already present on machine
  Normal  Created                4m    kubelet, node1     Created container
  Normal  Started                4m    kubelet, node1     Started container

minliacom · 2018 年10 月 21 日 03:27

进一步分析发现这个创建数据库的容器有问题

kubectl describe po -n c7n-system create-c7ntest-db-rkds4
Name:           create-c7ntest-db-rkds4
Namespace:      c7n-system
Node:           node1/172.26.38.24
Start Time:     Sun, 21 Oct 2018 11:14:13 +0800
Labels:         choerodon.io/infra=mysql-client
                choerodon.io/release=create-c7ntest-db
                controller-uid=6307da4e-d4df-11e8-b70f-00163e020b19
                job-name=create-c7ntest-db
Annotations:    kubernetes.io/created-by={"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"Job","namespace":"c7n-system","name":"create-c7ntest-db","uid":"6307da4e-d4df-11e8-b70f-00163e020b19","api...
Status:         Succeeded
IP:
Created By:     Job/create-c7ntest-db
Controlled By:  Job/create-c7ntest-db
Init Containers:
  mysqlcheck:
    Container ID:  docker://9b9824324c90e81209fc8405bf2e536e14bb01c75499677c5ad5211aebb04805
    Image:         registry.cn-hangzhou.aliyuncs.com/choerodon-tools/mysql-client:10.2.15-r0
    Image ID:      docker-pullable://registry.cn-hangzhou.aliyuncs.com/choerodon-tools/mysql-client@sha256:ecad8fbee52f1c64891a204939deb915ecf7ab9079fc223e6c56e070991ea5ca
    Port:          <none>
    Command:
      /bin/sh
    Args:
      -c
      $(while ! mysqlcheck --host="${MYSQL_HOST}" --port="${MYSQL_PORT}" --user="${MYSQL_USER}" --password="${MYSQL_PASS}" information_schema; do sleep 1; done)
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Sun, 21 Oct 2018 11:17:49 +0800
      Finished:     Sun, 21 Oct 2018 11:17:49 +0800
    Ready:          True
    Restart Count:  0
    Environment:
      MYSQL_HOST:  <set to the key 'MYSQL_HOST' in secret 'create-c7ntest-db-secret'>  Optional: false
      MYSQL_PORT:  <set to the key 'MYSQL_PORT' in secret 'create-c7ntest-db-secret'>  Optional: false
      MYSQL_USER:  <set to the key 'MYSQL_USER' in secret 'create-c7ntest-db-secret'>  Optional: false
      MYSQL_PASS:  <set to the key 'MYSQL_PASS' in secret 'create-c7ntest-db-secret'>  Optional: false
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-4bmm6 (ro)
Containers:
  create-c7ntest-db:
    Container ID:  docker://dbdfa9245c0b192fccbefe238b23bd49f8165527ee82871e1589cb84ecd2162d
    Image:         registry.cn-hangzhou.aliyuncs.com/choerodon-tools/mysql-client:10.2.15-r0
    Image ID:      docker-pullable://registry.cn-hangzhou.aliyuncs.com/choerodon-tools/mysql-client@sha256:ecad8fbee52f1c64891a204939deb915ecf7ab9079fc223e6c56e070991ea5ca
    Port:          <none>
    Command:
      /bin/sh
    Args:
      -c
      $(mysql -u"${MYSQL_USER}" -p"${MYSQL_PASS}" -h"${MYSQL_HOST}" -P"${MYSQL_PORT}" -e"${SQL_SCRIPT}")
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Sun, 21 Oct 2018 11:17:50 +0800
      Finished:     Sun, 21 Oct 2018 11:17:50 +0800
    Ready:          False
    Restart Count:  0
    Environment:
      MYSQL_HOST:  <set to the key 'MYSQL_HOST' in secret 'create-c7ntest-db-secret'>  Optional: false
      MYSQL_PORT:  <set to the key 'MYSQL_PORT' in secret 'create-c7ntest-db-secret'>  Optional: false
      MYSQL_USER:  <set to the key 'MYSQL_USER' in secret 'create-c7ntest-db-secret'>  Optional: false
      MYSQL_PASS:  <set to the key 'MYSQL_PASS' in secret 'create-c7ntest-db-secret'>  Optional: false
      SQL_SCRIPT:  <set to the key 'SQL_SCRIPT' of config map 'create-c7ntest-db-cm'>  Optional: false
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-4bmm6 (ro)
Conditions:
  Type           Status
  Initialized    True
  Ready          False
  PodScheduled   True
Volumes:
  default-token-4bmm6:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-4bmm6
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  <none>
Tolerations:     <none>
Events:
  Type    Reason                 Age   From               Message
  ----    ------                 ----  ----               -------
  Normal  Scheduled              12m   default-scheduler  Successfully assigned create-c7ntest-db-rkds4 to node1
  Normal  SuccessfulMountVolume  12m   kubelet, node1     MountVolume.SetUp succeeded for volume "default-token-4bmm6"
  Normal  Pulling                12m   kubelet, node1     pulling image "registry.cn-hangzhou.aliyuncs.com/choerodon-tools/mysql-client:10.2.15-r0"
  Normal  Pulled                 9m    kubelet, node1     Successfully pulled image "registry.cn-hangzhou.aliyuncs.com/choerodon-tools/mysql-client:10.2.15-r0"
  Normal  Created                9m    kubelet, node1     Created container
  Normal  Started                9m    kubelet, node1     Started container
  Normal  Pulled                 9m    kubelet, node1     Container image "registry.cn-hangzhou.aliyuncs.com/choerodon-tools/mysql-client:10.2.15-r0" already present on machine
  Normal  Created                9m    kubelet, node1     Created container
  Normal  Started                9m    kubelet, node1     Started container
  Normal  SandboxChanged         9m    kubelet, node1     Pod sandbox changed, it will be killed and re-created.

vinkdong · 2018 年10 月 21 日 03:41

这种情况一般是节点资源占用过多导致 k8s连不上该节点docker的 api，你可以将 node1 docker重启一下

minliacom · 2018 年10 月 25 日 04:57

今天又部署了一次，还是出现这个问题，帮忙指导一下


[Step 14]: create database for Choerodon ...
NAME:   create-c7nfw-db
LAST DEPLOYED: Thu Oct 25 12:45:30 2018
NAMESPACE: c7n-system
STATUS: DEPLOYED

RESOURCES:
==> v1/ConfigMap
NAME                DATA  AGE
create-c7nfw-db-cm  1     0s

==> v1/Job
NAME             DESIRED  SUCCESSFUL  AGE
create-c7nfw-db  1        0           0s

==> v1/Pod(related)
NAME                   READY  STATUS    RESTARTS  AGE
create-c7nfw-db-l5fvk  0/1    Init:0/1  0         0s

==> v1/Secret
NAME                    TYPE    DATA  AGE
create-c7nfw-db-secret  Opaque  4     0s


NAME:   create-c7ncd-db
LAST DEPLOYED: Thu Oct 25 12:45:31 2018
NAMESPACE: c7n-system
STATUS: DEPLOYED

RESOURCES:
==> v1/Secret
NAME                    TYPE    DATA  AGE
create-c7ncd-db-secret  Opaque  4     0s

==> v1/ConfigMap
NAME                DATA  AGE
create-c7ncd-db-cm  1     0s

==> v1/Job
NAME             DESIRED  SUCCESSFUL  AGE
create-c7ncd-db  1        0           0s

==> v1/Pod(related)
NAME                   READY  STATUS   RESTARTS  AGE
create-c7ncd-db-p6bth  0/1    Pending  0         0s


NAME:   create-c7nagile-db
LAST DEPLOYED: Thu Oct 25 12:45:31 2018
NAMESPACE: c7n-system
STATUS: DEPLOYED

RESOURCES:
==> v1/Secret
NAME                       TYPE    DATA  AGE
create-c7nagile-db-secret  Opaque  4     0s

==> v1/ConfigMap
NAME                   DATA  AGE
create-c7nagile-db-cm  1     0s

==> v1/Job
NAME                DESIRED  SUCCESSFUL  AGE
create-c7nagile-db  1        0           0s

==> v1/Pod(related)
NAME                      READY  STATUS    RESTARTS  AGE
create-c7nagile-db-5khcv  0/1    Init:0/1  0         0s


NAME:   create-c7ntest-db
LAST DEPLOYED: Thu Oct 25 12:45:32 2018
NAMESPACE: c7n-system
STATUS: DEPLOYED

RESOURCES:
==> v1/Secret
NAME                      TYPE    DATA  AGE
create-c7ntest-db-secret  Opaque  4     0s

==> v1/ConfigMap
NAME                  DATA  AGE
create-c7ntest-db-cm  1     0s

==> v1/Job
NAME               DESIRED  SUCCESSFUL  AGE
create-c7ntest-db  1        0           0s

==> v1/Pod(related)
NAME                     READY  STATUS    RESTARTS  AGE
create-c7ntest-db-2m66n  0/1    Init:0/1  0         0s


NAME:   create-c7nwiki-db
LAST DEPLOYED: Thu Oct 25 12:45:33 2018
NAMESPACE: c7n-system
STATUS: DEPLOYED

RESOURCES:
==> v1/Secret
NAME                      TYPE    DATA  AGE
create-c7nwiki-db-secret  Opaque  4     1s

==> v1/ConfigMap
NAME                  DATA  AGE
create-c7nwiki-db-cm  1     1s

==> v1/Job
NAME               DESIRED  SUCCESSFUL  AGE
create-c7nwiki-db  1        0           1s

==> v1/Pod(related)
NAME                     READY  STATUS    RESTARTS  AGE
create-c7nwiki-db-cdtjx  0/1    Init:0/1  0         1s


✔ Success create database for Choerodon.

[Step 15]: install kafka ...
NAME:   kafka
LAST DEPLOYED: Thu Oct 25 12:45:36 2018
NAMESPACE: c7n-system
STATUS: DEPLOYED

RESOURCES:
==> v1/Service
NAME            TYPE       CLUSTER-IP  EXTERNAL-IP  PORT(S)   AGE
kafka-headless  ClusterIP  None        <none>       9092/TCP  0s

==> v1beta1/StatefulSet
NAME   DESIRED  CURRENT  AGE
kafka  3        1        0s

==> v1/Pod(related)
NAME     READY  STATUS   RESTARTS  AGE
kafka-0  0/1    Pending  0         0s


✔ Success of install kafka.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
➜ kafka not ready,sleep 5s,check it.
✔ Kafka is ready.

[Step 16]: install Choerodon register server ...
NAME:   register-server
LAST DEPLOYED: Thu Oct 25 12:51:14 2018
NAMESPACE: c7n-system
STATUS: DEPLOYED

RESOURCES:
==> v1/ServiceAccount
NAME             SECRETS  AGE
register-server  1        0s

==> v1beta1/ClusterRoleBinding
NAME             AGE
register-server  0s

==> v1/Service
NAME             TYPE       CLUSTER-IP     EXTERNAL-IP  PORT(S)   AGE
register-server  ClusterIP  10.233.11.139  <none>       8000/TCP  0s

==> v1beta2/Deployment
NAME             DESIRED  CURRENT  UP-TO-DATE  AVAILABLE  AGE
register-server  1        1        1           0          0s

==> v1/Pod(related)
NAME                             READY  STATUS             RESTARTS  AGE
register-server-5c9977ff4-28gt8  0/1    ContainerCreating  0         0s


✔ Success of install Choerodon register server.
➜ register-server not ready,sleep 5s,check it.
➜ register-server not ready,sleep 5s,check it.
✔ Choerodon register server is ready.

[Step 17]: install Choerodon config server ...
NAME:   config-server
LAST DEPLOYED: Thu Oct 25 12:51:25 2018
NAMESPACE: c7n-system
STATUS: DEPLOYED

RESOURCES:
==> v1/Service
NAME           TYPE       CLUSTER-IP    EXTERNAL-IP  PORT(S)   AGE
config-server  ClusterIP  10.233.25.65  <none>       8010/TCP  0s

==> v1beta2/Deployment
NAME           DESIRED  CURRENT  UP-TO-DATE  AVAILABLE  AGE
config-server  1        1        1           0          0s

==> v1/Pod(related)
NAME                            READY  STATUS             RESTARTS  AGE
config-server-665bffc98b-h67vn  0/1    ContainerCreating  0         0s


✔ Success of install Choerodon register server.

[Step 18]: install Choerodon manager service ...
Error: Job failed: BackoffLimitExceeded
✔ Success of install Choerodon manager service.
➜ config-server not ready,sleep 5s,check it.
✔ Choerodon config server is ready.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found
➜ manager-service not ready,sleep 5s,check it.
Error from server (NotFound): deployments.extensions "manager-service" not found

minliacom · 2018 年10 月 25 日 04:59

状态是这个样子的


kubectl get po -n c7n-system -w
NAME                                         READY     STATUS      RESTARTS   AGE
c7n-mysql-64746b49cf-8xpjz                   1/1       Running     0          13m
c7n-redis-5cf967b4b7-74lbl                   1/1       Running     0          13m
chartmuseum-chartmuseum-864cb9cc5d-r8mxw     1/1       Running     0          13m
config-server-665bffc98b-h67vn               1/1       Running     0          7m
create-c7ncd-db-p6bth                        0/1       Completed   0          12m
dnsmasq-5f5777c999-zt95s                     1/1       Running     0          16m
gitlab-6bfb58b78d-f6hlw                      1/1       Running     0          13m
gitlab-mysql-7f9df57f66-rr97z                1/1       Running     0          13m
gitlab-redis-6c6cd6c7f-jg29w                 1/1       Running     0          13m
harbor-harbor-adminserver-848698c4cb-bckc2   1/1       Running     1          13m
harbor-harbor-database-0                     1/1       Running     0          13m
harbor-harbor-jobservice-8789bb4b-h7hcx      1/1       Running     1          13m
harbor-harbor-registry-786bc87b47-sh72s      1/1       Running     0          13m
harbor-harbor-ui-59df9446f8-9v7zr            1/1       Running     1          13m
harbor-redis-master-0                        1/1       Running     0          13m
kafka-0                                      1/1       Running     0          12m
kafka-1                                      1/1       Running     0          8m
kafka-2                                      1/1       Running     0          7m
manager-service-init-db-7drx4                0/1       Error       0          6m
manager-service-init-db-kc6l6                0/1       Error       0          7m
minio-c4c85b847-r42gf                        1/1       Running     0          13m
nfs-provisioner-6767bdd874-5hhgz             1/1       Running     0          16m
register-server-5c9977ff4-28gt8              1/1       Running     0          7m
zookeeper-0                                  1/1       Running     0          13m
zookeeper-1                                  1/1       Running     0          13m
zookeeper-2                                  1/1       Running     0          13m

minliacom · 2018 年10 月 25 日 06:19

最新情况，手动pull了所有docker images之后可以起来，出现gitlab 503的情况，日志如下

kubectl get po -n c7n-system
NAME                                         READY     STATUS             RESTARTS   AGE
agile-service-575d8dc4b8-pp4tt               1/1       Running            0          14m
api-gateway-84cdcd47b4-9mfdt                 1/1       Running            0          20m
asgard-service-6d96b6849d-hqgrh              1/1       Running            0          23m
c7n-mysql-64746b49cf-67hbp                   1/1       Running            0          27m
c7n-redis-5cf967b4b7-5grxf                   1/1       Running            0          27m
chartmuseum-chartmuseum-864cb9cc5d-m8vxn     1/1       Running            0          27m
choerodon-front-655f7999f-kwkqc              1/1       Running            0          11m
config-server-665bffc98b-j7nz5               1/1       Running            0          25m
devops-service-84fd4b7c4c-vcdhx              1/1       Running            0          17m
dnsmasq-5f5777c999-zbs2b                     1/1       Running            0          32m
file-service-b5cf6c4c9-2vfq6                 1/1       Running            0          18m
gateway-helper-7dcf5c6788-zxhfr              1/1       Running            0          19m
gitlab-587cfd8b6b-5h5zm                      0/1       Running            0          27m
gitlab-59b5bd8b85-npwnj                      0/1       CrashLoopBackOff   5          11m
gitlab-mysql-7f9df57f66-2rztg                1/1       Running            0          27m
gitlab-redis-6c6cd6c7f-7zbrt                 1/1       Running            0          27m
gitlab-service-59db974b6-rhhcw               1/1       Running            0          16m
harbor-harbor-adminserver-848698c4cb-2zv7j   1/1       Running            1          27m
harbor-harbor-database-0                     1/1       Running            0          27m
harbor-harbor-jobservice-8789bb4b-kh8th      1/1       Running            1          27m
harbor-harbor-registry-786bc87b47-rttwv      1/1       Running            0          27m
harbor-harbor-ui-59df9446f8-q67v5            1/1       Running            2          27m
harbor-redis-master-0                        1/1       Running            0          27m
iam-service-6cb9d9f75f-7s8t6                 1/1       Running            0          20m
kafka-0                                      1/1       Running            0          27m
kafka-1                                      1/1       Running            0          26m
kafka-2                                      1/1       Running            0          26m
manager-service-ccb49bcb4-8bwdd              1/1       Running            0          24m
minio-c4c85b847-kb2nz                        1/1       Running            0          27m
nfs-provisioner-6767bdd874-22r74             1/1       Running            0          33m
notify-service-5bd96c594d-lmmlg              1/1       Running            0          21m
oauth-server-84b85f95b4-cknmg                1/1       Running            0          18m
register-server-5c9977ff4-smwdp              1/1       Running            0          25m
test-manager-service-6f75659689-bwxsv        1/1       Running            0          13m
wiki-service-54f7b5779-rmlb8                 1/1       Running            0          11m
xwiki-6947fbd7f4-xghtg                       1/1       Running            0          12m
zookeeper-0                                  1/1       Running            0          27m
zookeeper-1                                  1/1       Running            0          27m
zookeeper-2                                  1/1       Running            0          27m
[root@node1 ~]# kubectl describe po -n c7n-system gitlab-59b5bd8b85-npwnj
Name:           gitlab-59b5bd8b85-npwnj
Namespace:      c7n-system
Node:           node1/172.26.38.24
Start Time:     Thu, 25 Oct 2018 14:05:23 +0800
Labels:         choerodon.io/infra=gitlab
                choerodon.io/release=gitlab
                pod-template-hash=1561684641
Annotations:    kubernetes.io/created-by={"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"c7n-system","name":"gitlab-59b5bd8b85","uid":"f5bdef6a-d81b-11e8-a989-00163e020b1...
Status:         Running
IP:             10.233.64.86
Created By:     ReplicaSet/gitlab-59b5bd8b85
Controlled By:  ReplicaSet/gitlab-59b5bd8b85
Containers:
  gitlab:
    Container ID:   docker://3b280973b3b6473c64b623a6a1a58a47c5308511b4ee1a6e66b3fc7ab7b6c841
    Image:          registry.cn-hangzhou.aliyuncs.com/choerodon-tools/gitlab-ce:11.0.1-ce.0-CST
    Image ID:       docker-pullable://registry.cn-hangzhou.aliyuncs.com/choerodon-tools/gitlab-ce@sha256:0522f8be64f9a463f8421bc770421fa23dcff09bee62e610b5e6a75abccd63ed
    Ports:          22/TCP, 80/TCP, 443/TCP
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Thu, 25 Oct 2018 14:14:09 +0800
      Finished:     Thu, 25 Oct 2018 14:15:16 +0800
    Ready:          False
    Restart Count:  5
    Limits:
      memory:  4Gi
    Requests:
      memory:   3Gi
    Readiness:  http-get http://:80/help delay=120s timeout=15s period=10s #success=1 #failure=3
    Environment:
      GITLAB_BACKUP_SCHEDULE:  daily
      TZ:                      Asia/Shanghai
      VALUES_ENV_CONFIG:       map[MYSQL_HOST:gitlab-mysql.c7n-system.svc SMTP_TLS:true SMTP_PASSWORD:<nil> GITLAB_SHELL_SSH_PORT:2289 SMTP_ADDRESS:<nil> CHOERODON_OMNIAUTH_ENABLED:true GITLAB_EXTERNAL_URL:http://gitlab.hi.chinfan.io GITLAB_TIMEZONE:Asia/Shanghai OMNIAUTH_AUTO_SIGN_IN_WITH_PROVIDER:oauth2_generic SMTP_PORT:<nil> PROMETHEUS_ENABLE:false NODE_EXPORTER_ENABLE:false CHOERODON_CLIENT_ID:gitlab GITLAB_DEFAULT_CAN_CREATE_GROUP:true MYSQL_USERNAME:root SMTP_DOMAIN:<nil> GITLAB_EMAIL_FROM:<nil> MYSQL_PASSWORD:password SMTP_ENABLE_STARTTLS_AUTO:true MYSQL_DATABASE:gitlabhq_production MYSQL_PORT:3306 PROMETHEUS_LISTEN_ADDRESS::9091 CHOERODON_API_URL:http://api.hi.chinfan.io REDIS_HOST:gitlab-redis.c7n-system.svc SMTP_USER_NAME:<nil> OMNIAUTH_BLOCK_AUTO_CREATED_USERS:false SMTP_AUTHENTICATION:login GITLAB_USERNAME_CHANGING_ENABLED:false REDIS_PORT:6379 SMTP_ENABLE:false]
    Mounts:
      /certs from gitlab-data (rw)
      /etc/gitlab from gitlab-data (rw)
      /opt/choerodon/paas/etc/gitlab.rb from gitlab-config (rw)
      /var/log/gitlab from gitlab-data (rw)
      /var/opt/gitlab from gitlab-data (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-jx47p (ro)
Conditions:
  Type           Status
  Initialized    True
  Ready          False
  PodScheduled   True
Volumes:
  gitlab-data:
    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:  gitlab-pvc
    ReadOnly:   false
  gitlab-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      gitlab-cm
    Optional:  false
  default-token-jx47p:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-jx47p
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     <none>
Events:
  Type     Reason                 Age               From               Message
  ----     ------                 ----              ----               -------
  Normal   Scheduled              11m               default-scheduler  Successfully assigned gitlab-59b5bd8b85-npwnj to node1
  Normal   SuccessfulMountVolume  11m               kubelet, node1     MountVolume.SetUp succeeded for volume "pvc-b0bec1b4-d819-11e8-a989-00163e020b19"
  Normal   SuccessfulMountVolume  11m               kubelet, node1     MountVolume.SetUp succeeded for volume "gitlab-config"
  Normal   SuccessfulMountVolume  11m               kubelet, node1     MountVolume.SetUp succeeded for volume "default-token-jx47p"
  Normal   Pulled                 7m (x4 over 11m)  kubelet, node1     Container image "registry.cn-hangzhou.aliyuncs.com/choerodon-tools/gitlab-ce:11.0.1-ce.0-CST" already present on machine
  Normal   Created                7m (x4 over 11m)  kubelet, node1     Created container
  Normal   Started                7m (x4 over 11m)  kubelet, node1     Started container
  Warning  FailedSync             6m (x6 over 9m)   kubelet, node1     Error syncing pod
  Warning  BackOff                1m (x16 over 9m)  kubelet, node1     Back-off restarting failed container

minliacom · 2018 年10 月 25 日 06:23

看到另一个gitlab也出现情况

kubectl describe po -n c7n-system gitlab-587cfd8b6b-5h5zm
Name:           gitlab-587cfd8b6b-5h5zm
Namespace:      c7n-system
Node:           node1/172.26.38.24
Start Time:     Thu, 25 Oct 2018 13:49:11 +0800
Labels:         choerodon.io/infra=gitlab
                choerodon.io/release=gitlab
                pod-template-hash=1437984626
Annotations:    kubernetes.io/created-by={"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"c7n-system","name":"gitlab-587cfd8b6b","uid":"b28b0d24-d819-11e8-a989-00163e020b1...
Status:         Running
IP:             10.233.64.19
Created By:     ReplicaSet/gitlab-587cfd8b6b
Controlled By:  ReplicaSet/gitlab-587cfd8b6b
Containers:
  gitlab:
    Container ID:   docker://9f7d15e649644b530c95264a5377e32a3801b92510c04a41f65f03cd0bccdf0c
    Image:          registry.cn-hangzhou.aliyuncs.com/choerodon-tools/gitlab-ce:11.0.1-ce.0-CST
    Image ID:       docker-pullable://registry.cn-hangzhou.aliyuncs.com/choerodon-tools/gitlab-ce@sha256:0522f8be64f9a463f8421bc770421fa23dcff09bee62e610b5e6a75abccd63ed
    Ports:          22/TCP, 80/TCP, 443/TCP
    State:          Running
      Started:      Thu, 25 Oct 2018 13:49:19 +0800
    Ready:          False
    Restart Count:  0
    Limits:
      memory:  4Gi
    Requests:
      memory:   3Gi
    Readiness:  http-get http://:80/help delay=120s timeout=15s period=10s #success=1 #failure=3
    Environment:
      GITLAB_BACKUP_SCHEDULE:  daily
      TZ:                      Asia/Shanghai
      VALUES_ENV_CONFIG:       map[GITLAB_DEFAULT_CAN_CREATE_GROUP:true MYSQL_PASSWORD:password MYSQL_USERNAME:root SMTP_AUTHENTICATION:login SMTP_PASSWORD:<nil> SMTP_USER_NAME:<nil> OMNIAUTH_BLOCK_AUTO_CREATED_USERS:false GITLAB_EXTERNAL_URL:http://gitlab.hi.chinfan.io SMTP_ENABLE_STARTTLS_AUTO:true SMTP_PORT:<nil> NODE_EXPORTER_ENABLE:false SMTP_DOMAIN:<nil> GITLAB_SHELL_SSH_PORT:2289 CHOERODON_CLIENT_ID:gitlab SMTP_ADDRESS:<nil> CHOERODON_OMNIAUTH_ENABLED:false MYSQL_DATABASE:gitlabhq_production MYSQL_HOST:gitlab-mysql.c7n-system.svc REDIS_PORT:6379 CHOERODON_API_URL:http://api.example.choerodon.io PROMETHEUS_LISTEN_ADDRESS::9091 GITLAB_USERNAME_CHANGING_ENABLED:false REDIS_HOST:gitlab-redis.c7n-system.svc SMTP_ENABLE:false GITLAB_EMAIL_FROM:<nil> SMTP_TLS:true GITLAB_TIMEZONE:Asia/Shanghai MYSQL_PORT:3306 PROMETHEUS_ENABLE:false]
    Mounts:
      /certs from gitlab-data (rw)
      /etc/gitlab from gitlab-data (rw)
      /opt/choerodon/paas/etc/gitlab.rb from gitlab-config (rw)
      /var/log/gitlab from gitlab-data (rw)
      /var/opt/gitlab from gitlab-data (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-jx47p (ro)
Conditions:
  Type           Status
  Initialized    True
  Ready          False
  PodScheduled   True
Volumes:
  gitlab-data:
    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:  gitlab-pvc
    ReadOnly:   false
  gitlab-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      gitlab-cm
    Optional:  false
  default-token-jx47p:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-jx47p
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     <none>
Events:
  Type     Reason                 Age                From               Message
  ----     ------                 ----               ----               -------
  Normal   Scheduled              33m                default-scheduler  Successfully assigned gitlab-587cfd8b6b-5h5zm to node1
  Normal   SuccessfulMountVolume  33m                kubelet, node1     MountVolume.SetUp succeeded for volume "pvc-b0bec1b4-d819-11e8-a989-00163e020b19"
  Normal   SuccessfulMountVolume  33m                kubelet, node1     MountVolume.SetUp succeeded for volume "gitlab-config"
  Normal   SuccessfulMountVolume  33m                kubelet, node1     MountVolume.SetUp succeeded for volume "default-token-jx47p"
  Normal   Pulled                 33m                kubelet, node1     Container image "registry.cn-hangzhou.aliyuncs.com/choerodon-tools/gitlab-ce:11.0.1-ce.0-CST" already present on machine
  Normal   Created                33m                kubelet, node1     Created container
  Normal   Started                33m                kubelet, node1     Started container
  Warning  Unhealthy              3m (x53 over 15m)  kubelet, node1     Readiness probe failed: HTTP probe failed with statuscode: 502

vinkdong · 2018 年10 月 25 日 06:46

你是在重新安装吗，如果mysql意外退出，容易导致数据出现问题，重装的话最好把数据清理之后再重装。

minliacom · 2018 年10 月 25 日 06:48

我是重置了服务器，那就等于是一个新的系统环境

minliacom · 2018 年10 月 25 日 06:49

现在看日志是这样的



kubectl get po -n c7n-system
NAME                                         READY     STATUS             RESTARTS   AGE
agile-service-575d8dc4b8-pp4tt               1/1       Running            0          46m
api-gateway-84cdcd47b4-9mfdt                 1/1       Running            0          51m
asgard-service-6d96b6849d-hqgrh              1/1       Running            0          54m
c7n-mysql-64746b49cf-67hbp                   1/1       Running            0          59m
c7n-redis-5cf967b4b7-5grxf                   1/1       Running            0          59m
chartmuseum-chartmuseum-864cb9cc5d-m8vxn     1/1       Running            0          59m
choerodon-front-655f7999f-kwkqc              1/1       Running            0          43m
config-server-665bffc98b-j7nz5               1/1       Running            0          56m
devops-service-84fd4b7c4c-vcdhx              1/1       Running            0          48m
dnsmasq-5f5777c999-zbs2b                     1/1       Running            0          1h
file-service-b5cf6c4c9-2vfq6                 1/1       Running            0          49m
gateway-helper-7dcf5c6788-zxhfr              1/1       Running            0          50m
gitlab-587cfd8b6b-5h5zm                      0/1       Running            0          59m
gitlab-59b5bd8b85-npwnj                      0/1       CrashLoopBackOff   10         43m
gitlab-mysql-7f9df57f66-2rztg                1/1       Running            0          59m
gitlab-redis-6c6cd6c7f-7zbrt                 1/1       Running            0          59m
gitlab-service-59db974b6-rhhcw               1/1       Running            0          47m
harbor-harbor-adminserver-848698c4cb-2zv7j   1/1       Running            1          59m
harbor-harbor-database-0                     1/1       Running            0          59m
harbor-harbor-jobservice-8789bb4b-kh8th      1/1       Running            1          59m
harbor-harbor-registry-786bc87b47-rttwv      1/1       Running            0          59m
harbor-harbor-ui-59df9446f8-q67v5            1/1       Running            2          59m
harbor-redis-master-0                        1/1       Running            0          59m
iam-service-6cb9d9f75f-7s8t6                 1/1       Running            0          51m
kafka-0                                      1/1       Running            0          58m
kafka-1                                      1/1       Running            0          58m
kafka-2                                      1/1       Running            0          57m
manager-service-ccb49bcb4-8bwdd              1/1       Running            0          56m
minio-c4c85b847-kb2nz                        1/1       Running            0          59m
nfs-provisioner-6767bdd874-22r74             1/1       Running            0          1h
notify-service-5bd96c594d-lmmlg              1/1       Running            0          52m
oauth-server-84b85f95b4-cknmg                1/1       Running            0          50m
register-server-5c9977ff4-smwdp              1/1       Running            0          56m
test-manager-service-6f75659689-bwxsv        1/1       Running            0          45m
wiki-service-54f7b5779-rmlb8                 1/1       Running            0          43m
xwiki-6947fbd7f4-xghtg                       1/1       Running            0          44m
zookeeper-0                                  1/1       Running            0          59m
zookeeper-1                                  1/1       Running            0          59m
zookeeper-2                                  1/1       Running            0          59m
[root@node1 ~]#
[root@node1 ~]# kubectl describe po -n c7n-system gitlab-59b5bd8b85-npwnj
Name:           gitlab-59b5bd8b85-npwnj
Namespace:      c7n-system
Node:           node1/172.26.38.24
Start Time:     Thu, 25 Oct 2018 14:05:23 +0800
Labels:         choerodon.io/infra=gitlab
                choerodon.io/release=gitlab
                pod-template-hash=1561684641
Annotations:    kubernetes.io/created-by={"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"c7n-system","name":"gitlab-59b5bd8b85","uid":"f5bdef6a-d81b-11e8-a989-00163e020b1...
Status:         Running
IP:             10.233.64.86
Created By:     ReplicaSet/gitlab-59b5bd8b85
Controlled By:  ReplicaSet/gitlab-59b5bd8b85
Containers:
  gitlab:
    Container ID:   docker://38e1b41a91175168fbbbd54321aafd0a095c17925551ef0b50415de3eb0f9065
    Image:          registry.cn-hangzhou.aliyuncs.com/choerodon-tools/gitlab-ce:11.0.1-ce.0-CST
    Image ID:       docker-pullable://registry.cn-hangzhou.aliyuncs.com/choerodon-tools/gitlab-ce@sha256:0522f8be64f9a463f8421bc770421fa23dcff09bee62e610b5e6a75abccd63ed
    Ports:          22/TCP, 80/TCP, 443/TCP
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    1
      Started:      Thu, 25 Oct 2018 14:43:06 +0800
      Finished:     Thu, 25 Oct 2018 14:44:12 +0800
    Ready:          False
    Restart Count:  10
    Limits:
      memory:  4Gi
    Requests:
      memory:   3Gi
    Readiness:  http-get http://:80/help delay=120s timeout=15s period=10s #success=1 #failure=3
    Environment:
      GITLAB_BACKUP_SCHEDULE:  daily
      TZ:                      Asia/Shanghai
      VALUES_ENV_CONFIG:       map[MYSQL_HOST:gitlab-mysql.c7n-system.svc SMTP_TLS:true SMTP_PASSWORD:<nil> GITLAB_SHELL_SSH_PORT:2289 SMTP_ADDRESS:<nil> CHOERODON_OMNIAUTH_ENABLED:true GITLAB_EXTERNAL_URL:http://gitlab.hi.chinfan.io GITLAB_TIMEZONE:Asia/Shanghai OMNIAUTH_AUTO_SIGN_IN_WITH_PROVIDER:oauth2_generic SMTP_PORT:<nil> PROMETHEUS_ENABLE:false NODE_EXPORTER_ENABLE:false CHOERODON_CLIENT_ID:gitlab GITLAB_DEFAULT_CAN_CREATE_GROUP:true MYSQL_USERNAME:root SMTP_DOMAIN:<nil> GITLAB_EMAIL_FROM:<nil> MYSQL_PASSWORD:password SMTP_ENABLE_STARTTLS_AUTO:true MYSQL_DATABASE:gitlabhq_production MYSQL_PORT:3306 PROMETHEUS_LISTEN_ADDRESS::9091 CHOERODON_API_URL:http://api.hi.chinfan.io REDIS_HOST:gitlab-redis.c7n-system.svc SMTP_USER_NAME:<nil> OMNIAUTH_BLOCK_AUTO_CREATED_USERS:false SMTP_AUTHENTICATION:login GITLAB_USERNAME_CHANGING_ENABLED:false REDIS_PORT:6379 SMTP_ENABLE:false]
    Mounts:
      /certs from gitlab-data (rw)
      /etc/gitlab from gitlab-data (rw)
      /opt/choerodon/paas/etc/gitlab.rb from gitlab-config (rw)
      /var/log/gitlab from gitlab-data (rw)
      /var/opt/gitlab from gitlab-data (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-jx47p (ro)
Conditions:
  Type           Status
  Initialized    True
  Ready          False
  PodScheduled   True
Volumes:
  gitlab-data:
    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
    ClaimName:  gitlab-pvc
    ReadOnly:   false
  gitlab-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      gitlab-cm
    Optional:  false
  default-token-jx47p:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-jx47p
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     <none>
Events:
  Type     Reason                 Age                 From               Message
  ----     ------                 ----                ----               -------
  Normal   Scheduled              43m                 default-scheduler  Successfully assigned gitlab-59b5bd8b85-npwnj to node1
  Normal   SuccessfulMountVolume  43m                 kubelet, node1     MountVolume.SetUp succeeded for volume "pvc-b0bec1b4-d819-11e8-a989-00163e020b19"
  Normal   SuccessfulMountVolume  43m                 kubelet, node1     MountVolume.SetUp succeeded for volume "gitlab-config"
  Normal   SuccessfulMountVolume  43m                 kubelet, node1     MountVolume.SetUp succeeded for volume "default-token-jx47p"
  Normal   Created                38m (x4 over 43m)   kubelet, node1     Created container
  Normal   Started                38m (x4 over 43m)   kubelet, node1     Started container
  Warning  BackOff                33m (x16 over 40m)  kubelet, node1     Back-off restarting failed container
  Normal   Pulled                 18m (x9 over 43m)   kubelet, node1     Container image "registry.cn-hangzhou.aliyuncs.com/choerodon-tools/gitlab-ce:11.0.1-ce.0-CST" already present on machine
  Warning  FailedSync             3m (x127 over 40m)  kubelet, node1     Error syncing pod

vinkdong · 2018 年10 月 25 日 06:52

看下gitlab-mysql能不能连上

minliacom · 2018 年10 月 25 日 06:56

怎么看，请帮忙给点指引

vinkdong · 2018 年10 月 25 日 07:02

到gitlab-mysql那个pod里面执行 mysql -u用户名 -p密码试试能不能连上哈

minliacom · 2018 年10 月 25 日 07:09

是不是这里的主机名有问题？看起来密码不对


kubectl exec -ti gitlab-mysql-7f9df57f66-2rztg  -n c7n-system -- /bin/bash

mysql -uchoerodon -ppassword -hlocalhost
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1045 (28000): Access denied for user 'choerodon'@'localhost' (using passwo                                                                    rd: YES)

vinkdong · 2018 年10 月 25 日 07:12

主机名不用加，如果密码没输入错的话就是mysql安装失败了，你用了已有数据的NFS吗

minliacom · 2018 年10 月 25 日 08:16

这些全部都是全新安装的，我是在aliyun里面重新初始化系统之后安装的。所以不存在已有数据的情况

minliacom · 2018 年10 月 25 日 08:27

但是我从主的mysql进去是可以的


kubectl exec -ti c7n-mysql-64746b49cf-67hbp -n c7n-system /bin/bash
root@c7n-mysql-64746b49cf-67hbp:/# mysql -uchoerodon -ppassword
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 1358
Server version: 5.7.23 MySQL Community Server (GPL)

Copyright (c) 2000, 2018, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> show databases;
+----------------------+
| Database             |
+----------------------+
| information_schema   |
| agile_service        |
| asgard_service       |
| devops_service       |
| gitlab_service       |
| iam_service          |
| manager_service      |
| notify_service       |
| test_manager_service |
| wiki_service         |
| xwiki                |
+----------------------+
11 rows in set (0.00 sec)

mysql>

minliacom · 2018 年10 月 25 日 08:33


kubectl logs  gitlab-mysql-7f9df57f66-2rztg  -n c7n-system

Initializing database
2018-10-25T05:49:16.048788Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2018-10-25T05:49:16.055547Z 0 [Warning] InnoDB: Using innodb_file_format is deprecated and the parameter may be removed in future releases. See http://dev.mysql.com/doc/refman/5.7/en/innodb-file-format.html
2018-10-25T05:49:17.315553Z 0 [Warning] InnoDB: New log files created, LSN=45790
2018-10-25T05:49:17.466414Z 0 [Warning] InnoDB: Creating foreign key constraint system tables.
2018-10-25T05:49:17.535492Z 0 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: b614218c-d819-11e8-a907-0a580ae94012.
2018-10-25T05:49:17.538706Z 0 [Warning] Gtid table is not ready to be used. Table 'mysql.gtid_executed' cannot be opened.
2018-10-25T05:49:17.539754Z 1 [Warning] root@localhost is created with an empty password ! Please consider switching off the --initialize-insecure option.
2018-10-25T05:49:18.528336Z 1 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:18.528367Z 1 [Warning] 'user' entry 'mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:18.528373Z 1 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:18.528383Z 1 [Warning] 'db' entry 'performance_schema mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:18.528386Z 1 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:18.528393Z 1 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:18.528419Z 1 [Warning] 'tables_priv' entry 'user mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:18.528432Z 1 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
Database initialized
Initializing certificates
Generating a 2048 bit RSA private key
...................................+++
....+++
unable to write 'random state'
writing new private key to 'ca-key.pem'
-----
Generating a 2048 bit RSA private key
.............................................+++
..............................+++
unable to write 'random state'
writing new private key to 'server-key.pem'
-----
Generating a 2048 bit RSA private key
.....................................................+++
...+++
unable to write 'random state'
writing new private key to 'client-key.pem'
-----
Certificates initialized
MySQL init process in progress...
2018-10-25T05:49:21.477495Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2018-10-25T05:49:21.480563Z 0 [Note] mysqld (mysqld 5.7.23) starting as process 92 ...
2018-10-25T05:49:21.487347Z 0 [Warning] InnoDB: Using innodb_file_format is deprecated and the parameter may be removed in future releases. See http://dev.mysql.com/doc/refman/5.7/en/innodb-file-format.html
2018-10-25T05:49:21.487437Z 0 [Note] InnoDB: PUNCH HOLE support available
2018-10-25T05:49:21.487453Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2018-10-25T05:49:21.487457Z 0 [Note] InnoDB: Uses event mutexes
2018-10-25T05:49:21.487461Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
2018-10-25T05:49:21.487472Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
2018-10-25T05:49:21.487476Z 0 [Note] InnoDB: Using Linux native AIO
2018-10-25T05:49:21.487799Z 0 [Note] InnoDB: Number of pools: 1
2018-10-25T05:49:21.487927Z 0 [Note] InnoDB: Using CPU crc32 instructions
2018-10-25T05:49:21.490211Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
2018-10-25T05:49:21.501695Z 0 [Note] InnoDB: Completed initialization of buffer pool
2018-10-25T05:49:21.504230Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2018-10-25T05:49:21.527380Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
2018-10-25T05:49:21.560049Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2018-10-25T05:49:21.560592Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2018-10-25T05:49:21.651904Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2018-10-25T05:49:21.707644Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
2018-10-25T05:49:21.707690Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
2018-10-25T05:49:21.710354Z 0 [Note] InnoDB: 5.7.23 started; log sequence number 2588944
2018-10-25T05:49:21.710743Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2018-10-25T05:49:21.710796Z 0 [Note] Plugin 'FEDERATED' is disabled.
2018-10-25T05:49:21.726805Z 0 [Note] InnoDB: Buffer pool(s) load completed at 181025 13:49:21
2018-10-25T05:49:21.730295Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them.
2018-10-25T05:49:21.732085Z 0 [Warning] CA certificate ca.pem is self signed.
MySQL init process in progress...
2018-10-25T05:49:22.304794Z 0 [Warning] Insecure configuration for --pid-file: Location '/var/run/mysqld' in the path is accessible to all OS users. Consider choosing a different directory.
2018-10-25T05:49:22.312842Z 0 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:22.312893Z 0 [Warning] 'user' entry 'mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:22.312908Z 0 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:22.312931Z 0 [Warning] 'db' entry 'performance_schema mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:22.312936Z 0 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:22.312946Z 0 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:22.327172Z 0 [Warning] 'tables_priv' entry 'user mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:22.327190Z 0 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:22.375595Z 0 [Note] Event Scheduler: Loaded 0 events
2018-10-25T05:49:22.375824Z 0 [Note] mysqld: ready for connections.
Version: '5.7.23'  socket: '/var/run/mysqld/mysqld.sock'  port: 0  MySQL Community Server (GPL)
Warning: Unable to load '/usr/share/zoneinfo/iso3166.tab' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/leap-seconds.list' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/zone.tab' as time zone. Skipping it.
Warning: Unable to load '/usr/share/zoneinfo/zone1970.tab' as time zone. Skipping it.
2018-10-25T05:49:25.940601Z 4 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:25.940631Z 4 [Warning] 'user' entry 'mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:25.940638Z 4 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:25.940653Z 4 [Warning] 'db' entry 'performance_schema mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:25.940658Z 4 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:25.940668Z 4 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:25.940742Z 4 [Warning] 'tables_priv' entry 'user mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:25.940759Z 4 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
mysql: [Warning] Using a password on the command line interface can be insecure.

2018-10-25T05:49:25.951430Z 0 [Note] Giving 0 client threads a chance to die gracefully
2018-10-25T05:49:25.951450Z 0 [Note] Shutting down slave threads
2018-10-25T05:49:25.951456Z 0 [Note] Forcefully disconnecting 0 remaining clients
2018-10-25T05:49:25.951462Z 0 [Note] Event Scheduler: Purging the queue. 0 events
2018-10-25T05:49:25.951519Z 0 [Note] Binlog end
2018-10-25T05:49:25.959365Z 0 [Note] Shutting down plugin 'ngram'
2018-10-25T05:49:25.959388Z 0 [Note] Shutting down plugin 'partition'
2018-10-25T05:49:25.959392Z 0 [Note] Shutting down plugin 'BLACKHOLE'
2018-10-25T05:49:25.959397Z 0 [Note] Shutting down plugin 'ARCHIVE'
2018-10-25T05:49:25.959399Z 0 [Note] Shutting down plugin 'PERFORMANCE_SCHEMA'
2018-10-25T05:49:25.959437Z 0 [Note] Shutting down plugin 'MRG_MYISAM'
2018-10-25T05:49:25.959443Z 0 [Note] Shutting down plugin 'MyISAM'
2018-10-25T05:49:25.959455Z 0 [Note] Shutting down plugin 'INNODB_SYS_VIRTUAL'
2018-10-25T05:49:25.959463Z 0 [Note] Shutting down plugin 'INNODB_SYS_DATAFILES'
2018-10-25T05:49:25.959466Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESPACES'
2018-10-25T05:49:25.959468Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN_COLS'
2018-10-25T05:49:25.959471Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN'
2018-10-25T05:49:25.959473Z 0 [Note] Shutting down plugin 'INNODB_SYS_FIELDS'
2018-10-25T05:49:25.959475Z 0 [Note] Shutting down plugin 'INNODB_SYS_COLUMNS'
2018-10-25T05:49:25.959478Z 0 [Note] Shutting down plugin 'INNODB_SYS_INDEXES'
2018-10-25T05:49:25.959487Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESTATS'
2018-10-25T05:49:25.959490Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLES'
2018-10-25T05:49:25.959492Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_TABLE'
2018-10-25T05:49:25.959494Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_CACHE'
2018-10-25T05:49:25.959496Z 0 [Note] Shutting down plugin 'INNODB_FT_CONFIG'
2018-10-25T05:49:25.959498Z 0 [Note] Shutting down plugin 'INNODB_FT_BEING_DELETED'
2018-10-25T05:49:25.959500Z 0 [Note] Shutting down plugin 'INNODB_FT_DELETED'
2018-10-25T05:49:25.959502Z 0 [Note] Shutting down plugin 'INNODB_FT_DEFAULT_STOPWORD'
2018-10-25T05:49:25.959505Z 0 [Note] Shutting down plugin 'INNODB_METRICS'
2018-10-25T05:49:25.959507Z 0 [Note] Shutting down plugin 'INNODB_TEMP_TABLE_INFO'
2018-10-25T05:49:25.959517Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_POOL_STATS'
2018-10-25T05:49:25.959520Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE_LRU'
2018-10-25T05:49:25.959522Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE'
2018-10-25T05:49:25.959525Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX_RESET'
2018-10-25T05:49:25.959527Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX'
2018-10-25T05:49:25.959529Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM_RESET'
2018-10-25T05:49:25.959532Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM'
2018-10-25T05:49:25.959543Z 0 [Note] Shutting down plugin 'INNODB_CMP_RESET'
2018-10-25T05:49:25.959545Z 0 [Note] Shutting down plugin 'INNODB_CMP'
2018-10-25T05:49:25.959548Z 0 [Note] Shutting down plugin 'INNODB_LOCK_WAITS'
2018-10-25T05:49:25.959550Z 0 [Note] Shutting down plugin 'INNODB_LOCKS'
2018-10-25T05:49:25.959552Z 0 [Note] Shutting down plugin 'INNODB_TRX'
2018-10-25T05:49:25.959554Z 0 [Note] Shutting down plugin 'InnoDB'
2018-10-25T05:49:25.959615Z 0 [Note] InnoDB: FTS optimize thread exiting.
2018-10-25T05:49:25.959746Z 0 [Note] InnoDB: Starting shutdown...
2018-10-25T05:49:26.060420Z 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool
2018-10-25T05:49:26.064900Z 0 [Note] InnoDB: Buffer pool(s) dump completed at 181025 13:49:26
2018-10-25T05:49:27.682564Z 0 [Note] InnoDB: Shutdown completed; log sequence number 12359060
2018-10-25T05:49:27.686436Z 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2018-10-25T05:49:27.686462Z 0 [Note] Shutting down plugin 'MEMORY'
2018-10-25T05:49:27.686470Z 0 [Note] Shutting down plugin 'CSV'
2018-10-25T05:49:27.686474Z 0 [Note] Shutting down plugin 'sha256_password'
2018-10-25T05:49:27.686484Z 0 [Note] Shutting down plugin 'mysql_native_password'
2018-10-25T05:49:27.686642Z 0 [Note] Shutting down plugin 'binlog'
2018-10-25T05:49:27.687089Z 0 [Note] mysqld: Shutdown complete


MySQL init process done. Ready for start up.

2018-10-25T05:49:27.979946Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2018-10-25T05:49:27.983788Z 0 [Note] mysqld (mysqld 5.7.23) starting as process 1 ...
2018-10-25T05:49:27.990412Z 0 [Warning] InnoDB: Using innodb_file_format is deprecated and the parameter may be removed in future releases. See http://dev.mysql.com/doc/refman/5.7/en/innodb-file-format.html
2018-10-25T05:49:27.990507Z 0 [Note] InnoDB: PUNCH HOLE support available
2018-10-25T05:49:27.990528Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2018-10-25T05:49:27.990532Z 0 [Note] InnoDB: Uses event mutexes
2018-10-25T05:49:27.990537Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
2018-10-25T05:49:27.990551Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
2018-10-25T05:49:27.990555Z 0 [Note] InnoDB: Using Linux native AIO
2018-10-25T05:49:27.990860Z 0 [Note] InnoDB: Number of pools: 1
2018-10-25T05:49:27.990977Z 0 [Note] InnoDB: Using CPU crc32 instructions
2018-10-25T05:49:27.992905Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
2018-10-25T05:49:28.003147Z 0 [Note] InnoDB: Completed initialization of buffer pool
2018-10-25T05:49:28.005556Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2018-10-25T05:49:28.041043Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
2018-10-25T05:49:28.073048Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2018-10-25T05:49:28.073597Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2018-10-25T05:49:28.181355Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2018-10-25T05:49:28.183440Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
2018-10-25T05:49:28.183464Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
2018-10-25T05:49:28.185047Z 0 [Note] InnoDB: 5.7.23 started; log sequence number 12359060
2018-10-25T05:49:28.185398Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2018-10-25T05:49:28.185455Z 0 [Note] Plugin 'FEDERATED' is disabled.
2018-10-25T05:49:28.208660Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them.
2018-10-25T05:49:28.208956Z 0 [Note] InnoDB: Buffer pool(s) load completed at 181025 13:49:28
2018-10-25T05:49:28.210316Z 0 [Warning] CA certificate ca.pem is self signed.
2018-10-25T05:49:28.212420Z 0 [Note] Server hostname (bind-address): '*'; port: 3306
2018-10-25T05:49:28.212461Z 0 [Note] IPv6 is available.
2018-10-25T05:49:28.212475Z 0 [Note]   - '::' resolves to '::';
2018-10-25T05:49:28.212502Z 0 [Note] Server socket created on IP: '::'.
2018-10-25T05:49:28.215101Z 0 [Warning] Insecure configuration for --pid-file: Location '/var/run/mysqld' in the path is accessible to all OS users. Consider choosing a different directory.
2018-10-25T05:49:28.221526Z 0 [Warning] 'user' entry 'root@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:28.221568Z 0 [Warning] 'user' entry 'mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:28.221584Z 0 [Warning] 'user' entry 'mysql.sys@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:28.221605Z 0 [Warning] 'db' entry 'performance_schema mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:28.221614Z 0 [Warning] 'db' entry 'sys mysql.sys@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:28.221621Z 0 [Warning] 'proxies_priv' entry '@ root@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:28.231480Z 0 [Warning] 'tables_priv' entry 'user mysql.session@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:28.231497Z 0 [Warning] 'tables_priv' entry 'sys_config mysql.sys@localhost' ignored in --skip-name-resolve mode.
2018-10-25T05:49:28.265757Z 0 [Note] Event Scheduler: Loaded 0 events
2018-10-25T05:49:28.266756Z 0 [Note] mysqld: ready for connections.
Version: '5.7.23'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  MySQL Community Server (GPL)
2018-10-25T05:51:48.159011Z 18 [Note] Aborted connection 18 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T05:52:37.519849Z 24 [Note] Aborted connection 24 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T05:53:08.009015Z 32 [Note] Aborted connection 32 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T05:53:48.070305Z 39 [Note] Aborted connection 39 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T05:54:08.045888Z 37 [Note] Aborted connection 37 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T05:54:38.040892Z 41 [Note] Aborted connection 41 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T05:55:58.648946Z 45 [Note] Aborted connection 45 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T05:56:58.604439Z 30 [Note] Aborted connection 30 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T05:59:08.836987Z 67 [Note] Aborted connection 67 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:00:03.369423Z 63 [Note] Aborted connection 63 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:01:48.086792Z 91 [Note] Aborted connection 91 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:01:48.088762Z 95 [Note] Aborted connection 95 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:02:51.423022Z 79 [Note] Aborted connection 79 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:07:48.044255Z 52 [Note] Aborted connection 52 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:07:50.587324Z 154 [Note] Aborted connection 154 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:09:11.600989Z 166 [Note] Aborted connection 166 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:25:34.176809Z 284 [Note] Aborted connection 284 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:31:39.988266Z 325 [Note] Aborted connection 325 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:37:58.952325Z 366 [Note] Aborted connection 366 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:44:11.974524Z 408 [Note] Aborted connection 408 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:50:20.897461Z 449 [Note] Aborted connection 449 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T06:56:36.133473Z 490 [Note] Aborted connection 490 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:06:19.471311Z 553 [Note] Access denied for user 'root'@'localhost' (using password: NO)
2018-10-25T07:07:23.780673Z 560 [Note] Access denied for user 'choerodon'@'localhost' (using password: YES)
2018-10-25T07:07:44.337254Z 563 [Note] Access denied for user 'choerodon'@'localhost' (using password: YES)
2018-10-25T07:08:59.902370Z 575 [Note] Aborted connection 575 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:15:16.104360Z 616 [Note] Aborted connection 616 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:21:33.026166Z 658 [Note] Aborted connection 658 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:27:41.999179Z 699 [Note] Aborted connection 699 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:33:27.421477Z 213 [Note] Aborted connection 213 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:33:27.421495Z 214 [Note] Aborted connection 214 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:34:06.875266Z 744 [Note] Aborted connection 744 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:38:37.223213Z 35 [Note] Aborted connection 35 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:40:21.848170Z 804 [Note] Aborted connection 804 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:46:34.925844Z 846 [Note] Aborted connection 846 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:52:53.000342Z 888 [Note] Aborted connection 888 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T07:59:01.762168Z 929 [Note] Aborted connection 929 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T08:05:14.866964Z 971 [Note] Aborted connection 971 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T08:10:57.410363Z 833 [Note] Aborted connection 833 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T08:10:57.410380Z 938 [Note] Aborted connection 938 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T08:11:25.578217Z 1014 [Note] Aborted connection 1014 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T08:17:36.502668Z 1057 [Note] Aborted connection 1057 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T08:20:39.321286Z 1077 [Note] Access denied for user 'choerodon'@'localhost' (using password: YES)
2018-10-25T08:23:47.594143Z 1100 [Note] Aborted connection 1100 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)
2018-10-25T08:28:25.558072Z 1128 [Note] Access denied for user 'choerodon'@'localhost' (using password: YES)
2018-10-25T08:30:03.373635Z 1142 [Note] Aborted connection 1142 to db: 'gitlabhq_production' user: 'root' host: '10.233.64.1' (Got an error reading communication packets)

minliacom · 2018 年10 月 25 日 09:18

看起来gitlab的部署还是有些问题