-
Choerodon平台版本: 0.19.0
-
遇到问题的执行步骤:
按升级文档 操作,问题目前有:
1、 devops数据迁移失败、敏捷管理 devops相关、知识管理数据都没了
2、 openldap 连接信息账号密码丢失
3、 升级文档格式有问题需调整:
其他 先帮忙把数据迁移对 再细看。。。
deovps 日志:
2019-11-11 00:00:17.356 INFO 7 --- [nio-8060-exec-2] i.c.d.a.s.i.AgentMsgHandlerServiceImpl : env 1 receive git ops msg :
{"id":0,"resourceIDs":[],"type":"sync","startedAt":"2019-11-10T16:00:17.00137023Z","endedAt":"2019-11-10T16:00:17.00137023Z","metadata":{"commit":"9e1b5e291055451f4e439216c0051375a21da69c"}}
2019-11-11 00:00:18.121 INFO 7 --- [nio-8060-exec-4] i.c.d.a.s.i.DevopsCheckLogServiceImpl : start upgrade task
2019-11-11 00:00:18.121 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : Start syncing relevance.
2019-11-11 00:00:18.127 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : End syncing relevance.
2019-11-11 00:00:18.128 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : It's been synchronized appService share.
2019-11-11 00:00:18.128 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 修复部署记录数据开始。此过程耗时稍长
2019-11-11 00:00:18.130 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 共0条手动部署的纪录需要迁移。
2019-11-11 00:00:18.132 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 共0条自动部署的纪录需要迁移。
2019-11-11 00:00:18.132 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 修复部署记录数据结束
2019-11-11 00:00:18.133 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 开始迁移集 群和证 书到项目下!
2019-11-11 00:00:18.139 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : There are 1 clusters to be migrated.
2019-11-11 00:00:18.141 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : There are 0 certifications to be migrated.
2019-11-11 00:00:18.142 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : The number of organizations involved is 1
2019-11-11 00:00:18.453 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 已创建项目,id为2
2019-11-11 00:00:18.563 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : Successfully add organization administrators to this project with id 2
2019-11-11 00:00:18.563 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 迁移id为1的组织下的证 书和集群到id为2的项目下.
2019-11-11 00:00:18.564 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : Sync cluster migration to the project,clusterId: 1, organizationId: 1
2019-11-11 00:00:18.566 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 迁移集群及证 书到项 目下已 完 成
2019-11-11 00:00:18.566 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : sync config begin!!!
2019-11-11 00:00:18.573 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : sync config end!!!
2019-11-11 00:00:18.573 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : Start syncing status.
2019-11-11 00:00:18.575 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : End syncing status.
2019-11-11 00:00:18.575 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : Start syncing branches.
2019-11-11 00:00:18.577 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : End syncing branches.
2019-11-11 00:00:19.483 INFO 7 --- [pool-7-thread-2] i.c.devops.app.eventhandler.SagaHandler : data: [{"resourceId":2,"resourceType":"project","roleLabels":["project.owner","project.gitlab.owner"],"userId":1,"username":"admin"}]
2019-11-11 00:00:19.488 INFO 7 --- [pool-7-thread-1] i.c.devops.app.eventhandler.SagaHandler : data: {"organizationCode":"operation","organizationName":"智联","projectCode":"def-ops-proj","projectId":2,"projectName":"默认运维项目","roleLabels":["project.owner","project.gitlab.owner"],"userId":1,"userName":"admin"}
2019-11-11 00:00:19.496 INFO 7 --- [pool-7-thread-1] s.c.a.AnnotationConfigApplicationContext : Refreshing SpringClientFactory-gitlab-service: startup date [Mon Nov 11 00:00:19 CST 2019]; parent: org.springframework.boot.web.servlet.context.AnnotationConfigServletWebServerApplicationContext@63e17e94
2019-11-11 00:00:19.518 INFO 7 --- [pool-7-thread-2] i.c.d.a.s.i.GitlabGroupMemberServiceImpl : error.gitlab.groupId.select
2019-11-11 00:00:19.524 INFO 7 --- [pool-7-thread-1] f.a.AutowiredAnnotationBeanPostProcessor : JSR-330 'javax.inject.Inject' annotation found and supported for autowiring
2019-11-11 00:00:19.543 INFO 7 --- [pool-7-thread-1] c.n.u.concurrent.ShutdownEnabledTimer : Shutdown hook installed for: NFLoadBalancer-PingTimer-gitlab-service
2019-11-11 00:00:19.543 INFO 7 --- [pool-7-thread-1] c.netflix.loadbalancer.BaseLoadBalancer : Client: gitlab-service instantiated a LoadBalancer: DynamicServerListLoadBalancer:{NFLoadBalancer:name=gitlab-service,current list of Servers=[],Load balancer stats=Zone stats: {},Server stats: []}ServerList:null
2019-11-11 00:00:19.545 INFO 7 --- [pool-7-thread-1] c.n.l.DynamicServerListLoadBalancer : Using serverListUpdater PollingServerListUpdater
2019-11-11 00:00:19.547 INFO 7 --- [pool-7-thread-1] c.netflix.config.ChainedDynamicProperty : Flipping property: gitlab-service.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647
2019-11-11 00:00:19.548 INFO 7 --- [pool-7-thread-1] c.n.l.DynamicServerListLoadBalancer : DynamicServerListLoadBalancer for client gitlab-service initialized: DynamicServerListLoadBalancer:{NFLoadBalancer:name=gitlab-service,current list of Servers=[10.88.58.183:8070],Load balancer stats=Zone stats: {defaultzone=[Zone:defaultzone; Instance count:1; Active connections count: 0; Circuit breaker tripped count: 0; Active connections per server: 0.0;]
},Server stats: [[Server:10.88.58.183:8070; Zone:defaultZone; Total Requests:0; Successive connection failure:0; Total blackout seconds:0; Last connection made:Thu Jan 01 08:00:00 CST 1970; First connection made: Thu Jan 01 08:00:00 CST 1970; Active Connections:0; total failure count in last (1000) msecs:0; average resp time:0.0; 90 percentile resp time:0.0; 95 percentile resp time:0.0; min resp time:0.0; max resp time:0.0; stddev resp time:0.0]
]}ServerList:org.springframework.cloud.netflix.ribbon.eureka.DomainExtractingServerList@41bedf47
2019-11-11 00:00:20.546 INFO 7 --- [erListUpdater-1] c.netflix.config.ChainedDynamicProperty : Flipping property: gitlab-service.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647
2019-11-11 00:00:23.952 INFO 7 --- [pool-7-thread-3] i.c.devops.app.eventhandler.SagaHandler : data: {"projectCode":"operation-def-ops-proj","projectId":2}
2019-11-11 00:00:24.034 INFO 7 --- [pool-7-thread-3] i.c.d.a.service.impl.HarborServiceImpl : null
2019-11-11 00:00:26.893 DEBUG 7 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool : HikariPool-1 - Pool stats (total=15, active=0, idle=15, waiting=0)
2019-11-11 00:00:56.606 INFO 7 --- [nio-8061-exec-4] c.c.c.ConfigServicePropertySourceLocator : Fetching config from server at : http://register-server.c7n-system:8000/
2019-11-11 00:00:56.620 INFO 7 --- [nio-8061-exec-4] c.c.c.ConfigServicePropertySourceLocator : Located environment: name=devops-service, profiles=[default], label=, version=0.18.6, state=
2019-11-11 00:00:56.894 DEBUG 7 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool : HikariPool-1 - Pool stats (total=15, active=0, idle=15, waiting=0)
2019-11-11 00:00:59.419 INFO 7 --- [nio-8060-exec-2] i.c.d.a.s.i.AgentMsgHandlerServiceImpl : sync command status!
你好,根据你所贴的devops的数据迁移的日志,并没有明确出现失败,其中疑似出问题的日志并不是devops-upgrade这个线程所输出的。你可以过滤devops-upgrade这个线程的日志,看看最后有没有输出数据迁移成功类似的日志。
能重复触发 迁移接口吗?日志已经刷没了 容器的日志路径是哪?
1)只有在其他数据修复完成才能调用界面的数据迁移接口
2)日志可以看pod的
3)从你这个日志看,devops数据迁移不影响其他服务的数据
1)满足datafix 看没错误日志
2)pod 日志已经被刷没了
3)按你的意思 devops这操作应该是不影响 敏捷管理跟 知识库的数据对吗?
现在进去平台 数据都没迁过来
好 我再试下
2019-11-11 10:42:41.996 INFO 7 --- [nio-8060-exec-2] i.c.d.a.s.i.DevopsCheckLogServiceImpl : start upgrade task
2019-11-11 10:42:42.018 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : Start syncing relevance.
2019-11-11 10:42:42.040 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : End syncing relevance.
2019-11-11 10:42:42.053 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : It's been synchronized appService share.
2019-11-11 10:42:42.053 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 修复部署记录数据开始。此过程耗时稍长
2019-11-11 10:42:42.062 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 共0条手动部署的纪录需要迁移。
2019-11-11 10:42:42.069 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 共0条自动部署的纪录需要迁移。
2019-11-11 10:42:42.070 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 修复部署记录数据结束
2019-11-11 10:42:42.070 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 开始迁移集群和证书到项目下!
2019-11-11 10:42:42.071 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : There are 0 clusters to be migrated.
2019-11-11 10:42:42.072 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : There are 0 certifications to be migrated.
2019-11-11 10:42:42.073 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : The number of organizations involved is 0
2019-11-11 10:42:42.105 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : 迁移集群及证书到项目下已完成
2019-11-11 10:42:42.105 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : sync config begin!!!
2019-11-11 10:42:42.116 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : sync config end!!!
2019-11-11 10:42:42.116 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : Start syncing status.
2019-11-11 10:42:42.120 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : End syncing status.
2019-11-11 10:42:42.121 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : Start syncing branches.
2019-11-11 10:42:42.124 INFO 7 --- [ devops-upgrade] i.c.d.a.s.i.DevopsCheckLogServiceImpl : End syncing branches.
2019-11-11 10:42:42.972 INFO 7 --- [nio-8060-exec-6] i.c.d.a.s.i.AgentMsgHandlerServiceImpl : sync command status!
2019-11-11 10:43:04.977 DEBUG 7 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool : HikariPool-1 - Pool stats (total=15, active=0, idle=15, waiting=0)
2019-11-11 10:43:06.588 INFO 7 --- [nio-8061-exec-4] c.c.c.ConfigServicePropertySourceLocator : Fetching config from server at : http://register-server.c7n-system:8
看样子 没有报错信息。。。
从日志上看devops的数据已经成功迁移了,其中做的一部分工作是将之前组织层的集群和证书迁移到组织下一个新建的名为默认运维项目的项目中的集群管理中,你可以去看看。
默认运维项目是一个为了迁移组织层数据的新建的项目,里面只应该有之前组织层的集群和证书的相关数据。
这个项目只是DevOps用于迁移数据的,其他部分并无使用这个项目迁移数据的需求,所以只会有DevOps之前在组织层的证书和集群的数据,其他部分的数据应该去原项目下查看。
这个你稍等,我联系其他组开发人员排查下问题
好的 麻烦了