流水线 自动触发部署 夯住了

Choerodon User Guide-Continuous Delivery
#1

  • Choerodon平台版本：0.17.0

  • 运行环境：自主搭建

  • 问题描述：

    image
    image1875×655 142 KB

    请尽量详细的描述您遇到的问题，以便我们能更快速的提供解决办法。

    devops-service 日志 mysql错误

2019-06-12 10:33:45.166 DEBUG 7 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@59bf89f1 failed

com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.
	at sun.reflect.GeneratedConstructorAccessor195.newInstance(Unknown Source)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)
	at com.mysql.jdbc.Util.getInstance(Util.java:408)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:919)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:898)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:887)
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:861)
	at com.mysql.jdbc.ConnectionImpl.throwConnectionClosedException(ConnectionImpl.java:1192)
	at com.mysql.jdbc.ConnectionImpl.checkClosed(ConnectionImpl.java:1187)
	at com.mysql.jdbc.ConnectionImpl.setNetworkTimeout(ConnectionImpl.java:5494)
	at com.zaxxer.hikari.pool.PoolBase.setNetworkTimeout(PoolBase.java:541)
	at com.zaxxer.hikari.pool.PoolBase.quietlyCloseConnection(PoolBase.java:129)
	at com.zaxxer.hikari.pool.HikariPool.lambda$closeConnection$1(HikariPool.java:434)
	at com.zaxxer.hikari.pool.HikariPool$$Lambda$1007.00000000BC003A30.run(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:813)

2019-06-12 10:33:45.166 DEBUG 7 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@7178b76c: (connection is dead)
2019-06-12 10:33:45.166 DEBUG 7 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPo
#2

mysql连接异常，可以参考这个https://blog.csdn.net/itguangit/article/details/79178155

#3

确认是这个mysql连接问题吗？

#4

这是要改项目的 配置文件吧 ， 你们这边不能打包 发布个小版本，我们直接升级下？

#5

image
image846×643 71.1 KB

一直在这不动

#6

这个任务又实例生成么

#7

如果有实例生成，说明已经执行成功，状态更新不对，可以点手动终止；如果没有实例生成可以截图给我还有什么异常么

#8

image
image819×710 63.2 KB

我去k8s上也看了没有生成实例

#9

可以截图一下workflow-service的日志么

#10 
2019-06-12 13:58:26.757 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 13:58:56.757 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 13:59:26.758 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 13:59:56.758 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 13:59:57.716  INFO 8 --- [trap-executor-0] c.n.d.s.r.aws.ConfigClusterResolver      : Resolving eureka endpoints via configuration
2019-06-12 14:00:05.820 DEBUG 8 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@9dbaa806: (connection has passed maxLifetime)
2019-06-12 14:00:05.826 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection com.mysql.jdbc.JDBC4Connection@faab7567
2019-06-12 14:00:07.410 DEBUG 8 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@685239cd: (connection has passed maxLifetime)
2019-06-12 14:00:07.414 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection com.mysql.jdbc.JDBC4Connection@b0adb27f
2019-06-12 14:00:07.453 DEBUG 8 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@78696844: (connection has passed maxLifetime)
2019-06-12 14:00:07.456 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection com.mysql.jdbc.JDBC4Connection@2f6af477
2019-06-12 14:00:12.979 DEBUG 8 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@6d7b87a1: (connection has passed maxLifetime)
2019-06-12 14:00:12.984 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection com.mysql.jdbc.JDBC4Connection@f6bec261
2019-06-12 14:00:14.056 DEBUG 8 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@5aca8914: (connection has passed maxLifetime)
2019-06-12 14:00:14.061 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection com.mysql.jdbc.JDBC4Connection@b88850c4
2019-06-12 14:00:22.950 DEBUG 8 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@1afe09de: (connection has passed maxLifetime)
2019-06-12 14:00:22.955 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection com.mysql.jdbc.JDBC4Connection@bee81284
2019-06-12 14:00:26.758 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:00:33.497 DEBUG 8 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@80c7cf79: (connection has passed maxLifetime)
2019-06-12 14:00:33.501 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection com.mysql.jdbc.JDBC4Connection@f5ab769c
2019-06-12 14:00:33.587 DEBUG 8 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@58a3b5ab: (connection has passed maxLifetime)
2019-06-12 14:00:33.591 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection com.mysql.jdbc.JDBC4Connection@52ce524e
2019-06-12 14:00:33.965  WARN 8 --- [nio-8066-exec-5] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Failed to validate connection com.mysql.jdbc.JDBC4Connection@a10e525b (No operations allowed after connection closed.). Possibly consider using a shorter maxLifetime value.
2019-06-12 14:00:33.965 DEBUG 8 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@a10e525b: (connection is dead)
2019-06-12 14:00:33.966  WARN 8 --- [nio-8066-exec-5] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Failed to validate connection com.mysql.jdbc.JDBC4Connection@87c4f763 (No operations allowed after connection closed.). Possibly consider using a shorter maxLifetime value.
2019-06-12 14:00:33.966 DEBUG 8 --- [nnection closer] com.zaxxer.hikari.pool.PoolBase          : HikariPool-1 - Closing connection com.mysql.jdbc.JDBC4Connection@87c4f763: (connection is dead)
2019-06-12 14:00:33.969 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection com.mysql.jdbc.JDBC4Connection@dce41edf
2019-06-12 14:00:33.969 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - After adding stats (total=9, active=0, idle=9, waiting=0)
2019-06-12 14:00:33.973 DEBUG 8 --- [onnection adder] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Added connection com.mysql.jdbc.JDBC4Connection@9a8622b6
2019-06-12 14:00:43.984  INFO 8 --- [nio-8066-exec-9] c.c.c.ConfigServicePropertySourceLocator : Fetching config from server at : http://register-server.c7n-system:8000/
2019-06-12 14:00:43.997  INFO 8 --- [nio-8066-exec-9] c.c.c.ConfigServicePropertySourceLocator : Located environment: name=workflow-service, profiles=[default], label=, version=0.16.2, state=
2019-06-12 14:00:56.767 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:01:26.768 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:01:56.768 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:02:26.768 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:02:56.768 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:03:26.769 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:03:56.769 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:04:26.769 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:04:56.769 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:04:57.716  INFO 8 --- [trap-executor-0] c.n.d.s.r.aws.ConfigClusterResolver      : Resolving eureka endpoints via configuration
2019-06-12 14:05:26.770 DEBUG 8 --- [l-1 housekeeper] com.zaxxer.hikari.pool.HikariPool        : HikariPool-1 - Pool stats (total=10, active=0, idle=10, waiting=0)
2019-06-12 14:05:43.981  INFO 8 --- [nio-8066-exec-1] c.c.c.ConfigServicePropertySourceLocator : Fetching config from server at : http://register-server.c7n-system:8000/
#11

你们这图片上传 真有问题 明明图片才2m 都没有 提示说过大。。。

#12

image
image930×375 101 KB

这里是 agent的 版本吗？怎么是0.16.2的

#13

之前升级文档没有更新要升级workflow-service，可以参考文档升级下http://choerodon.io/zh/docs/installation-configuration/update/0.16-to-0.17/

#14

image
image1260×180 126 KB

#15

升级成功后，可以重新执行一条流水线，看下workflow-service是否有打印流程开始之类的日志

#17

image
image1166×322 87 KB

就是这个消费没开 改成true 就ok了。。。

你们的升级文档 希望能及时维护 ，很坑啊。。。