OS Name/Version:
OS: Ubuntu 22.04.01 LTS
AMP: |Application Version|2.4.0.10|
| — | — |
|Release Stream|Release|
|Build Date|27/10/2022 18:15|
|InstanceID|01e00411-8436-4441-a311-edee117ef526|
Problem Description:
I updated one of the server instances and the ADS Instance from 2.4.0.8 to 2.4.0.10 the other 2 Instances were already on 4.0.10 After upgrading and amp service restart none of the 3 Instances are working anymore. I cannot connect!!!
Stopping instance Gatekeeper-TEST-BOT01...
13:25:13
Error response from daemon: Cannot kill container: AMP_Gatekeeper-TEST-BOT01: No such container: AMP_Gatekeeper-TEST-BOT01
Instance Gatekeeper-TEST-BOT01 has stopped.
Slow method invocation: StopInstance took 5194ms to complete.
Slow response: ADSModule.StopInstance took 5195ms to complete.
I can create new instances on that server node that are working fine and I can connect to them. But i cannot connect to the old ones.
Here are the logs of AMP ADS
[12:24:06] [Core Info] : Starting AMP version 2.4.0.10 (Halimede), built 27/10/2022 18:15
[12:24:06] [Core Info] : Stream: Mainline (Release) - built by CUBECODERS/buildbot on CCL-DEV
[12:24:06] [Core Info] : OS: Linux / x86_64
[12:24:06] [Core Info] : CPU: AMD Ryzen 5 3600 6-Core Processor (6C/12T)
[12:24:06] [Core Info] : AMP Instance ID: 01e00411-8436-4441-a311-edee117ef526
[12:24:06] [ModuleLoader Info] : Loaded ADSModule version 1.0.0.0 by CubeCoders Limited
[12:24:06] [ModuleLoader Info] : Loaded FileManagerPlugin version 1.0.0.0 by CubeCoders Limited
[12:24:06] [ModuleLoader Info] : Loaded EmailSenderPlugin version 1.0.0.0 by CubeCoders Limited
[12:24:06] [ModuleLoader Info] : Loaded WebRequestPlugin version 1.0.0.0 by CubeCoders Limited
[12:24:06] [ModuleLoader Info] : Loaded LocalFileBackupPlugin version 1.0.0.0 by CubeCoders Limited
[12:24:06] [ModuleLoader Info] : Loaded CommonCorePlugin version 1.0.0.0 by CubeCoders Limited
[12:24:06] [ModuleLoader Info] : ADSModule requests dependency InstanceManagerPlugin...
[12:24:06] [ModuleLoader Info] : Loaded InstanceManagerPlugin version 1.0.0.0 by CubeCoders Limited
[12:24:06] [ModuleLoader Info] : ADSModule requests dependency SystemUserManagerPlugin...
[12:24:06] [ModuleLoader Info] : Loaded SystemUserManagerPlugin version 1.0.0.0 by CubeCoders Limited
[12:24:07] [ModuleLoader Info] : Loaded steamcmdplugin version 1.0.0.0 by CubeCoders Limited
[12:24:07] [Core Info] : Metrics server started OK on port 12820
[12:24:07] [ADS Info] : Updating remote source CubeCoders/AMPTemplates
[12:24:07] [ADS Info] : Updating existing remote source https://github.com/CubeCoders/AMPTemplates.git...
[12:24:07] [FileManager Notice] : Using keypair with fingerprint :grinning: :grinning: :grinning:
[12:24:07] [FileManager Info] : SFTP Server started on 0.0.0.0:2223
[12:24:07] [WebServer Info] : Websockets are enabled.
[12:24:07] [WebServer Info] : Webserver started on http://0.0.0.0:8080
[12:24:07] [Logger Warning] : RouterTimer@10Hz with 2 jobs started
[12:24:07] [Core Info] : Checking for AMP updates...
Already up to date.
[12:24:07] [Core Info] : AMP is up-to-date.
[12:24:23] [ADS:admin Activity] : Managed remote instance Gatekeeper-TEST-BOT01 at http://127.0.0.1:8083/
[12:24:23] [Auth:admin Activity] : Authentication token for admin requested by ManageInstance on behalf of admin
[12:25:08] [InstanceManager:admin Info] : Stopping instance Gatekeeper-TEST-BOT01...
[12:25:13] [Core:admin Info] : Error response from daemon: Cannot kill container: AMP_Gatekeeper-TEST-BOT01: No such container: AMP_Gatekeeper-TEST-BOT01
[12:25:13] [InstanceManager:admin Info] : Instance Gatekeeper-TEST-BOT01 has stopped.
[12:25:13] [Core:admin Warning] : Slow method invocation: StopInstance took 5194ms to complete.
[12:25:13] [Core:admin Warning] : Slow response: ADSModule.StopInstance took 5195ms to complete.
[12:34:57] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:34:57] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:34:57] [Core:Anonymous Error] : SocketException
[12:34:57] [Core:Anonymous Error] : SocketException
[12:34:57] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:34:57] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:34:58] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:34:58] [Core:Anonymous Error] : SocketException
[12:34:58] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:34:58] [APIService Warning] : :grinning: :grinning:/Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.35 tried to use session ID 78022732-da0a-437c-8c9b-c6d2b5924279 - but no such ID exists
[12:34:59] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:34:59] [Core:Anonymous Error] : SocketException
[12:34:59] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:34:59] [APIService Warning] : :grinning: :grinning:/Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.35 tried to use session ID 78022732-da0a-437c-8c9b-c6d2b5924279 - but no such ID exists
[12:35:00] [Core Info] : Checking for AMP updates...
[12:35:00] [Core Info] : AMP is up-to-date.
[12:35:00] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:00] [Core:Anonymous Error] : SocketException
[12:35:00] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:00] [APIService Warning] :grinning: :grinning:/Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.35 tried to use session ID 78022732-da0a-437c-8c9b-c6d2b5924279 - but no such ID exists
[12:35:01] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:01] [Core:Anonymous Error] : SocketException
[12:35:01] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:02] [APIService Warning] : :grinning: :grinning:/Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.35 tried to use session ID 78022732-da0a-437c-8c9b-c6d2b5924279 - but no such ID exists
[12:35:02] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:02] [Core:Anonymous Error] : SocketException
[12:35:02] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:03] [APIService Warning] : :grinning: :grinning:/Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36 Edg/107.0.1418.35 tried to use session ID 78022732-da0a-437c-8c9b-c6d2b5924279 - but no such ID exists
[12:35:03] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:03] [Core:Anonymous Error] : SocketException
[12:35:03] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:04] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:04] [Core:Anonymous Error] : SocketException
[12:35:04] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:05] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:05] [Core:Anonymous Error] : SocketException
[12:35:05] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:06] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:06] [Core:Anonymous Error] : SocketException
[12:35:06] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:07] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:07] [Core:Anonymous Error] : SocketException
[12:35:07] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:08] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:08] [Core:Anonymous Error] : SocketException
[12:35:08] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:09] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:09] [Core:Anonymous Error] : SocketException
[12:35:09] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:10] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:10] [Core:Anonymous Error] : SocketException
[12:35:10] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:11] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:11] [Core:Anonymous Error] : SocketException
[12:35:11] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:11] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:11] [Core:Anonymous Error] : SocketException
[12:35:11] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:12] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:12] [Core:Anonymous Error] : SocketException
[12:35:12] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:35:13] [Core:Anonymous Warning] : Returned exception from API call ADSModule/Servers
[12:35:13] [Core:Anonymous Error] : SocketException
[12:35:13] [Core:Anonymous Error] : [0] (SocketException) : Connection refused
[12:36:40] [InstanceManager:admin Info] : Using cached archive: /home/amp/.ampdata/instances/AMPCache-Mainline-24010.zip
[12:36:44] [InstanceManager:admin Info] : [Info] AMPStart for Docker - v22.08.1
[12:36:44] [InstanceManager:admin Info] : [Info] Performing first-time container setup...
[12:36:45] [InstanceManager:admin Info] : [Info] Container setup complete.
[12:36:45] [InstanceManager:admin Info] : [Info] AMP Instance Manager v2.4.0.4 built 10/09/2022 16:02
[12:36:46] [InstanceManager:admin Info] : [Info] Release spec: Release - built by CUBECODERS/buildbot on CCL-DEV
[12:36:46] [InstanceManager:admin Info] : [Info] Certificates have been synced.
[12:36:47] [InstanceManager:admin Info] : [12:36:47] [Core Info] : Starting AMP version 2.4.0.10 (Halimede), built 27/10/2022 18:15
[12:36:47] [InstanceManager:admin Info] : [12:36:47] [Core Info] : Stream: Mainline (Release) - built by CUBECODERS/buildbot on CCL-DEV
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [Core Info] : Loading configuration from provisionargs.kvp...
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [Core Info] : OS: Linux / x86_64
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [Core Info] : CPU: AMD Ryzen 5 3600 6-Core Processor (6C/12T)
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [Core Info] : AMP Instance ID: 82f5fe54-433c-495c-8f93-e676182a79ee
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [Core Info] : Performing first-time setup for this instance, please wait...
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [ModuleLoader Info] : Loaded MinecraftModule version 1.0.0.3 by CubeCoders Limited
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [ModuleLoader Info] : Loaded FileManagerPlugin version 1.0.0.0 by CubeCoders Limited
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [ModuleLoader Info] : Loaded EmailSenderPlugin version 1.0.0.0 by CubeCoders Limited
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [ModuleLoader Info] : Loaded WebRequestPlugin version 1.0.0.0 by CubeCoders Limited
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [ModuleLoader Info] : Loaded LocalFileBackupPlugin version 1.0.0.0 by CubeCoders Limited
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [ModuleLoader Info] : Loaded CommonCorePlugin version 1.0.0.0 by CubeCoders Limited
[12:36:48] [InstanceManager:admin Info] : [12:36:48] [Core Info] : Performing activation, please wait...
[12:36:49] [InstanceManager:admin Info] : [12:36:49] [Core Info] : Activated successfully.
[12:36:49] [InstanceManager:admin Info] : [12:36:49] [Core Info] : Licence Present: AMP Professional Edition (Licenced to Marc Sch?fer)
[12:36:49] [InstanceManager:admin Info] : [12:36:49] [Core Info] : AMP has completed its first time setup. Saving settings and shutting down.
[12:36:52] [InstanceManager:admin Info] : :grinning: :grinning: :grinning:
[12:37:12] [ADS:admin Activity] : Managed remote instance TEST_Update01 at http://127.0.0.1:8084/
[12:37:12] [Auth:admin Activity] : Authentication token for admin requested by ManageInstance on behalf of admin
[12:37:21] [InstanceManager:admin Info] : :grinning: :grinning: :grinning:
[12:37:22] [Core:admin Warning] : Slow method invocation: StartInstance took 2284ms to complete.
[12:37:22] [Core:admin Warning] : Slow response: ADSModule.StartInstance took 2284ms to complete.
[12:37:22] [ADS:admin Activity] : Managed remote instance Gatekeeper-TEST-BOT01 at http://127.0.0.1:8083/
[12:37:22] [Auth:admin Activity] : Authentication token for admin requested by ManageInstance on behalf of admin
[12:37:23] [Core Warning] : Returned exception from API call ADSModule/Servers
[12:37:23] [Core Error] : SocketException
[12:37:23] [Core Error] : [0] (SocketException) : Connection refused
[12:38:14] [FileManager:admin Activity] : SFTP connection request from :grinning: :grinning: :grinning: (WinSCP_release_5.21.1)
[12:38:14] [FileManager:admin Activity] : SFTP login success for :grinning: :grinning: :grinning:
[12:40:15] [ADS:admin Activity] : Managed remote instance Gatekeeper-TEST-BOT01 at http://127.0.0.1:8083/
[12:40:15] [Auth:admin Activity] : Authentication token for admin requested by ManageInstance on behalf of admin
[12:40:19] [Core Warning] : Slow method invocation: Servers took 2020ms to complete.
[12:40:19] [Core Warning] : Slow response: ADSModule.Servers took 2021ms to complete.
Here the Update Log (Part of it)
[12:09:16] [InstanceManager:admin Info] : Stopping instance Gatekeeper-TEST-BOT01...
[12:09:17] [APIService Warning] : :grinning: :grinning: tried to use session ID bf8c2e0d-e5ee-493d-b8e9-8cd50bf0c1a0 - but that session belongs to 127.0.0.1 while attempting to call Servers
[12:09:18] [APIService Warning] : :grinning: :grinning: :grinning: tried to use session ID bf8c2e0d-e5ee-493d-b8e9-8cd50bf0c1a0 - but that session belongs to 127.0.0.1 while attempting to call Servers
[12:09:21] [Core:admin Info] : Error response from daemon: Cannot kill container: AMP_Gatekeeper-TEST-BOT01: No such container: AMP_Gatekeeper-TEST-BOT01
[12:09:21] [InstanceManager:admin Info] : Instance Gatekeeper-TEST-BOT01 has stopped.
[12:10:03] [ADS:admin Activity] : Managed remote instance TestBetterMCModpack1165v59501 at http://127.0.0.1:8082/
[12:10:03] [Auth:admin Activity] : Authentication token for admin requested by ManageInstance on behalf of admin
[12:10:46] [FileManager Activity] : Downloaded file __VDS__TestBetterMCModpack1165v59501/Minecraft/logs/latest.log (Direct mode)
[12:11:40] [InstanceManager:admin Info] : Stopping instance TestBetterMCModpack1165v59501...
[12:11:45] [Core:admin Info] : Error response from daemon: Cannot kill container: AMP_TestBetterMCModpack1165v59501: No such container: AMP_TestBetterMCModpack1165v59501
[12:11:45] [InstanceManager:admin Info] : Stopping instance Vanilla01...
[12:11:45] [InstanceManager:admin Info] : Instance TestBetterMCModpack1165v59501 has stopped.
[12:11:50] [Core:admin Info] : Error response from daemon: Cannot kill container: AMP_Vanilla01: No such container: AMP_Vanilla01
[12:11:50] [InstanceManager:admin Info] : Instance Vanilla01 has stopped.
[12:11:57] [Core:admin Info] : Stop requested: AMP update requested via API
[12:11:57] [Core Notice] : AMP shutdown requested.
[12:11:57] [Core Notice] : Stopping Application...
[12:12:02] [Core Notice] : Stopping Web Server...
[12:12:02] [WebServer Info] : Web server shutdown.
[12:12:02] [Core Notice] : Goodbye!
Rest in peace - Stephen Hawking 1942-2018
[12:12:02] [Logger Warning] : RouterTimer@10Hz stopped