Unable to license an instance

Note - If you do not fill in every section below, your post won’t be answered - you must provide the steps you have followed so far and the actions you’ve already taken. Make sure to remove this notice from your post too.

OS Name/Version:

Product Name/Version: Ubuntu 22.04 LTS (GNU/Linux 5.17.0-051700rc3-generic x86_64)

Problem Description:

Recently I had a memory failure on a server that caused all the licensing to drop. I was able to get 3/4 instances back. One of them refused to relicense itself and continues to crash.

ampinstmgr reactivate
[Info] AMP Instance Manager v2.3.3 built 23/05/2022 20:46
[Info] Release spec: Release - built by CUBECODERS/buildbot on CCL-DEV
Please enter value for Instance Name
>Minecraft03

Please enter value for Licence Key
>xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx(omited)

[Info] Checking licence key...
[Error] IM was unable to execute the requested command.
[Error] TimeoutException
[Error] [0] (TimeoutException) : The operation has timed out.
[Error]   at ServiceModel.Channels.HttpRequestChannel+HttpChannelRequestAsyncResult.WaitEnd ()
  at ServiceModel.Channels.HttpRequestChannel.EndRequest (IAsyncResult result)
  at ServiceModel.Channels.HttpRequestChannel.Request (ServiceModel.Channels.Message message, TimeSpan timeout)
  at ServiceModel.FrameworkInternal.ClientRuntimeChannel.Request (ServiceModel.Channels.Message msg, TimeSpan timeout)
  at ServiceModel.FrameworkInternal.ClientRuntimeChannel.Request (ServiceModel.Description.OperationDescription od, Boolean isAsync, Object[]& parameters, ServiceModel.OperationContext context)
  at ServiceModel.ClientRealProxy.DoInvoke (Runtime.Remoting.Messaging.IMessage inputMessage)
  at ServiceModel.ClientRealProxy.Invoke (Runtime.Remoting.Messaging.IMessage inputMessage)
  at Runtime.Remoting.Proxies.RealProxy.PrivateInvoke (Runtime.Remoting.Proxies.RealProxy rp, Runtime.Remoting.Messaging.IMessage msg, Exception& exc, Object[]& out_args)
  at (wrapper managed-to-native) Object.__icall_wrapper_framework_remoting_wrapper(intptr,intptr)
  at (wrapper remoting-invoke) CCLClient45.LicencingClient.IService.GetLicenceSummary(Guid)
  at CCLClient45.LicencingClient.ServiceClient.GetLicenceSummary (Guid LicenceKey)
  at CCLClient45.Licencing+<>c__DisplayClass21_0.<GetLicenceInfo>b__0 ()
  at CCLClient45.Licencing.GetLicenceInfo (String LicenceKey)
  at InstanceManagerCLI.Core.ReactivateInstance (String InstanceName, String LicenceKey)
  at InstanceManagerCLI.Core.ExecuteCommand (Collections.Generic.List`1[T] Params, Collections.Generic.Dictionary`2[TKey,TValue] Args)
  CubeCoders AMP

Steps to reproduce:

Change system hardware, then try to relicense instance.

Pretty stumped, the other instances all seemed to relicense fine. I have a internet connection.

What IP address is that instance bound to? Does that address have internet access?

It says 0.0.0.0 is the endpoint, is there a better way to check what is bound to?

That endpoint is fine. Try updating ampinstmgr via your package manager.

Unfortunately same error:

ampinstmgr reactivate
[Info] AMP Instance Manager v2.3.3.4 built 06/06/2022 18:55
[Info] Release spec: Release - built by CUBECODERS/buildbot on CCL-DEV
Please enter value for Instance Name
>Minecraft03

Please enter value for Licence Key
>

[Info] Checking licence key...
[Error] IM was unable to execute the requested command.
[Error] TimeoutException
[Error] [0] (TimeoutException) : The operation has timed out.
[Error]   at ServiceModel.Channels.HttpRequestChannel+HttpChannelRequestAsyncResult.WaitEnd ()
  at ServiceModel.Channels.HttpRequestChannel.EndRequest (IAsyncResult result)
  at ServiceModel.Channels.HttpRequestChannel.Request (ServiceModel.Channels.Message message, TimeSpan timeout)
  at ServiceModel.FrameworkInternal.ClientRuntimeChannel.Request (ServiceModel.Channels.Message msg, TimeSpan timeout)
  at ServiceModel.FrameworkInternal.ClientRuntimeChannel.Request (ServiceModel.Description.OperationDescription od, Boolean isAsync, Object[]& parameters, ServiceModel.OperationContext context)
  at ServiceModel.ClientRealProxy.DoInvoke (Runtime.Remoting.Messaging.IMessage inputMessage)
  at ServiceModel.ClientRealProxy.Invoke (Runtime.Remoting.Messaging.IMessage inputMessage)
  at Runtime.Remoting.Proxies.RealProxy.PrivateInvoke (Runtime.Remoting.Proxies.RealProxy rp, Runtime.Remoting.Messaging.IMessage msg, Exception& exc, Object[]& out_args)
  at (wrapper managed-to-native) Object.__icall_wrapper_framework_remoting_wrapper(intptr,intptr)
  at (wrapper remoting-invoke) CCLClient45.LicencingClient.IService.GetLicenceSummary(Guid)
  at CCLClient45.LicencingClient.ServiceClient.GetLicenceSummary (Guid LicenceKey)
  at CCLClient45.Licencing+<>c__DisplayClass21_0.<GetLicenceInfo>b__0 ()
  at CCLClient45.Licencing.GetLicenceInfo (String LicenceKey)
  at InstanceManagerCLI.Core.ReactivateInstance (String InstanceName, String LicenceKey)
  at InstanceManagerCLI.Core.ExecuteCommand (Collections.Generic.List`1[T] Params, Collections.Generic.Dictionary`2[TKey,TValue] Args)
  CubeCoders AMP

Try updating that instance first. (Also AMP should be 2.3.4.0 - so you’ve not quite updated, but that shouldn’t affect this issue)

Okay updated the instance and got ampinstmgr to 2.3.4. Not working, I do think it’s a networking problem but I don’t know what is wrong. Here is another networking error from a brand new instance. It says ip/port already in use, but I checked and there is nothing else using that port on this machine. I tried re-binding to another port and the same error “Address already in use”. Maybe that’s a different problem than the licensing.

[12:11:24] [Core Info]            : Starting AMP version 2.3.4.0 (Triton), built 16/06/2022 16:08
[12:11:24] [Core Info]            : Stream: Mainline (Release) - built by CUBECODERS/buildbot on CCL-DEV
[12:11:24] [Core Warning]         : Current time zone is set to EST - Servers should ideally be UTC to avoid time-zone related issues
[12:11:24] [Core Info]            : OS: Linux / x86_64
[12:11:24] [Core Info]            : CPU: 12th Gen Intel(R) Core(TM) i9-12900K (16C/32T)
[12:11:24] [Core Info]            : AMP Instance ID: d7ac30b8-00bc-4cab-adf4-25b142abddd1
[12:11:24] [ModuleLoader Info]    : Loaded MinecraftModule version 1.0.0.3 by CubeCoders Limited
[12:11:24] [Core Info]            : Metrics publishing is enabled at udp://127.0.0.1:12820.
[12:11:24] [ModuleLoader Info]    : Loaded FileManagerPlugin version 1.0.0.0 by CubeCoders Limited
[12:11:24] [ModuleLoader Info]    : Loaded EmailSenderPlugin version 1.0.0.0 by CubeCoders Limited
[12:11:24] [ModuleLoader Info]    : Loaded WebRequestPlugin version 1.0.0.0 by CubeCoders Limited
[12:11:24] [ModuleLoader Info]    : Loaded LocalFileBackupPlugin version 1.0.0.0 by CubeCoders Limited
[12:11:24] [ModuleLoader Info]    : Loaded CommonCorePlugin version 1.0.0.0 by CubeCoders Limited
[12:11:24] [Core Info]            : Licence Present: AMP Professional Edition (Licenced to Austin Detzel)
[12:11:24] [FileManager Notice]   : Using keypair with fingerprint n3LG3Fuj/KDKAU/Yn/XRi+e2TgvfZegZdhRzwRnh3pg=
[12:11:24] [FileManager Info]     : SFTP Server started on 0.0.0.0:2227
[12:11:24] [WebServer Info]       : Websockets are enabled.
[12:11:24] [WebServer Info]       : Webserver started on http://0.0.0.0:8085
[12:11:24] [Logger Warning]       : RouterTimer@10Hz with 2 jobs started
[12:11:24] [ErrorReporter Error]  : Socket exception - Trivial error / user error. Will not be submitted.
[12:11:24] [Core Info]            : Checking for AMP updates...
[12:11:24] [ErrorReporter Error]  : [Error] --- Begin Exception Data ---
[Error] OS: Linux (x86_64/None)
[Error] Module: MinecraftModule, Version: AMP 2.3.4.0
[Error] Release spec: Release - built by CUBECODERS/buildbot on CCL-DEV
[Error] Instance ID: d7ac30b8-00bc-4cab-adf4-25b142abddd1
[Error] SocketException
[Error] [0] (SocketException) : Address already in use
[Error]   at Net.Sockets.Socket.Bind (Net.EndPoint localEP) 
  at Net.Sockets.TcpListener.Start (Int32 backlog) 
  at m.Http.HttpBackend.ConnectionLoop () 
[Error] --- End Exception Data ---
[Warning] Last error was raised less than 60 minutes ago, error report will not be submitted.

[12:11:24] [ErrorReporter Info]   : ####################################
[12:11:24] [ErrorReporter Info]   : #         Self Diagnostics         #
[12:11:24] [ErrorReporter Info]   : ####################################
[12:11:24] [ErrorReporter Info]   : The IP and Port combination requested by the socket is already in use by another application. Either end the other application or re-bind this AMP instance to a different IP/port.

Also, I figured id include the original instances error log here, maybe it may help?

[12:11:03] [Core Info]            : Starting AMP version 2.3.4.0 (Triton), built 16/06/2022 16:08
[12:11:03] [Core Info]            : Stream: Mainline (Release) - built by CUBECODERS/buildbot on CCL-DEV
[12:11:04] [Core Warning]         : Current time zone is set to EST - Servers should ideally be UTC to avoid time-zone related issues
[12:11:04] [Core Info]            : OS: Linux / x86_64
[12:11:04] [Core Info]            : CPU: 12th Gen Intel(R) Core(TM) i9-12900K (16C/32T)
[12:11:04] [Core Info]            : AMP Instance ID: dbd77c78-77ab-41dc-ad98-80fd1731d296
[12:11:04] [ModuleLoader Info]    : Loaded MinecraftModule version 1.0.0.3 by CubeCoders Limited
[12:11:04] [Core Info]            : Metrics publishing is enabled at udp://127.0.0.1:12820.
[12:11:04] [ModuleLoader Info]    : Loaded FileManagerPlugin version 1.0.0.0 by CubeCoders Limited
[12:11:04] [ModuleLoader Info]    : Loaded EmailSenderPlugin version 1.0.0.0 by CubeCoders Limited
[12:11:04] [ModuleLoader Info]    : Loaded WebRequestPlugin version 1.0.0.0 by CubeCoders Limited
[12:11:04] [ModuleLoader Info]    : Loaded LocalFileBackupPlugin version 1.0.0.0 by CubeCoders Limited
[12:11:04] [ModuleLoader Info]    : Loaded CommonCorePlugin version 1.0.0.0 by CubeCoders Limited
[12:11:04] [FileManager Notice]   : Using keypair with fingerprint xnS4vqil8iz0tKQURv4cgp1YSpTEYWe9QblqjvFt4xI=
[12:11:04] [FileManager Info]     : SFTP Server started on 0.0.0.0:2226
[12:11:04] [Core Error]           : No valid AMP licence was found. Please run `ampinstmgr reactivate Minecraft03` to reactivate this instance.

Have you rebooted as a sanity check?

I have, a few times haha. Usually that’s my first go to. I reboot every time a change a setting too to make sure.

As another sanity check, I verified no other applications are using that port for the other problem.

I thought maybe just copying my files to another instance but if I cant get the new instances working either that wont work.

server1@server1:~$ sudo lsof -i:25568
server1@server1:~$

Are those instances running in containers?

Also ampinstmgr ports is the recommended way to check what ports AMP thinks are in use.

They are not running in containers, should they be?

Here is the response from ampinstmgr ports:

[Info] Port usage for BoostersV2 (Boosters V2)
[Info] Instance is currently not running.
[Info] LISTENING        8085    TCP     (Core.Webserver.Port)
[Info] CLOSED           2227    TCP     (FileManagerPlugin.SFTP.SFTPPortNumber)
[Info] CLOSED           25568   Both    (MinecraftModule.Minecraft.PortNumber)
[Warning] Some of the ports required by this instance are currently in use, which will prevent this instance from functioning correctly.

Optional, just a query that doesn’t affect things too much.

So the port is in use by something it’s a matter of finding out what. Use netstat -lnp | grep 8085
as root to see what’s up.

Okay, that was definitely my fault I was only looking at the Minecraft server port. Port 8085 is being used by a chirpstack application running on the server.

server1@server1:~$ sudo netstat -lnp | grep 8085
tcp6       0      0 :::8085                 :::*                    LISTEN      2176/chirpstack-app

I don’t see an easy way to change that port on the AMP Manager, I need to use ampinstmgr rebind correct? I think if I can get this working Ill just copy all the files from the other instance and write off trying to figure out what’s going on there.

Correct, you use ampinstmgr rebind to change it - you should then make sure that any ports being used by other apps are excluded from AMPs ranges.

Great, that worked. I don’t know what is going on with the licensing, but ill just copy to a new instance.