Option to Limit S3 Backup Upload Bandwidth

[Lloyd_Montgomery]

When using the S3 Cloud Backup feature for our Minecraft server, the backup upload consumes our entire bandwidth and makes the server unplayable during this time. We are working to increase the upload bandwidth of our host internet connection to decrease the backup time, but regardless of how good our upload bandwidth is, the server will be unplayable during this 10–60 minutes. Is there a way to limit the upload bandwidth consumed by the S3 backup? I don’t see an option in the Configuration → Backups → Cloud settings.

It appears that the Amazon S3 API now supports a parameter called max_bandwidth: “The maximum bandwidth that will be consumed for uploading and downloading data to and from Amazon S3” [1]. If there is currently no way to configure the max bandwidth in the AMP instance settings, I believe it would be a great addition (percentage or absolute values).

[1] AWS CLI S3 Configuration — AWS CLI 2.27.49 Command Reference

Thank you for your time,
Lloyd

[Mike]

So using this particular method isn’t practical because it’s not something supported among other S3 providers, but it might be possible for AMP to implement this manually by limiting the speed at which the source stream can be read from and throttling it. But I suspect this will result in ‘spikes’ and rubber banding rather than being smooth. Not sure how it’ll play out.

[Lloyd_Montgomery]

Ah, fair enough. I honestly hadn’t considered that there are other S3 providers. I had always associated S3 with Amazon. With that in mind, I see how this is a hairy problem to solve.

Thanks for the feedback! I’ll put a rush on upgrading our local internet speeds and schedule the Cloud backups to be less often—perhaps once a month instead of once a week.