If I wanted to divvy up my game servers across 2 machines (one dedicated for lighter/smaller instances, and one for everything else), would I have to buy 2 licenses?
Nope! AMP is licenced based on the total number of Instances not the number of machines used.
Only consideration is that managing instances across multiple machines on a single panel requires Pro or above.