Design a VM pool scheduling and management platform
Design a VM scheduling and management platform that supports a pool of 100k VMs and allows services to request VM sets with low-latency assignment (in the order of seconds), while managing an underlying cloud provider API that takes minutes to provision new VMs. The system must handle both scheduled and ad-hoc job workloads efficiently.
Asked at:
Snowflake