My experience scaling from 0 GPUs to tens of hundreds of GPUs.
Related Wiki Pages
- LLM Inference Economics — First-principles inference cost analysis; levers for 1000x reduction
- Keeping 20,000 GPUs Healthy — Modal — GPU fleet management; failure modes at scale
- GPU Memory Snapshots — Modal — Sub-second GPU startup via memory snapshots