Skip to content- Sources: primary
- Summary: Meta describes two levers: Rank More Ads, which raises candidate counts when CPU and accelerator surplus exist, and Serve Better Models, which routes a larger share of requests to stronger models using accelerator-only surplus. Physical and logical isolation protects baseline capacity, and value-aware load shedding at servers and clients handles sudden reclamation.
- Why it matters: It is a worked design for using preemptible GPU capacity in a latency-bound service without risking baseline SLOs.