LLM Gateway Routing, Fallback, and Governance in Bifrost
LLM routing decides which provider, model, and API key serve each request in an LLM gateway. This guide walks through the order in which Bifrost applies routing rules, retries, fallbacks, and virtual key budgets, and how to configure all three together.