NVIDIA-NeMo/Switchyard
LLM model routing library for AI agents
- Chart
- Not on a chart right now
- Stars
- 3.7k
What it is
Switchyard is an open-source Rust library that helps AI agents choose which model handles each request. It combines efficient and more capable models to balance task success, cost, and latency.
Who it is for
Developers and teams building gateways or agent harnesses who want flexible model routing across providers while keeping OpenAI and Anthropic API compatibility.
Why it is trending
It gained 41 stars today, reaching 3,623 total stars, following its v0.3.0 release. It stands out by letting applications own their model clients and credentials while Switchyard supplies routing decisions.
Main features
- Multiple routing algorithms including Auto, Task, Execution, and Composite
- Embeddable Rust core (libsy) with Python and TypeScript bindings
- Gateway integrations for Agent Router, LiteLLM, NeMo Relay, and OpenRouter
- Standalone demo server for local evaluation and benchmark comparisons
Summarized on November 17, 2026 from the README and repository data. It can be wrong; check the source before relying on it. Report a wrong summary