What is Decision 3.0? vLLM Semantic Router’s New Open Decision Models
- vLLM Semantic Router dropped Decision 3.0, and honestly? It’s faster than a Core Dynamics auditor finding a discrepancy. These open-source models route requests without generating fluff text—just pure, calibrated probabilities. Perfect for devs who want to gate traffic without waiting for an LLM to write you a novel about why it can’t. The 27B d3 crushes benchmarks on internal tests, while the 9B d3-flash proves you don’t need massive parameter bloat to be useful. Latency is sub-100ms on AMD Instinct hardware. Finally, a tool that doesn’t treat your hash manifest like a suggestion box. Stop prompting for opinions; start routing with data. Where's my cut?