Cursor Releases Cursor Router: A Request-Level Classifier Delivering Frontier Coding Quality at 30–50% Lower Cost
Cursor Router is a request-level classifier trained on 600k+ live requests that dispatches tasks to optimal models based on query, context, complexity, and domain. The system achieves frontier-quality performance with approximately 60% cost savings in online A/B tests by routing routine work to cheaper models while reserving frontier models for complex tasks. Unlike many routers, Cursor Router is cache-aware, meaning reported savings account for the token costs associated with prompt cache inval
Analysis
TL;DR
- Cursor Router is a request-level classifier trained on 600k+ live requests that dispatches tasks to optimal models based on query, context, complexity, and domain.
- The system achieves frontier-quality performance with approximately 60% cost savings in online A/B tests by routing routine work to cheaper models while reserving frontier models for complex tasks.
- Unlike many routers, Cursor Router is cache-aware, meaning reported savings account for the token costs associated with prompt cache invalidation when switching models mid-conversation.
- Evaluation relies on real-world metrics like user satisfaction (AFC) and code "keep rate" rather than offline benchmarks, reflecting actual developer workflow dynamics.
- The tool introduces three optimization modes (Auto Intelligence, Auto Balance, Cost) and mandates Grok 4.5 as a price-efficient routing option, with billing tied directly to the routed model's rate.
Why It Matters
This release highlights a critical shift in AI infrastructure from raw model capability to intelligent orchestration and cost-efficiency. For practitioners, it demonstrates that significant value can be extracted not just by using better models, but by correctly matching task complexity to model pricing tiers. The inclusion of cache-miss costs in savings calculations provides a more realistic benchmark for evaluating routing systems, addressing a common blind spot in previous implementations.
Technical Details
- Classifier Architecture: The router analyzes four specific inputs per request: query, context, task complexity, and domain. It combines these with learned knowledge of individual model behaviors to make dispatch decisions.
- Training Data & Optimization: Trained on over 600,000 live requests and optimized for User Satisfaction (AFC). The training dataset explicitly includes scenarios that result in cache misses, ensuring the model learns to minimize unnecessary switches that incur token penalties.
- Evaluation Metrics: Rejects offline evals in favor of online A/B testing across millions of requests. Key metrics include Agent Success (classified from user responses like moving to the next feature vs. correcting the agent) and Code Keep Rate (persistence of generated code in the codebase).
- Routing Rules: Implements three core strategies: simple work goes to price-efficient models, UI updates go to models with best aesthetic "taste," and complex/long-horizon problems go to frontier reasoning models.
- Deployment & Constraints: Available via desktop, web, iOS, CLI, and SDK. It requires Grok 4.5 (priced at $2/M input, $6/M output) as a baseline efficient option. Billing is dynamic, occurring at the routed model's specific rate rather than a flat fee.
Industry Insight
- Cost-Intelligence Pareto Frontier: Organizations should adopt routing strategies that decouple routine coding tasks from high-cost frontier models. The data suggests that "Auto Balance" can outperform top-tier models like Opus 4.8 on satisfaction while costing significantly less, indicating that marginal quality gains from premium models are often outweighed by their cost.
- Realistic ROI Calculation: When evaluating or building internal routing layers, teams must account for prompt cache invalidation costs. Ignoring the penalty of switching models mid-session leads to inflated savings estimates and suboptimal architecture designs.
- Dynamic Model Management: As model landscapes shift monthly, static model selection becomes obsolete. Implementing classifiers that can be updated to incorporate new models (like Grok 4.5) allows enterprises to maintain competitive efficiency without manual intervention for every new release.
Disclaimer: The above content is generated by AI and is for reference only.