Routed Adds Local MCP Routing and Multilingual Support
π‘Cut agent skill routing to under 20ms while keeping prompts private and tool schemas out of context.
β‘ 30-Second TL;DR
What Changed
Routed completes hybrid skill lookup in under 20ms using local ONNX embeddings, BM25, alias matching, and metadata heuristics.
Why It Matters
Routed could reduce latency, token usage, and context-window pressure in skill-heavy agent workflows. Its local-first design is also useful for privacy-sensitive development environments, though teams should benchmark routing accuracy against their own skill libraries.
What To Do Next
Install Routed 1.1.0 and benchmark its /route and routed mcp modes against your current prompt-based skill selection workflow.
Key Points
- β’Routed completes hybrid skill lookup in under 20ms using local ONNX embeddings, BM25, alias matching, and metadata heuristics.
- β’The new MCP server exposes one route_skill tool and injects only the selected tool schema into the model context.
- β’Native multilingual embeddings support more than 100 languages and can decompose compound terms such as the German word Speicherleck.
- β’The tool integrates with Cursor, Claude Code, Ollama, OpenCode, Windsurf, Continue, Codex, and other agent environments.
- β’Pre-built macOS, Linux, and Windows binaries are available, with MIT-licensed source code on GitHub.
Weekly AI Recap
Read this week's curated digest of top AI events β
πRelated Updates
Same topic
Explore #agent-routing
Same product
More on routed
Same source
Latest from Reddit r/MachineLearning
llama.cpp Expands MoE Experts at Runtime
Radar Point Density Beats Architecture in Classification
Is ML Reproducibility Becoming Irrelevant?
Shrink LLM KV Cache with Sliding Window Attention
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/MachineLearning β
This is a summary, not the original. Read the source, or get the weekly briefing.
Weekly AI briefing
One email a week. Unsubscribe anytime.