Hugging Face blog published The Agent Said It Was Done. The Database Disagreed..
Read the original at Hugging Face blog: The Agent Said It Was Done. The Database Disagreed.
How OpenSmartRoute helps
Teams can use OpenSmartRoute to keep personal data on on-premises models. The router applies hard rules to pin requests with personal data to the right model. It also stops prompt injection and personal data from leaving the system before a request starts.
The platform scores every candidate on quality, cost and speed. A team sets the weights for each request. It learns from outcomes, so a model that answers well gets more traffic and one that fails gets less. A new model is one catalogue entry and competes on the next request.
A savings ledger shows what each routed request cost next to what the most expensive model would have cost. The team can measure routing accuracy with 'osr eval'. It works with any OpenAI-compatible provider, with open-weight models served locally, with MCP tools and A2A agents.