How long does the integration take?

Change one base URL in an OpenAI-compatible client, or install the Python or TypeScript SDK; the quickstart routes a first request in a few minutes.

Will this lock us into another vendor?

No. The router is Apache-2.0 open source, your provider keys stay yours, and the API is OpenAI-compatible, so leaving is a change of base URL.

What happens when a provider fails?

The router falls back to the next model your policy allows and records the fallback in the trace, so an outage costs a retry, not an incident.

90 days of the enterprise, pro and team plans free, no card needed. See the plans

OpenSmartRoute

evaluator - Agent - OpenSmartRoute

Agentv1.0.0

evaluator

Name: evaluator
Author: GarroteSantiago

Thesis DSRM row 10a. Measures demonstration results against the frozen objectives, metrics and baselines, drafts evaluations and threats to validity. Dispatched by the dsrm-5-evaluation skill.

by GarroteSantiago(0) 0 installs

Free

Free account. Installing gives you the manifest plus copy-paste snippets.

See reviews

About

Claude Code subagent imported from GarroteSantiago/Thesis (.claude/agents/evaluator.md). Copyright stays with the author.

You evaluate (Peffers, activity 5). Follow ai/agent-contract.md.

Frozen measures: use only the metrics and baselines in the accepted metrics.md and baselines.md. A measure you think is missing is an open issue for me.
Numbers: every result is a measurement with its unit, artifact against baseline.
Not met is a valid result; record it as plainly as met.
Next: propose where the next iteration goes, with the reason.
Threats: one T{n}.md per threat, in Wohlin et al.'s four categories.

Use it

Copy one of these into your project. Installing also returns the manifest and these snippets.

# after Install: the listing is in your workspace's routing pool - nothing else to configure
curl -s -X POST https://api.opensmartroute.ai/api/v1/route -H 'Authorization: Bearer $OSR_API_KEY' -H 'Content-Type: application/json' -d '{"text": "...", "plan": true}'
# or pin it on the OpenAI-compatible endpoint: {"model": "garrotesantiago-thesis-evaluator-subagent", ...}

Installed into a catalogue, chosen by a router

Install evaluator and it becomes one more candidate the router can pick - when it fits.

A listing is a routing target with a manifest: what it does, which domains it covers, what it costs and who publishes it. Once installed it sits beside your own models and tools, is scored like any other candidate for each request, and shows up in the trace when it wins. Ratings come from workspaces that installed it, one per account.

Photo: RDNE Stock project

For the business

What it costs to adopt - in engineering time.

Same client, same code
One base URL
The OpenAI-compatible endpoint answers your existing SDK calls; model=auto lets the router choose.
The SDKs
One URL, every vendor
No vendor lock-in
Point your OpenAI-compatible client at one address; add, swap or retire providers in the catalogue without touching application code.
Every vendor side by side
Next eligible model answers
Failover built in
When a provider is down or over quota the request moves on; the trace says it did.

Manifest

An Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.

garrotesantiago-thesis-evaluator-subagent.ocm.jsonjson

{
  "ocm": "1",
  "id": "garrotesantiago-thesis-evaluator-subagent",
  "kind": "agent",
  "name": "evaluator",
  "description": "Thesis DSRM row 10a. Measures demonstration results against the frozen objectives, metrics and baselines, drafts evaluations and threats to validity. Dispatched by the dsrm-5-evaluation skill.",
  "publisher": "GarroteSantiago",
  "version": "1.0.0",
  "capabilities": {
    "domains": [
      "observability",
      "legal"
    ],
    "tags": [
      "agent-md",
      "github-claude-agents"
    ],
    "languages": [
      "en"
    ]
  },
  "quality_prior": 0.6,
  "examples": [
    "Thesis DSRM row 10a. Measures demonstration results against the frozen objectives, metrics and baselines, drafts evaluations and threats to validity. Dispatched by the dsrm-5-evaluation skill."
  ],
  "primary": false,
  "metadata": {
    "source": {
      "provider": "github-claude-agents",
      "repository": "https://github.com/GarroteSantiago/Thesis",
      "path": ".claude/agents/evaluator.md",
      "ref": "96704f010eae9cedeb26c54145291d4f3f2bf343",
      "url": "https://github.com/GarroteSantiago/Thesis/blob/96704f010eae9cedeb26c54145291d4f3f2bf343/.claude/agents/evaluator.md",
      "key": "GarroteSantiago/Thesis/.claude/agents/evaluator.md"
    },
    "tools": [
      "Read",
      "Write",
      "Glob",
      "Grep",
      "Bash"
    ]
  },
  "instructions": "You evaluate (Peffers, activity 5). Follow `ai/agent-contract.md`.\n\n- **Frozen measures:** use only the metrics and baselines in the accepted `metrics.md` and `baselines.md`. A measure you think is missing is an open issue for me.\n- **Numbers:** every result is a measurement with its unit, artifact against baseline.\n- **Not met** is a valid result; record it as plainly as *met*.\n- **Next:** propose where the next iteration goes, with the reason.\n- **Threats:** one `T{n}.md` per threat, in Wohlin et al.'s four categories.",
  "cost": {
    "context_tokens": 131
  }
}

Fetch it by URL: GET /api/v1/registry/garrotesantiago-thesis-evaluator-subagent/manifest?version=1.0.0

About

Use it

Install evaluator and it becomes one more candidate the router can pick - when it fits.

What it costs to adopt - in engineering time.

One base URL

No vendor lock-in

Failover built in

Manifest

Reviews