Imported from AnkitClassicVision/ankit_shared_skills (
caliber/SKILL.md). Install upstream withnpx skills add AnkitClassicVision/ankit_shared_skills --skill caliber. Copyright stays with the author (MIT).
CALIBER
CALIBER is a model-routing skill. It turns a request into a task-surface demand vector, compares that vector against a model capability matrix, and returns the cheapest constructor that can clear the task with the right defender.
A constructor is:
model + deployment path + context + retrieval + tools + verifier + human gate
Core rule
Do not ask “what is the best model?” Ask:
What is the cheapest allowed constructor whose proven capabilities clear this task's required surfaces and whose defender can verify the result?
Demand levels
| Level | Name | Meaning |
|---|---|---|
| -1 | deterministic | No model; use SQL/rules/regex/script/API directly. |
| 0 | tiny | Simple classify/extract/rewrite/routing. |
| 1 | small | Simple reasoning, short summaries, low-stakes drafts. |
| 2 | workhorse | Normal professional work, routine code/specs, common RAG. |
| 3 | strong specialist | Harder domain work, repo work, complex synthesis, multimodal reasoning. |
| 4 | frontier | Expensive-to-fail planning, novel architecture, high-reliability synthesis. |
| 5 | orchestrated frontier | Decomposition + tools + defenders + human gates. |
| 6 | reserved future | Future super-frontier/research-grade tier. |
Workflow
- Gate the deployment pool: regulated/private data, local-only requirements, secrets, production writes, or external sends may restrict allowed models.
- Break the task into surfaces such as reasoning, coding, long context, tool use, media, structured output, local/private, or compliance.
- Assign required level per surface.
- Filter candidate models/deployments from
references/model-capability-matrix.yaml. - Attach defenders from
references/defender-registry.md. - Pick the cheapest viable constructor.
- If the defender fails, escalate one tier or switch specialist lane.
Output shape
Task surfaces:
- <surface>: required level <n> — <why>
Gate pool:
- allowed deployments:
- excluded deployments:
Candidate comparison:
- cheapest viable:
- strongest reliable:
- local/private option:
- specialist option:
Defenders:
- required verifier(s):
- human gate:
Recommendation:
- primary constructor:
- fallback constructor:
- escalation rule:
- evidence confidence:
References
references/surface-taxonomy.mdreferences/model-capability-matrix.yamlreferences/model-capability-schema.jsonreferences/benchmark-source-ledger.mdreferences/defender-registry.mdreferences/routing-policy-v0.3.mdreferences/model-registry.mdreferences/demand-card.md