90 days of the enterprise, pro and team plans free, no card needed. See the plans
Anything with personal data is pinned to an on-prem model; everything else uses the cloud tiers.
Free account. Installing gives you the manifest plus copy-paste snippets.
See reviewsFor teams under a data-residency or PII policy: the router detects personal data and pins those requests to a self-hosted model that never leaves the boundary, while ordinary traffic still uses the faster cloud tiers. Swap llm-onprem for your own in-network deployment.
Copy one of these into your project. Installing also returns the manifest and these snippets.
osr stack plan registry://privacy-first@1.0.0 --registry https://api.opensmartroute.ai
osr stack apply registry://privacy-first@1.0.0 --registry https://api.opensmartroute.aiA declarative stack: models, rules and settings in one file. `osr stack apply` turns it into a running router.
{
"osr": "1",
"kind": "stack",
"name": "privacy-first",
"description": "Personal data stays on-prem; everything else uses the cloud tiers.",
"targets": [
{
"id": "llm-cloud",
"kind": "llm",
"name": "Cloud model",
"description": "Fast general model for non-sensitive requests",
"cost": {
"usd_per_1k_tokens": 0.003
},
"latency_ms": 700,
"quality_prior": 0.8
},
{
"id": "llm-onprem",
"kind": "llm",
"name": "On-prem model",
"description": "Regulated and personal data that must not leave the network",
"cost": {
"usd_per_1k_tokens": 0.0008
},
"latency_ms": 1200,
"quality_prior": 0.7,
"constraints": {
"data_boundary": "on_prem",
"pii_allowed": true
}
}
],
"rules": [
{
"name": "pii-stays-home",
"when": {
"contains_pii": true
},
"prefer": [
"llm-onprem"
],
"pin": true
}
],
"objective": {
"quality": 1,
"cost": 0.3,
"latency": 0.2
}
}Photo: RDNE Stock project
Fetch it by URL: GET /api/v1/registry/privacy-first/manifest?version=1.0.0
Star ratings from people who tried it. One review per account; edit yours any time.
No reviews yet. Install it, try it, and be the first to rate it.
