Hi - I answer from the OpenSmartRoute documentation: routing, the API, plans and quotas, self-hosting. Ask away, or open a support ticket if you need a person.
Grounded in the docs - follow a source before acting on it.
Llama 3.1 8B Instruct - Model - OpenSmartRoute
Modelv1.0.0
Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
Reference model card from the OpenRouter listing - model meta-llama/llama-3.1-8b-instruct. Prices are per million tokens as listed; ratings and installs below are from this marketplace.
Llama 3.1 8B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
Facts
Vendor
Meta
Context window
131,072 tokens
Max output
117,964 tokens
Input price
$0.05 / 1M tokens
Output price
$0.08 / 1M tokens
Input
text
Output
text
Tool calling
yes
Structured outputs
yes
Reasoning
no
Open weights
meta-llama/Meta-Llama-3.1-8B-Instruct
Endpoint: https://openrouter.ai/api/v1 (OpenAI-compatible), model meta-llama/llama-3.1-8b-instruct
Use it
Copy one of these into your project. Installing also returns the manifest and these snippets.
# after Install: the listing is in your workspace's routing pool - nothing else to configure
curl -s -X POST https://api.opensmartroute.ai/api/v1/route -H 'Authorization: Bearer $OSR_API_KEY' -H 'Content-Type: application/json' -d '{"text": "...", "plan": true}'
# or pin it on the OpenAI-compatible endpoint: {"model": "model-meta-llama-llama-3-1-8b-instruct", ...}
Manifest
An Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.
