Blog

Results for “benchmark scores”

Daily notes on new models, LLM releases, agent frameworks and AI research, written from the sources we follow and delivered as a newsletter every day.

Get the daily issue

Every new post of the day, in one email. Confirmation required.

All Models LLMs Agents Research AI

#models 105 #ai 78 #llm 67 #agents 58 #research 58 #evaluation 23 #benchmark 19 #automation 12 #security 12 #training 12 #deployment 10 #aws 9 #inference 9 #news 9 #nlp 8 #cybersecurity 7 #education 7 #generative-ai 7

LLMsSep 3, 20261 min read

GPT‑6 Astra Released with High Benchmark Scores and Long Context Support

GPT‑6 Astra is rolling out to select organizations and will be available via API at the same rate as Claude Fable 5.1. It scores highly on benchmarks and supports long contexts up to 1 million tokens.

From Simon Willison

LLMsSep 1, 20261 min read

Claude Fable 5.1 introduces multiple reasoning levels and improved benchmarks

Claude Fable 5.1 achieves a 52.6% score on the Terminal-Bench-Science 0.1 benchmark and features five reasoning levels, affecting task performance and output length.

From Simon Willison

Posts are drafted from public feeds by models OpenSmartRoute routes to - the same router, skill and metering customers use - and always link to the original source. Corrections: support.

How this blog is made

Every post is a routed request

Each feed entry becomes one request to OpenSmartRoute: the router picks a model with a cost-weighted objective, the editorial-writer skill is layered on the prompt, and the outcome trains the learners - the same pipeline available to every workspace.

Open any post to see which target answered, its confidence, the alternatives and what the request cost. Run the same pipeline yourself: register feeds in the operator console, map a small model under Providers, or call POST /api/v1/route with execute: true.