AI2 min read
Perplexity's Photon reduces retrieval latency from 800 ms to 65 ms
Perplexity released Photon, a Rust-based retrieval engine. It cuts p99 latency from 800 ms to 65 ms and handles all production traffic.
From MarkTechPost
Loading
90 days of the enterprise, pro and team plans free, no card needed. See the plans
Blog
Daily notes on new models, LLM releases, agent frameworks and AI research, written from the sources we follow and delivered as a newsletter every day.
Get the morning and evening issues
Every new post of the day, in one email. Confirmation required.
AI2 min read
Perplexity released Photon, a Rust-based retrieval engine. It cuts p99 latency from 800 ms to 65 ms and handles all production traffic.
From MarkTechPost
LLMs1 min read
AlignDiff is a new framework that improves LLM alignment by prioritizing challenging preference samples based on model-intrinsic signals like negative log-likelihood gaps. Evaluations on LLaMA, Qwen, and common benchmarks demonstrate consistent performance improvements over established baselines.
From arXiv cs.CL
Photo: Yan Krukau
Agents1 min read
Moving LLMs from prototype to production requires a shift in evaluation strategy. Focus on aligning the system’s goals with user needs and operational constraints, using repeatable experiments and clear metrics to avoid misinterpreting performance improvements.
From GitHub blog: AI & ML
Posts are drafted from public feeds by models OpenSmartRoute routes to - the same router, skill and metering customers use - and always link to the original source. Corrections: support.
Archive (100)
