LLMs1 min read
BenchMIRT analyzes what LLM benchmarks actually measure
BenchMIRT investigates the alignment between LLM benchmark tasks and real-world capabilities, highlighting potential discrepancies for model evaluation.
From Hugging Face blog
90 days of the enterprise, pro and team plans free, no card needed. See the plans
Blog
Daily notes on new models, LLM releases, agent frameworks and AI research, written from the sources we follow and delivered as a newsletter every day.
Get the morning and evening issues
Every new post of the day, in one email. Confirmation required.
LLMs1 min read
BenchMIRT investigates the alignment between LLM benchmark tasks and real-world capabilities, highlighting potential discrepancies for model evaluation.
From Hugging Face blog
AI1 min read
Walter Torous, senior lecturer and current program director, will now oversee all activities and operations at the MIT Center for Real Estate.
From MIT News: artificial intelligence
Photo: Yan Krukau
Agents1 min read
Jamf implemented real-time, per-user cost enforcement for Amazon Bedrock using IAM policies, Athena, and Lambda, enabling tiered model limits without disrupting sessions.
From AWS machine learning blog
LLMs1 min read
NVIDIA Groq 3 LPX is an AI inference accelerator designed for the Vera Rubin platform, enabling ultrafast interactivity with long context windows.
From NVIDIA technical blog
Agents1 min read
OpenAI terminated its partnership with Cursor following SpaceX’s acquisition, citing contract violations. This shift impacts Cursor’s access to OpenAI models and reflects broader competition within the AI landscape, particularly with Claude and Grok.
From Latent Space
Agents2 min read
OpenAI projects AGI completion by December 2026, driven by the Astra model, while the launch of Pollen Robotics’ Microduck robot gains traction with its open-source design and accessible price point.
From Latent Space
Research1 min read
The Planetary Prediction Engine (PPE) automates the entire geospatial modeling workflow, from data discovery to model training, significantly reducing prediction build times. This system improves prediction accuracy across public health, food security, and environmental risk tasks by autonomously synthesizing data and generating reports.
From Google Research blog
AI1 min read
The CrysVCD tool reduces time and costs in screening chemically unstable material designs, aiding real-world applications.
From MIT News: artificial intelligence
Research2 min read
Google Research developed AgentHands, an XR prototype leveraging LLMs to generate spatially grounded hand gestures for AI agent conversations. This system uses a taxonomy of hand behaviors and real-time object registration to provide intuitive physical demonstrations in immersive environments.
From Google Research blog
AI3 min read
Protecting capital in today's markets requires immense speed and precision. A financial analyst preparing a deal memo works across licensed market data, internal models, and confidential client files. General-purpose AI lacks the real-ti...
From Google Cloud AI blog
Research1 min read
Extendable framework enables testing agents on the full set of capabilities required to successfully complete a procedure, not isolated proxy tasks.
From Amazon Science
LLMs1 min read
Together AI allows engineers to conduct A/B tests in production by splitting traffic between model variants. This enables real-world measurement of model performance against the control, using a flexible endpoint-level routing system.
From Together AI blog
LLMs1 min read
Hugging Face introduces Strands Agents and LeRobot, enabling continuous data streaming for model training and deployment. This allows for real-time data processing and model updates, improving efficiency and responsiveness in production environments.
From Hugging Face blog
Models1 min read
AMIE is a research medical AI system capable of real-time clinical video consultations, demonstrated in a first-of-its-kind study.
From Google AI blog
AI1 min read
GeoPT enables AI models to better simulate responses to physical forces like wind and water, enhancing accuracy and efficiency in real-world scenario modeling.
From MIT News: artificial intelligence
LLMs1 min read
Hugging Face and NVIDIA Magpie TTS offer open-weights for building low-latency multilingual voice agents. Engineers gain full deployment control and optimized inference performance for real-time voice applications.
From Hugging Face blog
Research1 min read
Microsoft Research introduced Echoverse, a system that trains computer-use AI agents in deep, evolving environments. This approach addresses agent struggles with multi-step workflows by providing realistic and dynamic training scenarios.
From Microsoft Research
Research1 min read
PatientAgentBench generates a synthetic patient health record, a realistic clinical vignette, and a patient agent that converses with the AI system under evaluation, to capture what a patient-facing agent actually has to do.
From Amazon Science
Models1 min read
Illustration of a black magnifying glass in a white circle on green grass surrounded by items related to fun activities like tennis and games
From Google AI blog
Posts are drafted from public feeds by models OpenSmartRoute routes to - the same router, skill and metering customers use - and always link to the original source. Corrections: support.
Archive (100)