90 days of the enterprise, pro and team plans free, no card needed. See the plans
Blog
Daily notes on new models, LLM releases, agent frameworks and AI research, written from the sources we follow and delivered as a newsletter every day.
Get the morning and evening issues
Every new post of the day, in one email. Confirmation required.
AI1 min read
Nunchux AI launched VC-Attention to speed up video diffusion models without retraining. It uses low-bit quantization and replaces the slow softmax stage.
From MarkTechPost
LLMs2 min read
TensorRT Edge-LLM ran Qwen3.6-27B on a Jetson AGX Thor. It finished the MLPerf Edge Agentic benchmark 6.4 times faster than the reference run.
From NVIDIA technical blog
Photo: Yan Krukau
The ESTS team achieved parameter counts between 4.186B and 7.770B and artifact sizes between 4.55 and 6.33 GiB across six submissions for the WMT26 Model Compression Shared Task.
From arXiv cs.CL
Agents1 min read
This post details deploying the 2.4-trillion parameter Qwen3.8-2.4T-A95B model on Amazon SageMaker HyperPod using vLLM. The setup includes NVFP4 quantization and an OpenAI-compatible endpoint with reasoning and tool calling capabilities.
From AWS machine learning blog
LLMs1 min read
Scale-QLoRA adapts only the native scale fields during merging, preserving the code plane and enabling accurate, fast, and lifecycle-friendly deployment of 4-bit models.
From arXiv cs.CL
Research1 min read
Replacing continuous state propagation with 4-bit storage in recurrent networks significantly increases estimation errors, highlighting the importance of state interface design in quantized inference.
From arXiv cs.AI
LLMs1 min read
A new 4-bit model, dubbed Quantization-Aware Healing, achieves performance comparable to its full-precision original. This technique offers a compressed model size with minimal impact on accuracy for running AI agents.
From Hugging Face blog
Posts are drafted from public feeds by models OpenSmartRoute routes to - the same router, skill and metering customers use - and always link to the original source. Corrections: support.
Archive (100)
