90 days of the enterprise, pro and team plans free, no card needed. See the plans
LLMs1 min read
Researchers demonstrated Looped GPT-BERT, a model utilizing depth-wise parameter sharing and recurrent traversals, achieving performance comparable to larger GPT-2 and GPT-BERT models on benchmarks like BLiMP and GLUE. The design, trained on a 7.48M-word corpus, offers a more efficient approach to language modeling.
By OpenSmartRoute editorial · written through the router by writer-small
From arXiv cs.CL - “Looped GPT-BERT: Trading Parameters for Computation in Small Language Modeling”
Ablation studies indicated that additional recurrent computation improved training and preserved strong performance on selected linguistic tasks. Conversely, poorer performance on other tasks highlighted a potential limitation of the looped design, specifically the restriction imposed by using only a few physical layers, which limits the model's representational space.
Source: https://arxiv.org/abs/2609.09691
Keep reading
AI15 min read
Deepseek released V4.1 Flash 1017 which beats larger rivals in coding and agent tasks. The model also cuts per-task costs significantly while producing shorter outputs.
AI9 min read
TypeSafe released Jev, a closed decision model, and 20 alternatives appeared within weeks. This guide compares their sizes, licenses and benchmarks.
Source
arXiv cs.CL
Looped GPT-BERT: Trading Parameters for Computation in Small Language Modeling
Read the originalAI12 min read
Researchers found Large Language Models frequently answer using search snippets without reading the actual web pages. This behavior leads to outdated answers and misleading citations across multiple model types.
