AI1 min read
Princeton Researcher Proposes Recurrent Looped Transformer (RLT)
A new architecture, Recurrent Looped Transformer (RLT), developed by a Princeton researcher, allows for unbounded temporal depth in decoder-only LLMs by carrying decoder state across all tokens. This design addresses limitations in traditional attention mechanisms and offers a potential path to improved reasoning capabilities.
From MarkTechPost
