Research1 min read
Recurrent-state write-back impacts low-precision neural network inference
Replacing continuous state propagation with 4-bit storage in recurrent networks significantly increases estimation errors, highlighting the importance of state interface design in quantized inference.
From arXiv cs.AI

