Research1 min read
Damage-Aware Bandit Pruning for Transformer Models
Research presents a damage-aware multi-armed bandit approach for structured post-training pruning of transformer models. Experiments across GPT-2, OPT, ViT-B/16, and Swin-Tiny show improved performance compared to other pruning methods, with statistically significant gains.
From arXiv cs.AI