Research1 min read
RAPID: Reliability-Gated Pair Distillation for Improved Accuracy
RAPID achieves higher mean accuracy in text classification tasks by separating reliability-gated relational distillation from adaptive pair proposal. Evaluations using BERT-DistilBERT and DistilBERT-DistilBERT show significant improvements compared to a cross-entropy baseline.
From arXiv cs.AI