Research1 min read
Apple Research Shows Diffusion Confidence Limits and Distillation Risks
Apple researchers found diffusion models are often overconfident in discrete tasks. They also warn that on-policy distillation can hurt reasoning model training.
From Apple machine learning research
