Research1 min read
OpenDiscoveryTrace: Dataset for Evaluating AI Scientist Reasoning
OpenDiscoveryTrace provides a public dataset of 558 AI scientist trajectories, capturing the reasoning process of 124 scientific tasks across drug discovery and other domains. Analysis reveals significant behavioral differences between models, particularly highlighting error profiles and confidence levels, enabling more robust evaluation.
From arXiv cs.AI