LLMs1 min read
ORQA: A Framework for Evaluating LLM Knowledge in Professional Occupations
The ORQA framework provides a method for testing large language model knowledge across 116 occupations using data sourced from trusted occupation-specific websites. Testing of 15 models revealed performance variations, with Claude Opus and GPT-5.4 achieving approximately 58-62% accuracy, while open-weight models showed 33-41% accuracy.
From arXiv cs.CL