Discounting the opinions of LLM judges with highly correlated outputs ensures that panels of judges reflect a true diversity of perspectives.
Read the original at Amazon Science: When LLM judges agree, should we believe them?
Source: https://www.amazon.science/blog/when-llm-judges-agree-should-we-believe-them