Prompt file imported from Ramakrishna-Gedala/ragas-rag-evaluation-lab (
.github/prompts/add-ragas-metric.prompt.md). Copyright stays with the author.
Add a RAGAS Metric
Add a metric to the evaluation lab.
Before coding:
- Read
docs/RAGAS_CONCEPTS.md. - Read
backend/app/evaluation/metric_catalog.py. - Check the pinned/current RAGAS API for the metric.
- State its approach, required fields, reference requirement, and cost category.
Then:
- add it to the catalog
- implement it in the correct metric group
- add it only to appropriate DEV/QA/PROD profiles
- add an offline test when possible
- update documentation
- never silently convert a provider failure to score 0