Start with the topic guide.
Evaluation datasets, reference answers, task-specific metrics, retrieval quality, factuality, groundedness, tool-call correctness, human evaluation, judge-model calibration, regression testing, adversarial testing, and quality–cost–latency trade-offs.
This is a learning outline. A complete worked tutorial has not been published for this topic yet.
Concept scope
AI Evaluation & Reliability: 12 short lessons, one for each concept. Evaluation datasets, reference answers, task-specific metrics, retrieval quality, factuality, groundedness, tool-call correctness, human evaluation, judge-model calibration, regression testing, adversarial testing, and quality–cos