Evaluation scope and decision framework

Evaluation scope

System boundaries

Evaluation goals

Core quality dimensions

Retrieval quality

Generation quality

End-to-end answer quality

Framework approaches

Reference-free metrics

Model-based judges

Fine-grained diagnostics

Framework selection

Iteration speed

Calibration and reliability

Failure localization

Operational evaluation practice

Evaluation datasets

Regression gates

Human review