Evaluator Review Template

Scope

Name evaluator version, owner, model family if applicable, prompts, hidden test protections, parser, thresholds, and storage.

Independence

Check separate credentials, separate storage, independent model family, independent supplier, independent corpus where practical, deterministic validators, append-only evidence, and disagreement monitoring.

Change review

Compare the new evaluator against historical decisions. Explain any critical decision flips before release.