In plain English
This page is reference material: definitions, schemas, catalogs, templates, and implementation records.
- Why this matters: AI risk can come from the whole arrangement, not one obvious model.
- What to look for: data, memory, routes, adapters, tools, evaluators, updates, and rollback paths.
- Technical version below: the expert terminology remains available and is linked through the glossary.
Evaluator Review Template
Scope
Name evaluator versionThe exact version of the evaluator used for a test or release. Open glossary definition, owner, model family if applicable, prompts, hidden test protections, parser, thresholds, and storage.
Independence
Check separate credentials, separate storage, independent model family, independent supplier, independent corpus where practical, deterministic validators, append-only evidence, and disagreement monitoring.
Change review
Compare the new evaluatorA system that judges whether an AI output or candidate is acceptable. Open glossary definition against historical decisions. Explain any critical decision flips before release.