Model evaluation plan template
Metrics, datasets, targets and owners for evaluating an LLM or ML model, plus the gate a release must pass.
Use this templateFree, opens in your browser. No sign-up.
What's on the board
- Release gate
- All targets met on the golden set · No new P0 safety failures · A/B test on 10% of traffic for 1 week · Re-run on every prompt or model change
Table columns: Metric, What it tells us, Dataset, Target, Owner.
How to use this template
- Click Use this template. It opens in the Kelvo app as a new board, saved in your browser.
- Double-click any box to change its text. Replace the examples with your own content.
- Sketch, then convert. Draw boxes and arrows with the pen, select the strokes and click Convert sketch: they become real boxes and links.
- Ask Kelvo right on the board (Pro). With Pro, type @kelvo and what you want in any box or text, for example “@kelvo add error handling”, and press Enter. The change is made there and the request disappears; ⌘Z undoes it.
- Keep the prompt next to the diagram. Add a code block from the Insert (+) menu for prompts, schemas or config, right beside the boxes they belong to.
Good for
- ai
- llm
- evaluation
- quality
- ml
- Explaining an LLM feature's architecture to engineers and stakeholders
- Deciding between prompting, retrieval and fine-tuning
- Planning evaluations and risks before launch
Related templates
RAG pipeline
Retrieval-augmented generation end to end: ingest and embed documents offline, then retrieve, rerank and answer with citations.
LLM agent loop
How a tool-using agent plans, calls tools, observes results and updates memory until the goal is met, with guardrails.
Prompt design canvas
Design a production prompt piece by piece — role, context, task, constraints, examples, output format — plus test cases.
AI guardrails & risk register
Input and output guardrails around an LLM call, with a risk register for hallucination, injection, leakage and bias.
Code review checklist
What to look for in a pull request, from correctness to security, so reviews are fast and consistent.
Test pyramid (test strategy)
How many unit, integration and end-to-end tests to write, what each covers, and how fast they should run.
All ai and machine learning diagram templates · All templates