How to build an evaluation set for an LLM application
The most important tool in AI engineering: how to collect test cases, define success criteria, score outputs automatically and by hand, and run evals on every change.
AI Desk3 min read
Developers & Builders
Evals & Observability
Evaluating, testing and monitoring AI systems.
2 stories RSS
LLM-as-a-judge explained: using AI models to grade AI output
Language models can score other models' answers at scale. How LLM-as-a-judge works, its known biases, and how to design rubrics and checks that make it reliable.
AI Desk3 min read