Glossary term
LLM evaluation
LLM evaluation is the practice of measuring how well a language model or AI feature performs on defined tasks, using datasets, automated metrics and human review. In QA it works like regression testing for AI: run the same evals on every change and block releases that score worse.
Read the full guide: How to Test LLM Applications 2026 — Complete Guide for QA Engineers
More terms
Agentic testingAI hallucinationAI red teamingAnswer relevancyAPI testingBehaviour-driven development (BDD)CI quality gateContext precisionEnd-to-end testingExploratory testingFaithfulnessFlaky testGolden datasetIntegration testingJailbreakLLM guardrailsLLM-as-a-judgeLoad testingModel Context Protocol (MCP)OWASP Top 10 for LLM ApplicationsPage Object ModelPrompt injectionRegression testingRetrieval-augmented generation (RAG)SDETSelf-healing testsSmoke testingTest automationTest caseTest pyramidVisual regression testing
