Evaluation / Benchmark Sets

Evaluation and benchmark sets are collections of test questions with grading rubrics, used to measure how well a model or a prompt performs. Teams use them to compare versions and catch regressions. Look for sets that state what they measure, how answers are scored, how many cases they contain, and whether the questions could already have appeared in training data.

• General-Purpose LLM Response Quality Benchmark (200 items) - $10.00
  200-item benchmark across 5 categories for evaluating reasoning, factuality, instruction-following and formatting.
• Prompt Regression & Quality Benchmark Suite (150 cases) - $3.00
  150-case regression suite across 5 test types, for catching when a model or prompt change breaks something that worked.