> For AI agents: the complete documentation index is available at https://viteval.dev/llms.txt, the full documentation bundle is available at https://viteval.dev/llms-full.txt.

Why Viteval

# Test prompts and agents
against reference cases.

Run your prompts and agents against real cases. Score the answers and catch regressions before you ship.

[Explore features](#familiar-tooling)[See examples](/examples)

![Captured order extraction evaluation: three cases pass with ExactMatch scores of 1](/assets/viteval-hero-run.svg)

[Vitest-native
](#familiar-tooling)[Scoring
](#built-in-defaults)[Local results
](#local-first)[Your infrastructure
](#run-anywhere)

Familiar tooling


## Use your Vitest configuration

Keep native configuration, watch mode, retries, and CI exit codes. Import your
application functions into an evaluation, then score their answers.
[Write an eval →
](/guide/getting-started)

VITEST![](/assets/vitest-mark.svg)

VITEVAL![](/assets/viteval-flask.svg)

Same runner. A new kind of test.

Your criteria


## Score exact answers and free-form responses

Use deterministic checks for exact answers and structured output. Add embeddings
or LLM judges for free-form responses, or define a scorer for your own criteria.
[Choose a scorer →
](/api/scorers)

SCORER RESULTSexactMatchanswerSimilarityyourScorer

Local by default


## Inspect results locally

Start with JSON datasets and results in your project. Open the local dashboard
to inspect inputs, reference answers, outputs, and individual scores.
[Open the dashboard →
](/guide/cli#view-results)

~/my-agentviteval runresults saved locally

Run on your infrastructure


## Run evaluations in CI

Run the same evaluations on your laptop, in CI, or on a runner you control.
Return a nonzero exit code when a case fails its scoring threshold.

[Set up CI →
](/guide/advanced/ci)[Choose providers →
](/guide/providers)

LAPTOPCIPRIVATE

## Put your agent to the test.

Open source. No hosted account required.

[Write your first eval](/guide/getting-started)[See examples](/examples)