Skip to main content

Run tests

Once you've created cases and grouped them into datasets, you run a dataset to score the bot. You can run from the Testing Lab toolbar, or without leaving the agent, from the Conversation Builder.

Run a dataset

From the toolbar, click Run on a dataset (or use the bulk-select-and-run flow when multiple datasets are selected). The Run tests modal lets you set run options before queuing:

Run tests modal - the selected test cases, a Run as dropdown (synthetic-user persona), an Iterations stepper, and a Run across all models toggle
1/1Run a dataset - pick a persona, iterations, and models
  • Run as - pick a synthetic-user persona (defines tone, vocabulary, and error patterns for the simulated user side of the conversation).
  • Iterations - how many times to run each selected case; higher counts surface flakiness.
  • Run across all models - run the same case against multiple model variants to compare quality side-by-side.

The run goes to a queue and the Run history entry updates with live pass/fail counts. Click any historical run to drill into Reports for per-case results.

Manage tests from the Conversation Builder

You don't have to leave the agent surface to work with tests for it. The Conversation Builder (the Nexus agent-flow editor) exposes a Tests button in its topbar that opens a popover with:

  • The number of test cases linked to this agent.
  • The latest run's pass / fail summary.
  • A live progress bar for any in-flight run (auto-polls every 5 seconds).
  • An AI-generation indicator when Scenario drafts are in progress.
  • Quick links to the Testing Lab (deep-link pre-filters the table by this agent and auto-selects its tests, ready for a one-shot "Run Tests" click) and to the Run detail page.

Starting a run from the popover broadcasts across open tabs - the Testing Lab refreshes everywhere without a reload. The popover also exposes a Create test case shortcut that opens the standard drawer pre-populated with this agent as the source.

This is purely a navigation convenience - the cases themselves still live under the Trust Centre.

Read next: Reports - per-run, per-case results and saved views.