Evaluation instances

An evaluation instance is an occurrence of an evaluation. An evaluation instance is created when an evaluation runs. A single evaluation can have multiple instances. The Evaluation instances page shows a list of evaluation instances. By default, the page displays evaluation instances started within the last five days. For each instance, the list shows the associated evaluation and agentflow, the current status, the date and time the instance started, and the outcome.

Jump to:

Access the Evaluation instances page

  1. Go to Agents > Evaluations.

  2. Select the Evaluation instances tab.

Find evaluation instances

  1. Go to Agents > Evaluations > Evaluation instances.

  2. In the Filters section, click Custom filter, complete the search parameters that you want, and then click Apply filter.

    You can also click any of the default search filters:

  • Started last 5 days
  • Failed last 5 days
  • Fail outcome last 5 days

For more information on Custom filter, see Custom filter fields and selections.

Terminate evaluation instances

  1. Go to Agents > Evaluations > Evaluation instances.

  2. Click Select to terminate.
  3. Select the check boxes to the left of the evaluation instances that you want to terminate. You can select multiple instances.
  4. Click Terminate.

You can also terminate instances from the Instance details page.

Run a new evaluation instance

Use an existing evaluation instance to start another run of the associated evaluation.

  1. Go to Agents > Evaluations> Evaluation instances.

  2. Click Select to run new.

  3. Select the check boxes for the evaluation instances that you want to run again.

  4. Click Run new.

A new evaluation instance is created for each selected evaluation.

Drill down to evaluation instance details

  1. Go to Agents > Evaluations> Evaluation instances.

  2. Find the evaluation instance that you want to view.

  3. Click the instance name in the first column. The Evaluation instance details page appears.

For more information, see Evaluation instance details.

The following columns or selections are displayed when you view the Evaluation instances page.

Section

 Column or selection Description
(unlabeled) Refresh Click to refresh the evaluation instances list.

Filters

Started last 5 days

This is the default filter applied when the page loads. Shows evaluation instances that started within the last five days, regardless of their current status or outcome.

 

Failed last 5 days

Shows evaluation instances that failed within the last five days.

 

Fail outcome last 5 days

Shows evaluation instances that started within the last five days and have an outcome of Fail.

 

Custom filter

Click to search for evaluation instances using selected criteria.

For information, see Custom filter fields and selections.

(unlabeled)

Select to terminate

Click to display check boxes beside evaluation instances that can be terminated. Select one or more running instances, and then click Terminate.
  Select to run new Click to display check boxes beside evaluation instances that can be used to start a new evaluation run.

Evaluation instances

Instance name

The name of the evaluation instance. Click the instance name to open the Evaluation instance details page.

 

Status

The current state of the evaluation instance. Possible values are Queued, Running, Completed, Failed, and Terminated.

 

 Evaluation The name of the evaluation associated with the instance. Click the evaluation name to open the evaluation.

 

Agentflow

The name of the agentflow evaluated by the instance.
  Started The date and time when the evaluation instance started.
  Outcome The overall evaluation result. Possible values are Pass and Fail. The outcome might not be available until the evaluation instance is completed.

The following fields or selections are displayed when you click Custom filter.

Field or selection Description
Agentflow name Enter the name of the agentflow associated with the evaluation instances that you want to find.
Evaluation name Type the name of the instance that you want to search.
Status

Choose one of the following options:

  • All: (Default) Does not limit search results by instance status.
  • Queued : Shows evaluation instances waiting to run.
  • Running: Shows evaluation instances that are currently running.
  • Completed: Shows evaluation instances that completed successfully.
  • Failed: Shows evaluation instances that failed to complete.
  • Terminated: Shows evaluation instances that were terminated.
Outcome

Select an evaluation outcome. Available options are:

  • All: Does not limit the results by outcome. This is the default selection.

  • Pass: Shows evaluation instances with an outcome of Pass.

  • Fail: Shows evaluation instances with an outcome of Fail.

Start date range

Click the Date picker to select a date range.

Select Preset or Custom.

  • Preset: Quickly filter by past 1, 5, 30, 60, or 90 days.

  • Custom: Select a custom start and end date using the calendar.

Default value: Six days that includes the previous five days and today. For example, if the date today is September 30, then the default Start date range is from September 25 to 30.
Apply filter

Click to apply the selected criteria and display matching evaluation instances.