Dataset

Use datasets to provide test inputs and expected responses for evaluating an agentflow. Each dataset is associated with an agentflow and contains the test cases used when an evaluation runs.

Access the Dataset page

The dataset list is displayed on the Dataset page.

  1. Go to Agents > Evaluations.
  2. Click the Dataset tab.
    The page displays the datasets available.

Create a dataset

Create a dataset and add the test cases you want to use when evaluating an agentflow.

  1. Go to the Dataset page. For more information, see Access the Dataset page.

  2. Click Create dataset.

  3. In Dataset name, enter a name for the dataset.

  4. In Description, enter information that helps users understand the purpose of the dataset.

  5. In Select the agentflow to evaluate, search for and select the agentflow you want to evaluate.

  6. Click Create dataset.

Add test data using a CSV or JSON file

Upload a CSV or JSON file containing the test cases for the selected agentflow. After you select an agentflow, the required column headers appear under Add data. The headers are based on the start event inputs and output variables available in the selected agentflow.

Your uploaded file must contain the displayed column headers so that the test data can be mapped to the correct agentflow variables.

Download and complete the CSV template

Use the CSV template to ensure that your test data contains the required column headers.

  1. Select the agentflow you want to evaluate.

  2. Review the column headers displayed under Add data.

  3. Click Download CSV.

    The downloaded CSV file contains the required column headers for the selected agentflow.

  4. Open the downloaded file.

  5. Enter your test cases under the appropriate column headers.

  6. Save the completed file.

  7. Drag the file into the upload area, or click Select files and choose the file from your computer.

  8. After the file is uploaded, click Create dataset.

You can also upload an existing CSV or JSON file. Ensure that the file contains the required column headers displayed on the page for the selected agentflow.

Manage datasets

The Datasets page lists the datasets available in the tenant for evaluating agentflows. You can search for a dataset, view the number of rows it contains, and review the agentflow and editing information associated with it.

Edit a dataset

Open a dataset to view its columns and entries, download its data, upload additional test cases, or update its basic information.

  1. Go to the Dataset page. For more information, see Access the Dataset page.

  2. Click on the dataset name.

The dataset page opens and displays the column headers and entries in the dataset. From this page, you can:

  • Download the existing dataset as a CSV file.
  • Upload a CSV file containing additional or updated test cases.
  • Edit the dataset name, description, and other configuration details.

Download a dataset

Download the dataset when you want to review or update its existing entries in a CSV file.

  1. On the dataset page, click Download CSV.

  2. Open the downloaded CSV file.
    The file contains the dataset column headers and all existing entries.

  3. Update or add entries under the appropriate column headers.

  4. Save the file.

  5. Upload the completed file back to the dataset. For more information, see Upload a CSV file.

Upload a CSV file

Upload a CSV file to add or update test cases in an existing dataset.

  1. On the dataset page, click Upload CSV.

  2. Review the expected column headers displayed in the Upload CSV dialog.

    Note: The uploaded file must contain the expected column headers so that the data can be mapped correctly.

  3. To create a new file with the expected column headers, click Download CSV.

  4. Enter the test cases under the appropriate column headers and save the file.

  5. Drag the completed file into the upload area, or click Select files and choose the file from your computer.

  6. To retain the entries already in the dataset, ensure Keep existing data in the table is selected. Clear this option when you do not want to retain the existing entries.

  7. Click Upload.

Search for a dataset

  1. Go to the Dataset page. For more information, see Access the Dataset page.
  2. In Search datasets, enter the dataset name.
    The list displays datasets that match your search.

Open a dataset

  1. Go to the Dataset page. For more information, see Access the Dataset page.
  2. Click the name of the dataset you want to open.

Refresh the dataset list

To display the latest dataset information:

  1. Go to the Dataset page. For more information, see Access the Dataset page.
  2. Click Refresh.