Dataset
Use datasets to provide test inputs and expected responses for evaluating an agentflow. Each dataset is associated with an agentflow and contains the test cases used when an evaluation runs.
Jump to:
Access the Dataset page
The dataset list is displayed on the Dataset page.
- Go to Agents > Evaluations.
-
Click the Dataset tab.
The page displays the datasets available.
Create a dataset
Create a dataset and add the test cases you want to use when evaluating an agentflow.
-
Go to the Dataset page. For more information, see Access the Dataset page.
-
Click Create dataset.
-
In Dataset name, enter a name for the dataset.
-
In Description, enter information that helps users understand the purpose of the dataset.
-
In Select the agentflow to evaluate, search for and select the agentflow you want to evaluate.
-
Click Create dataset.
Add test data using a CSV or JSON file
Upload a CSV or JSON file containing the test cases for the selected agentflow. After you select an agentflow, the required column headers appear under Add data. The headers are based on the start event inputs and output variables available in the selected agentflow.
Your uploaded file must contain the displayed column headers so that the test data can be mapped to the correct agentflow variables.
Download and complete the CSV template
Use the CSV template to ensure that your test data contains the required column headers.
-
Select the agentflow you want to evaluate.
-
Review the column headers displayed under Add data.
-
Click Download CSV.
The downloaded CSV file contains the required column headers for the selected agentflow.
-
Open the downloaded file.
-
Enter your test cases under the appropriate column headers.
-
Save the completed file.
-
Drag the file into the upload area, or click Select files and choose the file from your computer.
-
After the file is uploaded, click Create dataset.
You can also upload an existing CSV or JSON file. Ensure that the file contains the required column headers displayed on the page for the selected agentflow.
Manage datasets
The Datasets page lists the datasets available in the tenant for evaluating agentflows. You can search for a dataset, view the number of rows it contains, and review the agentflow and editing information associated with it.
Edit a dataset
Open a dataset to view its columns and entries, download its data, upload additional test cases, or update its basic information.
-
Go to the Dataset page. For more information, see Access the Dataset page.
-
Click on the dataset name.
The dataset page opens and displays the column headers and entries in the dataset. From this page, you can:
- Download the existing dataset as a CSV file.
- Upload a CSV file containing additional or updated test cases.
- Edit the dataset name, description, and other configuration details.
Download a dataset
Download the dataset when you want to review or update its existing entries in a CSV file.
-
On the dataset page, click Download CSV.
-
Open the downloaded CSV file.
The file contains the dataset column headers and all existing entries. -
Update or add entries under the appropriate column headers.
-
Save the file.
-
Upload the completed file back to the dataset. For more information, see Upload a CSV file.
Upload a CSV file
Upload a CSV file to add or update test cases in an existing dataset.
-
On the dataset page, click Upload CSV.
-
Review the expected column headers displayed in the Upload CSV dialog.
Note: The uploaded file must contain the expected column headers so that the data can be mapped correctly.
-
To create a new file with the expected column headers, click Download CSV.
-
Enter the test cases under the appropriate column headers and save the file.
-
Drag the completed file into the upload area, or click Select files and choose the file from your computer.
-
To retain the entries already in the dataset, ensure Keep existing data in the table is selected. Clear this option when you do not want to retain the existing entries.
-
Click Upload.
Search for a dataset
- Go to the Dataset page. For more information, see Access the Dataset page.
-
In Search datasets, enter the dataset name.
The list displays datasets that match your search.
Open a dataset
- Go to the Dataset page. For more information, see Access the Dataset page.
- Click the name of the dataset you want to open.
Refresh the dataset list
To display the latest dataset information:
- Go to the Dataset page. For more information, see Access the Dataset page.
- Click Refresh.
The following columns, settings, and selections are available on the Dataset page.
| Column or selection | Description |
|---|---|
| Datasets | Displays the datasets available in the organization. |
| Search datasets | Filters the list by dataset name. |
| Refresh | Refreshes the page to display the latest dataset information. |
| Create dataset | Opens the page where you can create a dataset. |
| Dataset name | The name of the dataset. Select the name to open the dataset. |
| Rows | The number of rows in the dataset. |
| Agentflow | The agentflow associated with the dataset. |
| Date created | The date and time the dataset was created. |
| Last edited | The date and time the dataset was last edited. |
| Last edited by | The user who last edited the dataset. |
Options ( )
|
Opens a menu with actions for the dataset.
|
)