πͺHow to set up Bulk Runner?
Last updated
Last updated
@Dara.network / Gooey.AI / support@gooey.ai
In this example scenario, we are setting up a simple bulk run to check regression for an AI Copilot in production.
Choose the βSAVEDβ run from Gooey.AI Workflows that you would like to use.
Prepare your test question set:
Create a list of the most frequently asked questions for your AI Copilot (we recommend between 25 for optimum observability and regression you can do more if you prefer)
Make sure the Excel sheet/Google Sheets table has a βheaderβ section
Add all your questions in the column below it
Paste the link of your Google sheet or upload your data
In the current scenario, we want to use the Gooey Copilot to answer all the questions in the google sheet. So essentially they are the βinputβ for the Bulk Workflow.
Select the βquestionsβ column in the βInput Promptβ section.
As this is a βBulk onlyβ scenario, you can βdeleteβ the Copilot Evaluator option in the section. After that hit the βSubmitβ button.
The workflow will create a new CSV, with an added few columns based on the run, including, βOutput Textβ, βRun URLβ, and βRun Timeβ.
Your output will be on the right side of the page.
If you want more details in the Output section, use the checkboxes in the βShow All Columnsβ section on the right. This is useful if you want to keep track of Price, Error Messages, and other details.
Check out the example run here: BULK RUNNER (Regression Only)
Check out the example run here: BULK RUNNER (Bulk and Evaluation)