Change, Run, and Compare with Experiments in Mastra Studio

Run test cases against agents and workflows, score the results, and track quality over time.

Experiments, paired with recently shipped datasets, are a big step forward in Mastra Studio’s observability capabilities, giving you the ability to measure agent accuracy and improve output over time.

Each item in a dataset has an input and optionally a ground truth (the expected output). An experiment runs each item through a target and scores the result. Every time you change something, you run a new experiment and compare it against previous runs.