Workshops

Evals foundations

9 September 202610:00 AM PT

Jess Wang, Developer Advocate

Jess WangDeveloper Advocate

Designed for new Braintrust users, this workshop will cover the core foundations of evals and how to get started with Braintrust.

Jess will walk through the practical pieces of the eval workflow: moving from a question about your AI system to experiments, results, and feedback you can use to improve it.

Bring a system you are building, a quality question you want to answer, or simply your curiosity. You will leave with a clearer picture of how to measure and improve agent quality, plus a practical next step to take.

What you’ll learn

  • How Braintrust groups production traces into named failure patterns you can act on
  • How to filter a failure cluster into a labeled dataset
  • How to write an eval that targets a specific failure pattern and validate the fix
  • How to run a repeatable diagnose-to-eval workflow in Braintrust

Recent on-demand workshops

How financial services teams ship AI agents to production

26 August 20267:30 AM PT

Designed for new Braintrust users, this workshop will cover the core foundations of evals and how to get started with Braintrust.

Evals foundations

13 August 202610:00 AM PT

Designed for new Braintrust users, this workshop will cover the core foundations of evals and how to get started with Braintrust.

Build evals from real production data

10 July 202610:00 AM PT

Learn how to take the patterns Braintrust surfaces automatically, turn them into a labeled eval dataset, and run the same workflow every time a new pattern shows up.

Share

Put the workshop into practice

Start using Braintrust to trace what ships, score it against real data, and turn every regression into an eval you can rerun.

Trace everything