Build a custom AI observability layer in Braintrust
24 June 202610:00 AM PT
Nick SlavinSolutions Engineer
The signals that reveal how well your AI is serving users are different for every product. Braintrust lets you define them as custom facets and track every production trace against them.
In this session, Nick Slavin shows how to design custom facets for your specific use case, use SQL-queryable trace metadata for trend analysis and reporting, and build a quality practice that catches failures and surfaces what's working.
What you’ll learn
- How to define the dimensions that matter to your business as custom Topics facets and cluster every trace against them automatically
- What SQL-queryable trace metadata unlocks for analysis and reporting
- How to track trends over time and know when a fix actually held
- How teams scale production observability across multiple agents and product surfaces
Recent on-demand workshops
How financial services teams ship AI agents to production
26 August 20267:30 AM PT
Designed for new Braintrust users, this workshop will cover the core foundations of evals and how to get started with Braintrust.
Evals foundations
13 August 202610:00 AM PT
Designed for new Braintrust users, this workshop will cover the core foundations of evals and how to get started with Braintrust.
Put the workshop into practice
Start using Braintrust to trace what ships, score it against real data, and turn every regression into an eval you can rerun.