Braintrust on the Vercel Marketplace
"I've never seen a workflow transformation like the one that incorporates evals into 'mainstream engineering' processes before. It's astonishing." – Malte Ubl, CTO at Vercel
Braintrust is now available on the Vercel Marketplace. This means you can run evals, monitor model quality and user experience, and benchmark across models from OpenAI, Anthropic, Gemini, and more all from your Vercel dashboard. With just a few clicks, you can automatically send your Vercel application's AI traces to Braintrust, giving you comprehensive visibility into your AI application's performance in production.
The future of AI app development
As AI applications move to production, teams need infrastructure that catches regressions, tracks what changed, and turns real usage into improvements. With Braintrust on Vercel Marketplace, you can ship agents and AI features with built-in evaluation and observability -- going from vibes to verified through the complete development loop.
Why developers need AI observability
How do you know your AI feature actually works? Are bad responses reaching users? Can your team improve quality without guesswork?
AI systems fail in unpredictable ways. Teams rely on fragile in-house tooling, ad-hoc manual reviews, and have no visibility into production errors. This leads to unhappy users, wasted engineering time debugging mystery issues, and teams afraid to ship updates because they can't predict what will break.
Braintrust provides the infrastructure layer required for AI engineering:
- Systematic evals: Build reliable test suites that catch issues before they reach production
- Real-time observability: Track production AI applications with monitoring and online scoring
- Production-grade scale: Query, filter, analyze, and review logs 80x faster with Brainstore, our database purpose-built for AI workloads
- Model flexibility: Compare and swap LLM providers using Braintrust's proxy without rewriting code
How to set up the Braintrust integration
Install the Braintrust integration
From the Vercel Marketplace listing, select Install. You will be prompted to create a new Braintrust account. On the next screen, select either the Free plan or the Pro installation plan and select Continue. Create a name for your Braintrust project in the Product Name field and select Create. This creates a Braintrust project and links it to your Vercel account.
From here, either select Done to go to your integration page or Add Drain to start sending logs to Braintrust.
Add Drain
In the Add Drain panel, select Traces and Next. Create a name for the drain and choose which Vercel projects you want to send traces to Braintrust. You can select All Projects or designate one or several specific projects. Adjust the sampling rate to designate what percentage of Vercel logs are sent to Braintrust.
Configure OpenTelemetry
Once you've added the integration, you need to configure OpenTelemetry on each project that's sending traces to Braintrust. In your Next.js project, create an instrumentation.ts file and call registerOtel. Check out the Vercel docs on initializing OTel for an example.
Why build with Vercel?
The Vercel AI Cloud enables developers to build, scale, and deploy modern web and AI apps. With the Braintrust integration, AI developers on Vercel can now:
- Add evals directly into their workflows
- Monitor model quality and user experience across environments
- Benchmark across models from OpenAI, Anthropic, Mistral, Gemini, and more
- Manage accounts and billing in one place
Get started with Braintrust on Vercel Marketplace
You can add Braintrust to your Vercel project today. Check out our documentation, read customer stories on our blog, and bookmark Vercel's changelog for more updates.
Have questions or feedback? Join our Discord or book a demo.