Software Engineer, Developer Experience
San Francisco, New York City
About the company
Braintrust is the AI observability platform. By connecting evals and observability in one workflow, Braintrust gives builders the visibility to understand how AI behaves in production and the tools to improve it.
Teams at Notion, Stripe, Zapier, Vercel, and Ramp use Braintrust to compare models, test prompts, and catch regressions — turning production data into better AI with every release.
About the role
We're looking for an Engineer who loves building tools for other engineers. You'll own the systems we touch every day — local dev, CI, and the deploy pipeline — and make shipping to production fast, safe, and reliable. The work compounds across every engineer at the company and is very important to our whole team
What you'll do
Work directly with the engineering team to find friction and remove it — help them be nimble, happy and productive
Drive CI runtime down: parallelization, caching, sharding, test selection, and killing flakes
Own the deploy pipeline: progressive rollouts, fast rollbacks, and clear signals when something is wrong
Own the our build toolchain — bundlers, compilers, monorepo tooling — and keep cold builds and rebuilds fast as the codebase and archictecture grows
Harden our supply chain: SBOMs, signed artifacts, locked-down GitHub Actions, secret hygiene, and provenance for every build
Build CLIs, GitHub Apps, and bots that make the right thing the easy thing
Ideal candidate credentials
5+ years building developer tools, CI/CD, or platform infrastructure
A track record of taking slow, painful workflows and making them fast and pleasant
Deep GitHub expertise: Actions, Apps, APIs, merge queues, and branch protections
Strong fluency with JavaScript/TypeScript build and bundling tools (esbuild, swc, Vite, Turbopack, tsc, pnpm) and a clear sense of when to reach for which
Comfortable profiling and optimizing across the stack — flamegraphs, tracing, and just plain measurement
Supply chain security experience: SBOMs, Sigstore/cosign, SLSA, GitHub Actions hardening
Strong opinions on safe, reliable production deploys
Benefits include
Medical, dental, and vision insurance
Daily lunch, snacks, and beverages
Flexible time off
Competitive salary and equity
AI Stipend
Equal opportunity
Braintrust is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.