Encyclopedia Evalica / Tracing and instrumentation / User feedback
User feedback
/'yoo.zer 'fee.dbak/Explicit signals like thumbs up/down or ratings captured from end users in production and attached to traces. Feedback is valuable because it links quality judgments to concrete examples. (noun)
“User feedback on that trace was a thumbs-down, so we added it to the eval set.”
Customer example
Replit uses user feedback to investigate problems by pulling tens or hundreds of related production examples, so engineers can prioritize and fix whole families of issues instead of one-off bugs. Read more
Related Tracing and instrumentation terms
From the docs
Braintrust is the AI observability and eval platform for production AI. By connecting evals and observability in one workflow, teams at Notion, Stripe, Zapier, Vercel, and Ramp ship quality AI products at scale.
Start building