Skip to main content
Automations trigger actions based on events in Braintrust. Stay informed about production issues, export data to external systems, and manage data retention automatically.

​
Automation types

Braintrust supports three automation types:

​
Alerts

Send notifications when events occur:
  • Log alerts: Notify when conditions are met on production logs
  • Environment alerts: Notify when prompt environments are updated
Both alert types support:
  • Webhooks: POST JSON payloads to custom endpoints
  • Slack: Send messages to Slack channels
Use log alerts to catch errors, track quality degradation, or monitor usage patterns. Use environment alerts to track prompt deployments and version changes.

​
S3 export

Periodically export data to AWS S3 buckets:
  • Logs: Export traces or spans in JSON Lines or Parquet format
  • Custom queries: Use SQL to define exactly what data to export
Use exports for archiving, offline analysis, or feeding data warehouses like Snowflake or Databricks.

​
Data retention

Automatically delete old data based on time-based policies:
  • Logs: Remove logs older than a specified period
  • Experiments: Delete completed experiments after retention window
  • Datasets: Remove dataset rows past their retention date
Use retention policies to manage storage costs and comply with data privacy regulations.

​
Test automations

Before saving, test automations to verify configuration:
  • Alerts: Sends a test payload to your webhook or Slack channel
  • S3 exports: Writes and deletes a test file to your S3 bucket
  • Data retention: Previews which data would be deleted
Testing ensures automations work correctly before they run in production.

​
Monitor automation runs

View execution history and status:
  1. Go to Settings.
  2. Under Project, select Alerts or Data management.
  3. View run history, timing, and any errors
For S3 exports, you can also:
  • Manually trigger exports with Run once
  • Reset automation state to re-export all data

​
Next steps

Set up alerts

Configure webhooks and Slack notifications

Manage data

Export to S3 and configure retention policies