Skip to main content
Administer your Braintrust organization, control access to resources, configure integrations, and manage self-hosted deployments.

​
Manage organizations

Organizations represent your team or business. Configure organization-wide settings including:
  • Members: Invite users and assign permission groups
  • API keys: Create and manage authentication credentials
  • Service tokens: Set up system integrations with service accounts
  • AI providers: Configure API keys for OpenAI, Anthropic, Google, and others
  • Environment variables: Set secrets for functions across your organization
Navigate to Settings > Organization to manage these settings.

​
Control access

Braintrust provides flexible access control at multiple levels:
  • Organization level: Assign users to Owners, Engineers, or Viewers groups
  • Project level: Grant specific permissions to custom permission groups
  • Object level: Control access to individual experiments, datasets, or prompts
Create custom permission groups to match your team’s needs. Service accounts enable secure system integrations with granular permissions.

​
Manage projects

Projects organize AI features in your application. Each project contains logs, experiments, datasets, and functions. Configure project settings including:
  • Tags: Organize and filter logs across your project
  • Human review scores: Define manual review criteria
  • Aggregate scores: Combine multiple metrics into single values
  • Online scoring: Automatically evaluate production logs
  • Comparison keys: Customize experiment comparisons

​
Set up automations

Automate routine tasks and stay informed about production issues:
  • Alerts: Get notified when metrics exceed thresholds or errors spike
  • Data management: Configure retention policies and archiving rules
Automations run in the background, keeping your data clean and your team informed.

​
Self-host Braintrust

Deploy Braintrust in your own cloud infrastructure:
  • AWS: Deploy to Amazon Web Services
  • GCP: Deploy to Google Cloud Platform
  • Azure: Deploy to Microsoft Azure
Self-hosting keeps your data within your environment while providing the full Braintrust platform. Configure authentication, networking, and advanced options to match your infrastructure requirements.

​
Configure authentication

Braintrust supports multiple authentication methods:
  • Email/password: Standard authentication for individuals
  • SSO: Integrate with your identity provider (Okta, Google Workspace, Azure AD)
  • API keys: Authenticate SDK and API requests
  • Service tokens: Authenticate service accounts for system integrations

​
Next steps

Manage organizations

Configure organization settings and integrations

Control access

Set up permission groups and access controls

Manage projects

Configure project settings and features

Set up automations

Automate alerts and data management

Self-host Braintrust

Deploy in your own infrastructure

Configure authentication

Set up SSO and authentication methods