Skip to main content
Applies to:


​
Summary

Goal: Configure online scoring rules to access trace-level data for LLM-as-judge scorers. Features: Online scoring rules, span filtering, root span data access.

​
Configuration Steps

​
Step 1: Navigate to online scoring configuration

Open your project and go to Configuration → Online scoring.

​
Step 2: Add “All root spans” filter

In the scoring rule configuration, add the “All root spans” filter before testing or deploying. All root spans filter configuration

​
Step 3: Test the rule

Use “Test rule” to verify the scorer receives the expected data from the root span.

​
Why This Is Needed

When data is consolidated at the trace level (root span), scorers need the “All root spans” filter to access it. Without this filter, nested spans may not contain the data your scorer expects, causing empty or missing inputs.