Skip to main content

​
Inline Annotations

Inline annotations are the main way to leave human feedback on a trace. Any trace you can open has an annotation panel, whether you reached it from the Traces page, Issues, or a saved search.

​
How Inline Annotations Work

When viewing a trace:
  1. Open the trace detail view.
  2. Use the annotation panel on the right.
  3. Choose a scope:
    • Conversation-level: assess the whole interaction.
    • Message-level: annotate one message.
    • Text-range: anchor feedback to selected text inside a message.
  4. Add a thumbs-up or thumbs-down verdict and feedback.
  5. Optionally link the annotation to an issue.
Annotations save as drafts while you edit. Once finalized, they feed analytics, signal discovery, and evaluation alignment alongside annotations from flaggers and the API.

​
A Typical Review Workflow

For batch review, start from search or a saved search:
  1. Run or open a search for the cohort you want to review, such as “failed payments last week” or “checkout flows over 5 steps”.
  2. Open a matching trace.
  3. Read the conversation, annotate it, and move to the next trace.
  4. Reopen the saved search from the Saved searches dropdown whenever you want to pick the cohort back up.
For shared review work, saved searches are visible to everyone in the project, so a teammate can open the same cohort from the Saved searches dropdown.

​
When to Use Inline Annotations

Use inline annotations for:
  • Systematic review of a trace cohort
  • Ad-hoc spot checks while browsing traces
  • Issue investigation
  • Team review and coaching
  • Extra context on traces that already have scores or flagger annotations
If you want detection without human review for a fixed set of known failure categories, use flaggers.

​
Inline Annotations and Issues

When creating an inline annotation, you can leave issue assignment automatic or link the annotation to an existing signal. After the annotation is finalized, failed annotations enter signal discovery automatically.

​
Persisted Highlights

Message-level and text-range annotations leave highlights in the conversation view. Click a highlight to focus the matching annotation card in the panel.

​
Next Steps