Observe

See what happens in production

Full visibility into every AI interaction. Every request traced, every response scored, every regression caught before your customers notice.

What is agent observability?

Traditional monitoring tracks uptime and latency. Agent observability tracks whether LLM responses are good.

Trace every step of every LLM call: the prompt, the response, tool calls, retrieved context, and the final output. Score that traffic against quality criteria automatically, and get alerted when something drifts.

Seamless setup

Two paths to full visibility

Go from zero observability to full tracing with minimal effort. Use the gateway as your default capture layer, and the SDK for deeper context on your agent’s tool calls, planning steps, or loops.

SDK tracing

Enable auto-instrumentation once and every call to a supported provider is logged with inputs, outputs, latency, tokens, and cost. Wrap your own functions for deeper context on tool calls, planning steps, and agent loops. Logs are buffered and flushed asynchronously to keep overhead low.

Trace LLM calls
Initialize once and every LLM call is traced automatically.
import { initLogger } from "braintrust";
import OpenAI from "openai";

// Call once at startup — all LLM calls are traced automatically
initLogger({
  apiKey: process.env.BRAINTRUST_API_KEY,
  projectName: "My Project",
});

const client = new OpenAI();
const response = await client.responses.create({
  model: "gpt-5-mini",
  input: "What is the capital of France?",
});

Gateway

Change your base URL to the gateway and pass your Braintrust API key. No other code changes needed. You get a unified API across OpenAI, Anthropic, Google, AWS, and other providers, with automatic caching and observability on every request.

Use the gateway
Set the base URL to https://gateway.braintrust.dev.
import { OpenAI } from "openai";

const client = new OpenAI({
  baseURL: "https://gateway.braintrust.dev",
  apiKey: process.env.BRAINTRUST_API_KEY,
});

async function main() {
  const response = await client.responses.create({
    model: "gpt-5-mini",
    input: [{ role: "user", content: "Say hello!" }],
  });

  console.log(response.output_text);
}

main();
Monitoring in production

Everything you need to observe agents in production. From the first span to the final score.

Traces

Each request becomes a tree of nested spans: LLM calls, tool invocations, and retrieval steps. See the full chain from input to output, with latency, token counts, and cost attached to every step.

Log your first trace
Spans

Dashboards

Track latency, cost, quality, and volume in real time. Break down LLM spend by model, feature, or team, and build views for engineering, product, or leadership.

Explore monitoring
Latency

Alerts

Set thresholds on any metric, like score drops, latency spikes, or error rate changes. Get notified before your customers do.

Set up alerts
Created
Input
Factuality
Helpfulness
Sentiment
Jan 25, 2:34 PM
Hi! What's the status of order #12345?
94%
91%
82%
Jan 25, 2:31 PM
Can I return my order from last week?
91%
88%
75%
Jan 25, 2:28 PM
What are your shipping rates to Canada?
88%
86%
79%
Jan 25, 2:25 PM
I need to change my delivery address
96%
93%
85%
Jan 25, 2:22 PM
Do you have any discounts for bulk orders?
89%
87%
88%
Jan 25, 2:19 PM
My package arrived damaged
92%
84%
45%
Jan 25, 2:16 PM
What payment methods do you accept?
97%
92%
81%
Jan 25, 2:08 PM
Where is my refund? It's been 2 weeks!
78%
55%
32%
Jan 25, 2:01 PM
How do I track my order?
95%
90%
77%
Jan 25, 1:58 PM
Can I pick up my order in store?
93%
89%
84%
Jan 25, 1:55 PM
When will order #88219 ship?
91%
87%
71%

Online scoring

The same scorers you use in offline experiments run automatically on production traffic. Every conversation is scored as it happens.

Score production traffic
Customer stories

How the best AI teams run in production

Paul Klein IV, Founder & CEO

Braintrust shows us the model's input and output and what actions it took.

Malte Ubl, CTO

We didn't realize we needed deep observability until Braintrust.

Allen Kleiner, AI Engineering Lead

Loop helps us understand trace details that would be impossible to scan manually.

Start building

Create a free account and start monitoring in minutes.