Ship Agents Without the Anxiety.

Traces. Logs. Metrics. Sessions. Costs. Your agents aren't black boxes anymore. Evals powered by LLM-as-Judge, datasets, and scorers. Prompts refined from real feedback. Anomalies caught. Alerts sent.

One continuous loop. Ship with confidence.

Live Playground View Docs

Observe

Evaluate

↻

Label

Alert

Observe

Traces, logs, metrics—one place, zero blind spots

Quick Start

 $ curl -fsSL https://raw.githubusercontent.com/opensearch-project/agentops/main/install.sh | bash

Works everywhere. Installs everything. 🔥

Deploy to AWS One click to production

5 Minutes to Production Observability

From zero to full tracing in minutes. No complex configuration, no vendor lock-in.

main.py Python

from agentops import Client

# Initialize with one line
agentops.init(api_key="your_key")

# Your existing code works as-is
def process_request(prompt):
    response = llm.generate(prompt)
    return response

# Automatic OTEL traces captured
result = process_request("Hello AI")

Terminal Output

✓ Instrumentation initialized

✓ OTEL exporter configured

✓ Trace captured: process_request

✓ Cost tracked: $0.0023

✓ Latency: 342ms

→ View dashboard at http://localhost:8000

See Full Interactive Demo

Choose Your Integration Style

Three paths to production observability. Pick the one that fits your workflow.

Pre-Instrumented Framework

Zero configuration. Just import and go. Perfect for getting started fast.

example.pypython

from agentops import Client
# One line initialization
agentops.init(api_key="your_key")
# Your existing code works as-is
def my_agent_function(prompt):
    response = llm.generate(prompt)
    return response
# Automatic OTEL traces, metrics, and logs
result = my_agent_function("Hello AI")

Key Benefits

Zero configuration required
Automatic instrumentation of popular frameworks
Instant OTEL traces and metrics
Works with existing code
Production-ready in 5 minutes

Why OpenTelemetry Matters

Built on the industry standard for observability. No compromises, no lock-in.

Industry Standard (CNCF)

OpenTelemetry is a CNCF graduated project, backed by major tech companies and trusted by thousands of organizations worldwide.

Learn more

Your Data, Your Rules

Own your observability data completely. Export to any backend, store locally, or switch providers anytime without losing history.

Learn more

Future-Proof Investment

Built on open standards that evolve with the industry. Your instrumentation code stays relevant as technology advances.

Learn more

No Vendor Lock-In

Switch observability backends in minutes, not months. Your instrumentation is portable across any OTEL-compatible platform.

Learn more

Language Agnostic

Consistent instrumentation across Python, JavaScript, Go, Java, and 10+ languages. One standard for your entire stack.

Learn more

Community Driven

Benefit from contributions by thousands of developers. Active community, extensive documentation, and continuous improvements.

Learn more

Everything You Need to Build Production AI

A complete platform for observability, evaluation, and optimization of your LLM applications

LLM Tracing

Complete visibility into every LLM call with automatic instrumentation and detailed performance metrics.

Auto instrumentation for popular frameworks
Cost per request tracking
Agent and RAG workflow tracking

python

from agentops import trace

@trace
def my_llm_call(prompt):
    response = openai.chat.completions.create(
        model="gpt-4-turbo",
        messages=[{"role": "user", "content": prompt}]
    )
    return response

# Automatically tracked:
# - Latency, tokens, cost
# - Input/output content
# - Model and parameters

Prompt Management

Version control and A/B test your prompts with a centralized prompt library and deployment system.

Version control for prompts
A/B testing and rollback
Collaborative prompt editing

Customer Support Prompt

Version 3.2 • Production

Active

System Prompt

You are a helpful customer support assistant. Be concise, friendly, and always verify information before providing answers...

94%

Success Rate

1.2K

Uses Today

$0.12

Avg Cost

Evaluation Framework

Comprehensive evaluation suite with 10+ built-in methods and custom evaluator support.

Accuracy, relevance, and hallucination detection
Custom evaluator support
Automated regression testing

Accuracy 94%

Relevance 88%

Hallucination 96%

Toxicity 99%

Bias 92%

Coherence 90%

Fluency 95%

Custom 87%

AI Insights

Intelligent alerts and recommendations powered by automated analysis of your LLM usage patterns.

Anomaly detection and alerts
Cost optimization recommendations
Performance improvement suggestions

Cost Spike Detected

2 min ago

GPT-4 usage increased 340% in the last hour. Consider switching to GPT-3.5 for non-critical requests.

Optimization Opportunity

15 min ago

Your prompt for "summarization" could be 23% shorter without losing quality. Estimated savings: $420/month.

Loved by Developers

See what developers are saying about building with OpenTelemetry standards

Speed Wins

"5-minute setup. Tracing production requests immediately. This is what developer experience should feel like."

⚡ 5-minute setup vs 3-week integration

Sarah Chen

Senior Backend Engineer

TechCorp AI

OTEL Love

"Finally, an observability platform that doesn't lock me into proprietary formats. OTEL means I can switch backends anytime without rewriting instrumentation."

⚡ Zero vendor lock-in, full data portability