What AGENT OPS LTD does

AgentOps (legal entity STAF, INC, operating as AGENT OPS LTD) is a San Francisco-based developer platform that provides observability, testing, debugging, and cost management for autonomous AI agents and LLM applications. The company's core offering is a two-line SDK (Python and TypeScript) built on OpenTelemetry standards that automatically instruments LLM calls, tool executions, and multi-agent interactions across more than 400 supported LLMs and frameworks, including OpenAI Agents SDK, Anthropic, Google Gemini, CrewAI, AutoGen/AG2, LangChain, LlamaIndex, Smolagents, Agno, and Google ADK. This instrumentation feeds a web-based dashboard (app.agentops.ai) that delivers session replay with time-travel debugging, token and cost tracking across providers, prompt-injection detection, and the ability to fine-tune specialized LLMs using saved completions.

The product surface has expanded beyond the SDK and dashboard to include an MCP Server (in beta, 2025) that lets AI assistants in Cursor, Claude Desktop, VSCode, Windsurf, and Zed query AgentOps data directly, a read-only REST API with JWT authentication for programmatic access to trace and span data, and self-hosting deployment options across AWS, GCP, and Azure. Enterprise-tier customers additionally receive SOC-2, HIPAA, and NIST AI RMF compliance, Custom SSO, Slack Connect, on-premise deployment, and custom data retention.

AgentOps operates a hybrid go-to-market: a freemium product-led growth motion for developers (free tier up to 5,000 events/month, Pro tier at $40/month pay-as-you-go, distributed via pip, npm, GitHub, and Discord) layered with an enterprise field-sales motion for organizations requiring SLAs, compliance certifications, and on-premise deployment. Monetization is supplemented by professional services ("Hire an Agent Expert" and "Scale to Enterprise") delivered via Calendly. The company raised $2.6 million in seed funding in August 2024 and serves a globally distributed customer base spanning technology, consulting, financial services, healthcare, telecommunications, energy, and travel.

Name

AGENT OPS LTD

Legal name

STAF, INC

Website

https://agentops.ai

Company type

Private

Operating status

Operating

Short description

AgentOps provides observability, debugging, and cost tracking for AI agents and LLM applications across 400+ frameworks. The platform serves AI engineers and enterprises through a freemium SDK model with a $40/month Pro tier and custom-priced Enterprise deployments.

Ownership category

akta.pro rank

Product category

AI Agent Observability

NAICS

Software Publishers (5132), Custom Computer Programming Services (541511), Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services (5182)

SIC

Services-Prepackaged Software (7372), Services-Computer Programming Services (7371)

akta.pro primary industry

AI Application Enablement Platforms (Copilot/Agent Frameworks, SDKs) (HDAEANAJ)

akta.pro secondary industries

MLOps/LLMOps & Model Lifecycle Management Services (BPAEAHAH), End-to-End Enterprise AI Platforms (MLOps & Model Lifecycle Management) (HDAEANAA), Agents & Autonomous Workflows (Tool Use, Planning, Multi-Agent) (HDAAACAF)

Keywords

• AI agent observability
• LLM application monitoring
• Developer SDK tools
• Agent debugging platform
• AI cost tracking

Headquarters

HQ city

San Francisco

HQ country

United States

HQ region

North America

Offices1 record

Markets served

GTM type

B2B

Offering type

Software

Cost components

Personnel, Technology or R&D, Infrastructure, Marketing or Sales, Operations

Revenue model

1. Subscription - Basic Tier: Free tier providing up to 5,000 events monthly with Agent Agnostic SDK, LLM Cost Tracking, and Replay Analytics. Used for developer acquisition and onboarding.
2. Subscription - Pro Tier: $40 per month subscription with unlimited event limits, unlimited log retention, session and event export, dedicated Slack and email support, and role-based permissioning. Pay-as-you-go billing model.
3. Subscription - Enterprise Tier: Custom pricing for organizations requiring SLA, Slack Connect, Custom SSO, on-premise deployment, custom data retention policies, self-hosting options (AWS, GCP, Azure), and compliance certifications (SOC-2, HIPAA, NIST AI RMF).
4. Professional Services: Hire an Agent Expert service helping teams build and scale enterprise-grade agents; Scale to Enterprise consulting for deploying agents to production.

Pricing tiers

Go-to-market motion2 records

Distribution channels6 records

Marketing channels8 records

Core offering

AgentOps provides a developer platform for monitoring, testing, and debugging autonomous AI agents and LLM applications. Their Python and TypeScript SDKs integrate with 400+ LLM frameworks and providers, offering session replays, cost tracking, prompt-injection detection, and compliance-ready observability for teams deploying agent-based AI systems in production.

Product overview

AgentOps is a unified developer platform for building, testing, debugging, and deploying AI agents and LLM applications. The core product consists of the AgentOps SDK (Python and TypeScript) for instrumenting agents, combined with a web-based Dashboard for visualization and analytics. The platform automatically tracks LLM calls, tool executions, and multi-agent interactions across 400+ supported frameworks. Add-on modules include an MCP Server for IDE integration and a Public API for programmatic access. Enterprise customers can opt for Self-Hosting to maintain data sovereignty. Educational content is provided through AgentOps Courses.

Differentiator

Problem solved

Functional benefit

Products and services

• AgentOps Python SDK
• AgentOps TypeScript SDK
• AgentOps Dashboard
• AgentOps Public API
• AgentOps MCP Server
• AgentOps Self-Hosting
• Hire an Agent Expert
• Scale to Enterprise

Quantifiable outcome

• Fine-tune LLMs up to 25x cheaper using saved completions from AgentOps traces
• +2 more outcomes

Named customers23 records

Segments3 records

Ideal customer profiles3 records

Technology focussed Yes

API detail

Has API

Yes

API docs

API detail

Core technology

AI maturity

App detail

Integration35 records

AI capability7 records

Feature8 records

Partnerships

19 partnerships are on record, tiered core.

• CrewAIcoreTechnology or IntegrationNative integration with CrewAI multi-agent framework. Users can monitor CrewAI applications with AgentOps through automatic instrumentation. Featured as a key integration on homepage.
• AG2 (AutoGen)coreTechnology or IntegrationAG2 (formerly AutoGen) multi-agent conversible workflow with tool usage is natively supported. Track observations from AG2 agents automatically.
• LangChaincoreTechnology or IntegrationJupyter Notebook with sample LangChain integration. Monitor Haystack and LangChain agents with automatic AgentOps instrumentation.
• OpenAIcoreTechnology or IntegrationFirst-class support for GPT family of models. Automatic instrumentation of OpenAI SDK calls including Assistants API, streaming, and function calling.
• AnthropiccoreTechnology or IntegrationTrack observations from Claude, Haiku, and Sonnet series of models. First-class support with automatic SDK instrumentation.
• Google DeepMind (Gemini)coreTechnology or IntegrationExplore Google DeepMind's Gemini with observation via AgentOps. Automatic instrumentation for Gemini API calls.
• Mistral AIcoreTechnology or IntegrationSupport for Mistral AI's open-weight models with automatic instrumentation.
• CoherecoreTechnology or IntegrationFirst-class support for Command-R-Plus and chat streaming with automatic observability.
• GroqcoreTechnology or IntegrationUltra-fast LLM inference with Groq Cloud integrated with AgentOps observability.
• LlamaIndexcoreTechnology or IntegrationNative integration with LlamaIndex for RAG applications with automatic tracing.
• LiteLLMcoreTechnology or IntegrationUnified interface for multiple LLM providers tracked through AgentOps.
• OpenAI Agents SDKcoreTechnology or IntegrationAgentOps seamlessly integrates with OpenAI Agents SDK for Python and TypeScript, providing observability into multi-agent workflows including agent lifecycle, LLM generation, function calls, audio processing, and handoffs.
• HuggingFace smolagentscoreTechnology or IntegrationTrack HuggingFace's smolagents with AgentOps seamlessly. Supports code agents, tool-calling agents, and multi-agent systems.
• XpandercoreTechnology or IntegrationMonitor and analyze Xpander agent workflows with automatic AgentOps instrumentation. Zero-configuration setup for agent activities, tool executions, and LLM interactions.
• IBM Watsonx.aicoreTechnology or IntegrationSeamless integration with IBM Watsonx.ai Python SDK. Track and analyze all Watsonx.ai model interactions automatically.
• xAI (Grok)coreTechnology or IntegrationTrack and analyze xAI Grok API calls with AgentOps. Support for Grok and Grok Vision models via OpenAI SDK compatible API.
• Llama StackcoreTechnology or IntegrationCreate agents using Llama Stack with AgentOps observability. Example provided for web search and NBA analysis.
• Google ADKcoreTechnology or IntegrationIntegration with Google Agent Development Kit for AI agent observability.
• AgnocoreTechnology or IntegrationIntegration with Agno framework for AI agent observability and monitoring.

Scale indicators4 records

Recent moves6 records

Expansion highlights6 records

Direct peers

• Portkey: Portkey is an LLM gateway and observability platform providing tracing, cost tracking, and reliability features for LLM applications. It directly competes with AgentOps at the observability layer with a similar PLG, developer-first motion.
• LangSmith: LangSmith is the observability and evaluation platform built by LangChain, the dominant agent framework. It directly competes with AgentOps on tracing, debugging, and evaluation of LLM/agent workflows and benefits from native distribution through the LangChain ecosystem.
• Langfuse: Langfuse is an open-source LLM engineering platform offering tracing, evaluation, and prompt management. It competes head-to-head with AgentOps in agent/LLM observability and is often cited as the open-source alternative to LangSmith.
• Helicone: Helicone is an open-source LLM observability platform that provides logging, monitoring, and cost tracking for LLM calls. It directly overlaps with AgentOps' core observability value proposition and serves a similar developer-first audience.
• Arize AI: Arize AI provides LLM evaluation, tracing, and observability for production AI applications. It is a direct competitor in the agent/LLM observability category, with stronger enterprise sales presence but similar technical scope.
• WhyLabs: WhyLabs provides AI observability and monitoring with a focus on LLM and ML model performance, drift detection, and evaluation. It overlaps with AgentOps in tracing and monitoring of agent/LLM applications in production.

Broad incumbents

• Weights & Biases: Weights & Biases is an MLOps platform with model evaluation and tracing features that extends into LLM and agent workflows. It competes as a broader incumbent with deeper ML lifecycle roots and a larger enterprise footprint than AgentOps.
• Honeycomb.io: Honeycomb is an observability platform for production engineering that supports OpenTelemetry and has been extending into AI/agent tracing. It is an incumbent that competes at the broader observability layer and could move deeper into AgentOps' niche.
• Datadog: Datadog is a large-scale cloud observability platform that has launched LLM and AI observability features. It competes as a broad incumbent that can bundle AI agent tracing into existing enterprise observability contracts.

Emerging players

• Maxim AI: Maxim AI is an evaluation and observability platform for AI agents and LLM applications. It overlaps with AgentOps on tracing and evaluation, targeting a similar early-stage developer and startup audience.

Market position

Strengths2 records

Weaknesses5 records

Competitive moat5 records

Key risks6 records

Key highlights7 records

Customer concentration

• Xx.com/agentopsai
• GitHubgithub.com/AgentOps-AI/agentops
• LinkedInlinkedin.com/company/aistaff

Compliance4 records

Revenue estimate

Valuation estimate

Number of profiles

Profiles2 records

Funding overview

Funding rounds

Investors

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

M&A

Investments

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Frequently asked questions about AGENT OPS LTD