Developer docs
API playgroundTry for free, no card

Search company profiles

LiteLLM

Full company profile

uuid006g4jf

Namestring
LiteLLM
Legal namestring
Berrie AI Incorporated
Websiteurl
litellm.ai
Company typeenum
Private
Founded yearint
2023
Descriptiontext

LiteLLM is an open-source AI gateway that provides a unified, OpenAI-compatible API interface across more than 100 large language model providers, including OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Mistral, and DeepSeek. Operated by Berrie AI Incorporated and founded in 2023, the company is headquartered in San Francisco, backed by Y Combinator as part of its W24 cohort, and operates with a small team of 1-10 employees. Its core product, the LiteLLM AI Gateway (Proxy), is an MIT-licensed Python/FastAPI server that handles model routing, automatic fallbacks during provider outages, per-key/user/team spend attribution, virtual key management with budgets and rate limits, LLM guardrails, Prometheus metrics, and audit logging. A complementary Python SDK enables direct provider-agnostic LLM calls without the proxy. The product has achieved substantial open-source distribution — 40K GitHub stars, 240M+ Docker pulls, 1B+ gateway requests, and 1,005+ contributors — making it one of the most widely adopted LLM routing layers in the developer ecosystem.

The company monetizes through a two-tier model: a free open-source core targeting self-serve developer adoption, and an Enterprise tier (custom pricing, annual contracts, 30-day trials) that adds SSO/SAML, audit logs, key rotation, custom SLAs, enhanced support, and is available cloud-hosted or self-hosted. Distribution combines PLG channels (GitHub, PyPI, Docker Hub) with enterprise direct sales and listings on AWS Marketplace and Azure Marketplace. The product portfolio has expanded beyond the core gateway into adjacent modules including a Rust-based performance-optimized gateway (early beta, ~15x throughput improvement), an Agent Platform for autonomous-agent lifecycle management (alpha), MCP Gateway, LiteLLM Skills, semantic caching on Valkey/ElastiCache, the LiteLLM Observatory load-testing system, and componentized data-plane/control-plane deployments. Strategic partnerships with CrowdStrike (security), Akto (AI agent security), and DigitalOcean (ecosystem) extend the platform's reach. Notable customers include Netflix and Lemonade. Compliance posture includes SOC 2 Type I/II and ISO 27001 certifications.

Short descriptiontext

LiteLLM is an open-source AI gateway providing unified, OpenAI-compatible API access to 100+ LLM providers, serving platform engineering and AI development teams with model routing, spend tracking, fallbacks, and enterprise governance.

Operating statusenum
Operating
Ownership categoryenum
Headcount rangeband
11–50
akta.pro rankint
HeadquartersSan Francisco, United States
HQ citystring
San Francisco
HQ countrystring
United States
HQ regionstring
North America
Markets served

Serves global market

Keyword5 values
AI gateway software, LLM proxy, unified LLM API, LLM cost management, multi-provider routing
Industry3 codes
PRIMARYHDAEANAD
LLMOps & Generative AI Platforms (Prompt/Agent Orchestration, RAG)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
SECONDARYBPAEAHAH
MLOps/LLMOps & Model Lifecycle Management Services
SECONDARYHDAIAFAI
Network Performance, Visibility & SLA Monitoring (Managed NPM/Observability)
Hardware, Technology & Telecom/Telecommunications & Network Services/Data & IP Network Services (MPLS, SD-WAN, Ethernet)
NAICS code2 codes
  • Computer Systems Design and Related Services5415
  • Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services518
SIC code1 code
  • Services-Prepackaged Software7372
Product category
AI Infrastructure / LLM Gateway
GTM motion2 records

Each record includes

Type, Description, Source

Revenue model2 records
1Open Source (MIT License)
TypeFreemium
Description

Free, open-source AI gateway downloadable from GitHub, PyPI, and Docker Hub. Users self-host and manage their own infrastructure. Revenue is indirect through enterprise adoption leading to paid cloud/managed offerings.

litellm.ai
2Enterprise Subscription
TypeSubscription Recurring
Description

Enterprise tier with custom pricing including SSO/SAML, audit logs, custom SLAs, enhanced support, and all enterprise features. Sold via direct sales with 30-day trial. Available as cloud-hosted or self-hosted deployment. Revenue is subscription-based, billed annually or multi-year.

litellm.ai
Marketing channels6 records

Each record includes

Title, Type, Stage, Description, Source

Distribution channels4 records

Each record includes

Title, Type, Scope, Target buyer, Description, Source

Cost components5 values
Personnel, Technology or R&D, Infrastructure, Marketing or Sales, Operations
Pricing details2 tiers
1Free, open-source AI gateway for developers
ModelFreemiumBilling cadenceOthers
Notes

100+ LLM Provider Integrations; Langfuse, Arize Phoenix, Langsmith, OTEL Logging; Virtual Keys, Budgets, Teams; Load Balancing, RPM/TPM limits; LLM Guardrails; MIT License. Available via GitHub, PyPI, and Docker.

litellm.ai
2Enterprise-grade AI gateway with custom SLAs and support
ModelSubscriptionBilling cadenceAnnual
Notes

Everything in OSS; Enterprise Support + Custom SLAs; JWT Auth, SSO, Audit Logs; All Enterprise Features. Cloud or Self-Hosted deployment options. 30-day trial available. Contact sales for pricing.

litellm.ai
GTM typeB2B
B2B
Offering typeSoftware
Software
Core offering1 text field

LiteLLM provides an open-source AI gateway (Python FastAPI proxy server) and Python SDK that deliver a unified, OpenAI-compatible interface to call 100+ LLM providers (OpenAI, Anthropic, Azure, Bedrock, Gemini, Vertex, Mistral, DeepSeek, and others). The platform adds routing with automatic fallbacks, per-key/user/team spend tracking and attribution, virtual API key management with budgets and rate limits, LLM guardrails, Prometheus observability, audit logs, and enterprise controls (SSO/SAML, JWT, key rotation). A paid Enterprise tier adds custom SLAs, SSO, audit logs, and dedicated support, deployed cloud-hosted or self-hosted.

Differentiator
Functional benefit
Problem solved
Quantifiable outcome1 of 5 values shown
  • Day 0 model deployment — new LLM models available within 1 day of release without per-model integration work
+4 more records
Product overview1 text field

LiteLLM is an AI gateway platform providing unified API access to 100+ LLM providers via OpenAI-compatible format. The product portfolio consists of the open-source MIT-licensed LiteLLM Python SDK (direct client library) and LiteLLM AI Gateway/Proxy (self-hosted gateway server) as core products, with LiteLLM Enterprise tier adding SSO/SAML, Audit Logs, Key Rotation, and custom SLAs. The LiteLLM Agent Platform (alpha) enables natural-language-driven AI agent management, built on the LiteLLM MCP Gateway and LiteLLM Skills for Anthropic Claude Code integration. LiteLLM Rust Gateway (early beta) offers a performance-optimized Rust implementation with sub-1ms overhead and 15x throughput improvement. Additional modules include LiteLLM Observatory (24-hour load testing), LiteLLM Semantic Caching (Valkey/AWS ElastiCache), LiteLLM Lite-Harness SDK (unified coding agent API), and LiteLLM Managed Agents Platform (alpha). The platform delivers AI gateway capabilities including spend tracking, rate limiting, load balancing, fallbacks, LLM guardrails, key management, and observability across OpenAI, Anthropic Claude, Google Gemini, AWS Bedrock, Azure, Mistral, DeepSeek, and 70+ other LLM providers.

Product and service7 records
1LiteLLM AI Gateway (Proxy)
CategoryAI Gateway / Proxy
Description

Unified AI gateway and proxy server providing OpenAI-compatible API access to 100+ LLM providers with model routing, automatic fallbacks, spend tracking, rate limiting, and observability. Designed for platform and DevOps teams and AI application developers who need centralized multi-provider LLM access. Offered as MIT-licensed open source and as an Enterprise tier.

2LiteLLM Python SDK
CategoryAI SDK
Description

Python client library for calling LLMs directly (without the proxy) via litellm.completion(), litellm.embeddings(), and other unified functions supporting 100+ providers with OpenAI-compatible format. Built for AI application developers who want unified calls inside their own code rather than a hosted proxy.

3LiteLLM Agent Platform
CategoryAI Agent Platform
Description

Alpha-stage platform for deploying and managing autonomous AI agents with natural-language commands, enabling AI agents to create users, teams, keys, models, and MCP servers via the LiteLLM proxy. Targets organizations running agentic AI workflows.

4LiteLLM Rust Gateway
CategoryAI Gateway / Proxy
Description

Performance-optimized Rust implementation of the LiteLLM AI gateway offering sub-1ms overhead, sub-100MB memory footprint, 15x throughput improvement (453 to 6,782 requests/sec) and 11x memory reduction (359MB to 32MB). Maintains the same config.yaml, database, client API, and provider coverage as the Python gateway, targeting high-volume production LLM proxy deployments.

5LiteLLM Observatory
CategoryReliability Engineering Tooling
Description

Long-running 24-hour load-testing system used internally by LiteLLM to validate releases and catch regressions before deployment; positioned as part of the stability-first release process for the AI gateway.

6LiteLLM Semantic Caching
CategoryLLM Cost Optimization
Description

Semantic caching layer on Valkey and AWS ElastiCache (Redis) that caches semantically similar LLM responses to reduce cost and latency by avoiding redundant provider calls across the gateway.

7LiteLLM MCP Gateway
CategoryAI Agent Infrastructure
Description

Model Context Protocol (MCP) gateway endpoint (/mcp) that enables AI agents to connect to tools and resources via the MCP standard, supporting Anthropic Skills API endpoints (/skills) and agent-to-agent (A2A) communication. Targets organizations running agentic AI workloads on LiteLLM.

Scale indicator7 records

Each record includes

Type, Value, Description, Source

Partnership1 partner
Strategic tierCoreTypeTechnology or IntegrationAnnounced on2026-06-17
Description

CrowdStrike extended its Falcon AI Detection and Response product across LiteLLM's AI gateway to enable real-time threat detection, policy enforcement, and correlated telemetry for AI interactions. The integration places security controls at the AI gateway layer, inspecting AI traffic for prompt injection, data leakage, and manipulation risks, feeding data into CrowdStrike's Falcon Next-Gen SIEM product.

Recent move6 records

Each record includes

Date, Type, Title, Description, Source

Expansion highlight6 records

Each record includes

Type, Description

Peers10 records
TypeBroad incumbent
Description

Cloudflare's AI Gateway provides caching, rate limiting, and analytics across LLM providers as part of Cloudflare's broader edge and developer platform. It overlaps directly with LiteLLM's gateway features but is bundled into a much larger platform.

TypeEmerging player
Description

Unify is an emerging AI routing and cost-optimization platform that routes requests across LLM providers for cost and latency optimization. It competes with LiteLLM's auto-routing, cost attribution, and budget enforcement features.

TypeEmerging player
Description

Helicone is an LLM observability and gateway platform offering request logging, caching, rate limits, and routing across providers. It overlaps with LiteLLM's observability, caching, and routing modules and targets a similar developer persona.

TypeDirect peer
Description

OpenRouter provides unified routing and billing across 100+ LLMs through a single OpenAI-compatible API. It competes head-on with LiteLLM's core value proposition of provider abstraction, with a hosted (vs. self-host) model.

TypeEmerging player
Description

TrueFoundry is an AI/ML deployment and serving platform that includes LLM gateway, routing, and governance features. It overlaps with LiteLLM's enterprise gateway, spend tracking, and governance modules.

TypeBroad incumbent
Description

Google Vertex AI provides model serving, routing across multiple foundation models, and enterprise governance features as part of Google Cloud. It competes as a broad incumbent platform offering capabilities overlapping with LiteLLM's gateway and enterprise tier.

TypeBroad incumbent
Description

Kong is an established API gateway vendor that has extended its platform to provide AI/LLM routing, policy enforcement, and observability. It competes as a broader API infrastructure incumbent rather than an LLM-native specialist.

TypeDirect peer
Description

Portkey is a venture-backed AI gateway offering unified LLM routing, observability, guardrails, and cost tracking across providers. It is the most direct functional competitor to LiteLLM's gateway/proxy product for production AI workloads.

TypeEmerging player
Description

Martian provides intelligent LLM routing that automatically selects providers and models based on cost, latency, and quality. It overlaps with LiteLLM's model-routing and fallback capabilities for production AI workloads.

TypeBroad incumbent
Description

AWS Bedrock is a managed foundation-model service that includes model routing, guardrails, and cost controls as part of the AWS ecosystem. It serves as a broad incumbent alternative to LiteLLM for AWS-centric enterprises.

Market position
Strengths5 records

Each record includes

Headline, Details, Source

Weaknesses5 records

Each record includes

Headline, Details, Source

Competitive moat5 records

Each record includes

Type, Details

Key risks7 records

Each record includes

Headline, Details, Source

Key highlights7 records

Each record includes

Headline, Details, Source

Customer concentration

Classification, Details

Named customers2 records

Each record includes

Name, Industry, Type, Use case, Source, UUID

Segment2 records

Each record includes

Title, Type, Primary, Description, Pain point addressed, Use case, Source

Ideal customer profile2 records

Each record includes

Profile, Firmographic size, Sales motion, Sales cycle length, Buying structure, Purchase trigger, Buyer persona, Geography, Industry vertical, Primary use case, Description, Pain points, Evidence proof points, Target buyer

Technology focused
Yes
API detail
Has APIbool
Yes

Docs URL, Description

Integration27 records

Each record includes

Title, Type, Description, Source

AI capability15 records

Each record includes

Type, Description, Source

AI maturity
App detail

Has app

Feature9 records

Each record includes

Title, Differentiator, Description, Source

Core technology
Revenue estimate
Valuation estimate
Number of profiles
Profiles2 records

Each record includes

Name, Designation, Designation category, Overview, Profile commentary, Source

No data
Compliance4 records

Each record includes

Name, Class, Description

Funding overview

Funding stage, Last funding date, Total funding USD

Funding rounds

Each record includes

Round, Amount USD, Date, Pre money valuation, Total investors, Investors, News

Investors

Each record includes

Name, Type, Date of entry, Rounds participated, Website

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

M&A

Each record includes

Name, Acquisition type, Announced date, Completed date, Status, Website, News

Investment

Each record includes

Name, Round, Announced date, Lead investor, Website, News

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

LiteLLM

AI Infrastructure / LLM Gatewaylitellm.ai

LiteLLM is an open-source AI gateway providing unified, OpenAI-compatible API access to 100+ LLM providers, serving platform engineering and AI development teams with model routing, spend tracking, fallbacks, and enterprise governance.

What LiteLLM does

LiteLLM is an open-source AI gateway that provides a unified, OpenAI-compatible API interface across more than 100 large language model providers, including OpenAI, Anthropic, Google Gemini, AWS Bedrock, Azure OpenAI, Mistral, and DeepSeek. Operated by Berrie AI Incorporated and founded in 2023, the company is headquartered in San Francisco, backed by Y Combinator as part of its W24 cohort, and operates with a small team of 1-10 employees. Its core product, the LiteLLM AI Gateway (Proxy), is an MIT-licensed Python/FastAPI server that handles model routing, automatic fallbacks during provider outages, per-key/user/team spend attribution, virtual key management with budgets and rate limits, LLM guardrails, Prometheus metrics, and audit logging. A complementary Python SDK enables direct provider-agnostic LLM calls without the proxy. The product has achieved substantial open-source distribution — 40K GitHub stars, 240M+ Docker pulls, 1B+ gateway requests, and 1,005+ contributors — making it one of the most widely adopted LLM routing layers in the developer ecosystem.

The company monetizes through a two-tier model: a free open-source core targeting self-serve developer adoption, and an Enterprise tier (custom pricing, annual contracts, 30-day trials) that adds SSO/SAML, audit logs, key rotation, custom SLAs, enhanced support, and is available cloud-hosted or self-hosted. Distribution combines PLG channels (GitHub, PyPI, Docker Hub) with enterprise direct sales and listings on AWS Marketplace and Azure Marketplace. The product portfolio has expanded beyond the core gateway into adjacent modules including a Rust-based performance-optimized gateway (early beta, ~15x throughput improvement), an Agent Platform for autonomous-agent lifecycle management (alpha), MCP Gateway, LiteLLM Skills, semantic caching on Valkey/ElastiCache, the LiteLLM Observatory load-testing system, and componentized data-plane/control-plane deployments. Strategic partnerships with CrowdStrike (security), Akto (AI agent security), and DigitalOcean (ecosystem) extend the platform's reach. Notable customers include Netflix and Lemonade. Compliance posture includes SOC 2 Type I/II and ISO 27001 certifications.

LiteLLM firmographics

Firmographics
Name
LiteLLM
Legal name
Berrie AI Incorporated
Website
https://litellm.ai
Company type
Private
Founded year
2023
Operating status
Operating
Headcount range
11–50 employees
Short description
LiteLLM is an open-source AI gateway providing unified, OpenAI-compatible API access to 100+ LLM providers, serving platform engineering and AI development teams with model routing, spend tracking, fallbacks, and enterprise governance.
Ownership category
akta.pro rank

LiteLLM industry classification

Industry
Product category
AI Infrastructure / LLM Gateway
NAICS
Computer Systems Design and Related Services (5415), Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services (518)
SIC
Services-Prepackaged Software (7372)
akta.pro industry
PRIMARYHDAEANAD
LLMOps & Generative AI Platforms (Prompt/Agent Orchestration, RAG)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
SECONDARYBPAEAHAH
MLOps/LLMOps & Model Lifecycle Management Services
SECONDARYHDAIAFAI
Network Performance, Visibility & SLA Monitoring (Managed NPM/Observability)
Hardware, Technology & Telecom/Telecommunications & Network Services/Data & IP Network Services (MPLS, SD-WAN, Ethernet)

Keywords

  • AI gateway software
  • LLM proxy
  • Unified LLM API
  • LLM cost management
  • Multi-provider routing

Where LiteLLM is headquartered

Location

Headquarters

HQ city
San Francisco
HQ country
United States
HQ region
North America

Markets served

LiteLLM business model

Business model
GTM type
B2B
Offering type
Software
Cost components
Personnel, Technology or R&D, Infrastructure, Marketing or Sales, Operations

Revenue model

  1. Open Source (MIT License): Free, open-source AI gateway downloadable from GitHub, PyPI, and Docker Hub. Users self-host and manage their own infrastructure. Revenue is indirect through enterprise adoption leading to paid cloud/managed offerings.
  2. Enterprise Subscription: Enterprise tier with custom pricing including SSO/SAML, audit logs, custom SLAs, enhanced support, and all enterprise features. Sold via direct sales with 30-day trial. Available as cloud-hosted or self-hosted deployment. Revenue is subscription-based, billed annually or multi-year.

Pricing tiers

ModelBillingPrice
FreemiumOthersFree, open-source AI gateway for developers
SubscriptionAnnualEnterprise-grade AI gateway with custom SLAs and support

Go-to-market motion2 records

Distribution channels4 records

Marketing channels6 records

LiteLLM product offering

Product offering

Core offering

LiteLLM provides an open-source AI gateway (Python FastAPI proxy server) and Python SDK that deliver a unified, OpenAI-compatible interface to call 100+ LLM providers (OpenAI, Anthropic, Azure, Bedrock, Gemini, Vertex, Mistral, DeepSeek, and others). The platform adds routing with automatic fallbacks, per-key/user/team spend tracking and attribution, virtual API key management with budgets and rate limits, LLM guardrails, Prometheus observability, audit logs, and enterprise controls (SSO/SAML, JWT, key rotation). A paid Enterprise tier adds custom SLAs, SSO, audit logs, and dedicated support, deployed cloud-hosted or self-hosted.

Product overview

LiteLLM is an AI gateway platform providing unified API access to 100+ LLM providers via OpenAI-compatible format. The product portfolio consists of the open-source MIT-licensed LiteLLM Python SDK (direct client library) and LiteLLM AI Gateway/Proxy (self-hosted gateway server) as core products, with LiteLLM Enterprise tier adding SSO/SAML, Audit Logs, Key Rotation, and custom SLAs. The LiteLLM Agent Platform (alpha) enables natural-language-driven AI agent management, built on the LiteLLM MCP Gateway and LiteLLM Skills for Anthropic Claude Code integration. LiteLLM Rust Gateway (early beta) offers a performance-optimized Rust implementation with sub-1ms overhead and 15x throughput improvement. Additional modules include LiteLLM Observatory (24-hour load testing), LiteLLM Semantic Caching (Valkey/AWS ElastiCache), LiteLLM Lite-Harness SDK (unified coding agent API), and LiteLLM Managed Agents Platform (alpha). The platform delivers AI gateway capabilities including spend tracking, rate limiting, load balancing, fallbacks, LLM guardrails, key management, and observability across OpenAI, Anthropic Claude, Google Gemini, AWS Bedrock, Azure, Mistral, DeepSeek, and 70+ other LLM providers.

Differentiator

Problem solved

Functional benefit

Products and services

  • LiteLLM AI Gateway (Proxy) Unified AI gateway and proxy server providing OpenAI-compatible API access to 100+ LLM providers with model routing, automatic fallbacks, spend tracking, rate limiting, and observability. Designed for platform and DevOps teams and AI application developers who need centralized multi-provider LLM access. Offered as MIT-licensed open source and as an Enterprise tier.
  • LiteLLM Python SDK Python client library for calling LLMs directly (without the proxy) via litellm.completion(), litellm.embeddings(), and other unified functions supporting 100+ providers with OpenAI-compatible format. Built for AI application developers who want unified calls inside their own code rather than a hosted proxy.
  • LiteLLM Agent Platform Alpha-stage platform for deploying and managing autonomous AI agents with natural-language commands, enabling AI agents to create users, teams, keys, models, and MCP servers via the LiteLLM proxy. Targets organizations running agentic AI workflows.
  • LiteLLM Rust Gateway Performance-optimized Rust implementation of the LiteLLM AI gateway offering sub-1ms overhead, sub-100MB memory footprint, 15x throughput improvement (453 to 6,782 requests/sec) and 11x memory reduction (359MB to 32MB). Maintains the same config.yaml, database, client API, and provider coverage as the Python gateway, targeting high-volume production LLM proxy deployments.
  • LiteLLM Observatory Long-running 24-hour load-testing system used internally by LiteLLM to validate releases and catch regressions before deployment; positioned as part of the stability-first release process for the AI gateway.
  • LiteLLM Semantic Caching Semantic caching layer on Valkey and AWS ElastiCache (Redis) that caches semantically similar LLM responses to reduce cost and latency by avoiding redundant provider calls across the gateway.
  • LiteLLM MCP Gateway Model Context Protocol (MCP) gateway endpoint (/mcp) that enables AI agents to connect to tools and resources via the MCP standard, supporting Anthropic Skills API endpoints (/skills) and agent-to-agent (A2A) communication. Targets organizations running agentic AI workloads on LiteLLM.

Quantifiable outcome

  • Day 0 model deployment — new LLM models available within 1 day of release without per-model integration work
  • +4 more outcomes

Companies that use LiteLLM

Customer profile

Named customers2 records

Segments2 records

Ideal customer profiles2 records

LiteLLM technology and API

Technology

Technology focussed Yes

API detail

Has API
Yes
API docs
API detail

Core technology

AI maturity

App detail

Integration27 records

AI capability15 records

Feature9 records

LiteLLM partnerships and signals

Strategic signal

Partnerships

One partnership is on record.

  • CrowdStrikecoreTechnology or Integration · 17 June 2026CrowdStrike extended its Falcon AI Detection and Response product across LiteLLM's AI gateway to enable real-time threat detection, policy enforcement, and correlated telemetry for AI interactions. The integration places security controls at the AI gateway layer, inspecting AI traffic for prompt injection, data leakage, and manipulation risks, feeding data into CrowdStrike's Falcon Next-Gen SIEM product.

Scale indicators7 records

Recent moves6 records

Expansion highlights6 records

LiteLLM competitors and assessment

Company assessment

Broad incumbents

  • Cloudflare AI Gateway: Cloudflare's AI Gateway provides caching, rate limiting, and analytics across LLM providers as part of Cloudflare's broader edge and developer platform. It overlaps directly with LiteLLM's gateway features but is bundled into a much larger platform.
  • Google Vertex AI: Google Vertex AI provides model serving, routing across multiple foundation models, and enterprise governance features as part of Google Cloud. It competes as a broad incumbent platform offering capabilities overlapping with LiteLLM's gateway and enterprise tier.
  • Kong (Kong AI Gateway): Kong is an established API gateway vendor that has extended its platform to provide AI/LLM routing, policy enforcement, and observability. It competes as a broader API infrastructure incumbent rather than an LLM-native specialist.
  • AWS Bedrock: AWS Bedrock is a managed foundation-model service that includes model routing, guardrails, and cost controls as part of the AWS ecosystem. It serves as a broad incumbent alternative to LiteLLM for AWS-centric enterprises.

Emerging players

  • Unify AI: Unify is an emerging AI routing and cost-optimization platform that routes requests across LLM providers for cost and latency optimization. It competes with LiteLLM's auto-routing, cost attribution, and budget enforcement features.
  • Helicone: Helicone is an LLM observability and gateway platform offering request logging, caching, rate limits, and routing across providers. It overlaps with LiteLLM's observability, caching, and routing modules and targets a similar developer persona.
  • TrueFoundry: TrueFoundry is an AI/ML deployment and serving platform that includes LLM gateway, routing, and governance features. It overlaps with LiteLLM's enterprise gateway, spend tracking, and governance modules.
  • Martian: Martian provides intelligent LLM routing that automatically selects providers and models based on cost, latency, and quality. It overlaps with LiteLLM's model-routing and fallback capabilities for production AI workloads.

Direct peers

  • OpenRouter: OpenRouter provides unified routing and billing across 100+ LLMs through a single OpenAI-compatible API. It competes head-on with LiteLLM's core value proposition of provider abstraction, with a hosted (vs. self-host) model.
  • Portkey: Portkey is a venture-backed AI gateway offering unified LLM routing, observability, guardrails, and cost tracking across providers. It is the most direct functional competitor to LiteLLM's gateway/proxy product for production AI workloads.

Market position

Strengths5 records

Weaknesses5 records

Competitive moat5 records

Key risks7 records

Key highlights7 records

Customer concentration

LiteLLM social profiles

Digital presence

LiteLLM compliance and trust

Trust signal

Compliance4 records

LiteLLM financial estimates

Financial estimate

Revenue estimate

Valuation estimate

LiteLLM leadership team

Management profile

Number of profiles

Profiles2 records

LiteLLM funding detail

Funding detail

Funding overview

Funding rounds

Investors

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

LiteLLM M&A and investment

M&A and investment

M&A

Investments

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Frequently asked questions about LiteLLM

What does LiteLLM do?

LiteLLM provides an open-source AI gateway (Python FastAPI proxy server) and Python SDK that deliver a unified, OpenAI-compatible interface to call 100+ LLM providers (OpenAI, Anthropic, Azure, Bedrock, Gemini, Vertex, Mistral, DeepSeek, and others). The platform adds routing with automatic fallbacks, per-key/user/team spend tracking and attribution, virtual API key management with budgets and rate limits, LLM guardrails, Prometheus observability, audit logs, and enterprise controls (SSO/SAML, JWT, key rotation). A paid Enterprise tier adds custom SLAs, SSO, audit logs, and dedicated support, deployed cloud-hosted or self-hosted.

Is LiteLLM a public or private company?

LiteLLM is a private company. It is classified as venture growth investor backed and is currently operating.

When was LiteLLM founded?

LiteLLM was founded in 2023. It employs 11 to 50 people.

Where is LiteLLM based?

LiteLLM is headquartered in San Francisco, United States, in the North America region.

How does LiteLLM make money?

Two revenue lines are on record. Open Source (MIT License) is the primary driver. The others are enterprise Subscription.

Who are LiteLLM's main competitors?

Broad incumbents on record are Cloudflare AI Gateway, Google Vertex AI, Kong (Kong AI Gateway) and AWS Bedrock. Emerging players are Unify AI, Helicone, TrueFoundry and Martian. Direct peers are OpenRouter and Portkey.

Does LiteLLM have an API?

Yes. REST API with OpenAI-compatible endpoints (/v1/chat/completions, /v1/completions, /v1/embeddings, /v1/responses, /v1/messages, /assistants, /audio/transcriptions, /audio/speech, /batches, /embeddings, /images, /rerank, /moderations, /skills, /search, /mcp, /a2a, /memory, /realtime, /rag/ingest, /rag/query, /vector_stores, /files, /fine_tuning, /evals). Supports Virtual Keys (sk- prefixed), OIDC/JWT-based Auth, Role-based Access Controls (RBAC), Service Accounts, and CLI/SSO authentication. Management API for keys, teams, users, models, spend logs, and audit logs. Separate Prometheus-compatible /metrics endpoint. Anthropic Skills API endpoints via /skills. MCP Gateway via /mcp. Developer documentation is at docs.litellm.ai/docs.

What industry is LiteLLM in?

LiteLLM's product category is AI Infrastructure / LLM Gateway. Its primary akta.pro industry code is HDAEANAD, LLMOps & Generative AI Platforms (Prompt/Agent Orchestration, RAG), with a secondary code of BPAEAHAH, MLOps/LLMOps & Model Lifecycle Management Services. Its NAICS code is 5415 and its SIC code is 7372.

Unlock the full company data

50 free credits on sign-up, no credit card required.

Contact sales
Live signals
WikipediaBlack October (information security)October 2026 saw multiple major security incidents, including eMudhra's weak intermediate CA keys, PHP2Shell vulnerabilities, and a LiteLLM supply-chain attack. The eMudhra incident led to browser revocations and the company's withdrawal from the SSL/TLS business, while PHP2Shell required urgent patching.Naver[테크톡노트] 공식 경로로 받았는데 악성코드…AI 공급망의 허점Hackers compromised the official distribution of LiteLLM, an AI model integration tool, injecting malicious code into version 1.107.0. The attack exposed authentication information and allowed remote code execution, with the malicious package estimated to have been downloaded about 49,000 times. The developer has removed the infected version, but users who installed it may need additional security checks.ITWebOctober's cyber scares are the new realityOctober saw multiple cyber scares: a Railway cloud platform breach, critical PHP vulnerabilities, a malicious LiteLLM release, and Ahold Delhaize taking its websites offline. Attackers target trusted platforms and credentials, prompting Flowgear to promote SOC 2 Type II audits and centralized secret management.The Hacker NewsRadio With No Radar: Why Agent Runtime Security Fails Without the Layers Beneath ItAgent runtime security must be distributed across platform hooks, not a single gateway, because agents run inside third-party platforms. A LiteLLM compromise exposed over 2,500 organizations, and Reco's discovery approach moved posture from 47% to 91% across 21 platforms in 30 days.ScworldHow our cyber Black October resembled the crash of 1987 — and how teams should respondOn October 22, multiple critical vulnerabilities in PHP, LiteLLM, and Railway were exposed, prompting a cybersecurity event dubbed Black October. The author compares the coordinated attacks to the 1987 Black Monday crash, arguing security teams should pre-approve circuit breakers and isolation rules to avoid reactive measures.Security BoulevardLiteLLM’s Second Breach Began With a Key Nobody RevokedLiteLLM's PyPI package 1.107.0 was poisoned on October 21, 2026, after an unrevoked admin key exposed since May 27 was used to steal a GitHub owner token. The stealer collected cloud credentials, Kubernetes files, and provider keys from about 49,000 downloads. Microsoft advises rebuilding environments and rotating all credentials.Cyber Security NewsHacktober – Cyberattack Wave Hits PHP, Node.js, Binance, LiteLLM, Pentagon, and a Few MoreOctober saw a wave of cybersecurity incidents affecting Binance, PHP, LiteLLM, and others. Binance investigated $6.3 billion in unauthorized transactions, while PHP and Node.js received emergency patches. The Pentagon and Denmark also disclosed sensitive record breaches.WikipediaBlack October (information security)October 2026 saw major security incidents, including eMudhra's weak intermediate CA keys, PHP2Shell vulnerabilities, a LiteLLM supply-chain attack, and a GitLab remote code execution flaw. The eMudhra incident led to browser revocations and the company's withdrawal from SSL/TLS, while PHP patches were released urgently.MediaNamaAI hacking claims around PHP, Railway and LiteLLM lack evidenceThe author argues that recent hacks of eMudhra, Railway, and LiteLLM lack evidence of AI involvement, citing no claims of AI-assisted attacks. He notes that AI helps defenders find and patch vulnerabilities faster, and that non-technical users cannot easily exploit CVEs without tooling.Crypto BriefingLiteLLM traces supply chain attack to a GitHub key nobody revokedLiteLLM traced a supply chain attack to a master key left active for 136 days, which an attacker used to poison a release. The malicious version was downloaded an estimated 49,000 times before being yanked. The attack included a credential-stealing component and a backdoor.