TrueFoundry
TrueFoundry provides a Kubernetes-native enterprise AI infrastructure platform combining an AI Gateway, MCP Gateway, and Agent Gateway to deploy, govern, and scale production LLM and agentic AI workloads across cloud, on-prem, and air-gapped environments for Fortune 1000 enterprises.
- Company typePrivate
- Founded2022
- HeadquartersSan Francisco, United States
- Headcount11–50
- GTM typeB2B
- OfferingSoftware
What TrueFoundry does
TrueFoundry (legal entity Ensemble Labs Inc.) is a San Francisco-based enterprise AI infrastructure company founded in 2022 that provides a Kubernetes-native platform built around a unified AI Gateway, MCP Gateway, and Agent Gateway for governing, deploying, and scaling production LLM and agentic AI workloads. Its split-plane architecture keeps a control plane for orchestration while running compute inside the customer's VPC, on-prem, or air-gapped environment, supporting inference backends such as vLLM, TGI, Triton, SGLang, and TensorRT-LLM. The platform consolidates multi-model routing, semantic caching, RBAC, immutable audit logging, GPU orchestration with fractional GPU support, and a managed agent runtime (Agent Harness) for plan-act-observe loops with sandboxing and approvals. TrueFoundry reports processing over 10 billion requests per month and more than 1 trillion tokens per day across 1,000+ clusters at ~3–4 ms gateway latency, and is the first AI Gateway provider to offer ITAR-compliant deployments alongside SOC 2, HIPAA, and GDPR certifications.
The company sells primarily through enterprise subscriptions with custom multi-year contracts to Fortune 1000 customers — including NVIDIA, Siemens Healthineers, Resmed, Automation Anywhere, Games 24x7, Cargill, Aviva, Mavenir, and Whatfix — supplemented by a self-serve PLG funnel (free instant sandbox, starting subscription around $499/month), cloud marketplace listings on AWS and Azure, and a VAR/VAD partner program. Revenue streams combine managed AI Gateway subscriptions, enterprise platform licensing deployed in customer environments, professional services for regulated and air-gapped rollouts, and marketplace consumption-based resale. Strategic distribution and security integrations with CrowdStrike Falcon AIDR, Palo Alto Networks Prisma AIRS, and Akto extend the platform's positioning as a centralized governance layer for enterprise AI traffic.
TrueFoundry has raised $21 million in total disclosed funding, including a $19 million Series A in February 2025 led by Intel Capital with participation from Eniac Ventures, Peak XV's Surge, and Jump Capital (Intel Capital's Avi Bharadwaj joined the board). The company has executed one acquisition — UK-based MLOps vendor Seldon AI in June 2026 — to unify traditional ML and agentic AI workloads, and has been recognized as a Representative Vendor in the 2025 Gartner Market Guide for AI Gateways, named in the Gartner Hype Cycle for Platform Engineering 2026, and won 'LLM Platform of the Year' at the 2026 AI Breakthrough Awards. Operations span North America, India (Chennai), and the UK via Seldon AI, with multilingual website presence supporting broader global reach.
TrueFoundry firmographics
Firmographics- Name
- TrueFoundry
- Legal name
- Ensemble Labs Inc.
- Website
- https://truefoundry.com
- Company type
- Private
- Founded year
- 2022
- Operating status
- Operating
- Headcount range
- 11–50 employees
- Short description
- TrueFoundry provides a Kubernetes-native enterprise AI infrastructure platform combining an AI Gateway, MCP Gateway, and Agent Gateway to deploy, govern, and scale production LLM and agentic AI workloads across cloud, on-prem, and air-gapped environments for Fortune 1000 enterprises.
- Ownership category
- akta.pro rank
TrueFoundry industry classification
Industry- Product category
- AI Gateway & AI Infrastructure
- NAICS
- Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services (5182), Computer Systems Design Services (541512), Software Publishers (51321)
- SIC
- Services-Computer Programming, Data Processing, Etc. (7370), Services-Computer Integrated Systems Design (7373)
- akta.pro primary industry
- Model Serving, Inference & Deployment Platforms (APIs, Edge/On-Prem) (HDAEANAC)
- akta.pro secondary industries
- AI Application Enablement Platforms (Copilot/Agent Frameworks, SDKs) (HDAEANAJ), AI Compute Virtualization & Scheduling (GPU virtualization, cluster schedulers) (HDAAAAAG), AI/ML Solution Integration & MLOps Enablement (BPAEAAAJ), Identity, Access & Secrets Management for AI Systems (IAM for agents/models) (HDAAAKAJ)
Keywords
Where TrueFoundry is headquartered
LocationHeadquarters
- HQ city
- San Francisco
- HQ country
- United States
- HQ region
- North America
Offices2 records
Markets served
TrueFoundry business model
Business model- GTM type
- B2B
- Offering type
- Software
- Cost components
- Personnel
Revenue model
- Managed AI Gateway Subscription: Recurring subscription to TrueFoundry's managed AI Gateway with enterprise features starting at approximately $499 per month, sold versus open-source LiteLLM alternatives.
- Enterprise Platform Licensing: Enterprise contracts to Fortune 1000 customers (NVIDIA, Siemens Healthineers, Resmed, Automation Anywhere, Games 24x7) for the full AI Gateway, MCP Gateway, Agent Gateway, deployment, and fine-tuning platform, with deployment in customer's VPC, on-prem, or air-gapped environments.
- Professional Services / Implementation: Enterprise-grade 24/7 support with SLA-backed response and implementation services for regulated, on-prem, and air-gapped deployments.
- Cloud Marketplace Channel Sales: Listing and consumption-based resale through AWS, Azure, and other cloud marketplaces alongside direct sales.
Pricing tiers
| Model | Billing | Price |
|---|---|---|
| Subscription | Monthly | Managed AI Gateway subscription starting at ~$499/month |
| Other | Multi-year contract | Enterprise / custom platform licensing |
| Freemium | Pay-as-you-go | Free live sandbox / self-serve signup |
Go-to-market motion1 record
Distribution channels5 records
Marketing channels10 records
TrueFoundry product offering
Product offeringCore offering
TrueFoundry provides a Kubernetes-native enterprise AI infrastructure platform centered on an AI Gateway, MCP Gateway, and Agent Gateway that consolidates LLM deployment, multi-model routing, traffic management, agent governance, and observability across providers such as Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, and Azure OpenAI. It additionally offers an AI Deployment Platform, Training & Fine-Tuning, and an Agent Harness runtime for production AI and agentic workloads, deployable in customer VPC, on-prem, hybrid, or air-gapped environments.
Product overview
TrueFoundry is a platform-plus-modules enterprise AI infrastructure offering built on Kubernetes that combines a unified AI Gateway control plane with an Agent Platform, an ML/LLMOps platform for training and deployment, and an underlying observability and governance layer. The core is the AI Gateway, which consolidates deployment, multi-model access, and traffic management across providers (Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI). On top of the AI Gateway sit the MCP Gateway (governing Model Context Protocol tool servers and registries), the Agent Gateway (governing agent-to-agent traffic with per-agent identity, RBAC, quotas, and tracing), Prompt Management, and the Agent Skills Registry. The Agent Harness is the runtime that orchestrates managed AI agents with sandboxing, approvals, and tracing; the Agent Registry provides unified discovery of TrueFoundry-native and remote agents (A2A or HTTP frameworks). The deployment side includes an AI Deployment Platform, Model Serving, Training & Fine-Tuning (one-click LLM deployment and fine-tuning on Kubernetes), a Tracing module for OpenTelemetry-based observability, and an LLMOps stack (including TrueFailover for model-outage failover). Acquired Seldon AI extends the platform with production-grade MLOps, and the underlying TrueFoundry ML Platform (Jobs, Model Registry, Services, Workflows, Volumes) supports general ML and time-series workloads.
Differentiator
Problem solved
Functional benefit
Brands
- AI Gateway: Unified AI gateway product for governing, routing, and observing model, MCP-tool, and agent-to-agent traffic in enterprise environments.
- MCP Gateway
- Agent Gateway
- TrueFailover
- Agent Harness
Products and services
- AI Gateway Centralized Kubernetes-native control plane consolidating LLM deployment, multi-model access, traffic management, semantic caching, intelligent failover, RBAC, budget enforcement, prompt templating, and guardrails across Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI, and self-hosted models; exposes OpenAI- and Anthropic-compatible endpoints.
- MCP Gateway Governed gateway for Model Context Protocol (MCP) servers that centralizes discovery, authentication, RBAC, request-level tracing, and lifecycle management (Apps and Tasks extensions) for both internal and third-party MCP servers.
- Agent Gateway Unified control plane for agent-to-agent traffic that gives agents per-agent identity, RBAC, token/cost quotas, retries, timeouts, loop safeguards, and end-to-end tracing across multi-agent systems; governs east-west A2A traffic and integrates with the AI Gateway and MCP Gateway.
- AI Deployment Platform Kubernetes-native platform for deploying any AI model, agent, or MCP server with autoscaling, canary deployments, and observability; supports hosting LLMs via vLLM, TGI, or Triton and deploying agents built with LangGraph, CrewAI, and AutoGen.
- Training & Fine-Tuning Launch fine-tuning jobs on user data, track experiments, and deploy updated checkpoints directly to production through the unified AI Deployment Platform; supports one-click fine-tuning of open-source LLMs from Hugging Face (Llama, Mistral, Phi).
- TrueFailover Add-on module to the AI Gateway that automatically routes AI traffic around model outages, regional failures, and API degradations with multi-model, multi-region, multi-cloud failover, health monitoring, latency tracking, and caching.
- Agent Harness Managed runtime layer on top of the AI Gateway and MCP Gateway that orchestrates plan-act-observe agent loops with sandboxing, approvals, the Agent Skills Registry, subagents, human-in-the-loop gates, and end-to-end tracing; no API keys are stored in agent definitions.
Companies that use TrueFoundry
Customer profileNamed customers14 records
Segments8 records
Ideal customer profiles2 records
TrueFoundry technology and API
TechnologyTechnology focussed Yes
API detail
- Has API
- Yes
- API docs
- API detail
Core technology
AI maturity
App detail
Integration15 records
AI capability5 records
Feature8 records
TrueFoundry partnerships and signals
Strategic signalPartnerships
Eleven partnerships are on record, tiered flagship and core.
- Seldon AIflagshipAcquired in June 2026 to combine Seldon's production-grade Kubernetes-native MLOps foundation with TrueFoundry's AI Gateway control plane, enabling agentic AI capabilities for enterprise customers (financial institutions, healthcare, retail) without replacing their existing Kubernetes infrastructure.
- CrowdStrikeflagshipCrowdStrike extended its Falcon AI Detection and Response (AIDR) across TrueFoundry's AI Gateway to provide real-time threat detection, prompt injection defense, data leakage prevention, and policy enforcement — with telemetry feeding CrowdStrike's Falcon Next-Gen SIEM.
- Google CloudcoreCrowdStrike's Falcon AIDR integration partner alongside TrueFoundry; Google Cloud is also a deployment target via the AI Gateway.
- Microsoft AzurecoreCrowdStrike's Falcon AIDR integration partner alongside TrueFoundry; Azure is also a deployment target via the AI Gateway.
- AktocoreAkto's runtime guardrails, continuous discovery, and observability for AI agents are embedded natively into TrueFoundry's platform to protect against prompt injection, uncontrolled tool access, and sensitive data leakage.
- LangChaincoreCo-integrated with Akto to expand AI Agent Security; part of the same set of native runtime integrations alongside TrueFoundry.
- PortkeycoreCo-integrated with Akto to expand AI Agent Security; part of the same set of native runtime integrations alongside TrueFoundry.
- LiteLLMcoreCo-integrated with Akto to expand AI Agent Security; also covered in CrowdStrike's Falcon AIDR extension across AI gateways.
- Palo Alto Networks (Prisma AIRS)flagshipIntegration between Palo Alto Networks' Prisma AIRS security platform and TrueFoundry's AI Gateway providing real-time prompt injection detection, data loss prevention, and output filtering through a centralized single-integration platform.
- AWS (Amazon Web Services)flagshipDedicated AWS partner page on the TrueFoundry website; TrueFoundry supports deployment on customer AWS infrastructure for multi-cloud orchestration.
- Microsoft AzureflagshipDedicated Azure partner page on the TrueFoundry website; TrueFoundry supports deployment on customer Azure infrastructure and routes to Azure OpenAI.
Scale indicators8 records
Recent moves6 records
Expansion highlights6 records
TrueFoundry competitors and assessment
Company assessmentDirect peers
- Portkey: Portkey is a direct AI gateway competitor offering LLM routing, observability, caching, guardrails and failover for production AI applications. It is one of the most head-to-head comparison points on TrueFoundry's own website.
- Kong: Kong is an API gateway vendor that has added AI gateway and LLM governance capabilities, competing directly with TrueFoundry's traffic-management and policy-enforcement features. It is positioned on TrueFoundry's own comparison page.
- LiteLLM: LiteLLM is an open-source LLM proxy/gateway that TrueFoundry explicitly benchmarks and competes against on price (referenced as the primary open-source alternative with $2,000–$3,500/month self-managed TCO).
- Seldon (now part of TrueFoundry): Seldon is a UK-based production-grade MLOps platform on Kubernetes that TrueFoundry acquired in June 2026. It is the closest peer in the MLOps layer and is now part of the combined TrueFoundry platform.
Broad incumbents
- Cloudflare: Cloudflare operates a broad internet and developer platform whose Workers AI and AI Gateway products provide LLM routing, caching, and observability. It is a much larger incumbent with a global edge network and a deep enterprise channel.
- Microsoft (Azure API Management / Azure AI Gateway): Microsoft Azure offers API Management Premium tier and Azure AI Gateway features that compete for the same LLM governance and traffic-management budget. As a hyperscaler, it bundles gateway functionality with broader cloud and AI services.
- AWS (Bedrock / API Gateway): AWS Bedrock and API Gateway are used by many of the same enterprises TrueFoundry serves, and AWS is a hyperscaler with native AI gateway capabilities and a cloud marketplace channel that TrueFoundry also relies on.
- Databricks (Mosaic AI): Databricks' Mosaic AI offers model serving, governance, and AI/ML platform capabilities on a unified data + AI stack. It is a broad incumbent competing for the same enterprise AI platform budget.
Emerging players
- Helicone: Helicone is an emerging AI observability and LLM gateway product focused on logging, evaluation and routing for AI applications. It overlaps with TrueFoundry's AI Gateway on observability and routing, but with a smaller, more developer-focused footprint.
- Fiddler AI: Fiddler AI is an emerging AI observability and model governance platform for production ML and LLM systems. It competes in the same AI governance and compliance space that TrueFoundry addresses with its AI Gateway and audit features.
Market position
Strengths5 records
Weaknesses5 records
Competitive moat5 records
Key risks7 records
Key highlights7 records
Customer concentration
TrueFoundry social profiles
Digital presenceTrueFoundry compliance and trust
Trust signalCompliance4 records
TrueFoundry financial estimates
Financial estimateRevenue estimate
Valuation estimate
TrueFoundry leadership team
Management profileNumber of profiles
Profiles5 records
TrueFoundry funding detail
Funding detailFunding overview
Funding rounds2 records
Investors8 records
Funding detail is available on the Subscription and Enterprise plan.Contact sales →
TrueFoundry M&A and investment
M&A and investmentM&A1 record
Investments
M&A and investment is available on the Subscription and Enterprise plan.Contact sales →
Frequently asked questions about TrueFoundry
What does TrueFoundry do?
TrueFoundry provides a Kubernetes-native enterprise AI infrastructure platform centered on an AI Gateway, MCP Gateway, and Agent Gateway that consolidates LLM deployment, multi-model routing, traffic management, agent governance, and observability across providers such as Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, and Azure OpenAI. It additionally offers an AI Deployment Platform, Training & Fine-Tuning, and an Agent Harness runtime for production AI and agentic workloads, deployable in customer VPC, on-prem, hybrid, or air-gapped environments.
Is TrueFoundry a public or private company?
TrueFoundry is a private company. It is classified as venture growth investor backed and is currently operating.
When was TrueFoundry founded?
TrueFoundry was founded in 2022. It employs 11 to 50 people.
Where is TrueFoundry based?
TrueFoundry is headquartered in San Francisco, United States, in the North America region.
How does TrueFoundry make money?
Four revenue lines are on record. Managed AI Gateway Subscription is the primary driver. The others are enterprise Platform Licensing, professional Services / Implementation and cloud Marketplace Channel Sales.
Who are TrueFoundry's main competitors?
Direct peers on record are Portkey, Kong, LiteLLM and Seldon (now part of TrueFoundry). Broad incumbents are Cloudflare, Microsoft (Azure API Management / Azure AI Gateway), AWS (Bedrock / API Gateway) and Databricks (Mosaic AI). Emerging players are Helicone and Fiddler AI.
Does TrueFoundry have an API?
Yes. TrueFoundry offers OpenAI-compatible and Anthropic-compatible REST API endpoints through its AI Gateway, allowing developers to integrate multiple LLM providers (Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI, self-hosted models) behind a single unified endpoint. Developers can also access a Model Serving API for deployed ML models, a Forecast API for time-series predictions (SARIMAX/Prophet), a Workflow orchestration API (ArgoWorkflows-based), and an Agent Harness REST API with session creation, SSE streaming of agent progress, and integration hooks. Authentication uses scoped virtual keys; control plane endpoint format is https://.truefoundry.cloud/api/llm/v1. The platform also exposes MCP Gateway endpoints for governing Model Context Protocol servers. Developer documentation is at www.truefoundry.com/docs/introduction.
What industry is TrueFoundry in?
TrueFoundry's product category is AI Gateway & AI Infrastructure. Its primary akta.pro industry code is HDAEANAC, Model Serving, Inference & Deployment Platforms (APIs, Edge/On-Prem), with a secondary code of HDAEANAJ, AI Application Enablement Platforms (Copilot/Agent Frameworks, SDKs). Its NAICS code is 5182 and its SIC code is 7370.