Developer docs
API playgroundTry for free, no card

Search company profiles

TrueFoundry

Full company profile

uuid00008mk

Namestring
TrueFoundry
Legal namestring
Ensemble Labs Inc.
Websiteurl
truefoundry.com
Company typeenum
Private
Founded yearint
2022
Descriptiontext

TrueFoundry (legal entity Ensemble Labs Inc.) is a San Francisco-based enterprise AI infrastructure company founded in 2022 that provides a Kubernetes-native platform built around a unified AI Gateway, MCP Gateway, and Agent Gateway for governing, deploying, and scaling production LLM and agentic AI workloads. Its split-plane architecture keeps a control plane for orchestration while running compute inside the customer's VPC, on-prem, or air-gapped environment, supporting inference backends such as vLLM, TGI, Triton, SGLang, and TensorRT-LLM. The platform consolidates multi-model routing, semantic caching, RBAC, immutable audit logging, GPU orchestration with fractional GPU support, and a managed agent runtime (Agent Harness) for plan-act-observe loops with sandboxing and approvals. TrueFoundry reports processing over 10 billion requests per month and more than 1 trillion tokens per day across 1,000+ clusters at ~3–4 ms gateway latency, and is the first AI Gateway provider to offer ITAR-compliant deployments alongside SOC 2, HIPAA, and GDPR certifications.

The company sells primarily through enterprise subscriptions with custom multi-year contracts to Fortune 1000 customers — including NVIDIA, Siemens Healthineers, Resmed, Automation Anywhere, Games 24x7, Cargill, Aviva, Mavenir, and Whatfix — supplemented by a self-serve PLG funnel (free instant sandbox, starting subscription around $499/month), cloud marketplace listings on AWS and Azure, and a VAR/VAD partner program. Revenue streams combine managed AI Gateway subscriptions, enterprise platform licensing deployed in customer environments, professional services for regulated and air-gapped rollouts, and marketplace consumption-based resale. Strategic distribution and security integrations with CrowdStrike Falcon AIDR, Palo Alto Networks Prisma AIRS, and Akto extend the platform's positioning as a centralized governance layer for enterprise AI traffic.

TrueFoundry has raised $21 million in total disclosed funding, including a $19 million Series A in February 2025 led by Intel Capital with participation from Eniac Ventures, Peak XV's Surge, and Jump Capital (Intel Capital's Avi Bharadwaj joined the board). The company has executed one acquisition — UK-based MLOps vendor Seldon AI in June 2026 — to unify traditional ML and agentic AI workloads, and has been recognized as a Representative Vendor in the 2025 Gartner Market Guide for AI Gateways, named in the Gartner Hype Cycle for Platform Engineering 2026, and won 'LLM Platform of the Year' at the 2026 AI Breakthrough Awards. Operations span North America, India (Chennai), and the UK via Seldon AI, with multilingual website presence supporting broader global reach.

Short descriptiontext

TrueFoundry provides a Kubernetes-native enterprise AI infrastructure platform combining an AI Gateway, MCP Gateway, and Agent Gateway to deploy, govern, and scale production LLM and agentic AI workloads across cloud, on-prem, and air-gapped environments for Fortune 1000 enterprises.

Operating statusenum
Operating
Ownership categoryenum
Headcount rangeband
101–250
akta.pro rankint
HeadquartersSan Francisco, United States
HQ citystring
San Francisco
HQ countrystring
United States
HQ regionstring
North America
Markets served

Serves global market

Offices2 records

Each record includes

City, Country, Type, Description, Source

Keyword5 values
AI gateway platform, MCP gateway, LLM infrastructure, Kubernetes AI deployment, agent governance platform
Industry5 codes
PRIMARYHDAEANAC
Model Serving, Inference & Deployment Platforms (APIs, Edge/On-Prem)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
SECONDARYHDAEANAJ
AI Application Enablement Platforms (Copilot/Agent Frameworks, SDKs)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
SECONDARYHDAAAAAG
AI Compute Virtualization & Scheduling (GPU virtualization, cluster schedulers)
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/AI Infrastructure & Compute (GPUs/ASICs, accelerators)
SECONDARYBPAEAAAJ
AI/ML Solution Integration & MLOps Enablement
SECONDARYHDAAAKAJ
Identity, Access & Secrets Management for AI Systems (IAM for agents/models)
NAICS code3 codes
  • Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services5182
  • Computer Systems Design Services541512
  • Software Publishers51321
SIC code2 codes
  • Services-Computer Programming, Data Processing, Etc.7370
  • Services-Computer Integrated Systems Design7373
Product category
AI Gateway & AI Infrastructure
GTM motion1 record

Each record includes

Type, Description, Source

Revenue model4 records
1Managed AI Gateway Subscription
TypeSubscription Recurring
Description

Recurring subscription to TrueFoundry's managed AI Gateway with enterprise features starting at approximately $499 per month, sold versus open-source LiteLLM alternatives.

truefoundry.com
2Enterprise Platform Licensing
TypeSubscription Recurring
Description

Enterprise contracts to Fortune 1000 customers (NVIDIA, Siemens Healthineers, Resmed, Automation Anywhere, Games 24x7) for the full AI Gateway, MCP Gateway, Agent Gateway, deployment, and fine-tuning platform, with deployment in customer's VPC, on-prem, or air-gapped environments.

businesswire.com
3Professional Services / Implementation
TypeProfessional Services
Description

Enterprise-grade 24/7 support with SLA-backed response and implementation services for regulated, on-prem, and air-gapped deployments.

truefoundry.com
4Cloud Marketplace Channel Sales
TypeMarketplace Commission
Description

Listing and consumption-based resale through AWS, Azure, and other cloud marketplaces alongside direct sales.

truefoundry.com
Marketing channels10 records

Each record includes

Title, Type, Stage, Description, Source

Distribution channels5 records

Each record includes

Title, Type, Scope, Target buyer, Description, Source

Cost components1 value
Personnel
Pricing details3 tiers
1Managed AI Gateway subscription starting at ~$499/month
ModelSubscriptionBilling cadenceMonthly
Notes

Entry-level managed tier at approximately $499 per month with enterprise features; positioned against open-source LiteLLM at $2,000–$3,500/month TCO for self-managed production deployments.

truefoundry.com
2Enterprise / custom platform licensing
ModelOtherBilling cadenceMulti-year contract
Notes

Custom enterprise contracts for Fortune 1000 customers, deployed in customer VPC, on-prem, air-gapped, or hybrid environments; pricing not publicly listed.

businesswire.com
3Free live sandbox / self-serve signup
ModelFreemiumBilling cadencePay-as-you-go
Notes

Instant-access live sandbox for product trial with no credit card required, supporting self-serve evaluation and upgrade to paid tiers.

truefoundry.com
GTM typeB2B
B2B
Offering typeSoftware
Software
Brand1 of 5 records shown
1AI Gateway
Description

Unified AI gateway product for governing, routing, and observing model, MCP-tool, and agent-to-agent traffic in enterprise environments.

truefoundry.com
+4 more records
Core offering1 text field

TrueFoundry provides a Kubernetes-native enterprise AI infrastructure platform centered on an AI Gateway, MCP Gateway, and Agent Gateway that consolidates LLM deployment, multi-model routing, traffic management, agent governance, and observability across providers such as Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, and Azure OpenAI. It additionally offers an AI Deployment Platform, Training & Fine-Tuning, and an Agent Harness runtime for production AI and agentic workloads, deployable in customer VPC, on-prem, hybrid, or air-gapped environments.

Differentiator
Functional benefit
Problem solved
Product overview1 text field

TrueFoundry is a platform-plus-modules enterprise AI infrastructure offering built on Kubernetes that combines a unified AI Gateway control plane with an Agent Platform, an ML/LLMOps platform for training and deployment, and an underlying observability and governance layer. The core is the AI Gateway, which consolidates deployment, multi-model access, and traffic management across providers (Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI). On top of the AI Gateway sit the MCP Gateway (governing Model Context Protocol tool servers and registries), the Agent Gateway (governing agent-to-agent traffic with per-agent identity, RBAC, quotas, and tracing), Prompt Management, and the Agent Skills Registry. The Agent Harness is the runtime that orchestrates managed AI agents with sandboxing, approvals, and tracing; the Agent Registry provides unified discovery of TrueFoundry-native and remote agents (A2A or HTTP frameworks). The deployment side includes an AI Deployment Platform, Model Serving, Training & Fine-Tuning (one-click LLM deployment and fine-tuning on Kubernetes), a Tracing module for OpenTelemetry-based observability, and an LLMOps stack (including TrueFailover for model-outage failover). Acquired Seldon AI extends the platform with production-grade MLOps, and the underlying TrueFoundry ML Platform (Jobs, Model Registry, Services, Workflows, Volumes) supports general ML and time-series workloads.

Product and service7 records
1AI Gateway
CategoryAI Gateway
Description

Centralized Kubernetes-native control plane consolidating LLM deployment, multi-model access, traffic management, semantic caching, intelligent failover, RBAC, budget enforcement, prompt templating, and guardrails across Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI, and self-hosted models; exposes OpenAI- and Anthropic-compatible endpoints.

2MCP Gateway
CategoryAI Gateway
Description

Governed gateway for Model Context Protocol (MCP) servers that centralizes discovery, authentication, RBAC, request-level tracing, and lifecycle management (Apps and Tasks extensions) for both internal and third-party MCP servers.

3Agent Gateway
CategoryAI Gateway
Description

Unified control plane for agent-to-agent traffic that gives agents per-agent identity, RBAC, token/cost quotas, retries, timeouts, loop safeguards, and end-to-end tracing across multi-agent systems; governs east-west A2A traffic and integrates with the AI Gateway and MCP Gateway.

4AI Deployment Platform
CategoryAI Deployment Platform
Description

Kubernetes-native platform for deploying any AI model, agent, or MCP server with autoscaling, canary deployments, and observability; supports hosting LLMs via vLLM, TGI, or Triton and deploying agents built with LangGraph, CrewAI, and AutoGen.

5Training & Fine-Tuning
CategoryAI Deployment Platform
Description

Launch fine-tuning jobs on user data, track experiments, and deploy updated checkpoints directly to production through the unified AI Deployment Platform; supports one-click fine-tuning of open-source LLMs from Hugging Face (Llama, Mistral, Phi).

6TrueFailover
CategoryAI Gateway
Description

Add-on module to the AI Gateway that automatically routes AI traffic around model outages, regional failures, and API degradations with multi-model, multi-region, multi-cloud failover, health monitoring, latency tracking, and caching.

7Agent Harness
CategoryAgent Runtime
Description

Managed runtime layer on top of the AI Gateway and MCP Gateway that orchestrates plan-act-observe agent loops with sandboxing, approvals, the Agent Skills Registry, subagents, human-in-the-loop gates, and end-to-end tracing; no API keys are stored in agent definitions.

Scale indicator8 records

Each record includes

Type, Value, Description, Source

Partnership11 partners
1Seldon AI
Strategic tierFlagshipTypeStrategic or Co-development PartnerAnnounced on2026-06-25
Description

Acquired in June 2026 to combine Seldon's production-grade Kubernetes-native MLOps foundation with TrueFoundry's AI Gateway control plane, enabling agentic AI capabilities for enterprise customers (financial institutions, healthcare, retail) without replacing their existing Kubernetes infrastructure.

globalfintechseries.com
Strategic tierFlagshipTypeTechnology or IntegrationAnnounced on2026-06-17
Description

CrowdStrike extended its Falcon AI Detection and Response (AIDR) across TrueFoundry's AI Gateway to provide real-time threat detection, prompt injection defense, data leakage prevention, and policy enforcement — with telemetry feeding CrowdStrike's Falcon Next-Gen SIEM.

Strategic tierCoreTypeTechnology or IntegrationAnnounced on2026-06-17
Description

CrowdStrike's Falcon AIDR integration partner alongside TrueFoundry; Google Cloud is also a deployment target via the AI Gateway.

4Microsoft Azure
Strategic tierCoreTypeTechnology or IntegrationAnnounced on2026-06-17
Description

CrowdStrike's Falcon AIDR integration partner alongside TrueFoundry; Azure is also a deployment target via the AI Gateway.

securitybrief.com.au
Strategic tierCoreTypeTechnology or IntegrationAnnounced on2026-04-23
Description

Akto's runtime guardrails, continuous discovery, and observability for AI agents are embedded natively into TrueFoundry's platform to protect against prompt injection, uncontrolled tool access, and sensitive data leakage.

Strategic tierCoreTypeTechnology or IntegrationAnnounced on2026-04-23
Description

Co-integrated with Akto to expand AI Agent Security; part of the same set of native runtime integrations alongside TrueFoundry.

Strategic tierCoreTypeTechnology or IntegrationAnnounced on2026-04-23
Description

Co-integrated with Akto to expand AI Agent Security; part of the same set of native runtime integrations alongside TrueFoundry.

Strategic tierCoreTypeTechnology or IntegrationAnnounced on2026-04-23
Description

Co-integrated with Akto to expand AI Agent Security; also covered in CrowdStrike's Falcon AIDR extension across AI gateways.

Strategic tierFlagshipTypeTechnology or IntegrationAnnounced on2025-11-03
Description

Integration between Palo Alto Networks' Prisma AIRS security platform and TrueFoundry's AI Gateway providing real-time prompt injection detection, data loss prevention, and output filtering through a centralized single-integration platform.

Strategic tierFlagshipTypeChannel Partner/ Reseller/ Distributor
Description

Dedicated AWS partner page on the TrueFoundry website; TrueFoundry supports deployment on customer AWS infrastructure for multi-cloud orchestration.

11Microsoft Azure
Strategic tierFlagshipTypeChannel Partner/ Reseller/ Distributor
Description

Dedicated Azure partner page on the TrueFoundry website; TrueFoundry supports deployment on customer Azure infrastructure and routes to Azure OpenAI.

truefoundry.com
Recent move6 records

Each record includes

Date, Type, Title, Description, Source

Expansion highlight6 records

Each record includes

Type, Description

Peers10 records
TypeDirect peer
Description

Portkey is a direct AI gateway competitor offering LLM routing, observability, caching, guardrails and failover for production AI applications. It is one of the most head-to-head comparison points on TrueFoundry's own website.

TypeBroad incumbent
Description

Cloudflare operates a broad internet and developer platform whose Workers AI and AI Gateway products provide LLM routing, caching, and observability. It is a much larger incumbent with a global edge network and a deep enterprise channel.

TypeDirect peer
Description

Kong is an API gateway vendor that has added AI gateway and LLM governance capabilities, competing directly with TrueFoundry's traffic-management and policy-enforcement features. It is positioned on TrueFoundry's own comparison page.

TypeDirect peer
Description

LiteLLM is an open-source LLM proxy/gateway that TrueFoundry explicitly benchmarks and competes against on price (referenced as the primary open-source alternative with $2,000–$3,500/month self-managed TCO).

5Seldon (now part of TrueFoundry)
TypeDirect peer
Description

Seldon is a UK-based production-grade MLOps platform on Kubernetes that TrueFoundry acquired in June 2026. It is the closest peer in the MLOps layer and is now part of the combined TrueFoundry platform.

TypeBroad incumbent
Description

Microsoft Azure offers API Management Premium tier and Azure AI Gateway features that compete for the same LLM governance and traffic-management budget. As a hyperscaler, it bundles gateway functionality with broader cloud and AI services.

TypeBroad incumbent
Description

AWS Bedrock and API Gateway are used by many of the same enterprises TrueFoundry serves, and AWS is a hyperscaler with native AI gateway capabilities and a cloud marketplace channel that TrueFoundry also relies on.

TypeBroad incumbent
Description

Databricks' Mosaic AI offers model serving, governance, and AI/ML platform capabilities on a unified data + AI stack. It is a broad incumbent competing for the same enterprise AI platform budget.

TypeEmerging player
Description

Helicone is an emerging AI observability and LLM gateway product focused on logging, evaluation and routing for AI applications. It overlaps with TrueFoundry's AI Gateway on observability and routing, but with a smaller, more developer-focused footprint.

TypeEmerging player
Description

Fiddler AI is an emerging AI observability and model governance platform for production ML and LLM systems. It competes in the same AI governance and compliance space that TrueFoundry addresses with its AI Gateway and audit features.

Market position
Strengths5 records

Each record includes

Headline, Details, Source

Weaknesses5 records

Each record includes

Headline, Details, Source

Competitive moat5 records

Each record includes

Type, Details

Key risks7 records

Each record includes

Headline, Details, Source

Key highlights7 records

Each record includes

Headline, Details, Source

Customer concentration

Classification, Details

Named customers14 records

Each record includes

Name, Industry, Type, Use case, Source, UUID

Segment8 records

Each record includes

Title, Type, Primary, Description, Pain point addressed, Use case, Source

Ideal customer profile2 records

Each record includes

Profile, Firmographic size, Sales motion, Sales cycle length, Buying structure, Purchase trigger, Buyer persona, Geography, Industry vertical, Primary use case, Description, Pain points, Evidence proof points, Target buyer

Technology focused
Yes
API detail
Has APIbool
Yes

Docs URL, Description

Integration15 records

Each record includes

Title, Type, Description, Source

AI capability5 records

Each record includes

Type, Description, Source

AI maturity
App detail

Has app

Feature8 records

Each record includes

Title, Differentiator, Description, Source

Core technology
Revenue estimate
Valuation estimate
Number of profiles
Profiles5 records

Each record includes

Name, Designation, Designation category, Overview, Profile commentary, Source

No data
Compliance4 records

Each record includes

Name, Class, Description

Funding overview

Funding stage, Last funding date, Total funding USD

Funding rounds2 records

Each record includes

Round, Amount USD, Date, Pre money valuation, Total investors, Investors, News

Investors8 records

Each record includes

Name, Type, Date of entry, Rounds participated, Website

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

M&A1 record

Each record includes

Name, Acquisition type, Announced date, Completed date, Status, Website, News

Investment

Each record includes

Name, Round, Announced date, Lead investor, Website, News

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

TrueFoundry

AI Gateway & AI Infrastructuretruefoundry.com

TrueFoundry provides a Kubernetes-native enterprise AI infrastructure platform combining an AI Gateway, MCP Gateway, and Agent Gateway to deploy, govern, and scale production LLM and agentic AI workloads across cloud, on-prem, and air-gapped environments for Fortune 1000 enterprises.

What TrueFoundry does

TrueFoundry (legal entity Ensemble Labs Inc.) is a San Francisco-based enterprise AI infrastructure company founded in 2022 that provides a Kubernetes-native platform built around a unified AI Gateway, MCP Gateway, and Agent Gateway for governing, deploying, and scaling production LLM and agentic AI workloads. Its split-plane architecture keeps a control plane for orchestration while running compute inside the customer's VPC, on-prem, or air-gapped environment, supporting inference backends such as vLLM, TGI, Triton, SGLang, and TensorRT-LLM. The platform consolidates multi-model routing, semantic caching, RBAC, immutable audit logging, GPU orchestration with fractional GPU support, and a managed agent runtime (Agent Harness) for plan-act-observe loops with sandboxing and approvals. TrueFoundry reports processing over 10 billion requests per month and more than 1 trillion tokens per day across 1,000+ clusters at ~3–4 ms gateway latency, and is the first AI Gateway provider to offer ITAR-compliant deployments alongside SOC 2, HIPAA, and GDPR certifications.

The company sells primarily through enterprise subscriptions with custom multi-year contracts to Fortune 1000 customers — including NVIDIA, Siemens Healthineers, Resmed, Automation Anywhere, Games 24x7, Cargill, Aviva, Mavenir, and Whatfix — supplemented by a self-serve PLG funnel (free instant sandbox, starting subscription around $499/month), cloud marketplace listings on AWS and Azure, and a VAR/VAD partner program. Revenue streams combine managed AI Gateway subscriptions, enterprise platform licensing deployed in customer environments, professional services for regulated and air-gapped rollouts, and marketplace consumption-based resale. Strategic distribution and security integrations with CrowdStrike Falcon AIDR, Palo Alto Networks Prisma AIRS, and Akto extend the platform's positioning as a centralized governance layer for enterprise AI traffic.

TrueFoundry has raised $21 million in total disclosed funding, including a $19 million Series A in February 2025 led by Intel Capital with participation from Eniac Ventures, Peak XV's Surge, and Jump Capital (Intel Capital's Avi Bharadwaj joined the board). The company has executed one acquisition — UK-based MLOps vendor Seldon AI in June 2026 — to unify traditional ML and agentic AI workloads, and has been recognized as a Representative Vendor in the 2025 Gartner Market Guide for AI Gateways, named in the Gartner Hype Cycle for Platform Engineering 2026, and won 'LLM Platform of the Year' at the 2026 AI Breakthrough Awards. Operations span North America, India (Chennai), and the UK via Seldon AI, with multilingual website presence supporting broader global reach.

TrueFoundry firmographics

Firmographics
Name
TrueFoundry
Legal name
Ensemble Labs Inc.
Website
https://truefoundry.com
Company type
Private
Founded year
2022
Operating status
Operating
Headcount range
101–250 employees
Short description
TrueFoundry provides a Kubernetes-native enterprise AI infrastructure platform combining an AI Gateway, MCP Gateway, and Agent Gateway to deploy, govern, and scale production LLM and agentic AI workloads across cloud, on-prem, and air-gapped environments for Fortune 1000 enterprises.
Ownership category
akta.pro rank

TrueFoundry industry classification

Industry
Product category
AI Gateway & AI Infrastructure
NAICS
Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services (5182), Computer Systems Design Services (541512), Software Publishers (51321)
SIC
Services-Computer Programming, Data Processing, Etc. (7370), Services-Computer Integrated Systems Design (7373)
akta.pro industry
PRIMARYHDAEANAC
Model Serving, Inference & Deployment Platforms (APIs, Edge/On-Prem)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
SECONDARYHDAEANAJ
AI Application Enablement Platforms (Copilot/Agent Frameworks, SDKs)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
SECONDARYHDAAAAAG
AI Compute Virtualization & Scheduling (GPU virtualization, cluster schedulers)
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/AI Infrastructure & Compute (GPUs/ASICs, accelerators)
SECONDARYBPAEAAAJ
AI/ML Solution Integration & MLOps Enablement
SECONDARYHDAAAKAJ
Identity, Access & Secrets Management for AI Systems (IAM for agents/models)

Keywords

  • AI gateway platform
  • MCP gateway
  • LLM infrastructure
  • Kubernetes AI deployment
  • Agent governance platform

Where TrueFoundry is headquartered

Location

Headquarters

HQ city
San Francisco
HQ country
United States
HQ region
North America

Offices2 records

Markets served

TrueFoundry business model

Business model
GTM type
B2B
Offering type
Software
Cost components
Personnel

Revenue model

  1. Managed AI Gateway Subscription: Recurring subscription to TrueFoundry's managed AI Gateway with enterprise features starting at approximately $499 per month, sold versus open-source LiteLLM alternatives.
  2. Enterprise Platform Licensing: Enterprise contracts to Fortune 1000 customers (NVIDIA, Siemens Healthineers, Resmed, Automation Anywhere, Games 24x7) for the full AI Gateway, MCP Gateway, Agent Gateway, deployment, and fine-tuning platform, with deployment in customer's VPC, on-prem, or air-gapped environments.
  3. Professional Services / Implementation: Enterprise-grade 24/7 support with SLA-backed response and implementation services for regulated, on-prem, and air-gapped deployments.
  4. Cloud Marketplace Channel Sales: Listing and consumption-based resale through AWS, Azure, and other cloud marketplaces alongside direct sales.

Pricing tiers

ModelBillingPrice
SubscriptionMonthlyManaged AI Gateway subscription starting at ~$499/month
OtherMulti-year contractEnterprise / custom platform licensing
FreemiumPay-as-you-goFree live sandbox / self-serve signup

Go-to-market motion1 record

Distribution channels5 records

Marketing channels10 records

TrueFoundry product offering

Product offering

Core offering

TrueFoundry provides a Kubernetes-native enterprise AI infrastructure platform centered on an AI Gateway, MCP Gateway, and Agent Gateway that consolidates LLM deployment, multi-model routing, traffic management, agent governance, and observability across providers such as Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, and Azure OpenAI. It additionally offers an AI Deployment Platform, Training & Fine-Tuning, and an Agent Harness runtime for production AI and agentic workloads, deployable in customer VPC, on-prem, hybrid, or air-gapped environments.

Product overview

TrueFoundry is a platform-plus-modules enterprise AI infrastructure offering built on Kubernetes that combines a unified AI Gateway control plane with an Agent Platform, an ML/LLMOps platform for training and deployment, and an underlying observability and governance layer. The core is the AI Gateway, which consolidates deployment, multi-model access, and traffic management across providers (Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI). On top of the AI Gateway sit the MCP Gateway (governing Model Context Protocol tool servers and registries), the Agent Gateway (governing agent-to-agent traffic with per-agent identity, RBAC, quotas, and tracing), Prompt Management, and the Agent Skills Registry. The Agent Harness is the runtime that orchestrates managed AI agents with sandboxing, approvals, and tracing; the Agent Registry provides unified discovery of TrueFoundry-native and remote agents (A2A or HTTP frameworks). The deployment side includes an AI Deployment Platform, Model Serving, Training & Fine-Tuning (one-click LLM deployment and fine-tuning on Kubernetes), a Tracing module for OpenTelemetry-based observability, and an LLMOps stack (including TrueFailover for model-outage failover). Acquired Seldon AI extends the platform with production-grade MLOps, and the underlying TrueFoundry ML Platform (Jobs, Model Registry, Services, Workflows, Volumes) supports general ML and time-series workloads.

Differentiator

Problem solved

Functional benefit

Brands

  • AI Gateway: Unified AI gateway product for governing, routing, and observing model, MCP-tool, and agent-to-agent traffic in enterprise environments.
  • MCP Gateway
  • Agent Gateway
  • TrueFailover
  • Agent Harness

Products and services

  • AI Gateway Centralized Kubernetes-native control plane consolidating LLM deployment, multi-model access, traffic management, semantic caching, intelligent failover, RBAC, budget enforcement, prompt templating, and guardrails across Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI, and self-hosted models; exposes OpenAI- and Anthropic-compatible endpoints.
  • MCP Gateway Governed gateway for Model Context Protocol (MCP) servers that centralizes discovery, authentication, RBAC, request-level tracing, and lifecycle management (Apps and Tasks extensions) for both internal and third-party MCP servers.
  • Agent Gateway Unified control plane for agent-to-agent traffic that gives agents per-agent identity, RBAC, token/cost quotas, retries, timeouts, loop safeguards, and end-to-end tracing across multi-agent systems; governs east-west A2A traffic and integrates with the AI Gateway and MCP Gateway.
  • AI Deployment Platform Kubernetes-native platform for deploying any AI model, agent, or MCP server with autoscaling, canary deployments, and observability; supports hosting LLMs via vLLM, TGI, or Triton and deploying agents built with LangGraph, CrewAI, and AutoGen.
  • Training & Fine-Tuning Launch fine-tuning jobs on user data, track experiments, and deploy updated checkpoints directly to production through the unified AI Deployment Platform; supports one-click fine-tuning of open-source LLMs from Hugging Face (Llama, Mistral, Phi).
  • TrueFailover Add-on module to the AI Gateway that automatically routes AI traffic around model outages, regional failures, and API degradations with multi-model, multi-region, multi-cloud failover, health monitoring, latency tracking, and caching.
  • Agent Harness Managed runtime layer on top of the AI Gateway and MCP Gateway that orchestrates plan-act-observe agent loops with sandboxing, approvals, the Agent Skills Registry, subagents, human-in-the-loop gates, and end-to-end tracing; no API keys are stored in agent definitions.

Companies that use TrueFoundry

Customer profile

Named customers14 records

Segments8 records

Ideal customer profiles2 records

TrueFoundry technology and API

Technology

Technology focussed Yes

API detail

Has API
Yes
API docs
API detail

Core technology

AI maturity

App detail

Integration15 records

AI capability5 records

Feature8 records

TrueFoundry partnerships and signals

Strategic signal

Partnerships

Eleven partnerships are on record, tiered flagship and core.

  • Seldon AIflagshipStrategic or Co-development Partner · 25 June 2026Acquired in June 2026 to combine Seldon's production-grade Kubernetes-native MLOps foundation with TrueFoundry's AI Gateway control plane, enabling agentic AI capabilities for enterprise customers (financial institutions, healthcare, retail) without replacing their existing Kubernetes infrastructure.
  • CrowdStrikeflagshipTechnology or Integration · 17 June 2026CrowdStrike extended its Falcon AI Detection and Response (AIDR) across TrueFoundry's AI Gateway to provide real-time threat detection, prompt injection defense, data leakage prevention, and policy enforcement — with telemetry feeding CrowdStrike's Falcon Next-Gen SIEM.
  • Google CloudcoreTechnology or Integration · 17 June 2026CrowdStrike's Falcon AIDR integration partner alongside TrueFoundry; Google Cloud is also a deployment target via the AI Gateway.
  • Microsoft AzurecoreTechnology or Integration · 17 June 2026CrowdStrike's Falcon AIDR integration partner alongside TrueFoundry; Azure is also a deployment target via the AI Gateway.
  • AktocoreTechnology or Integration · 23 April 2026Akto's runtime guardrails, continuous discovery, and observability for AI agents are embedded natively into TrueFoundry's platform to protect against prompt injection, uncontrolled tool access, and sensitive data leakage.
  • LangChaincoreTechnology or Integration · 23 April 2026Co-integrated with Akto to expand AI Agent Security; part of the same set of native runtime integrations alongside TrueFoundry.
  • PortkeycoreTechnology or Integration · 23 April 2026Co-integrated with Akto to expand AI Agent Security; part of the same set of native runtime integrations alongside TrueFoundry.
  • LiteLLMcoreTechnology or Integration · 23 April 2026Co-integrated with Akto to expand AI Agent Security; also covered in CrowdStrike's Falcon AIDR extension across AI gateways.
  • Palo Alto Networks (Prisma AIRS)flagshipTechnology or Integration · 3 November 2025Integration between Palo Alto Networks' Prisma AIRS security platform and TrueFoundry's AI Gateway providing real-time prompt injection detection, data loss prevention, and output filtering through a centralized single-integration platform.
  • AWS (Amazon Web Services)flagshipChannel Partner/ Reseller/ DistributorDedicated AWS partner page on the TrueFoundry website; TrueFoundry supports deployment on customer AWS infrastructure for multi-cloud orchestration.
  • Microsoft AzureflagshipChannel Partner/ Reseller/ DistributorDedicated Azure partner page on the TrueFoundry website; TrueFoundry supports deployment on customer Azure infrastructure and routes to Azure OpenAI.

Scale indicators8 records

Recent moves6 records

Expansion highlights6 records

TrueFoundry competitors and assessment

Company assessment

Direct peers

  • Portkey: Portkey is a direct AI gateway competitor offering LLM routing, observability, caching, guardrails and failover for production AI applications. It is one of the most head-to-head comparison points on TrueFoundry's own website.
  • Kong: Kong is an API gateway vendor that has added AI gateway and LLM governance capabilities, competing directly with TrueFoundry's traffic-management and policy-enforcement features. It is positioned on TrueFoundry's own comparison page.
  • LiteLLM: LiteLLM is an open-source LLM proxy/gateway that TrueFoundry explicitly benchmarks and competes against on price (referenced as the primary open-source alternative with $2,000–$3,500/month self-managed TCO).
  • Seldon (now part of TrueFoundry): Seldon is a UK-based production-grade MLOps platform on Kubernetes that TrueFoundry acquired in June 2026. It is the closest peer in the MLOps layer and is now part of the combined TrueFoundry platform.

Broad incumbents

  • Cloudflare: Cloudflare operates a broad internet and developer platform whose Workers AI and AI Gateway products provide LLM routing, caching, and observability. It is a much larger incumbent with a global edge network and a deep enterprise channel.
  • Microsoft (Azure API Management / Azure AI Gateway): Microsoft Azure offers API Management Premium tier and Azure AI Gateway features that compete for the same LLM governance and traffic-management budget. As a hyperscaler, it bundles gateway functionality with broader cloud and AI services.
  • AWS (Bedrock / API Gateway): AWS Bedrock and API Gateway are used by many of the same enterprises TrueFoundry serves, and AWS is a hyperscaler with native AI gateway capabilities and a cloud marketplace channel that TrueFoundry also relies on.
  • Databricks (Mosaic AI): Databricks' Mosaic AI offers model serving, governance, and AI/ML platform capabilities on a unified data + AI stack. It is a broad incumbent competing for the same enterprise AI platform budget.

Emerging players

  • Helicone: Helicone is an emerging AI observability and LLM gateway product focused on logging, evaluation and routing for AI applications. It overlaps with TrueFoundry's AI Gateway on observability and routing, but with a smaller, more developer-focused footprint.
  • Fiddler AI: Fiddler AI is an emerging AI observability and model governance platform for production ML and LLM systems. It competes in the same AI governance and compliance space that TrueFoundry addresses with its AI Gateway and audit features.

Market position

Strengths5 records

Weaknesses5 records

Competitive moat5 records

Key risks7 records

Key highlights7 records

Customer concentration

TrueFoundry social profiles

Digital presence

TrueFoundry compliance and trust

Trust signal

Compliance4 records

TrueFoundry financial estimates

Financial estimate

Revenue estimate

Valuation estimate

TrueFoundry leadership team

Management profile

Number of profiles

Profiles5 records

TrueFoundry funding detail

Funding detail

Funding overview

Funding rounds2 records

Investors8 records

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

TrueFoundry M&A and investment

M&A and investment

M&A1 record

Investments

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Frequently asked questions about TrueFoundry

What does TrueFoundry do?

TrueFoundry provides a Kubernetes-native enterprise AI infrastructure platform centered on an AI Gateway, MCP Gateway, and Agent Gateway that consolidates LLM deployment, multi-model routing, traffic management, agent governance, and observability across providers such as Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, and Azure OpenAI. It additionally offers an AI Deployment Platform, Training & Fine-Tuning, and an Agent Harness runtime for production AI and agentic workloads, deployable in customer VPC, on-prem, hybrid, or air-gapped environments.

Is TrueFoundry a public or private company?

TrueFoundry is a private company. It is classified as venture growth investor backed and is currently operating.

When was TrueFoundry founded?

TrueFoundry was founded in 2022. It employs 101 to 250 people.

Where is TrueFoundry based?

TrueFoundry is headquartered in San Francisco, United States, in the North America region.

How does TrueFoundry make money?

Four revenue lines are on record. Managed AI Gateway Subscription is the primary driver. The others are enterprise Platform Licensing, professional Services / Implementation and cloud Marketplace Channel Sales.

Who are TrueFoundry's main competitors?

Direct peers on record are Portkey, Kong, LiteLLM and Seldon (now part of TrueFoundry). Broad incumbents are Cloudflare, Microsoft (Azure API Management / Azure AI Gateway), AWS (Bedrock / API Gateway) and Databricks (Mosaic AI). Emerging players are Helicone and Fiddler AI.

Does TrueFoundry have an API?

Yes. TrueFoundry offers OpenAI-compatible and Anthropic-compatible REST API endpoints through its AI Gateway, allowing developers to integrate multiple LLM providers (Anthropic, OpenAI, AWS Bedrock, Google Vertex AI, Azure OpenAI, self-hosted models) behind a single unified endpoint. Developers can also access a Model Serving API for deployed ML models, a Forecast API for time-series predictions (SARIMAX/Prophet), a Workflow orchestration API (ArgoWorkflows-based), and an Agent Harness REST API with session creation, SSE streaming of agent progress, and integration hooks. Authentication uses scoped virtual keys; control plane endpoint format is https://.truefoundry.cloud/api/llm/v1. The platform also exposes MCP Gateway endpoints for governing Model Context Protocol servers. Developer documentation is at www.truefoundry.com/docs/introduction.

What industry is TrueFoundry in?

TrueFoundry's product category is AI Gateway & AI Infrastructure. Its primary akta.pro industry code is HDAEANAC, Model Serving, Inference & Deployment Platforms (APIs, Edge/On-Prem), with a secondary code of HDAEANAJ, AI Application Enablement Platforms (Copilot/Agent Frameworks, SDKs). Its NAICS code is 5182 and its SIC code is 7370.

Unlock the full company data

50 free credits on sign-up, no credit card required.

Contact sales
Live signals
Biometric UpdateAI agent identity takes shape across fraud detection and access controlsBioCatch launched AiRE to detect AI agents in banking sessions, while LexisNexis introduced KYA intelligence to verify agent identity. Okta and TrueFoundry integrated the Cross App Access protocol for agent authorization. The tools aim to address authentication gaps as agentic AI adoption grows.TechRoundThe Best AI-Native Gateways For Developer-First Teams In 2026Five AI-native gateways are ranked for developer-first teams, with TrueFoundry leading for production-scale governance. Arch, APISIX, Traefik Hub, and Requesty are also covered, each with distinct strengths. The guide emphasizes native design for LLM traffic over retrofitted features.MarTech SeriesBigeye Adds Policy Engine to Agent Trust Hub, With Runtime Enforcement Across AI GatewaysBigeye launched Policy Engine in Agent Trust Hub to enforce AI agent policies at runtime across partner gateways. The platform integrates with Kong, TrueFoundry, OpenLLM, Bifrost, and Gravitee, and EY's survey cited 85% of agentic AI users lack real-time human oversight.Business Wire BlogTrueFoundry Receives Frost & Sullivan's 2026 Global Enterprise AI Control Plane Transformational Innovation Leadership RecognitionTrueFoundry received Frost & Sullivan's 2026 Global Enterprise AI Control Plane Transformational Innovation Leadership Recognition for its unified governance and operational control. The company's AI Gateway processes over 1 trillion tokens daily, with production teams reporting 3x faster time-to-value and up to 50% cost savings.PR NewswireTrueFoundry Receives Frost & Sullivan's 2026 Global Enterprise AI Control Plane Transformational Innovation Leadership Recognition for Enterprise AI Governance and Operational ExcellenceFrost & Sullivan awarded TrueFoundry its 2026 Global Enterprise AI Control Plane Transformational Innovation Leadership Recognition for enterprise AI governance and operational excellence. The company's platform unifies governance, security, observability, and agent lifecycle management, with production deployments at Fortune 500s and vertical leaders. It reports 3x faster time to value, 60% faster AI deployments, and 30% average cost optimization.AdvfnTrueFoundry Receives Frost & Sullivan's 2026 Global Enterprise AI Control Plane Transformational Innovation Leadership Recognition for Enterprise AI Governance and Operational ExcellenceTrueFoundry received Frost & Sullivan's 2026 Global Enterprise AI Control Plane Transformational Innovation Leadership Recognition for its unified AI governance and operational platform. The company reports 3x faster time to value, 60% faster AI deployments, and 30% cost optimization across Fortune 500 and vertical deployments.PR NewswireTrueFoundry Receives Frost & Sullivan's 2026 Global Enterprise AI Control Plane Transformational Innovation Leadership Recognition for Enterprise AI Governance and Operational ExcellenceTrueFoundry received Frost & Sullivan's 2026 Global Enterprise AI Control Plane Transformational Innovation Leadership Recognition for its unified AI governance and operational platform. The company reports 3x faster time to value, 60% faster AI deployments, and 30% average cost optimization, with deployments spanning Fortune 500s and vertical leaders.NewswireTrueFoundry Receives Frost & Sullivan's 2026 Global Enterprise AI Control Plane Transformational Innovation Leadership Recognition for Enterprise AI Governance and Operational ExcellenceTrueFoundry received Frost & Sullivan's 2026 Global Enterprise AI Control Plane Transformational Innovation Leadership Recognition for its unified AI governance and operational platform. The company reports 3x faster time to value, 60% faster AI deployments, and 30% average cost optimization, with deployments spanning Fortune 500s and vertical leaders.AiThorityTrueFoundry AI Gateway Now Available in the Microsoft MarketplaceTrueFoundry announced its AI Gateway is now available on the Microsoft Marketplace, enabling Azure customers to deploy it directly. The gateway provides unified control for LLM, MCP, and agent workloads, with support for on-premise, multi-cloud, and hybrid installations. It also supports SOC 2, HIPAA, and GDPR compliance.MarketScreenerTrueFoundry Announces Availability of TrueFoundry AI Gateway in Microsoft Marketplace for Microsoft Azure CustomersTrueFoundry announced the availability of TrueFoundry AI Gateway in the Microsoft Marketplace, allowing Azure customers to discover and deploy it. The gateway integrates smoothly with Microsoft Azure and other Microsoft products, enabling enterprises to deploy it within their existing Microsoft environment.