Developer docs
API playgroundTry for free, no card

Search company profiles

Inferact

Full company profile

uuid00n5yzf

Namestring
Inferact
Legal namestring
Inferact Inc.
Websiteurl
inferact.ai
Company typeenum
Private
Founded yearint
2026
Descriptiontext

Inferact is a San Francisco-based AI infrastructure startup founded in January 2026 by the creators and core maintainers of vLLM, the open-source large language model inference engine originally developed at UC Berkeley's Sky Computing Lab. The company's core technology, vLLM, accelerates LLM inference by 2-4x and supports more than 500 model architectures across 200+ accelerator types, currently running on over 400,000 GPUs globally with contributions from more than 2,000 open-source developers. vLLM is used in production by major technology companies including Meta, Google, and Character.ai, and the project has day-zero support relationships with model vendors and hardware vendors, positioning the company at the intersection of model and hardware ecosystems.

The company pursues a dual-product strategy: continuing to maintain and enhance the free open-source vLLM engine while developing a planned paid serverless inference platform targeting enterprises that need to deploy frontier AI models at scale without dedicated infrastructure teams. Optimizations developed commercially flow back to the open-source project. The six-person founding team comprises Simon Mo (CEO), Woosuk Kwon, Kaichao You (Chief Scientist, Tsinghua University PhD), Roger Wang, Joseph Gonzalez, and Ion Stoica (Databricks co-founder). Inferact's customer segmentation is horizontal, serving both AI-native companies deploying frontier models at scale (frontier labs, hyperscalers, AI startups serving millions of users) and mid-market companies that lack the engineering resources to build custom inference infrastructure.

Inferact is venture-backed following a $150 million seed round in January 2026 at an $800 million post-money valuation, co-led by Andreessen Horowitz and Lightspeed Venture Partners, with participation from Sequoia Capital, Altimeter Capital, Redpoint Ventures, ZhenFund, Databricks Ventures, UC Berkeley Chancellor's Fund, and other investors. The company currently has 11-50 employees and has not yet disclosed revenue, as the commercial serverless platform remains in development.

Short descriptiontext

Inferact commercializes vLLM, the leading open-source LLM inference engine, delivering 2-4x faster inference across 500+ model architectures and 200+ accelerator types. The San Francisco startup serves AI companies and enterprises deploying frontier models at scale, with a planned paid serverless platform for organizations lacking dedicated inference infrastructure teams.

Operating statusenum
Operating
Ownership categoryenum
Headcount rangeband
11–50
akta.pro rankint
HeadquartersSan Francisco, United States
HQ citystring
San Francisco
HQ countrystring
United States
HQ regionstring
North America
Markets served

Serves global market

Keyword5 values
LLM inference engine, AI inference infrastructure, open source inference, model serving platform, serverless AI deployment
Industry3 codes
PRIMARYHDAAACAB
Model Hosting, Serving & Inference Platforms
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/Foundation Models & Generative AI (LLMs, multimodal)
SECONDARYHDAAABAF
Model Deployment, Serving & Inference Platforms
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/ML Platforms, MLOps & Model Lifecycle Management
SECONDARYHDAEANAD
LLMOps & Generative AI Platforms (Prompt/Agent Orchestration, RAG)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
NAICS code3 codes
  • Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services51821
  • Computer Systems Design and Related Services5415
  • Custom Computer Programming Services541511
SIC code2 codes
  • Services-Prepackaged Software7372
  • Services-Computer Programming, Data Processing, Etc.7370
Product category
AI Inference Infrastructure
Social media profiles2 records
GTM motion1 record

Each record includes

Type, Description, Source

Revenue model1 record
1Serverless Inference Platform
TypeSubscription Recurring
Description

Commercial paid serverless version of vLLM targeting enterprises that need to deploy frontier AI models at scale without dedicated infrastructure teams. The open-source vLLM remains free while the managed/cloud service provides additional convenience and support.

inferact.ai
Marketing channels3 records

Each record includes

Title, Type, Stage, Description, Source

Distribution channels2 records

Each record includes

Title, Type, Scope, Target buyer, Description, Source

Cost components5 values
Personnel, Technology or R&D, Infrastructure, Marketing or Sales, Operations
GTM typeB2B
B2B
Offering typeSoftware
Software
Core offering1 text field

Inferact develops and commercializes vLLM, the open-source LLM inference engine originally created at UC Berkeley's Sky Computing Lab. The engine delivers 2-4x faster LLM inference, supports 500+ model architectures across 200+ accelerator types, and runs on 400,000+ GPUs globally. Inferact plans to layer a paid serverless version of vLLM on top of the open-source project so enterprises can deploy frontier AI models without dedicated infrastructure teams.

Differentiator
Functional benefit
Problem solved
Quantifiable outcome1 value
  • 2-4x LLM inference speed improvement
Product overview1 text field

Inferact operates a dual-product strategy centered on vLLM. The company maintains and develops vLLM as an open-source inference engine (the core open-source product), while also building a commercial serverless offering (Inferact Serverless) on top of it. The open-source vLLM provides the foundational technology and community, while the commercial product adds managed infrastructure capabilities for enterprise customers who want serverless deployment without building custom infrastructure.

Product and service2 records
1vLLM (Open Source)
CategoryOpen-source inference engine
2Inferact Serverless
CategoryManaged inference platform
Scale indicator6 records

Each record includes

Type, Value, Description, Source

Recent move7 records

Each record includes

Date, Type, Title, Description, Source

Expansion highlight5 records

Each record includes

Type, Description

Peers10 records
TypeDirect peer
Description

Fireworks AI provides a low-latency LLM inference and fine-tuning platform optimized for production deployment. It targets the same developer and enterprise buyers looking to serve frontier models at scale.

TypeBroad incumbent
Description

Hugging Face is a broad platform for open-source AI models and includes Inference Endpoints for serving models. While not specialized in inference, it overlaps with Inferact's open-source-rooted go-to-market and offers managed serving.

TypeDirect peer
Description

Anyscale commercializes Ray and offers Anyscale Endpoints for LLM serving and inference at scale. It targets the same enterprise developer persona and competes directly for managed LLM inference workloads.

TypeDirect peer
Description

OctoAI builds an AI compute platform optimized for running and fine-tuning open-source models. It is comparable to Inferact as a managed serving layer for production AI inference.

TypeDirect peer
Description

Modal offers serverless compute infrastructure for AI and data workloads, including LLM inference. Its 'serverless GPU' positioning competes head-on with Inferact's planned serverless inference offering.

TypeDirect peer
Description

Replicate runs a cloud that lets developers deploy and scale AI models via an API, with a focus on open-source models. It is a direct competitor in serving open-source LLMs to developers and small enterprises.

TypeDirect peer
Description

DeepInfra provides low-cost, low-latency inference-as-a-service for open-source LLMs and other models. It targets a similar cost-sensitive developer and enterprise customer base.

TypeDirect peer
Description

Together AI operates a cloud platform for training, serving, and inference of open-source and frontier LLMs. It is the closest direct competitor in the open-source-rooted, paid-inference serverless model.

TypeDirect peer
Description

Baseten offers managed infrastructure and serving for ML models, with a strong focus on LLM inference workloads. Its developer- and enterprise-focused serving platform directly overlaps with Inferact's planned offering.

TypeBroad incumbent
Description

NVIDIA's TensorRT-LLM and NIM microservices provide optimized LLM inference on NVIDIA hardware, bundled with the dominant accelerator stack. It competes for the same workloads but as part of NVIDIA's broader AI platform portfolio.

Market position
Strengths4 records

Each record includes

Headline, Details, Source

Weaknesses4 records

Each record includes

Headline, Details, Source

Competitive moat5 records

Each record includes

Type, Details

Key risks5 records

Each record includes

Headline, Details, Source

Key highlights6 records

Each record includes

Headline, Details, Source

Customer concentration

Classification, Details

Segment2 records

Each record includes

Title, Type, Primary, Description, Pain point addressed, Use case, Source

Ideal customer profile2 records

Each record includes

Profile, Firmographic size, Sales motion, Sales cycle length, Buying structure, Purchase trigger, Buyer persona, Geography, Industry vertical, Primary use case, Description, Pain points, Evidence proof points, Target buyer

Technology focused
Yes
API detail
Has APIbool
No

Docs URL, Description

AI capability2 records

Each record includes

Type, Description, Source

AI maturity
App detail

Has app

Feature2 records

Each record includes

Title, Differentiator, Description, Source

Core technology
Revenue estimate
Valuation estimate
Number of profiles
Profiles6 records

Each record includes

Name, Designation, Designation category, Overview, Profile commentary, Source

No data
No data
Funding overview

Funding stage, Last funding date, Total funding USD

Funding rounds1 record

Each record includes

Round, Amount USD, Date, Pre money valuation, Total investors, Investors, News

Investors12 records

Each record includes

Name, Type, Date of entry, Rounds participated, Website

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

M&A

Each record includes

Name, Acquisition type, Announced date, Completed date, Status, Website, News

Investment

Each record includes

Name, Round, Announced date, Lead investor, Website, News

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Inferact

AI Inference Infrastructureinferact.ai

Inferact commercializes vLLM, the leading open-source LLM inference engine, delivering 2-4x faster inference across 500+ model architectures and 200+ accelerator types. The San Francisco startup serves AI companies and enterprises deploying frontier models at scale, with a planned paid serverless platform for organizations lacking dedicated inference infrastructure teams.

What Inferact does

Inferact is a San Francisco-based AI infrastructure startup founded in January 2026 by the creators and core maintainers of vLLM, the open-source large language model inference engine originally developed at UC Berkeley's Sky Computing Lab. The company's core technology, vLLM, accelerates LLM inference by 2-4x and supports more than 500 model architectures across 200+ accelerator types, currently running on over 400,000 GPUs globally with contributions from more than 2,000 open-source developers. vLLM is used in production by major technology companies including Meta, Google, and Character.ai, and the project has day-zero support relationships with model vendors and hardware vendors, positioning the company at the intersection of model and hardware ecosystems.

The company pursues a dual-product strategy: continuing to maintain and enhance the free open-source vLLM engine while developing a planned paid serverless inference platform targeting enterprises that need to deploy frontier AI models at scale without dedicated infrastructure teams. Optimizations developed commercially flow back to the open-source project. The six-person founding team comprises Simon Mo (CEO), Woosuk Kwon, Kaichao You (Chief Scientist, Tsinghua University PhD), Roger Wang, Joseph Gonzalez, and Ion Stoica (Databricks co-founder). Inferact's customer segmentation is horizontal, serving both AI-native companies deploying frontier models at scale (frontier labs, hyperscalers, AI startups serving millions of users) and mid-market companies that lack the engineering resources to build custom inference infrastructure.

Inferact is venture-backed following a $150 million seed round in January 2026 at an $800 million post-money valuation, co-led by Andreessen Horowitz and Lightspeed Venture Partners, with participation from Sequoia Capital, Altimeter Capital, Redpoint Ventures, ZhenFund, Databricks Ventures, UC Berkeley Chancellor's Fund, and other investors. The company currently has 11-50 employees and has not yet disclosed revenue, as the commercial serverless platform remains in development.

Inferact firmographics

Firmographics
Name
Inferact
Legal name
Inferact Inc.
Website
https://inferact.ai
Company type
Private
Founded year
2026
Operating status
Operating
Headcount range
11–50 employees
Short description
Inferact commercializes vLLM, the leading open-source LLM inference engine, delivering 2-4x faster inference across 500+ model architectures and 200+ accelerator types. The San Francisco startup serves AI companies and enterprises deploying frontier models at scale, with a planned paid serverless platform for organizations lacking dedicated inference infrastructure teams.
Ownership category
akta.pro rank

Inferact industry classification

Industry
Product category
AI Inference Infrastructure
NAICS
Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services (51821), Computer Systems Design and Related Services (5415), Custom Computer Programming Services (541511)
SIC
Services-Prepackaged Software (7372), Services-Computer Programming, Data Processing, Etc. (7370)
akta.pro industry
PRIMARYHDAAACAB
Model Hosting, Serving & Inference Platforms
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/Foundation Models & Generative AI (LLMs, multimodal)
SECONDARYHDAAABAF
Model Deployment, Serving & Inference Platforms
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/ML Platforms, MLOps & Model Lifecycle Management
SECONDARYHDAEANAD
LLMOps & Generative AI Platforms (Prompt/Agent Orchestration, RAG)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise

Keywords

  • LLM inference engine
  • AI inference infrastructure
  • Open source inference
  • Model serving platform
  • Serverless AI deployment

Where Inferact is headquartered

Location

Headquarters

HQ city
San Francisco
HQ country
United States
HQ region
North America

Markets served

Inferact business model

Business model
GTM type
B2B
Offering type
Software
Cost components
Personnel, Technology or R&D, Infrastructure, Marketing or Sales, Operations

Revenue model

  1. Serverless Inference Platform: Commercial paid serverless version of vLLM targeting enterprises that need to deploy frontier AI models at scale without dedicated infrastructure teams. The open-source vLLM remains free while the managed/cloud service provides additional convenience and support.

Go-to-market motion1 record

Distribution channels2 records

Marketing channels3 records

Inferact product offering

Product offering

Core offering

Inferact develops and commercializes vLLM, the open-source LLM inference engine originally created at UC Berkeley's Sky Computing Lab. The engine delivers 2-4x faster LLM inference, supports 500+ model architectures across 200+ accelerator types, and runs on 400,000+ GPUs globally. Inferact plans to layer a paid serverless version of vLLM on top of the open-source project so enterprises can deploy frontier AI models without dedicated infrastructure teams.

Product overview

Inferact operates a dual-product strategy centered on vLLM. The company maintains and develops vLLM as an open-source inference engine (the core open-source product), while also building a commercial serverless offering (Inferact Serverless) on top of it. The open-source vLLM provides the foundational technology and community, while the commercial product adds managed infrastructure capabilities for enterprise customers who want serverless deployment without building custom infrastructure.

Differentiator

Problem solved

Functional benefit

Products and services

  • vLLM (Open Source)
  • Inferact Serverless

Quantifiable outcome

  • 2-4x LLM inference speed improvement

Companies that use Inferact

Customer profile

Segments2 records

Ideal customer profiles2 records

Inferact technology and API

Technology

Technology focussed Yes

API detail

Has API
No
API docs
API detail

Core technology

AI maturity

App detail

AI capability2 records

Feature2 records

Inferact partnerships and signals

Strategic signal

Scale indicators6 records

Recent moves7 records

Expansion highlights5 records

Inferact competitors and assessment

Company assessment

Direct peers

  • Fireworks AI: Fireworks AI provides a low-latency LLM inference and fine-tuning platform optimized for production deployment. It targets the same developer and enterprise buyers looking to serve frontier models at scale.
  • Anyscale: Anyscale commercializes Ray and offers Anyscale Endpoints for LLM serving and inference at scale. It targets the same enterprise developer persona and competes directly for managed LLM inference workloads.
  • OctoAI (OctoML): OctoAI builds an AI compute platform optimized for running and fine-tuning open-source models. It is comparable to Inferact as a managed serving layer for production AI inference.
  • Modal Labs: Modal offers serverless compute infrastructure for AI and data workloads, including LLM inference. Its 'serverless GPU' positioning competes head-on with Inferact's planned serverless inference offering.
  • Replicate: Replicate runs a cloud that lets developers deploy and scale AI models via an API, with a focus on open-source models. It is a direct competitor in serving open-source LLMs to developers and small enterprises.
  • DeepInfra: DeepInfra provides low-cost, low-latency inference-as-a-service for open-source LLMs and other models. It targets a similar cost-sensitive developer and enterprise customer base.
  • Together AI: Together AI operates a cloud platform for training, serving, and inference of open-source and frontier LLMs. It is the closest direct competitor in the open-source-rooted, paid-inference serverless model.
  • Baseten: Baseten offers managed infrastructure and serving for ML models, with a strong focus on LLM inference workloads. Its developer- and enterprise-focused serving platform directly overlaps with Inferact's planned offering.

Broad incumbents

  • Hugging Face: Hugging Face is a broad platform for open-source AI models and includes Inference Endpoints for serving models. While not specialized in inference, it overlaps with Inferact's open-source-rooted go-to-market and offers managed serving.
  • NVIDIA (TensorRT-LLM / NIM): NVIDIA's TensorRT-LLM and NIM microservices provide optimized LLM inference on NVIDIA hardware, bundled with the dominant accelerator stack. It competes for the same workloads but as part of NVIDIA's broader AI platform portfolio.

Market position

Strengths4 records

Weaknesses4 records

Competitive moat5 records

Key risks5 records

Key highlights6 records

Customer concentration

Inferact social profiles

Digital presence

Inferact financial estimates

Financial estimate

Revenue estimate

Valuation estimate

Inferact leadership team

Management profile

Number of profiles

Profiles6 records

Inferact funding detail

Funding detail

Funding overview

Funding rounds1 record

Investors12 records

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

Inferact M&A and investment

M&A and investment

M&A

Investments

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Frequently asked questions about Inferact

What does Inferact do?

Inferact develops and commercializes vLLM, the open-source LLM inference engine originally created at UC Berkeley's Sky Computing Lab. The engine delivers 2-4x faster LLM inference, supports 500+ model architectures across 200+ accelerator types, and runs on 400,000+ GPUs globally. Inferact plans to layer a paid serverless version of vLLM on top of the open-source project so enterprises can deploy frontier AI models without dedicated infrastructure teams.

Is Inferact a public or private company?

Inferact is a private company. It is classified as venture growth investor backed and is currently operating.

When was Inferact founded?

Inferact was founded in 2026. It employs 11 to 50 people.

Where is Inferact based?

Inferact is headquartered in San Francisco, United States, in the North America region.

How does Inferact make money?

One revenue line is on record: serverless Inference Platform.

Who are Inferact's main competitors?

Direct peers on record are Fireworks AI, Anyscale, OctoAI (OctoML), Modal Labs, Replicate, DeepInfra, Together AI and Baseten. Broad incumbents are Hugging Face and NVIDIA (TensorRT-LLM / NIM).

Does Inferact have an API?

No public API is recorded for Inferact.

What industry is Inferact in?

Inferact's product category is AI Inference Infrastructure. Its primary akta.pro industry code is HDAAACAB, Model Hosting, Serving & Inference Platforms, with a secondary code of HDAAABAF, Model Deployment, Serving & Inference Platforms. Its NAICS code is 51821 and its SIC code is 7372.

Unlock the full company data

50 free credits on sign-up, no credit card required.

Contact sales
Live signals
Crypto BriefingInferact raises $150M seed round to scale the vLLM inference engineInferact, founded by vLLM maintainers, raised $150M in seed funding at an $800M post-money valuation. The company will commercialize vLLM's PagedAttention inference engine, which supports over 500 model architectures and 200 accelerators. It plans to add serverless and observability services.WowtaleAI 추론(Inference) 스타트업 지형도 2026: 학습에서 추론으로The AI industry's focus is shifting rapidly from model training to inference, with Deloitte projecting inference workloads will account for roughly two-thirds of total AI computing in 2026, up from one-third in 2023, driving a projected $50 billion+ inference optimization chip market. A landscape report maps the emerging startup ecosystem across four layers—inference engines, managed inference platforms, multi-silicon orchestration, and inference-specific chips—with companies like Inferact, RadixArk, Cerebras, and Etched raising collective billions in funding at valuations reaching up to $23 billion. The transition is being accelerated by AI agents that generate 5–15x more tokens than traditional chatbots, creating multi-stage workloads with varying computational demands that current infrastructure cannot optimally handle.PitchBookVCs continue to pile into AI inference chip startupsVenture capital investors are accelerating funding into AI inference chip and infrastructure startups, with Rebellions becoming at least the ninth company in the sector to announce new funding in 2026, reflecting a broader thesis that inference represents recurring-revenue business as AI moves from experimentation to real-world deployment. Notable recent rounds include Inferact's $150 million seed funding in January and Baseten's $300 million round in February, with investors citing inference as more stable than training from a revenue perspective. South Korea's National Growth Fund, a roughly $100 billion initiative to support the semiconductor industry, participated in Rebellions' latest funding round.FinSMEsInferact Raises $150M in Seed FundingInferact, a San Francisco-based AI inference engine developer, raised $150M in seed funding co-led by Andreessen Horowitz and Lightspeed Venture Partners. The company will use the funds to expand its team and finalize its vLLM technology, which supports 500+ model architectures and 200+ accelerators.Pulse 2.0Inferact Launches With $150 Million Funding At $800M Valuation To Commercialize vLLM As Inference Demand SurgesInferact, an AI infrastructure startup founded by creators and core maintainers of the open-source vLLM inference engine, has launched with $150 million in seed funding at an $800 million valuation. The funding round was co-led by Andreessen Horowitz and Lightspeed Venture Partners, with participation from Sequoia Capital, Altimeter Capital, Redpoint Ventures, ZhenFund, and other investors. The company aims to address growing inference bottlenecks as AI models and agentic workflows become more computationally demanding, while maintaining vLLM's open-source development model.WowtalevLLM open source, independent with 'Interact'... raised $150 million in seed funding with a valuation of $800 million.The vLLM development team established Inferact (인퍼랙트) and secured $150 million in seed funding at an $800 million valuation, co-led by Andreessen Horowitz and Lightspeed Venture Partners. vLLM is an open-source inference engine developed at UC Berkeley's Sky Computing Lab that increases LLM inference speed by 2–4x, currently running on over 400,000 GPUs globally and used by major companies including Meta, Google, and Character.ai. The investment signals a broader industry shift from AI model training to inference infrastructure, as AI agents increasingly require longer task execution with more steps and token generation.36krvLLM Team Officially Launches Startup, Secures $150M in Financing with Tsinghua Special Award Winner YOU Kaichao as Co-FounderInferact, an AI startup founded by the creators of the open-source vLLM inference framework, has officially launched and secured $150 million in seed funding at an $800 million valuation. The round was led by Andreessen Horowitz and Lightspeed, with participation from Sequoia Capital, Altimeter Capital, Redpoint Ventures, and ZhenFund, marking one of the largest seed financings in AI infrastructure history. The company aims to develop vLLM into the world's leading AI inference engine, with co-founder Kaichao You being a PhD from Tsinghua University who contributed to the vLLM project.The SaaS NewsInferact Secures $150 Million Seed FundingInferact, a San Francisco-based AI infrastructure startup formed by the creators of open-source vLLM inference engine, has secured $150 million in seed funding at an $800 million valuation, with the round co-led by Andreessen Horowitz and Lightspeed Venture Partners. The funding also includes participation from Sequoia Capital, Altimeter Capital, Redpoint Ventures, and ZhenFund. The company plans to use the capital to commercialize vLLM, scale its platform for enterprise AI inference, and expand adoption among new and existing customers.WhalesbookInferact Raises $150M at $800M Valuation for AI Inference TechInferact, an AI inference startup originating from the open-source vLLM project, has secured $150 million in seed funding at an $800 million valuation, co-led by Andreessen Horowitz and Lightspeed Venture Partners with participation from Sequoia Capital, Altimeter Capital, Redpoint Ventures, and ZhenFund. The funding round signals strong investor confidence in AI inference optimization technologies as the industry pivots from model training to application deployment, with the AI inference market projected to reach over $250 billion by 2030. The emergence of Inferact and similar startups like RadixArk underscores a competitive landscape where specialized AI deployment solutions are attracting significant venture capital against established cloud providers.TechCrunchInference startup Inferact lands $150M to commercialize vLLMThe creators of the open source vLLM project have launched a VC-backed startup called Inferact, raising $150 million in seed funding at an $800 million valuation. The round was co-led by Andreessen Horowitz and Lightspeed Venture Partners. This commercialization reflects a broader industry shift from AI model training toward inference deployment, with technologies like vLLM and SGLang attracting significant investor attention after being incubated at UC Berkeley.