Developer docs
API playgroundTry for free, no card

Search company profiles

Moreh

Full company profile

uuid00006wl

Namestring
Moreh
Legal namestring
Moreh, Inc.
Websiteurl
moreh.io
Company typeenum
Private
Founded yearint
2020
Descriptiontext

Moreh is an AI infrastructure software company founded in September 2020 in Seoul, South Korea, that builds a full-stack inference platform — the MoAI framework — optimized for heterogeneous GPU clusters spanning AMD Instinct, NVIDIA, and Tenstorrent accelerators. The core product line includes the MoAI Inference Framework (cluster-scale routing, scheduling, auto-scaling, KV cache management), Moreh vLLM drop-in replacements for AMD and Tenstorrent GPUs, MoAI Performance Gateway for cross-vendor workload distribution, MoAI Fabric for RDMA-based KV cache transfer across vendors, and proprietary primitives including HetCCL (cross-vendor collective communication), SLOPE (long-context prefill engine), and TIDE (runtime draft model trainer). The company reports differentiated capabilities such as cross-vendor prefill-decode disaggregation between NVIDIA H100 and AMD MI300X, with published benchmarks claiming up to 1.84x lower latency and 67% higher throughput versus single-vendor baselines.

The company monetizes via enterprise software licensing (subscription, quote-based, multi-year) combined with professional and managed services that bundle hardware procurement, cluster design and deployment, and ongoing optimization for AMD and Tenstorrent clusters; pricing is not publicly disclosed. Distribution runs through direct enterprise sales to AI data centers, cloud service providers, and telecom operators, augmented by strategic channel partnerships with AMD and Tenstorrent for joint go-to-market and open-source contributions to ROCm, SGLang, SkyPilot, and Tenstorrent Metalium. Key customers include KT Cloud (Hyperscale AI Computing service running 1,200+ AMD MI250 GPUs) and the Korea Ministry of Science and ICT (lead consortium for the national sovereign AI foundation model project); subsidiary Motif Technologies develops proprietary Korean-language LLMs. The company is backed by AMD, KT, and Forest Ventures, with cumulative funding exceeding $50 million USD and a post-money valuation of approximately 350 billion KRW (~$250M USD) as of September 2025.

Short descriptiontext

Moreh is a Seoul-based AI infrastructure software company building the MoAI full-stack inference platform that orchestrates heterogeneous GPU clusters (AMD, NVIDIA, Tenstorrent), serving AI data centers, cloud providers, telecom operators, and government AI initiatives with cross-vendor disaggregation and custom inference engines.

Operating statusenum
Operating
Ownership categoryenum
Headcount rangeband
51–100
akta.pro rankint
HeadquartersSeoul, South Korea
HQ citystring
Seoul
HQ countrystring
South Korea
HQ regionstring
Asia
Markets served

Serves global market

Offices3 records

Each record includes

City, Country, Type, Description, Source

Keyword5 values
AI inference software, GPU cluster management, LLM serving infrastructure, heterogeneous computing platforms, GPU virtualization software
Industry5 codes
PRIMARYHDAEANAC
Model Serving, Inference & Deployment Platforms (APIs, Edge/On-Prem)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
SECONDARYHDAAAAAI
AI Compiler, Runtime & Kernel Optimization Software (CUDA/ROCm/XLA, graph compilers)
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/AI Infrastructure & Compute (GPUs/ASICs, accelerators)
SECONDARYHDAAAAAG
AI Compute Virtualization & Scheduling (GPU virtualization, cluster schedulers)
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/AI Infrastructure & Compute (GPUs/ASICs, accelerators)
SECONDARYHDAAABAF
Model Deployment, Serving & Inference Platforms
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/ML Platforms, MLOps & Model Lifecycle Management
SECONDARYHDAAACAB
Model Hosting, Serving & Inference Platforms
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/Foundation Models & Generative AI (LLMs, multimodal)
NAICS code3 codes
  • Computer Systems Design and Related Services5415
  • Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services518
  • Custom Computer Programming Services541511
SIC code3 codes
  • Services-Prepackaged Software7372
  • Services-Computer Integrated Systems Design7373
  • Services-Computer Programming, Data Processing, Etc.7370
Product category
AI Inference Software
Social media profiles3 records
GTM motion3 records

Each record includes

Type, Description, Source

Revenue model4 records
1AI Infrastructure Software Licensing
TypeSubscription Recurring
Description

Software licensing for AI inference infrastructure, including MoAI Inference Framework and Moreh vLLM. Provided as container images with regular updates for AMD GPU clusters and Tenstorrent solutions. Pricing appears to be enterprise quote-based with multi-year contracts.

moreh.io
2Turnkey GPU Cluster Solutions
TypeProfessional Services
Description

End-to-end AMD GPU cluster solutions combining hardware procurement, cluster design/building, software deployment, and ongoing technical support. Covers rack layout, power planning, network topology design, and deployment of Moreh inference software.

moreh.io
3Tenstorrent AI Cluster Solutions
TypeManaged Services
Description

Scalable AI cluster solutions built around Tenstorrent Wormhole processors, including hardware supply, cluster construction, software deployment, and continuous technical support for Tenstorrent-specific issues and performance tuning.

moreh.io
4Custom Benchmarking Services
TypeProfessional Services
Description

Custom benchmarking engagements where Moreh runs performance tests on customer workloads to demonstrate cost reduction effects and token-per-dollar improvements, likely as part of enterprise sales process.

moreh.io
Marketing channels6 records

Each record includes

Title, Type, Stage, Description, Source

Distribution channels3 records

Each record includes

Title, Type, Scope, Target buyer, Description, Source

Cost components5 values
Personnel, Technology or R&D, Operations, Marketing or Sales, Infrastructure
Pricing details1 tier
1Enterprise licensing with custom benchmarking
ModelSubscriptionBilling cadenceMulti-year contract
Notes

Quote-based pricing; custom benchmarking offered to demonstrate ROI on customer workloads; likely multi-year contracts for ongoing support and software updates

moreh.io
GTM typeB2B
B2B
Offering typeSoftware
Software
Core offering1 text field

Moreh develops and licenses full-stack AI inference software (the MoAI platform) that enables organizations to run and serve large language models on heterogeneous GPU clusters combining AMD Instinct, NVIDIA, and Tenstorrent accelerators. The offering spans chip-level custom kernels, Moreh vLLM inference engines optimized for AMD and Tenstorrent chips, cluster-level orchestration with cross-vendor prefill-decode disaggregation, and turnkey GPU cluster solutions for AI data centers, cloud service providers, telecom operators, and government AI projects.

Differentiator
Functional benefit
Problem solved
Quantifiable outcome1 of 7 values shown
  • 1.68x throughput improvement for DeepSeek R1 671B on AMD MI300X vs ROCm vLLM baseline
+6 more records
Product overview1 text field

Moreh is an AI infrastructure software company founded in 2020 by HPC experts, offering a modular platform-plus-modules architecture. Its core products include the MoAI Inference Framework (cluster-scale orchestration), Moreh vLLM for AMD and Tenstorrent (chip-level inference engines), MoAI Performance Gateway (intelligent workload routing), MoAI Fabric (cross-vendor KV cache transfer), and MoAI Training Framework (fine-tuning and training). Additional capabilities include SLOPE (long-context prefill engine), TIDE (runtime draft model training), and HetCCL (cross-vendor collective communication). Moreh delivers turnkey GPU cluster solutions for AMD Instinct and Tenstorrent hardware, enabling organizations to unify heterogeneous GPUs across vendors and generations into a single inference cluster. Its subsidiary Motif Technologies develops Korean-language generative AI models. The company targets AI data centers seeking to maximize tokens per dollar through chip-level, cluster-level, and infrastructure optimization.

Product and service11 records
1MoAI Inference Framework
CategoryAI Inference Software
Description

Production-grade end-to-end inference stack optimized for heterogeneous accelerators (AMD, NVIDIA, Tenstorrent) that provides routing and scheduling, auto scaling, SLO-driven optimization, and KV cache management across cluster-scale deployments. Targets enterprise AI data centers running large language models.

2MoAI Performance Gateway
CategoryAI Inference Software
Description

Intelligent workload distribution component across heterogeneous accelerators, enabling cross-vendor GPU orchestration and automated optimization decisions within the MoAI Inference Framework. Provides dynamic routing and load balancing across GPUs from different vendors and generations.

3MoAI Fabric
CategoryAI Inference Software
Description

Software-defined, cross-vendor GPU memory fabric for KV cache transfer, enabling RDMA-based communication between GPUs from different vendors (e.g., NVIDIA and AMD) across cluster nodes for inference workloads.

4Moreh vLLM for AMD
CategoryAI Inference Software
Description

Drop-in vLLM replacement optimized for AMD GPUs that delivers up to 2x higher throughput on AMD Instinct GPUs. Includes custom kernels for GEMM, Attention, and MoE operations, and is distributed as container images with regular updates for AMD GPU clusters.

5Moreh vLLM for Tenstorrent
CategoryAI Inference Software
Description

High-performance vLLM serving engine purpose-built for Tenstorrent Wormhole accelerators. Supports state-of-the-art MoE models including DeepSeek, GPT-OSS, and Qwen, with 450+ optimized operators for general heterogeneous GPU inference.

6MoAI Training Framework
CategoryAI Training Software
Description

Training and fine-tuning framework for AMD and Tenstorrent GPU clusters. PyTorch-compatible with 450+ operators, enabling fine-tuning and training on the same cluster used for inference.

7Turnkey AMD GPU Clusters
CategoryGPU Cluster Solutions
Description

Full-stack turnkey AMD Instinct GPU cluster solution that includes hardware procurement, rack layout and power planning, network topology design (RoCE), Kubernetes platform deployment, and Moreh's inference software stack. Delivered to AI data centers, with 1,200+ AMD MI250 GPUs deployed at KT Cloud for training operations.

8Tenstorrent AI Clusters
CategoryGPU Cluster Solutions
Description

Cost-efficient AI cluster solution built around Tenstorrent's network-integrated Wormhole processors and Galaxy servers. Moreh provides end-to-end support from hardware supply and cluster building to software deployment and ongoing technical support for Tenstorrent-specific issues and performance tuning.

9Heterogeneous GPU Inference Solution
CategoryGPU Cluster Solutions
Description

Solution unifying GPUs across vendors, architectures, and generations into a single inference cluster. Supports three scenarios: legacy + new generation GPUs (e.g., H100 + B200), NVIDIA + AMD mixed clusters (e.g., H200 + MI355X), and GPU + AI accelerator mixed (e.g., GPU + Tenstorrent).

10Inference Cost Optimization Solution
CategoryGPU Cluster Solutions
Description

Cost-per-token optimization solution operating across three levers: chip-level optimization (Moreh vLLM), cluster-level optimization (PD disaggregation, prefix caching, auto scaling), and infrastructure cost reduction (heterogeneous GPU utilization). Achieves up to 2.2x throughput on 40% fewer servers.

11Motif Technologies AI Models
CategoryFoundation Models / Cloud Services
Description

Subsidiary that develops Korean-language generative AI models including Motif 12.7B with proprietary GDA (group differential attention) architecture, plus cloud services. Selected as lead team for Korea's government 'Independent AI Foundation Model' project developing multimodal foundation models across text, images, video, and audio.

Scale indicator13 records

Each record includes

Type, Value, Description, Source

Partnership5 partners
Strategic tierCoreTypeStrategic or Co-development PartnerAnnounced on2026-02-20
Description

Selected as lead team for Korea's 'Independent AI Foundation Model' project, forming consortium with 17 participating institutions and 12 demand-side institutions. Consortium includes Moreh for GPU optimization, academic institutions for multimodal design, and companies for data creation and synthetic VLA data generation.

Strategic tierSecondaryTypeStrategic or Co-development PartnerAnnounced on2025-09-11
Description

Collaboration to expand into deep learning inference market. Joint development of AMD-based distributed inference system. Showcase of distributed inference system on AMD hardware at AI Infra Summit 2025, demonstrating DeepSeek model optimization more efficient than NVIDIA systems.

Strategic tierCoreTypeStrategic or Co-development PartnerAnnounced on2025-02-01
Description

Subsidiary established in February 2025 for model development and cloud services. Led by Motif CEO Lim Jung-hwan, developing proprietary AI architecture including GDA (group differential attention) structure. Motif 12.7B model ranked first among domestic models in Artificial Analysis intelligence index. Selected as lead team for Korea's sovereign AI foundation model project.

4Tenstorrent
Strategic tierCoreTypeStrategic or Co-development PartnerAnnounced on2024-11-18
Description

Strategic partnership to challenge NVIDIA in AI data center market. Combines Tenstorrent's AI semiconductors (NPUs/Wormhole processors) with Moreh's parallel processing software to support inference and LLM training applications. Planned for commercialization in H1 2025. Joint AI data center solution unveiled at SuperComputing 2025 with cost-efficient alternative to NVIDIA infrastructure.

moreh.io
Strategic tierCoreTypeChannel Partner/ Reseller/ DistributorAnnounced on2022-11-11
Description

Launched Hyperscale AI Computing service in December 2021 based on Moreh's MoAI platform and AMD Instinct MI250 accelerators. Service became paid in August 2022. Selected as official cloud service for Korean government HPC program. KT Cloud resells GPU access through Moreh's virtualization platform.

Recent move10 records

Each record includes

Date, Type, Title, Description, Source

Expansion highlight6 records

Each record includes

Type, Description

Peers10 records
TypeDirect peer
Description

Anyscale operates a Ray-based AI compute platform for production AI workloads including LLM serving and batch inference. Comparable to Moreh as a platform layer that abstracts heterogeneous compute (Ray clusters vs Moreh's MoAI cluster abstraction) for enterprise AI deployment, with similar developer-led go-to-market and OSS roots.

TypeDirect peer
Description

Together AI provides an AI cloud and inference platform optimized for open-source LLMs with custom kernels and inference engines. Directly comparable to Moreh in offering inference-as-a-service with proprietary optimizations on top of open-source serving frameworks (vLLM, FlashAttention), targeting cost-sensitive enterprise and developer customers.

TypeDirect peer
Description

Fireworks AI is a model-serving platform optimized for low-latency LLM inference with proprietary kernel and routing optimizations. Comparable to Moreh's MoAI Inference Framework as a production-grade inference orchestration layer, with similar focus on throughput-per-dollar and serving reliability for frontier models.

TypeDirect peer
Description

Modular builds the Mojo language and a unified AI inference platform (MAX) that targets heterogeneous accelerators with high-performance compilation. Comparable to Moreh in pursuing compiler/runtime-level optimization (Moreh IR vs Modular's Mojo/MAX) and in abstracting GPUs from the application developer, with similar AI infrastructure software positioning.

TypeDirect peer
Description

OctoAI built an enterprise AI inference platform optimized across hardware backends before being acquired by NVIDIA. Comparable as a prior independent inference-software specialist competing on cost-per-token across heterogeneous accelerators — a direct competitive template Moreh continues to operate within.

TypeDirect peer
Description

Replicate operates a cloud platform for running and deploying ML models, with proprietary inference optimization on heterogeneous hardware (AMD, NVIDIA, Apple Silicon). Comparable to Moreh's MoAI as a software layer that makes running open-source models efficient across accelerators, targeting developers and enterprises.

TypeEmerging player
Description

RunPod provides GPU cloud infrastructure with inference endpoints and custom kernel optimizations for AMD and NVIDIA hardware. Comparable as a smaller, AMD-friendly alternative GPU cloud whose software stack overlaps with Moreh's turnkey AMD cluster offerings for cost-sensitive AI customers.

TypeBroad incumbent
Description

CoreWeave is a large-scale GPU cloud provider with proprietary orchestration and inference serving software (TensorWave). Comparable as an AI infrastructure operator competing for the same cost-optimized inference workloads, though NVIDIA-centric and significantly larger and more capitalized than Moreh.

9Lambda Labs
TypeBroad incumbent
Description

Lambda provides GPU cloud, on-prem clusters, and inference serving software for AI workloads. Comparable to Moreh in offering turnkey GPU clusters with proprietary software optimizations, though primarily NVIDIA-focused and operating at a larger scale.

10Tenstorrent
TypeOthers
Description

Tenstorrent is an AI accelerator (NPU) company and Moreh's strategic partner, with joint AI data center solutions unveiled at SuperComputing 2025. Listed as a peer rather than partner because Tenstorrent's success directly determines Moreh's addressable market on the Tenstorrent hardware ecosystem; the strategic alignment is also a mutual competitive dependency.

Market position
Strengths5 records

Each record includes

Headline, Details, Source

Weaknesses5 records

Each record includes

Headline, Details, Source

Competitive moat5 records

Each record includes

Type, Details

Key risks6 records

Each record includes

Headline, Details, Source

Key highlights7 records

Each record includes

Headline, Details, Source

Customer concentration

Classification, Details

Named customers4 records

Each record includes

Name, Industry, Type, Use case, Source, UUID

Segment4 records

Each record includes

Title, Type, Primary, Description, Pain point addressed, Use case, Source

Ideal customer profile4 records

Each record includes

Profile, Firmographic size, Sales motion, Sales cycle length, Buying structure, Purchase trigger, Buyer persona, Geography, Industry vertical, Primary use case, Description, Pain points, Evidence proof points, Target buyer

Technology focused
Yes
API detail
Has APIbool
Yes

Docs URL, Description

Integration4 records

Each record includes

Title, Type, Description, Source

AI capability6 records

Each record includes

Type, Description, Source

AI maturity
App detail

Has app

Feature10 records

Each record includes

Title, Differentiator, Description, Source

Core technology
Revenue estimate
Valuation estimate
Number of profiles
Profiles6 records

Each record includes

Name, Designation, Designation category, Overview, Profile commentary, Source

Subsidiaries2 records

Each record includes

Name, Acquired on, Relationship type, Type, Business focus

Compliance1 record

Each record includes

Name, Class, Description

Funding overview

Funding stage, Last funding date, Total funding USD

Funding rounds6 records

Each record includes

Round, Amount USD, Date, Pre money valuation, Total investors, Investors, News

Investors4 records

Each record includes

Name, Type, Date of entry, Rounds participated, Website

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

M&A

Each record includes

Name, Acquisition type, Announced date, Completed date, Status, Website, News

Investment

Each record includes

Name, Round, Announced date, Lead investor, Website, News

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Moreh

AI Inference Softwaremoreh.io

Moreh is a Seoul-based AI infrastructure software company building the MoAI full-stack inference platform that orchestrates heterogeneous GPU clusters (AMD, NVIDIA, Tenstorrent), serving AI data centers, cloud providers, telecom operators, and government AI initiatives with cross-vendor disaggregation and custom inference engines.

What Moreh does

Moreh is an AI infrastructure software company founded in September 2020 in Seoul, South Korea, that builds a full-stack inference platform — the MoAI framework — optimized for heterogeneous GPU clusters spanning AMD Instinct, NVIDIA, and Tenstorrent accelerators. The core product line includes the MoAI Inference Framework (cluster-scale routing, scheduling, auto-scaling, KV cache management), Moreh vLLM drop-in replacements for AMD and Tenstorrent GPUs, MoAI Performance Gateway for cross-vendor workload distribution, MoAI Fabric for RDMA-based KV cache transfer across vendors, and proprietary primitives including HetCCL (cross-vendor collective communication), SLOPE (long-context prefill engine), and TIDE (runtime draft model trainer). The company reports differentiated capabilities such as cross-vendor prefill-decode disaggregation between NVIDIA H100 and AMD MI300X, with published benchmarks claiming up to 1.84x lower latency and 67% higher throughput versus single-vendor baselines.

The company monetizes via enterprise software licensing (subscription, quote-based, multi-year) combined with professional and managed services that bundle hardware procurement, cluster design and deployment, and ongoing optimization for AMD and Tenstorrent clusters; pricing is not publicly disclosed. Distribution runs through direct enterprise sales to AI data centers, cloud service providers, and telecom operators, augmented by strategic channel partnerships with AMD and Tenstorrent for joint go-to-market and open-source contributions to ROCm, SGLang, SkyPilot, and Tenstorrent Metalium. Key customers include KT Cloud (Hyperscale AI Computing service running 1,200+ AMD MI250 GPUs) and the Korea Ministry of Science and ICT (lead consortium for the national sovereign AI foundation model project); subsidiary Motif Technologies develops proprietary Korean-language LLMs. The company is backed by AMD, KT, and Forest Ventures, with cumulative funding exceeding $50 million USD and a post-money valuation of approximately 350 billion KRW (~$250M USD) as of September 2025.

Moreh firmographics

Firmographics
Name
Moreh
Legal name
Moreh, Inc.
Website
https://moreh.io
Company type
Private
Founded year
2020
Operating status
Operating
Headcount range
51–100 employees
Short description
Moreh is a Seoul-based AI infrastructure software company building the MoAI full-stack inference platform that orchestrates heterogeneous GPU clusters (AMD, NVIDIA, Tenstorrent), serving AI data centers, cloud providers, telecom operators, and government AI initiatives with cross-vendor disaggregation and custom inference engines.
Ownership category
akta.pro rank

Moreh industry classification

Industry
Product category
AI Inference Software
NAICS
Computer Systems Design and Related Services (5415), Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services (518), Custom Computer Programming Services (541511)
SIC
Services-Prepackaged Software (7372), Services-Computer Integrated Systems Design (7373), Services-Computer Programming, Data Processing, Etc. (7370)
akta.pro industry
PRIMARYHDAEANAC
Model Serving, Inference & Deployment Platforms (APIs, Edge/On-Prem)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
SECONDARYHDAAAAAI
AI Compiler, Runtime & Kernel Optimization Software (CUDA/ROCm/XLA, graph compilers)
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/AI Infrastructure & Compute (GPUs/ASICs, accelerators)
SECONDARYHDAAAAAG
AI Compute Virtualization & Scheduling (GPU virtualization, cluster schedulers)
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/AI Infrastructure & Compute (GPUs/ASICs, accelerators)
SECONDARYHDAAABAF
Model Deployment, Serving & Inference Platforms
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/ML Platforms, MLOps & Model Lifecycle Management
SECONDARYHDAAACAB
Model Hosting, Serving & Inference Platforms
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/Foundation Models & Generative AI (LLMs, multimodal)

Keywords

  • AI inference software
  • GPU cluster management
  • LLM serving infrastructure
  • Heterogeneous computing platforms
  • GPU virtualization software

Where Moreh is headquartered

Location

Headquarters

HQ city
Seoul
HQ country
South Korea
HQ region
Asia

Offices3 records

Markets served

Moreh business model

Business model
GTM type
B2B
Offering type
Software
Cost components
Personnel, Technology or R&D, Operations, Marketing or Sales, Infrastructure

Revenue model

  1. AI Infrastructure Software Licensing: Software licensing for AI inference infrastructure, including MoAI Inference Framework and Moreh vLLM. Provided as container images with regular updates for AMD GPU clusters and Tenstorrent solutions. Pricing appears to be enterprise quote-based with multi-year contracts.
  2. Turnkey GPU Cluster Solutions: End-to-end AMD GPU cluster solutions combining hardware procurement, cluster design/building, software deployment, and ongoing technical support. Covers rack layout, power planning, network topology design, and deployment of Moreh inference software.
  3. Tenstorrent AI Cluster Solutions: Scalable AI cluster solutions built around Tenstorrent Wormhole processors, including hardware supply, cluster construction, software deployment, and continuous technical support for Tenstorrent-specific issues and performance tuning.
  4. Custom Benchmarking Services: Custom benchmarking engagements where Moreh runs performance tests on customer workloads to demonstrate cost reduction effects and token-per-dollar improvements, likely as part of enterprise sales process.

Pricing tiers

ModelBillingPrice
SubscriptionMulti-year contractEnterprise licensing with custom benchmarking

Go-to-market motion3 records

Distribution channels3 records

Marketing channels6 records

Moreh product offering

Product offering

Core offering

Moreh develops and licenses full-stack AI inference software (the MoAI platform) that enables organizations to run and serve large language models on heterogeneous GPU clusters combining AMD Instinct, NVIDIA, and Tenstorrent accelerators. The offering spans chip-level custom kernels, Moreh vLLM inference engines optimized for AMD and Tenstorrent chips, cluster-level orchestration with cross-vendor prefill-decode disaggregation, and turnkey GPU cluster solutions for AI data centers, cloud service providers, telecom operators, and government AI projects.

Product overview

Moreh is an AI infrastructure software company founded in 2020 by HPC experts, offering a modular platform-plus-modules architecture. Its core products include the MoAI Inference Framework (cluster-scale orchestration), Moreh vLLM for AMD and Tenstorrent (chip-level inference engines), MoAI Performance Gateway (intelligent workload routing), MoAI Fabric (cross-vendor KV cache transfer), and MoAI Training Framework (fine-tuning and training). Additional capabilities include SLOPE (long-context prefill engine), TIDE (runtime draft model training), and HetCCL (cross-vendor collective communication). Moreh delivers turnkey GPU cluster solutions for AMD Instinct and Tenstorrent hardware, enabling organizations to unify heterogeneous GPUs across vendors and generations into a single inference cluster. Its subsidiary Motif Technologies develops Korean-language generative AI models. The company targets AI data centers seeking to maximize tokens per dollar through chip-level, cluster-level, and infrastructure optimization.

Differentiator

Problem solved

Functional benefit

Products and services

  • MoAI Inference Framework Production-grade end-to-end inference stack optimized for heterogeneous accelerators (AMD, NVIDIA, Tenstorrent) that provides routing and scheduling, auto scaling, SLO-driven optimization, and KV cache management across cluster-scale deployments. Targets enterprise AI data centers running large language models.
  • MoAI Performance Gateway Intelligent workload distribution component across heterogeneous accelerators, enabling cross-vendor GPU orchestration and automated optimization decisions within the MoAI Inference Framework. Provides dynamic routing and load balancing across GPUs from different vendors and generations.
  • MoAI Fabric Software-defined, cross-vendor GPU memory fabric for KV cache transfer, enabling RDMA-based communication between GPUs from different vendors (e.g., NVIDIA and AMD) across cluster nodes for inference workloads.
  • Moreh vLLM for AMD Drop-in vLLM replacement optimized for AMD GPUs that delivers up to 2x higher throughput on AMD Instinct GPUs. Includes custom kernels for GEMM, Attention, and MoE operations, and is distributed as container images with regular updates for AMD GPU clusters.
  • Moreh vLLM for Tenstorrent High-performance vLLM serving engine purpose-built for Tenstorrent Wormhole accelerators. Supports state-of-the-art MoE models including DeepSeek, GPT-OSS, and Qwen, with 450+ optimized operators for general heterogeneous GPU inference.
  • MoAI Training Framework Training and fine-tuning framework for AMD and Tenstorrent GPU clusters. PyTorch-compatible with 450+ operators, enabling fine-tuning and training on the same cluster used for inference.
  • Turnkey AMD GPU Clusters Full-stack turnkey AMD Instinct GPU cluster solution that includes hardware procurement, rack layout and power planning, network topology design (RoCE), Kubernetes platform deployment, and Moreh's inference software stack. Delivered to AI data centers, with 1,200+ AMD MI250 GPUs deployed at KT Cloud for training operations.
  • Tenstorrent AI Clusters Cost-efficient AI cluster solution built around Tenstorrent's network-integrated Wormhole processors and Galaxy servers. Moreh provides end-to-end support from hardware supply and cluster building to software deployment and ongoing technical support for Tenstorrent-specific issues and performance tuning.
  • Heterogeneous GPU Inference Solution Solution unifying GPUs across vendors, architectures, and generations into a single inference cluster. Supports three scenarios: legacy + new generation GPUs (e.g., H100 + B200), NVIDIA + AMD mixed clusters (e.g., H200 + MI355X), and GPU + AI accelerator mixed (e.g., GPU + Tenstorrent).
  • Inference Cost Optimization Solution Cost-per-token optimization solution operating across three levers: chip-level optimization (Moreh vLLM), cluster-level optimization (PD disaggregation, prefix caching, auto scaling), and infrastructure cost reduction (heterogeneous GPU utilization). Achieves up to 2.2x throughput on 40% fewer servers.
  • Motif Technologies AI Models Subsidiary that develops Korean-language generative AI models including Motif 12.7B with proprietary GDA (group differential attention) architecture, plus cloud services. Selected as lead team for Korea's government 'Independent AI Foundation Model' project developing multimodal foundation models across text, images, video, and audio.

Quantifiable outcome

  • 1.68x throughput improvement for DeepSeek R1 671B on AMD MI300X vs ROCm vLLM baseline
  • +6 more outcomes

Companies that use Moreh

Customer profile

Named customers4 records

Segments4 records

Ideal customer profiles4 records

Moreh technology and API

Technology

Technology focussed Yes

API detail

Has API
Yes
API docs
API detail

Core technology

AI maturity

App detail

Integration4 records

AI capability6 records

Feature10 records

Moreh partnerships and signals

Strategic signal

Partnerships

Five partnerships are on record, tiered core and secondary.

  • Korea Ministry of Science and ICTcoreStrategic or Co-development Partner · 20 February 2026Selected as lead team for Korea's 'Independent AI Foundation Model' project, forming consortium with 17 participating institutions and 12 demand-side institutions. Consortium includes Moreh for GPU optimization, academic institutions for multimodal design, and companies for data creation and synthetic VLA data generation.
  • SGLangsecondaryStrategic or Co-development Partner · 11 September 2025Collaboration to expand into deep learning inference market. Joint development of AMD-based distributed inference system. Showcase of distributed inference system on AMD hardware at AI Infra Summit 2025, demonstrating DeepSeek model optimization more efficient than NVIDIA systems.
  • Motif TechnologiescoreStrategic or Co-development Partner · 1 February 2025Subsidiary established in February 2025 for model development and cloud services. Led by Motif CEO Lim Jung-hwan, developing proprietary AI architecture including GDA (group differential attention) structure. Motif 12.7B model ranked first among domestic models in Artificial Analysis intelligence index. Selected as lead team for Korea's sovereign AI foundation model project.
  • TenstorrentcoreStrategic or Co-development Partner · 18 November 2024Strategic partnership to challenge NVIDIA in AI data center market. Combines Tenstorrent's AI semiconductors (NPUs/Wormhole processors) with Moreh's parallel processing software to support inference and LLM training applications. Planned for commercialization in H1 2025. Joint AI data center solution unveiled at SuperComputing 2025 with cost-efficient alternative to NVIDIA infrastructure.
  • KT CloudcoreChannel Partner/ Reseller/ Distributor · 11 November 2022Launched Hyperscale AI Computing service in December 2021 based on Moreh's MoAI platform and AMD Instinct MI250 accelerators. Service became paid in August 2022. Selected as official cloud service for Korean government HPC program. KT Cloud resells GPU access through Moreh's virtualization platform.

Scale indicators13 records

Recent moves10 records

Expansion highlights6 records

Moreh competitors and assessment

Company assessment

Direct peers

  • Anyscale: Anyscale operates a Ray-based AI compute platform for production AI workloads including LLM serving and batch inference. Comparable to Moreh as a platform layer that abstracts heterogeneous compute (Ray clusters vs Moreh's MoAI cluster abstraction) for enterprise AI deployment, with similar developer-led go-to-market and OSS roots.
  • Together AI: Together AI provides an AI cloud and inference platform optimized for open-source LLMs with custom kernels and inference engines. Directly comparable to Moreh in offering inference-as-a-service with proprietary optimizations on top of open-source serving frameworks (vLLM, FlashAttention), targeting cost-sensitive enterprise and developer customers.
  • Fireworks AI: Fireworks AI is a model-serving platform optimized for low-latency LLM inference with proprietary kernel and routing optimizations. Comparable to Moreh's MoAI Inference Framework as a production-grade inference orchestration layer, with similar focus on throughput-per-dollar and serving reliability for frontier models.
  • Modular: Modular builds the Mojo language and a unified AI inference platform (MAX) that targets heterogeneous accelerators with high-performance compilation. Comparable to Moreh in pursuing compiler/runtime-level optimization (Moreh IR vs Modular's Mojo/MAX) and in abstracting GPUs from the application developer, with similar AI infrastructure software positioning.
  • OctoAI (acquired by NVIDIA): OctoAI built an enterprise AI inference platform optimized across hardware backends before being acquired by NVIDIA. Comparable as a prior independent inference-software specialist competing on cost-per-token across heterogeneous accelerators — a direct competitive template Moreh continues to operate within.
  • Replicate: Replicate operates a cloud platform for running and deploying ML models, with proprietary inference optimization on heterogeneous hardware (AMD, NVIDIA, Apple Silicon). Comparable to Moreh's MoAI as a software layer that makes running open-source models efficient across accelerators, targeting developers and enterprises.

Emerging players

  • RunPod: RunPod provides GPU cloud infrastructure with inference endpoints and custom kernel optimizations for AMD and NVIDIA hardware. Comparable as a smaller, AMD-friendly alternative GPU cloud whose software stack overlaps with Moreh's turnkey AMD cluster offerings for cost-sensitive AI customers.

Broad incumbents

  • CoreWeave: CoreWeave is a large-scale GPU cloud provider with proprietary orchestration and inference serving software (TensorWave). Comparable as an AI infrastructure operator competing for the same cost-optimized inference workloads, though NVIDIA-centric and significantly larger and more capitalized than Moreh.
  • Lambda Labs: Lambda provides GPU cloud, on-prem clusters, and inference serving software for AI workloads. Comparable to Moreh in offering turnkey GPU clusters with proprietary software optimizations, though primarily NVIDIA-focused and operating at a larger scale.

Others

  • Tenstorrent: Tenstorrent is an AI accelerator (NPU) company and Moreh's strategic partner, with joint AI data center solutions unveiled at SuperComputing 2025. Listed as a peer rather than partner because Tenstorrent's success directly determines Moreh's addressable market on the Tenstorrent hardware ecosystem; the strategic alignment is also a mutual competitive dependency.

Market position

Strengths5 records

Weaknesses5 records

Competitive moat5 records

Key risks6 records

Key highlights7 records

Customer concentration

Moreh social profiles

Digital presence

Moreh compliance and trust

Trust signal

Compliance1 record

Moreh financial estimates

Financial estimate

Revenue estimate

Valuation estimate

Moreh leadership team

Management profile

Number of profiles

Profiles6 records

Moreh subsidiaries and ownership

Company hierarchy

Subsidiaries2 records

Moreh funding detail

Funding detail

Funding overview

Funding rounds6 records

Investors4 records

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

Moreh M&A and investment

M&A and investment

M&A

Investments

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Frequently asked questions about Moreh

What does Moreh do?

Moreh develops and licenses full-stack AI inference software (the MoAI platform) that enables organizations to run and serve large language models on heterogeneous GPU clusters combining AMD Instinct, NVIDIA, and Tenstorrent accelerators. The offering spans chip-level custom kernels, Moreh vLLM inference engines optimized for AMD and Tenstorrent chips, cluster-level orchestration with cross-vendor prefill-decode disaggregation, and turnkey GPU cluster solutions for AI data centers, cloud service providers, telecom operators, and government AI projects.

Is Moreh a public or private company?

Moreh is a private company. It is classified as venture growth investor backed and is currently operating.

When was Moreh founded?

Moreh was founded in 2020. It employs 51 to 100 people.

Where is Moreh based?

Moreh is headquartered in Seoul, South Korea, in the Asia region.

How does Moreh make money?

Four revenue lines are on record. AI Infrastructure Software Licensing is the primary driver. The others are turnkey GPU Cluster Solutions, tenstorrent AI Cluster Solutions and custom Benchmarking Services.

Who are Moreh's main competitors?

Direct peers on record are Anyscale, Together AI, Fireworks AI, Modular, OctoAI (acquired by NVIDIA) and Replicate. RunPod is listed as an emerging player. Broad incumbents are CoreWeave and Lambda Labs. Tenstorrent is listed as an others.

Does Moreh have an API?

Yes. Moreh provides an OpenAI-compatible API endpoint across its cluster deployments via the MoAI Inference Framework, allowing developers to route inference requests through a unified cluster-wide API. The API supports both inference and training workloads and is accessible via standard REST calls. Developer documentation is at docs.moreh.io.

What industry is Moreh in?

Moreh's product category is AI Inference Software. Its primary akta.pro industry code is HDAEANAC, Model Serving, Inference & Deployment Platforms (APIs, Edge/On-Prem), with a secondary code of HDAAAAAI, AI Compiler, Runtime & Kernel Optimization Software (CUDA/ROCm/XLA, graph compilers). Its NAICS code is 5415 and its SIC code is 7372.

Unlock the full company data

50 free credits on sign-up, no credit card required.

Contact sales
Live signals
AijournMOREH Showcases High-Performance LLM Inference on AMD GPUs at AMD Advancing AI 2026Moreh, an AI infrastructure software company, participated in AMD Advancing AI 2026 in San Francisco on July 22–23, 2026, demonstrating its MoAI Inference Framework running the GLM-5.1 large language model on a system with 32 AMD Instinct MI300X GPUs across four nodes. The live demonstration showcased real-time inference metrics including GPU utilization, Tokens Per Second, Time To First Token, and Time Per Output Token, receiving positive feedback from attendees for its fast response times and stable performance at production-grade levels. Moreh stated it aims to continue advancing its AI infrastructure software to help enterprises operate AI services efficiently regardless of the underlying GPU platform.PR Newswire APACMOREH Showcases High-Performance LLM Inference on AMD GPUs at AMD Advancing AI 2026Moreh, a Korean AI infrastructure software company, showcased its MoAI Inference Framework running the GLM-5.1 large language model on 32 AMD Instinct MI300X GPUs at AMD Advancing AI 2026 in San Francisco on July 22–23. The live demonstration displayed real-time inference metrics including GPU utilization, Tokens Per Second, and Time To First Token, allowing attendees to verify production-grade performance and efficiency on AMD hardware. Global AI industry leaders and enterprise customers expressed strong interest in the technology, which Moreh positions as the world's first commercially deployed distributed inference solution for the AMD ecosystem.PR NewswireMOREH Showcases High-Performance LLM Inference on AMD GPUs at AMD Advancing AI 2026Moreh, an AI infrastructure software company, participated in AMD Advancing AI 2026 in San Francisco, demonstrating its MoAI Inference Framework running the GLM-5.1 large language model across 32 AMD Instinct MI300X GPUs. The live demonstration showcased real-time inference metrics including GPU utilization, Tokens Per Second, Time To First Token, and Time Per Output Token, receiving positive feedback from attendees for its fast response times and stable performance. Moreh positions its distributed inference technology as addressing the industry's challenge of rising AI infrastructure and service costs by delivering more efficient inference infrastructure.MorningstarMOREH Showcases High-Performance LLM Inference on AMD GPUs at AMD Advancing AI 2026Moreh demonstrated its MoAI Inference Framework running GLM-5.1 on 32 AMD Instinct MI300X GPUs at AMD Advancing AI 2026. The live demo showed real-time metrics like GPU utilization, TPS, TTFT, and TPOT, with positive feedback on performance and stability. Moreh plans to continue advancing its AI infrastructure software for enterprises.YahooMOREH Showcases High-Performance LLM Inference on AMD GPUs at AMD Advancing AI 2026Moreh, an AI infrastructure software company, participated in AMD Advancing AI 2026 held in San Francisco on July 22–23, 2026, where it demonstrated its MoAI Inference Framework running the GLM-5.1 large language model across 32 AMD Instinct MI300X GPUs. The live demonstration showcased key performance metrics including GPU utilization, Tokens Per Second, and Time To First Token, receiving positive feedback for fast response times and stable performance. Moreh, which claims the MoAI Inference Framework is the world's first commercially deployed distributed inference solution for the AMD ecosystem, positions the technology as addressing the industry's challenge of rising AI infrastructure and service costs.Venturesquare모레, UN이 주목한 AI 인프라…’AI for Good’ 혁신 사례 선정More's heterogeneous AI infrastructure software was selected as an influential innovation case at the ITU's AI for Good Global Summit 2026. The software integrates various AI accelerators without relying on specific GPUs, reducing cost and energy consumption. More plans to expand its AI infrastructure software business and overseas markets.PR NewswireMOREH Demonstrates Production-Ready LLM Inference on Tenstorrent Galaxy, Achieving DGX A100-Class Performance with Improved Cost EfficiencyMoreh, an AI infrastructure software company, announced successful validation of LLM inference performance on the Tenstorrent Galaxy Wormhole system, achieving performance matching or surpassing NVIDIA DGX A100-class systems across leading MoE models including GPT-OSS, Qwen, GLM, and DeepSeek. The company demonstrated improved cost efficiency by implementing a disaggregated serving architecture that uses Tenstorrent processors as dedicated prefill accelerators, reducing reliance on expensive HBM memory. The results were unveiled at Tenstorrent's TT-Deploy launch event in San Francisco on May 1, where Moreh showcased its MoAI Inference Framework enabling unified operation of heterogeneous GPUs and NPUs within a single cluster.LinkedInLinkedInMoreh has introduced SLOPE, an engine that aggregates multiple legacy GPU servers to efficiently handle long-context prefill operations in AI data centers, applying context parallelism and pipeline parallelism to reduce time to first token for long input sequences. The technology was demonstrated processing the prefill stage of gpt-oss-120b with 16 AMD MI250 GPUs in under one second for 64,000-token inputs. Moreh positions SLOPE as part of its broader strategy to help data centers better utilize existing GPU infrastructure alongside newer accelerators, and also offers TIDE for training draft models on older GPUs.Morehブログ – MorehMoreh reports on various advancements and benchmarks involving GPU-based inference and training for large language models (LLMs), focusing on AMD's MI300X and NVIDIA's H100 GPUs. These include cross-vendor disaggregated inference frameworks, performance improvements, and system architectures, with specific impacts on latency and throughput.Moreh블로그 – MorehVarious technical reports, case studies, and blog posts detail the development and optimization of Large Language Model (LLM) inference and training frameworks utilizing AMD and NVIDIA GPUs, specifically involving AMD MI300X and NVIDIA H100. Key advancements include reduced inference latency, increased throughput, and improved scalability of AI models across heterogeneous and multi-node GPU clusters.