What Standard Performance Evaluation does

Standard Performance Evaluation Corporation (SPEC) is a non-profit corporation founded in 1988 and headquartered in Gainesville, Virginia, established to create and maintain standardized, vendor-neutral benchmarks and tools for evaluating computing system performance and energy efficiency. The organization operates as a membership consortium with over 120 member organizations spanning 22 countries — including hardware vendors (AMD, Intel, NVIDIA, Dell, HPE, Lenovo, Supermicro, Ampere, ARM, SiFive), hyperscale cloud providers (AWS, Google, Microsoft), educational institutions, and government agencies. SPEC is governed by an elected board of directors and staffed by four headquarters personnel managing worldwide operations across six groups: Open Systems Group (OSG), Graphics and Workstation Performance Group (GWPG), High Performance Group (HPG), International Standards Group (ISG), Research Group (RG), and Embedded Group (EG, formed via the 2023 absorption of EEMBC).

The portfolio spans approximately two dozen active benchmarks across CPU (SPEC CPU 2026, the flagship suite with 52 tests), graphics and workstation (SPECviewperf 15, SPECapc for SolidWorks/Solid Edge/Siemens NX/Creo/Maya, SPECworkstation 4.0), high-performance computing (SPEChpc 2021, SPEC MPI 2007, SPEC OMP 2012, SPECaccel 2023), Java servers (SPECjbb 2015, SPECjEnterprise 2018, SPECjvm 2008), cloud infrastructure (SPEC Cloud IaaS 2018), storage and file serving (SPECstorage Solution 2020, SPEC SFS 2014), virtualization (SPECvirt Datacenter 2021), power and energy efficiency (SPECpower_ssj 2008, the SERT Suite with Chauffeur WDK and PTDaemon interface), and embedded systems (CoreMark, CoreMark-Pro, MLMark, ADASMark, AudioMark). Over 64,000 SPEC CPU results have been published and 300–400 results are reviewed and published weekly.

Revenue is generated through two primary streams: group-based membership dues (recurring) providing full access to benchmarks and participation in development, and licensed benchmark suite sales (one-time/site licenses) through the spec.org storefront, with payment processing handled by Cleverbridge. Discounted pricing is offered to educational institutions, non-profits, and government agencies. SPEC's SERT suite has been codified as the mandatory test method in U.S. EPA ENERGY STAR for Computer Servers (Version 3.0), the EU Ecodesign Directive (Commission Regulation 2019/424, Lot 9), Japan's METI Top Runner Programme, and ISO/IEC JTC1 SC39 21836:2020. The organization drives awareness through the co-sponsored ACM/SPEC International Conference on Performance Engineering (ICPE), its website, newsletters, social media, and earned media coverage in publications such as Tom's Hardware and Jon Peddie Research.

Name

Standard Performance Evaluation

Legal name

Standard Performance Evaluation Corporation

Website

https://spec.org

Company type

Private

Founded year

1988

Operating status

Operating

Headcount range

1–10 employees

Short description

SPEC is a non-profit consortium founded in 1988 that develops vendor-neutral, standardized benchmark suites for evaluating computing system performance and energy efficiency, serving hardware vendors, software developers, cloud providers, government regulators, and academic researchers across 22 countries.

Ownership category

akta.pro rank

Product category

Computing Performance Benchmarking Software

NAICS

Software Publishers (51321), Custom Computer Programming Services (541511)

SIC

Services-Prepackaged Software (7372), Services-Computer Programming Services (7371)

akta.pro primary industry

AI Benchmarking, Profiling & Performance Monitoring (HDAAAAAJ)

Keywords

• Computing performance benchmarks
• Vendor-neutral benchmarks
• Energy efficiency benchmarking
• HPC benchmark suites
• System performance evaluation

Headquarters

HQ city

Gainesville

HQ country

United States

HQ region

North America

Offices1 record

Markets served

GTM type

B2B

Offering type

Software

Cost components

Personnel, Technology or R&D, Operations, Marketing or Sales, Infrastructure

Revenue model

1. Benchmark Suite Sales: SPEC sells benchmark suites as licensed software products. Each group charges separately for its benchmark suites. Source code is provided along with tools and documentation. Income from benchmark source sales supports administrative costs.
2. Membership Dues: Companies and organizations pay dues to join SPEC groups. Membership provides full access to existing benchmarks including company-wide licenses and participation in ongoing development. Dues vary by group and cover operating costs.
3. Educational and Non-profit Pricing: SPEC offers discounted pricing for educational institutions, non-profit organizations, and government agencies. Educational discounts require purchase by and licensing to a faculty member or full-time employee.

Pricing tiers

Go-to-market motion2 records

Distribution channels3 records

Marketing channels8 records

Core offering

SPEC develops standardized, vendor-neutral benchmark suites and tools to evaluate performance and energy efficiency for computing systems, spanning CPU, graphics, HPC, Java, cloud, storage, virtualization, and embedded domains. The benchmarks are based on real-world applications and include source code that has been ported to numerous platforms, distributed as licensed software products and through a 125+ member consortium.

Product overview

SPEC (Standard Performance Evaluation Corporation) is a non-profit organization that establishes and maintains standardized, vendor-neutral benchmarks and tools to evaluate performance and energy efficiency for computing systems. The company offers a comprehensive portfolio of benchmark suites spanning multiple computing domains. The core products include the SPEC CPU benchmark series (SPEC CPU 2026 as the latest generation) for processor performance testing, the SPECviewperf and SPECapc families for graphics and workstation performance, SPEChpc and SPECaccel for high-performance computing, SPECjbb and SPECjEnterprise for Java server performance, SPEC Cloud IaaS for cloud infrastructure, SPECpower_ssj and SERT Suite for power and energy efficiency, and embedded benchmarks including CoreMark, CoreMark-Pro, MLMark, and ADASMark through the Embedded Group. The products are distributed as licensed software with source code, requiring users to compile and run benchmarks on their own systems with results published to SPEC's website. Each benchmark suite is managed by a specific committee within one of SPEC's six groups: Open Systems Group (OSG), Graphics and Workstation Performance Group (GWPG), High Performance Group (HPG), International Standards Group (ISG), Research Group (RG), and Embedded Group (EG).

Differentiator

Problem solved

Functional benefit

Products and services

• SPEC CPU 2026 Latest-generation vendor-neutral CPU benchmark suite with 52 tests, used by hardware vendors and procurement teams to measure compute-intensive performance across platforms.
• SPEC CPU 2017 Previous-generation CPU benchmark suite with 43 benchmark programs and over seven million lines of source code for measuring compute-intensive performance.
• SPECviewperf 15 Worldwide standard benchmark for measuring graphics performance based on professional applications, supporting DirectX 12 and Vulkan APIs.
• SPECapc for SolidWorks Application Performance Characterization benchmark for Dassault Systèmes SOLIDWORKS CAD/CAM software, updated annually.
• SPECapc for Maya Application Performance Characterization benchmark for Autodesk Maya 3D animation software.
• SPECapc for Siemens NX (SNX) Application Performance Characterization benchmark for Siemens NX CAD/CAM software, including SNX 2024 release.
• SPECapc for Creo Application Performance Characterization benchmark for PTC Creo CAD/CAM software.
• SPECworkstation 4.0 Comprehensive workstation performance benchmark measuring CPU, graphics, I/O, and memory bandwidth across diverse professional applications with modular architecture and AI/ML workload support.
• SPECaccel 2023 Benchmark suite measuring hardware-accelerated performance for highly parallel compute-intensive applications using OpenCL, OpenACC, and OpenMP standards.
• SPEChpc 2021 High performance computing benchmark suite representing real applications in scientific and technical computing.
• SPEC MPI 2007 Benchmark suite for measuring performance of compute-intensive applications using the Message-Passing Interface (MPI) across cluster and SMP hardware.
• SPEC OMP 2012 Benchmark suite for measuring performance and energy efficiency using applications based on the OpenMP standard for shared-memory parallel processing.
• SPECjbb 2015 Server-side Java benchmark developed to measure performance based on the latest Java application features, supporting virtualized hosts.
• SPECjEnterprise 2018 Web Profile Benchmark measuring full-system performance for Java Enterprise Edition (Java EE) Web Profile Version 7 or later application servers, databases, and supporting infrastructure.
• SPECjvm 2008 Java virtual machine benchmark with multithreaded workloads representing a broad range of application areas.
• SPEC Cloud IaaS 2018 Infrastructure-as-a-service performance benchmark for public and private cloud platforms.
• SPECpower_ssj 2008 First industry-standard benchmark evaluating power and performance characteristics of volume server-class computers.
• SERT Suite Server Efficiency Rating Tool developed for the U.S. EPA ENERGY STAR for Computer Servers specification; latest version 2.0.8 supports NVIDIA Grace, AMD Instinct MI300A, and Microsoft Pioneer platforms.
• SPECstorage Solution 2020 Benchmark suite to measure performance of storage configurations.
• SPEC SFS 2014 File server performance benchmark testing speed and request-handling capabilities using NFSv3 and CIFS protocols.
• SPECvirt Datacenter 2021 Benchmark addressing performance evaluation of datacenter servers used in virtualized server consolidation.
• SPECmail 2009 Benchmark for evaluating performance of mail servers compliant with SMTP and IMAP4 protocols.
• SPECweb 2009 Benchmark for measuring performance of web servers with real-world workloads and dynamic content in PHP and JSP.
• CoreMark Industry-standard benchmark for measuring performance of embedded processor hardware and software used in IoT and embedded devices.
• CoreMark-Pro Comprehensive benchmark for embedded processor performance covering modern mixed-signal SOCs, FPU, DSP, and cache/memory hierarchy.
• MLMark Benchmark for measuring machine learning performance on embedded platforms, covering inference workloads.
• ADASMark Benchmark for autonomous driving and advanced driver-assistance systems.
• AudioMark Benchmark for measuring embedded audio processing performance.

Quantifiable outcome

• Server efficiency improved 19X since SPECpower_ssj2008 introduction
• +2 more outcomes

Named customers16 records

Segments5 records

Ideal customer profiles5 records

API detail

Has API

No

API docs

API detail

Core technology

AI maturity

App detail

AI capability2 records

Feature5 records

Partnerships

Six partnerships are on record, tiered core and minor.

• U.S. Environmental Protection Agency (EPA)coreStrategic or Co-development PartnerSPEC developed the Server Efficiency Rating Tool (SERT) for use by the EPA. SERT became the mandatory test method for the ENERGY STAR Version 3.0 for Computer Servers specification, enabling EPA certification of server energy efficiency.
• European CommissioncoreStrategic or Co-development PartnerThe European Commission selected SERT as the only test method for the Ecodesign Directive (Commission Regulation (EU) 2019/424, aka Lot9) aimed at enterprise servers.
• Japan Ministry of the Environment (METI)coreStrategic or Co-development PartnerSERT became the only planned test method for Japan's Top Runner Programme, a set of efficiency standards for energy intensive products implemented through METI.
• International Standards Organization (ISO)coreStrategic or Co-development PartnerSPEC worked with ISO on the development of ISO/IEC JTC1 SC39 21836:2020 International Standard, expected to be the first international standard tool for server energy efficiency measurement.
• The Green Grid (TGG)minorStrategic or Co-development PartnerDavid Reiner serves as chairman of The Green Grid since 2020, leading the TGG Executive Leadership Council. TGG's Server and Storage Energy Working Group includes leading server energy efficiency regulatory experts.
• Association for Computing Machinery (ACM)coreStrategic or Co-development PartnerSPEC co-sponsors the ACM/SPEC International Conference on Performance Engineering (ICPE) with ACM. ICPE is the flagship conference in performance engineering, bringing together academic scholars and industrial practitioners.

Scale indicators8 records

Recent moves6 records

Expansion highlights7 records

Direct peers

• PassMark Software: Provider of PerformanceTest and BurnInTest benchmarking and stress-testing tools for Windows systems. Comparable to SPEC as a developer of standardized performance benchmarking software sold to enterprises, hardware vendors, and IT procurement teams.
• UL Solutions (Futuremark / 3DMark / PCMark): Provider of the 3DMark and PCMark benchmark suites for graphics and system performance. Comparable to SPEC as a vendor-neutral benchmarking suite provider for consumer and enterprise computing systems, with globally recognized benchmark brands.
• Primate Labs (Geekbench): Developer of the Geekbench cross-platform CPU and GPU benchmark, widely used for performance comparison across desktops, mobile, and servers. Comparable to SPEC's CPU benchmarking offering as a standardized cross-platform compute performance test consumed by hardware vendors and reviewers.
• MLCommons (MLPerf): Open engineering consortium that produces MLPerf benchmarks for machine learning training and inference performance across hardware platforms. Closely comparable to SPEC as a vendor-neutral benchmarking consortium with broad vendor membership (Google, NVIDIA, Intel, Meta, Microsoft) targeting AI infrastructure performance.
• Storage Performance Council (SPC): Industry consortium that defines and publishes standardized storage benchmark results (SPC-1, SPC-2). Comparable to SPEC as a non-profit benchmarking consortium with similar vendor-neutral methodology and licensed benchmark products.
• Transaction Processing Performance Council (TPC): Non-profit consortium that defines and publishes vendor-neutral transaction processing and database benchmarks (e.g., TPC-C, TPC-H, TPC-DS). Closely comparable to SPEC in consortium structure, vendor-neutral methodology, and benchmarking focus on enterprise computing systems.
• Business Applications Performance Corporation (BAPCo): Industry consortium developing vendor-neutral benchmarks for personal computer platforms and business applications, including SYSmark and MobileMark. Directly comparable to SPEC as a multi-vendor benchmarking consortium with licensed software benchmarks.

Emerging players

• Phoronix Test Suite / Phoronix Media: Open-source benchmarking platform widely used for Linux and cross-platform performance testing. Comparable to SPEC as a developer of standardized performance benchmarking tools, with a more open-source and Linux-focused go-to-market model.
• SiSoftware (Sandra): Developer of the Sandra benchmarking suite for system analysis and performance measurement. Comparable to SPEC as a vendor of standardized performance benchmarking tools, though focused on a single commercial product rather than a multi-vendor consortium.

Others

• The Green Grid (TGG): Industry consortium focused on data center efficiency and sustainability, with active working groups on server and storage energy efficiency. Comparable to SPEC's energy-efficiency standards work (SERT/SPECpower) and a strategic partner, though with broader sustainability scope rather than benchmarking focus.

Market position

Strengths5 records

Weaknesses5 records

Competitive moat6 records

Key risks6 records

Key highlights7 records

Customer concentration

• Xx.com/spec_perf
• Facebookfacebook.com/spec.org
• LinkedInlinkedin.com/company/standard-performance-evaluation-corporation

Compliance1 record

Revenue estimate

Valuation estimate

Number of profiles

Profiles9 records

Subsidiaries1 record

Funding overview

Funding rounds

Investors

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

M&A

Investments

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Frequently asked questions about Standard Performance Evaluation