Toloka

What Toloka does

Toloka is a Netherlands-headquartered AI training data platform founded in 2014 by Olga Megorskaya, operating as a subsidiary of Nebius Group N.V. The company combines proprietary agentic technology with a vetted global network of 6,000+ human contributors spanning 100+ countries, 40+ languages, and 90+ domains to produce AI training, evaluation, and quality-assurance data for frontier AI labs and large technology companies. Its core technology stack — the Toloka Quality Loop — deploys five stages of AI-augmented quality management including BILT calibration, expert matching, real-time Production Copilot guidance, and an LLM-based QA system achieving 89.1% failure-detection accuracy, backed by ISO 27001/27701, SOC 2, GDPR, CCPA, HIPAA, and ISO 9001/42001/23894/5259 certifications. Toloka also operates Toloka Arena, an independent evaluation platform for agentic AI using private, non-contaminated RL Gym-style benchmarks with deterministic database-state-hash grading.

Name

Toloka

Legal name

Toloka AI BV

Website

https://toloka.ai

Company type

Private

Founded year

2014

Operating status

Operating

Headcount range

251–500 employees

Short description

Toloka is a Netherlands-based AI training data platform combining a vetted global network of 6,000+ expert contributors with proprietary agentic quality systems to produce training, evaluation, and benchmarking data for frontier AI labs and major technology companies including Anthropic, Amazon, Microsoft, and Shopify.

Ownership category

akta.pro rank

Product category

AI Training Data Services

NAICS

Computer Systems Design and Related Services (54151)

SIC

Services-Computer Programming, Data Processing, Etc. (7370)

akta.pro primary industry

Generative AI & LLM Solutions Services (RAG, Agents, Copilots) (BPAEAHAG)

akta.pro secondary industry

LLMOps & Generative AI Platforms (Prompt/Agent Orchestration, RAG) (HDAEANAD)

Keywords

• AI training data
• Data annotation platform
• RLHF data solutions
• AI agent evaluation
• Human-in-the-loop data

Headquarters

HQ city

Luzern

HQ country

Switzerland

HQ region

Europe

Offices1 record

Markets served

GTM type

B2B and B2C

Offering type

Software

Cost components

Personnel, Operations, Technology or R&D, Marketing or Sales, Supply Chain

Revenue model

1. Managed Service Data Business: Full-service data annotation and collection for enterprise partners requiring custom pipelines, dedicated project management, and domain expert matching. Revenue generated through project-based contracts with defined quality SLAs.
2. Self-Service Data Annotation Platform: SaaS platform enabling researchers and ML teams to configure, launch, and manage annotation projects independently. Pay-per-task model with transparent pricing, no minimums or long-term contracts. Users pay only for work that passes QA.
3. Tendem Hybrid Agent Platform: Subscription or per-task model for professionals delegating work to hybrid AI-human teams. The platform manages full workflows from request to verified delivery, handling market research, writing, analysis, and content creation.
4. Benchmark/RL Gym Licensing: Toloka Arena benchmarks and RL Gym datasets are available for purchase, allowing AI labs to license evaluation data for training and testing their own models.

Pricing tiers

Go-to-market motion3 records

Distribution channels3 records

Marketing channels6 records

Core offering

Toloka is an AI training data platform that combines a vetted global network of human experts with proprietary AI automation to produce, evaluate, and quality-assure training data for AI agents, LLMs, and VLMs. Its core offerings include a self-service data annotation platform (Toloka Platform), managed enterprise data services, the Tendem hybrid AI-human agent platform for professionals, and the Toloka Arena private benchmarking platform for agentic AI evaluation.

Product overview

Toloka is an AI training data platform offering a portfolio of products centered on human-AI collaboration for AI development. The core offering is the Toloka Platform (self-service data annotation) complemented by Tendem (hybrid AI agent for prosumer markets) and Toloka Arena (agent evaluation benchmarking). The company provides specialized training datasets for AI agents, LLMs/VLMs, coding assistants, and creative AI, along with proprietary benchmarks including VOX-DUB (AI dubbing), JEEM (Arabic dialects), and U-MATH (university math). A five-stage Quality Loop system ensures data quality through proprietary agentic technology and human expertise. The expert network spans 6000+ contributors in 90+ domains.

Differentiator

Problem solved

Functional benefit

Brands

• Tendem: Hybrid AI agent platform combining AI orchestration with vetted human experts for professional task delegation including market research, writing, analysis, and content creation.
• Toloka Arena
• Toloka Platform

Products and services

• Toloka Platform Self-service SaaS platform enabling researchers and ML teams to configure, launch, and manage data collection and annotation projects independently without operational overhead. Features AI-assisted project builder, LLM-based quality assurance (89.1% failure detection accuracy), instant expert matching across 90+ domains, multi-stage pipeline support, and pay-as-you-go pricing with no minimum commitments.
• Tendem Hybrid AI agent platform combining AI orchestration with vetted human experts for professional task delegation. Enables professionals to delegate market research, writing, analysis, content creation, and consulting tasks with verified quality. Delivers 1.8x higher quality than AI-only tools and 2.1x faster delivery than freelance platforms. Accessible via self-serve early access at tendem.ai.
• Toloka Arena Independent evaluation platform for agentic intelligence providing private benchmarking of frontier AI models on RL Gym-style enterprise workflows. Tests multi-step, multi-tool agent capabilities using deterministic grading (database state hash comparison) across manufacturing, airlines, logistics, banking, food services, and other domains. Includes public leaderboard showcasing model evaluation results.
• AI Agent Training & Evaluation Data Managed data service providing training and evaluation data solutions for AI agents, including agent trajectory demonstrations, step-by-step evaluations, virtual environments with MCP replicas, safety red-teaming, and expert-captured workflows. Targets frontier AI labs building agentic systems.
• Advanced LLM & VLM Datasets Managed data service providing domain-specific demonstration and preference data for large language and vision-language models. Includes reinforcement learning tasks with built-in verification, step-by-step reasoning chains for complex problem-solving, and multilingual content for foundation model training.
• Programming Data for AI Coding Assistants Managed data service providing training data for AI coding assistants and software engineering workflows, including production-ready code generation examples, repository structures, issue resolution data, code review demonstrations, and rapid prototyping datasets.
• VOX-DUB Benchmark First open human-evaluated benchmark for AI dubbing systems using pairwise A/B testing with native speakers. Rates systems on pronunciation, naturalness, audio quality, emotional accuracy, and voice similarity across multilingual content.
• JEEM Benchmark Benchmark for evaluating multimodal models in low-resource Arabic dialects including Jordanian, Egyptian, Emirati, and Moroccan. Covers image captioning and visual question-answering tasks in four regional dialects. Developed in partnership with MBZUAI.
• U-MATH Benchmark Largest multimodal benchmark for university-level math problems with 1,000+ complex prompts and 20% visual reasoning component. Developed in partnership with Gradarius for evaluating LLM capabilities in academic mathematics.
• Toloka Expert Network Vetted global network service providing 6,000+ active contributors across 90+ domains with 70%+ holding advanced degrees. Spans 100+ countries and 40+ languages. Provides credentialed experts in medicine, law, finance, and other specialized fields for complex annotation, evaluation, and data production tasks.

Quantifiable outcome

• 89.1% accuracy in catching QA failures automatically before reaching pipeline
• +6 more outcomes

Named customers6 records

Segments5 records

Ideal customer profiles5 records

Technology focussed Yes

API detail

Has API

No

API docs

API detail

Core technology

AI maturity

App detail

AI capability13 records

Feature6 records

Partnerships

Four partnerships are on record, tiered core.

• HuggingFacecoreStrategic or Co-development Partner · 11 June 2026Toloka participates in the BigCode project with HuggingFace and ServiceNow, contributing to open-source code AI development.
• ServiceNowcoreStrategic or Co-development Partner · 11 June 2026Toloka collaborates with ServiceNow on the BigCode project for AI code generation research.
• Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)coreStrategic or Co-development Partner · 14 April 2025Partnership to create JEEM benchmark for evaluating AI models in low-resource Arabic dialects. MBZUAI provided expertise in Arabic multimodal models, Toloka contributed data annotation capabilities. Benchmark covers Jordanian, Egyptian, Emirati, and Moroccan dialects.
• GradariuscoreStrategic or Co-development Partner · 5 December 2024Partnership with educational math platform to launch U-MATH benchmark for evaluating LLMs on university-level math problems. Combined Toloka's data annotation capabilities with Gradarius's Math Engine for comprehensive multimodal evaluation.

Scale indicators7 records

Recent moves7 records

Expansion highlights6 records

Direct peers

• Scale AI: Scale AI is the most direct competitor to Toloka, offering RLHF, data annotation, and evaluation services for foundation models. Both serve frontier AI labs with high-quality human-labeled training data and operate globally distributed expert workforces.
• Surge AI: Surge AI specializes in RLHF and preference data for foundation model alignment, directly competing with Toloka's domain expert network and serving similar AI lab customers with human feedback pipelines.
• Appen: Appen is a global data annotation company providing training data for AI/ML models, comparable to Toloka's managed services and crowd-based annotation offerings across multiple data modalities.
• Labelbox: Labelbox provides a data labeling platform with human-in-the-loop annotation capabilities, comparable to Toloka's self-service Platform offering for ML teams needing configurable annotation pipelines.
• Defined.ai: Defined.ai provides training data and evaluation datasets for AI systems, competing with Toloka across speech, NLP, and computer vision annotation with similar enterprise sales motion.
• SuperAnnotate: SuperAnnotate offers an AI data annotation platform with managed services for ML teams, comparable to Toloka's hybrid model of self-service tools combined with expert annotation workforce.
• Sama: Sama provides high-quality data annotation and validation for AI applications, serving enterprise customers with curated workforces similar to Toloka's expert network approach.
• CloudFactory: CloudFactory offers managed data annotation with a distributed workforce, comparable to Toloka's managed services offering for enterprises needing scalable human-in-the-loop data production.

Emerging players

• Snorkel AI: Snorkel AI focuses on data-centric AI with programmatic labeling and weak supervision. It overlaps with Toloka's data production services but emphasizes automated labeling over human annotation.
• Roboflow: Roboflow specializes in computer vision data preparation and annotation, overlapping with Toloka's image and video annotation capabilities for ML teams building vision models.

Market position

Strengths5 records

Weaknesses5 records

Competitive moat5 records

Key highlights7 records

Customer concentration

• Xx.com/tolokaai
• LinkedInlinkedin.com/company/toloka-ai

Compliance8 records

Revenue estimate

Valuation estimate

Number of profiles

Profiles4 records

Subsidiaries1 record

Funding overview

Funding rounds1 record

Investors1 record

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

M&A

Investments

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Frequently asked questions about Toloka