Fraunhofer Institute for Digital Media Technology

What Fraunhofer Institute for Digital Media Technology does

Fraunhofer IDMT is an applied research institute specializing in AI-based audio intelligence, with its headquarters in Ilmenau, Thuringia, and a branch (Institutsteil HSA) in Oldenburg, Germany. The institute develops technologies for acoustic event detection, machine listening, speech recognition, spatial audio, media forensics, and mobile neurotechnology, serving automotive manufacturers (Mercedes-Benz, Burmester, CARIAD), industrial companies (Airbus, Premium AEROTEC), consumer-electronics firms (Deutsche Telekom, Humantechnik, RTW), healthcare/assistive device makers, broadcasters, and conservation organizations (WWF). Its core technology stack is built around proprietary AI/ML models for audio and video signal analysis, combined with hardware sensor integration (acoustic MEMS, EEG) and on-device processing capabilities, validated through peer-reviewed publication and contributions to international audio standardization bodies.

The institute's flagship commercial technologies include Audiofields (object-based 3D spatial audio, now in Mercedes-Benz series production with Burmester sound systems), YourSound (intuitive personalized sound optimization), The Hearing Car (acoustic sensor platform for autonomous-vehicle environmental perception), and Sprachsteuerung (robust offline voice control for industrial and consumer applications). Supporting products span industrial acoustic quality monitoring (QualiBolS for stud welding, Fräsamo for milling tool wear, Rapid-KI for laser ablation), hearing assistance (earis TV system with Humantechnik), driver/neurotechnology (SensAI, NAFAS mobile EEG, NEMO EEG anonymization, SleepWell), and media analytics (InsightPersona multimodal biometrics, large-scale broadcast content analysis).

Fraunhofer IDMT operates as a legally non-profit constituent entity of Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V., with revenue generated from three streams: (1) public research funding from federal, state, and EU sources, (2) project-based industry R&D collaborations with enterprise customers, and (3) technology licensing royalties (e.g., Audiofields to automotive OEMs, YourSound and earis algorithms to consumer-electronics partners). Pricing is not publicly disclosed, and the institute does not sell directly to consumers, distributing its IP through embedded OEM/white-label channels and direct enterprise partnerships.

Name

Fraunhofer Institute for Digital Media Technology

Legal name

Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.

Website

https://idmt.fraunhofer.de

Company type

Private

Founded year

2008

Operating status

Operating

Headcount range

51–100 employees

Short description

Fraunhofer IDMT is a German non-profit applied research institute developing AI-based audio intelligence technologies — including 3D spatial audio, acoustic event detection, speech recognition, and media forensics — serving automotive, industrial, healthcare, and media sectors through licensing and R&D collaborations.

Ownership category

akta.pro rank

Product category

Applied Audio Intelligence & Acoustic AI Research

NAICS

Navigational, Measuring, Electromedical, and Control Instruments Manufacturing (3345), Electromedical and Electrotherapeutic Apparatus Manufacturing (334510), Other Measuring and Controlling Device Manufacturing (334519)

SIC

Industrial Instruments For Measurement, Display, And Control (3823), Household Audio & Video Equipment (3651), Instruments For Meas & Testing Of Electricity & Elec Signals (3825), Electromedical & Electrotherapeutic Apparatus (3845)

akta.pro primary industry

Audio & Speech Analytics (call analytics, QA, insights) (HDAAAFAH)

akta.pro secondary industries

Speech Enhancement & Noise Suppression (AEC/NR) (HDAAAFAG), AI Music Creation & Assistive Tools (Generation, Separation, Mastering) (MPAIAIAG), Wake Word & Keyword Spotting (HDAAAFAJ), Assistive Hearing & Communication Access (Captioning, Hearing Support, Transcription) (EDAFAKAC)

Keywords

• Audio signal processing
• Acoustic event detection
• Speech recognition systems
• Spatial audio technology
• Media forensics tools

Headquarters

HQ city

Ilmenau

HQ country

Germany

HQ region

Europe

Offices2 records

Markets served

GTM type

B2B

Offering type

Services

Cost components

Personnel, Technology or R&D, Operations, Infrastructure, Marketing or Sales, Others

Revenue model

1. Public Research Funding: As part of Fraunhofer-Gesellschaft, receives government funding for applied research from federal and state sources.
2. Industry Research Collaborations: Project-based collaborations with automotive manufacturers (Mercedes-Benz), industrial companies, and technology partners for custom R&D development.
3. Technology Licensing: Licensing of developed technologies such as Audiofields 3D audio, YourSound personalization, and speech recognition algorithms to commercial partners.

Go-to-market motion1 record

Distribution channels4 records

Marketing channels8 records

Core offering

Fraunhofer IDMT develops AI-based audio intelligence technologies spanning acoustic event detection, 3D spatial audio, robust speech recognition, media forensics, EEG-based neurotechnology, and industrial acoustic monitoring. The institute delivers these through project-based research collaborations with industry, technology licensing to commercial partners (e.g., Audiofields 3D audio into Mercedes-Benz vehicles), and publicly funded research programs. Core commercial offerings include the Audiofields 3D audio system, YourSound personalization, The Hearing Car acoustic sensor platform, Sprachsteuerung voice control, earis TV hearing system, and SleepWell sleep monitoring.

Product overview

Fraunhofer IDMT is a research institute with a broad portfolio of audio intelligence products and solutions spanning automotive, industrial manufacturing, healthcare, and media applications. The core products include Audiofields (object-based 3D spatial audio for Mercedes-Benz vehicles with Burmester sound systems), YourSound (personalized sound optimization across consumer devices and vehicles), The Hearing Car (KI-based acoustic sensor systems for autonomous vehicle perception), and Sprachsteuerung (robust voice control for industrial and consumer applications). These are supported by specialized solutions including SleepWell (near-ear sleep monitoring), earis (personalized TV hearing system with Humantechnik), QualiBolS and Fräsamo (industrial acoustic quality monitoring for welding and milling), Drohnenerkennung (acoustic drone detection), InsightPersona (multimodal face/speaker recognition for media archives), AUVIP (virtual acoustic product development), and neurotechnology platforms (NAFAS mobile EEG for BCIs, NEMO EEG anonymization, SensAI driver distraction detection, NeuroSensEar bio-inspired acoustic sensors). The institute also develops AI-powered tools for environmental monitoring including Trapscan (wildlife camera analysis with WWF) and Rapid-KI (acoustic monitoring for laser ablation). YourSound and earis address consumer personalization, The Hearing Car and Audiofields serve the automotive sector, speech control targets Industry 4.0, and the neurotechnology products (SleepWell, NAFAS, NEMO) address healthcare applications. The diverse product portfolio is organized under the Ilmenau headquarters and the Oldenburg branch (Hör-, Sprach- und Audiotechnologie HSA), with research areas in audio/video analysis, industrial and environmental sound analysis, intelligent acoustic sensors, media forensics, sound field control, and privacy/trustworthy AI.

Differentiator

Problem solved

Functional benefit

Brands

• Audiofields: Object-based 3D audio technology for automotive and professional audio applications
• The Hearing Car (Das Hörende Auto)
• YourSound
• earis
• SleepWell

Products and services

• Audiofields (formerly SpatialSound Wave) Object-based 3D audio technology that creates a fully spatial sound field throughout vehicle cabins, transforming conventional stereo content into an immersive three-dimensional soundscape. Licensed to automotive OEMs for integration into infotainment systems; deployed with Mercedes-Benz and Burmester.
• YourSound Personalization Digital assistant that enables users to adapt sound reproduction to their personal preferences in a playful manner without knowledge of audio levels or frequencies. Uses Fraunhofer algorithms for optimal sound matching, applied across infotainment platforms, smartphones, TV systems, and multimedia systems via dynamic hearing profiles.
• The Hearing Car AI-supported acoustic sensor systems for the automotive sector that enable vehicles to perceive their acoustic environment for enhanced safety and reliability in road traffic. Includes siren detection and localization, acoustic event detection, predictive maintenance of powertrain/chassis/tires, and acoustic perception for autonomous driving; combines acoustic sensors with optical sensor systems (cameras, lidar, radar).
• Sprachsteuerung (Speech Control) Application-specific, robust voice control solutions for industrial manufacturing, consumer electronics, telecommunications, and smart environments. Enables touch-free, reliable device operation via voice commands, running locally on devices or within enterprise infrastructure without internet connectivity, with multi-channel signal processing, beamforming, noise reduction, echo cancellation, and reverb suppression.
• earis TV Hearing System TV hearing system developed with Humantechnik GmbH that uses personalized sound profiles and adaptive algorithms from Fraunhofer IDMT for users with declining hearing ability, providing personalized sound and speech intelligibility in TV listening.
• SleepWell - Near-Ear Multisensor System Self-applicable wearable sensor technology for comfortable capture of high-quality sleep behavior data at home, enabling sleep laboratory-style monitoring to be brought into patients' homes as part of mobile neurotechnology research.
• Acoustic Drone Detection (Drohnenerkennung) Acoustic drone detection technology that recognizes and localizes drones beyond line-of-sight using intelligent sensor data fusion, complementing radar, camera, and lidar systems for security-critical applications at airports and critical infrastructure.
• QualiBolS - Acoustic Monitoring for Stud Welding AI-based acoustic inline monitoring system for quality assurance of stud welding connections, monitoring welding quality in real time to ensure reliable joint integrity in industrial production.
• Fräsamo - Acoustic Monitoring of Milling Tools Machine learning algorithms for acoustic monitoring of milling tool wear states, detecting machine and processing errors in milling operations to optimize tool service life and reduce production downtime.
• InsightPersona - Multimodal Media Analysis Combined face and speaker recognition system for automated analysis of large media archives, using multimodal biometric approaches to identify and categorize persons in video and audio content.
• AUVIP - Virtual Acoustic Product Development Virtual acoustic product development platform enabling acoustic metaverse experiences for product development, allowing product sound design and acoustic optimization in virtual environments before physical prototyping.
• Media Forensics Technologies Technologies for detecting manipulation, synthesis, and reuse of audio material, as well as forensic audio analysis for investigative authorities. Includes deepfake detection and active authentication of media content.

Quantifiable outcome

• Successfully integrated into Mercedes-Benz series production vehicles
• +3 more outcomes

Named customers9 records

Segments5 records

Ideal customer profiles5 records

Technology focussed Yes

API detail

Has API

No

API docs

API detail

Core technology

AI maturity

App detail

AI capability14 records

Feature10 records

Partnerships

20 partnerships are on record, tiered flagship, core and minor.

• Mercedes-Benz Group AGflagshipStrategic or Co-development Partner · 2 March 2026Exclusive partnership for integration of Audiofields (formerly SpatialSound Wave) object-based 3D audio technology into Mercedes-Benz series production vehicles. Technology creates immersive spatial sound throughout vehicle cabin, transforming stereo content into 3D soundscape. Debut in CLA, GLC, GLB, and S-Class models with MBUX and Burmester sound systems. Algorithm specifically adapted since 2021 for computing efficiency.
• Burmester AudiosystemeflagshipStrategic or Co-development Partner · 2 March 2026Partner in exclusive product launch of Audiofields 3D audio technology for Mercedes-Benz vehicles with premium and high-end Burmester sound systems. Berlin-based premium audio manufacturer.
• Zander LabscoreStrategic or Co-development Partner · 1 January 2026Collaboration on NAFAS project for development of EEG system for BCI applications outside the laboratory. Fraunhofer IDMT and Zander Labs developing mobile EEG systems for neuroadaptive systems.
• AirbuscoreStrategic or Co-development PartnerAirbus implementing audio-based work instructions in electrical area of aircraft manufacturing. Practical application of speech assistance to support workers. Collaboration on industrial speech assistance systems.
• Hochschule Emden/LeercoreStrategic or Co-development PartnerCo-founder of industry working group 'Audiotechnologie für die intelligente Produktion AiP' together with Fraunhofer IDMT-HSA. Joint research on speech recognition and AI in industrial manufacturing.
• Carl von Ossietzky Universität OldenburgcoreStrategic or Co-development PartnerScientific cooperation partner. Fraunhofer IDMT-HSA closely connected through scientific collaborations, also partner in excellence cluster 'Hearing4all' and Sonderforschungsbereich 'Hörakustik'.
• Jade HochschuleminorStrategic or Co-development PartnerScientific cooperation partner connected through Oldenburg hearing research network.
• Humantechnik GmbHcoreOEM/ Whitelabel/ Licensing PartnerCollaboration on TV hearing system 'earis' using personalized sound profiles developed by Fraunhofer IDMT. Product includes Kinnbügel headphones and pocket receiver with dynamic hearing profiles.
• RTW (Rotzler Treiwitz & Wieners)coreOEM/ Whitelabel/ Licensing PartnerIntegration of speech intelligibility optimization technologies into hardware-based audio measurement platform for professional audio production in film, TV, streaming, and live productions.
• WWF (World Wildlife Fund)coreStrategic or Co-development PartnerDevelopment of 'Trapscan' AI tool for automated analysis and mapping of wildlife camera video data. Successfully analyzing thousands of videos in WWF projects at Middle Elbe since January 2026.
• Müller-BBM GmbHcoreStrategic or Co-development PartnerTechnology company setting standards with electronic acoustic systems in international concert halls and opera houses (including Sydney Opera). Partner in room acoustics project for Alte Oper Frankfurt using Vivace system and AI-controlled acoustic management.
• Alte Oper FrankfurtcoreStrategic or Co-development PartnerResearch collaboration on AI-controlled room acoustics for Mozart Hall. First-time application of AI for hall acoustics control, in addition to implementation of Vivace room acoustics system.
• CARIAD SEcoreStrategic or Co-development PartnerAutomotive software company partner for testing acoustic sensor systems and Fraunhofer measurement technology for 'The Hearing Car' at test track in Sweden.
• Fraunhofer IFAMcoreStrategic or Co-development PartnerPartner institute in Rapid-KI project for intelligent inline control of laser ablation processes for electronics recycling.
• Fraunhofer ILTcoreStrategic or Co-development PartnerPartner institute in Rapid-KI project for laser technology in sustainable electronics recycling processes.
• Fraunhofer EMIcoreStrategic or Co-development PartnerPartner institute in Rapid-KI project for sustainable laser ablation recycling processes.
• Ludwig-Maximilians-Universität MünchencoreStrategic or Co-development PartnerResearch partner in large-scale German TV study on climate communication, published in Nature Climate Change journal.
• Universität HamburgcoreStrategic or Co-development PartnerResearch partner in large-scale German TV study on climate communication, published in Nature Climate Change journal.
• Freie Universität BerlincoreStrategic or Co-development PartnerResearch partner in large-scale German TV study on climate communication, published in Nature Climate Change journal.
• Fraunhofer-GesellschaftcoreOthersParent organization - a legally non-independent institution of Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V., Munich. Provides institutional framework and access to network of 76+ Fraunhofer institutes.

Scale indicators3 records

Recent moves6 records

Expansion highlights6 records

Emerging players

• SoundHound AI: Independent voice AI / conversational intelligence company providing speech recognition and natural language understanding for automotive, restaurants, and IoT. Overlaps with Fraunhofer IDMT's industrial speech control and automotive voice work.
• ASK Industries: Automotive audio and acoustics supplier (part of ASK Group) providing infotainment speakers, active noise cancellation, and sound tuning to OEMs. A direct ecosystem peer for Fraunhofer IDMT's automotive audio and YourSound licensing.

Broad incumbents

• Nuance Communications (Microsoft): Speech recognition and conversational AI leader, now part of Microsoft, with deep automotive (Dragon Drive) and enterprise voice deployments. Comparable to Fraunhofer IDMT's Sprachsteuerung and speech analytics capabilities.
• Sennheiser electronic SE & Co. KG: German audio specialist with significant automotive (Sennheiser Mobility), professional, and consumer audio businesses. Comparable in audio heritage and automotive OEM integration to Fraunhofer IDMT's audio work.
• Bose Corporation: Major audio products and automotive sound systems company with active R&D in noise management, immersive audio, and active sound solutions. Competes with Fraunhofer IDMT's automotive audio and active noise control capabilities.
• Dolby Laboratories: Global leader in audio/visual technologies including object-based 3D audio (Dolby Atmos) widely deployed in automotive infotainment. Competes head-on with Audiofields in OEM licensing deals.

Direct peers

• Fraunhofer IIS: Sister Fraunhofer institute covering audio & media technologies (historically home to mp3, AAC, EVS codecs). Directly comparable as a Fraunhofer applied-research entity commercializing audio IP through licensing and industry partnerships.
• HEAD acoustics: German specialist in acoustic measurement, sound quality engineering, and voice/audio quality testing for automotive and telecom. Comparable to Fraunhofer IDMT's measurement work with RTW and overall industrial/automotive audio analytics.
• Dirac Research: Swedish digital audio processing company specializing in sound optimization, spatial audio, and room correction for automotive, headphones, and home audio. Closely comparable to Audiofields and YourSound product lines.
• Cerence Inc. Pure-play automotive AI company focused on in-car voice assistants, speech recognition, and sound-based HMI for OEMs. Directly comparable to Fraunhofer IDMT's Sprachsteuerung and The Hearing Car initiatives.

Market position

Strengths5 records

Weaknesses5 records

Competitive moat5 records

Key risks5 records

Key highlights6 records

Customer concentration

• YouTubeyoutube.com/channel/UCeIGYuAZu3TKivR56hZBqQQ
• LinkedInlinkedin.com/company/fraunhofer-idmt
• Instagraminstagram.com/fraunhofer.idmt
• Xx.com/fraunhofer_idmt

Revenue estimate

Valuation estimate

Number of profiles

Profiles10 records

Subsidiaries1 record

Funding overview

Funding rounds

Investors

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

M&A

Investments

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Frequently asked questions about Fraunhofer Institute for Digital Media Technology