AI Binaural Audio Conversion for Personalized Head and Ear Profiles

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing binaural recording devices and artificial intelligence models fail to account for individual user head and ear size variations, leading to mismatched audio experiences.

Innovation Solution

An electronic apparatus using an artificial intelligence model that learns from both general and binaural audio data, incorporating user-specific information to adjust audio output based on head and ear size, and optionally considering context and application type.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a fixed-size dummy head or dummy ear is used for binaural recording, then the recording device structure is simple and manufacturing is easy, but the audio output does not match individual user head and ear size variations

Engineering Contradiction:
Improveadaptability to individual user head and ear sizeVSAvoidcomplexity of recording device and AI model
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses AI models to create virtual copies of binaural recording effects that can be applied to standard stereo recordings. Instead of requiring physical dummy heads for each user, the system generates synthetic binaural audio data through machine learning models that simulate how sound would be captured by ears of different sizes and shapes, then applies these virtual transformations to achieve personalized binaural playback without custom physical devices for each user.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent employs AI models with adjustable parameters that can be tuned to match different user characteristics such as head size, ear size, and ear canal geometry. By changing the parameters of the neural network models during training and inference, the system adapts the binaural rendering to individual users without requiring physical customization of the recording device, thus achieving adaptability through software parameter adjustment rather than hardware modification.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If binaural audio data is recorded with a fixed dummy head size, then the recording process is simple, but the converted audio data does not suit users with different head and ear sizes

Engineering Contradiction:
Improveease of audio conversion operationVSAvoidsuitability for individual users
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent develops universal AI models that can handle multiple user types and head/ear size variations through a single system. The trained models are designed to work with diverse input characteristics and can be applied to convert stereo audio to binaural audio for any user by adjusting input parameters, eliminating the need for separate recording devices or complex customization procedures for each individual while maintaining ease of operation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces AI models as an intermediary layer between standard stereo audio and personalized binaural playback. This intermediary system processes the audio signal and applies learned transformations that account for individual user characteristics, serving as a software mediator that bridges the gap between fixed recording methods and variable user anatomy without requiring changes to either the source audio or the playback hardware.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If an AI model is trained with fixed dummy head size data, then the model training is straightforward, but the model output does not account for user-specific head and ear size variations

Engineering Contradiction:
Improveprecision of audio conversionVSAvoidcomplexity of AI model training data collection
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary actions by pre-training AI models on comprehensive datasets that include binaural recordings from multiple dummy heads with different sizes and configurations. This pre-training phase creates a robust foundation model that already understands the relationship between various head/ear geometries and acoustic characteristics. When deployed, the system can then fine-tune or adapt this pre-trained model to specific users with minimal additional data, achieving high precision without requiring extensive custom data collection for each user.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamic adaptability in the AI model by designing neural networks that can adjust their parameters and behavior based on input characteristics. The model dynamically adapts to different user profiles by modifying its internal representations during inference, allowing it to account for individual head and ear size variations even though the base training data comes from fixed dummy heads. This dynamic adjustment capability enables precision customization without requiring static, user-specific training datasets.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12413930B2Electronic apparatus and controlling method thereof
Publication Date: 2025.09.09 SAMSUNG ELECTRONICS CO LTD
  • US12413930B2 patent drawing
  • US12413930B2 patent drawing
  • US12413930B2 patent drawing

AI summary

An electronic apparatus is provided. The electronic apparatus includes a camera, a processor and a memory configured to store at least one instruction executable by the processor where and the processor is configured to input input audio data to an artificial intelligence model corresponding to user information, and obtain output audio data from the artificial intelligence model, and the artificial intelligence model is a model learned based on first learning audio data obtained by recording a sound source with a first recording device, second learning audio data obtained by recording the sound source with a second recording device, and information on a recording device for obtaining the second learning audio data, and the second learning audio data is binaural audio data.