Object Audio Reproduction Using Personalized and Common HRTFs

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing audiobook technologies struggle to provide realistic sound localization for multiple characters due to the variation in ear shapes among listeners, leading to a high processing load on both production and reproduction sides.

Innovation Solution

A reproducing device and method that utilizes personalized HRTFs for specific listeners and common HRTFs for multiple listeners, along with metadata generation and processing units to manage audio content distribution efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If personalized HRTF is used for all sound objects, then sound localization accuracy is improved, but processing load increases

Engineering Contradiction:

Improvesound localization accuracyVSAvoidprocessing load

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments sound objects into two categories: main sound objects that require personalized HRTF for accurate localization, and other sound objects that use common HRTF. This segmentation allows the system to apply personalized processing only where necessary, reducing overall computational load while maintaining localization accuracy for critical sounds.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies different quality levels of HRTF processing to different sound objects based on their importance. Main sound objects receive high-quality personalized HRTF processing, while other objects use lower-quality common HRTF, optimizing the balance between localization accuracy and processing efficiency.

Inventive Principle:

Principle #3Local quality

2Device complexity

If common HRTF is used for all sound objects, then processing load is reduced, but sound localization accuracy deteriorates

Engineering Contradiction:

Improveprocessing loadVSAvoidsound localization accuracy

Core Design Contradiction:

Device complexityVSMeasurement precision

Solution Approach 1:

The patent divides sound objects into main and other categories, applying common HRTF to other objects to reduce processing load while reserving personalized HRTF for main objects where localization accuracy is critical.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies personalized HRTF processing partially - only to main sound objects rather than all objects. This partial action approach reduces processing load while maintaining sufficient localization accuracy for the most important sounds.

Inventive Principle:

Principle #16Partial or excessive action

3Ease of manufacture

If voice narration is used for multiple characters, then content delivery is simplified, but realism deteriorates

Engineering Contradiction:

Improvecontent delivery simplicityVSAvoidrealism

Core Design Contradiction:

Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent segments audio content into main sound objects (character voices requiring realistic localization) and other objects (background sounds). This allows voice narrations to be delivered simply while applying personalized HRTF only to character voices to enhance realism.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies different processing qualities to different audio elements: main character voices receive personalized HRTF processing for realistic localization, while other sounds use common HRTF, maintaining simplicity while enhancing realism where needed.

Inventive Principle:

Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces processing load while enhancing sound localization accuracy and realism in audiobooks, allowing for immersive and stereoscopic sound experiences.

Implementation Method 1

Through an operation using an HRTF that mathematically expresses how a sound travels from a sound source to ears, a sound from headphones can be stereoscopically reproduced.

Methodology Applied

Scientific EffectHRTF (Head-Related Transfer Function):

Data Source

PatentUS12526597B2Reproducing device, reproducing method, information processing device, information processing method, and program

Publication Date: 2026.01.13 SONY GROUP CORP

AI summary

The present technique relates to a reproducing device, a reproducing method, an information processing device, an information processing method, and a program, by which realistic contents can be provided while reducing a load of processing.A reproducing device according to a first aspect of the present technique includes a reproducing unit configured to reproduce object audio contents including a first object reproduced by using a personalized HRTF that is an HRTF personalized for a listener, and a second object reproduced by using a common HRTF that is an HRTF shared among a plurality of listeners. The present technique is applicable to a device that reproduces contents including audio data.