Cloud HRTF Repository API for Personalized Audio Virtualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The creation of accurate and personalized Head-Related Transfer Functions (HRTFs) is costly and time-consuming due to the complexity of capturing individual anthropometric variables, such as the reflection properties of the head and torso, and is unique to each user, making it difficult to achieve effective virtualization of audio signals for three-dimensional sound.

Innovation Solution

A cloud-based HRTF repository system that allows users to store and retrieve personalized HRTFs, as well as generalized manufacturer HRTFs, using a public API, enabling the combination of user-specific and brand-specific data for enhanced virtualization, with options for uploading, downloading, and processing HRTF data through companion apps and media service providers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If personalized HRTF measurement is performed for each user, then the accuracy of audio virtualization is improved, but the time and cost required increases significantly

Engineering Contradiction:
ImproveHRTF accuracyVSAvoidHRTF creation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs HRTF measurements in advance during manufacturing or initial setup, storing the results in a database. When a user needs HRTF data, the system retrieves pre-measured data from the database rather than performing new measurements, significantly reducing the time required while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates copies of HRTF measurement data from dummy head measurements or one user's data and applies them to other users or devices. This allows the system to provide personalized HRTF effects without requiring new measurements for each user, reducing both time and cost while maintaining sufficient accuracy.

Inventive Principle:
Principle #26Copying

2Measurement precision

If personalized HRTF measurement is performed for each user, then the accuracy of audio virtualization is improved, but the cost increases significantly

Engineering Contradiction:
ImproveHRTF accuracyVSAvoidHRTF creation cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The system uses copies of HRTF data from dummy head measurements or representative users and applies them to individual users through software processing. This eliminates the need for expensive custom measurement equipment and procedures for each user, significantly reducing manufacturing costs while maintaining acceptable accuracy levels.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system develops universal HRTF measurement procedures and databases that can serve multiple users and device types. A single measurement setup can generate data applicable to multiple users or device models, reducing the per-user cost while maintaining personalized accuracy through software-based adaptation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If generic HRTF is used for all users, then the complexity of HRTF creation is reduced, but the virtualization quality decreases due to individual anatomical variations

Engineering Contradiction:
ImproveHRTF system complexityVSAvoidVirtualization accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system uses a generic HRTF as the base for all users but applies local, user-specific adjustments based on individually measured anatomical parameters such as ear shape, head size, and torso characteristics. This maintains simplicity in the overall system while improving accuracy for each individual user through targeted personalization.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system starts with a generic HRTF and modifies specific parameters (frequency response, time delays, spatial characteristics) based on individual user measurements. This allows the system to maintain a simple base structure while adapting to individual anatomical variations, balancing complexity and accuracy.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11113092B2Global HRTF repository
Publication Date: 2021.09.07 SONY GROUP CORP
  • US11113092B2 patent drawing
  • US11113092B2 patent drawing
  • US11113092B2 patent drawing

AI summary

A cloud-based HRTF repository system that can be accessed via a public application program interface (API) on the remote repository server to permit individual users of audio-capable client devices to upload and store personalized HRTFs and basic device data in an open format. The cloud server repository includes a computer readable non-volatile memory which further includes a program memory portion comprising an application program interface (API) module configured for receiving HRTF data from a client device, or from a brand manufacturer, and for sending HRTF data to a client device. A brand manufacturer can upload HRTF data to the cloud-based HRTF repository system either directly from their branded companion app in a client device, or optionally via their own cloud server. One technique includes using a Media Service Provider (MSP) app in the client device with a provided server access library (SAL) thereby enabling retrieval of HRTF data for bath a personalized HRTF for any brand client device, or for retrieval of generalized HRTF data by brand manufacturers having a SAL in their brand server via the remote server repository public API.