HRTF Personalization Using Depth Image Template Matching

Solution Overview

Problem

Existing HRTF personalization methods are complex, time-consuming, and impractical for large-scale implementation due to the need for specialized acoustic measurements and high-resolution three-dimensional head scans, which are difficult to obtain from a large number of users.

Innovation Solution

A system and method that utilize a depth image of a user to create personalized HRTFs by collecting a generic set of HRTFs, a base three-dimensional face template, and a depth image, bending the template to match the user's face, calculating distortion parameters, and adjusting the HRTFs to generate personalized sound.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If specialized acoustic measurements and high-resolution three-dimensional head scans are used for HRTF personalization, then measurement precision is improved, but device complexity and ease of operation deteriorate

Engineering Contradiction:

ImproveHRTF measurement precisionVSAvoidEase of HRTF personalization

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The patent uses a depth image (a simplified copy) of the user's head to estimate HRTF personalization parameters, instead of requiring high-resolution three-dimensional head scans. This copying approach maintains sufficient measurement precision for HRTF personalization while dramatically simplifying the data collection process and improving ease of operation.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces complex mechanical/acoustic measurement systems with a depth imaging system. Instead of using specialized acoustic measurement equipment and high-resolution 3D scanning, the system substitutes these with a depth camera that captures head geometry, which is then used to estimate HRTF parameters through image processing and template matching.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If specialized acoustic measurements and high-resolution three-dimensional head scans are used for HRTF personalization, then measurement precision is improved, but device complexity worsens

Engineering Contradiction:

ImproveHRTF measurement precisionVSAvoidSystem complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a depth image (a simplified copy) of the user's head to estimate HRTF personalization parameters, instead of requiring high-resolution three-dimensional head scans. This copying approach maintains sufficient measurement precision for HRTF personalization while dramatically simplifying the data collection process and improving ease of operation.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces complex mechanical/acoustic measurement systems with a depth imaging system. Instead of using specialized acoustic measurement equipment and high-resolution 3D scanning, the system substitutes these with a depth camera that captures head geometry, which is then used to estimate HRTF parameters through image processing and template matching.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If manual HRTF measurements are performed, then HRTF personalization accuracy is improved, but loss of time worsens

Engineering Contradiction:

ImproveHRTF personalization accuracyVSAvoidTime for HRTF personalization

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent uses a pre-collected database of HRTF measurements from multiple subjects to create generic HRTF sets and three-dimensional face templates in advance. During personalization, the system quickly matches the user's depth image to the pre-prepared templates and applies pre-computed distortion parameters, eliminating the need for time-consuming manual measurements while maintaining personalization accuracy.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses a depth image (a simplified copy) of the user's head to estimate HRTF personalization parameters, instead of requiring high-resolution three-dimensional head scans. This copying approach maintains sufficient measurement precision for HRTF personalization while dramatically simplifying the data collection process and improving ease of operation.

Inventive Principle:

Principle #26Copying

Data Source

PatentUS10028070B1Systems and methods for HRTF personalization

Publication Date: 2018.07.17 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Systems and methods for HRTF personalization are provided. More specifically, the systems and methods provide HRTF personalization for a user based on a depth image of the user. Accordingly, the provided systems and methods are less complicated, easier to use, and easier to implement for personalizing HRTFs when compared to previously utilized systems and methods that required high-resolution three-dimensional head scans or one or more specific and/or discrete anthropomorphic measurements of the user.