Virtual Sound Source Position Calibration via Head Pose Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

After the initial measurement of the head-related transfer function, wearing deviations can occur when using sound output apparatuses like headphones or head-mounted displays, leading to unnatural sound source positioning for users, requiring time-consuming and labor-intensive re-measurement for calibration.

Innovation Solution

An information processing apparatus with an output processing unit, recognized-position acquisition unit, and comparing unit that generates sound using the head-related transfer function, acquires the user's recognized position of a virtual sound source, and adjusts the sound source position based on the comparison between the intended and recognized positions, allowing for easy calibration without re-measuring the head-related transfer function.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the head-related transfer function is measured again to correct wearing deviation, then the sound image localization accuracy is improved, but the calibration time and labor cost increase significantly

Engineering Contradiction:
Improvesound image localization accuracyVSAvoidcalibration time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system captures the user's head pose information in real-time during sound playback and uses this feedback to dynamically adjust the virtual sound source position. The head-mounted display includes sensors that detect head orientation, and the processing unit compensates for wearing deviations by adjusting sound source coordinates based on detected head pose, eliminating the need for time-consuming re-measurement while maintaining localization accuracy

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes the parameters of the virtual sound source position based on detected head pose parameters. By monitoring head orientation changes and dynamically adjusting sound source coordinates accordingly, the system compensates for wearing deviations without requiring re-measurement of the head-related transfer function, thus maintaining accuracy while reducing calibration time

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the head-related transfer function is measured again to correct wearing deviation, then the sound image localization accuracy is improved, but the operational complexity increases

Engineering Contradiction:
Improvesound image localization accuracyVSAvoidcalibration operation ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs automatic calibration by capturing head pose information from sensors in the head-mounted display and autonomously adjusting virtual sound source positions. The processing unit automatically compensates for wearing deviations using detected head orientation data, eliminating the need for users to perform complex re-measurement operations while maintaining sound image localization accuracy

Inventive Principle:
Principle #25Self-service

3Measurement precision

If multiple virtual sound sources are used for calibration, then the calibration accuracy is improved, but the processing complexity increases

Engineering Contradiction:
Improvecalibration accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the calibration process by using multiple virtual sound sources positioned at different spatial locations to independently measure and correct deviations in different directions. Each sound source provides specific directional calibration data, and the processing unit integrates these segmented measurements to achieve comprehensive calibration accuracy without excessive complexity

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11785411B2Information processing apparatus, information processing method, and information processing system
Publication Date: 2023.10.10 SONY GROUP CORP
  • US11785411B2 patent drawing
  • US11785411B2 patent drawing
  • US11785411B2 patent drawing

AI summary

Provided is an information processing apparatus that includes an output processing unit, a recognized-position acquisition unit, and a comparing unit. The output processing unit generates a sound by using a head-related transfer function of a user measured in advance, the sound being to be output from a virtual sound source located at a first position in a space around the user. The recognized-position acquisition unit acquires information of a second position in the space, the second position being recognized as a position of the virtual sound source by the user who has listened to the sound. The comparing unit compares the first position and the second position with each other. The output processing unit controls the position of the virtual sound source of the sound output toward the user on the basis of a result of the comparison by the comparing unit.