Auditory Perception Mapping via Optical Tracking and Intermediary Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for measuring auditory perception are limited by the need for subject constraint, reduced effectiveness due to discomfort, and uncontrolled sound source positioning, which impairs precision and standardization.

Innovation Solution

A method using a head-mounted visual display system with eye-tracking and motion capture technology to allow subjects to move freely while accurately measuring auditory perception by randomly positioning sound sources, preventing visual cues and ensuring precise data collection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the subject is constrained in a fixed position with head restrained on chin rest, then the measurement precision of auditory perception is maintained, but the subject comfort and ability to concentrate deteriorates

Engineering Contradiction:
Improveprecision of auditory perception measurementVSAvoidsubject comfort and concentration
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces the mechanical constraint system (chin rest, head restraint) with an optical tracking system (head-mounted display, eye-tracking device, motion capture system). This substitution allows the subject to move freely while the system automatically tracks and records head position and gaze direction, maintaining measurement precision without physical constraint.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a head-mounted display system as an intermediary between the subject and the measurement process. This intermediary provides visual instructions to the subject while simultaneously tracking head position and preventing the subject from seeing the actual sound source location, thus maintaining measurement integrity without physical restraint.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If the sound source is moved at successive arbitrary locations by human operator, then the test setup is simple, but the measurement precision and standardization deteriorates

Engineering Contradiction:
Improvesimplicity of test setupVSAvoidprecision and standardization of sound source positioning
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent implements a feedback system where the motion capture system continuously monitors the actual position of the sound source and the subject's head, and the eye-tracking device monitors gaze direction. This feedback is used by the control unit to ensure accurate and standardized positioning measurements, eliminating the uncertainty introduced by manual operation while maintaining ease of setup.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs automatic tracking and positioning verification without requiring human intervention during the test. The motion capture system and eye-tracking device automatically record positions and orientations, and the control unit processes this data to ensure standardized measurements, making the system self-sufficient and eliminating operator-induced variability.

Inventive Principle:
Principle #25Self-service

3Productivity

If the sound source positions follow a predictable pattern, then the test procedure is systematic, but the reliability of measurement deteriorates due to subject cheating

Engineering Contradiction:
Improvesystematic test procedureVSAvoidreliability of auditory perception measurement
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The head-mounted display acts as an intermediary that presents visual instructions to the subject without revealing sound source locations. This intermediary maintains the systematic test procedure while preventing the subject from using visual cues or predictable patterns to cheat, as the subject cannot see the actual sound source positions through the head-mounted display.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Ease of operation

If the subject is allowed to move freely during the test, then the subject comfort and natural behavior are improved, but the measurement precision of head position deteriorates

Engineering Contradiction:
Improvesubject freedom of movementVSAvoidprecision of head position measurement
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent replaces mechanical head constraint with optical tracking technology (motion capture system, eye-tracking device). This substitution enables the subject to move freely in natural behavior while the optical system continuously and precisely tracks head position and gaze direction, maintaining measurement precision without physical restriction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances data collection precision and comfort, allowing for standardized mapping of auditory perception without subject constraint, improving the accuracy and reliability of measurements.

Implementation Method 1

measuring the spatial coordinates of a first location marker worn by the subject, this head-mounted display system preventing the subject from seeing his surroundings

Methodology Applied
Scientific EffectMotion capture:

Implementation Method 2

measuring an orientation of the subject's gaze, using an eye-tracking device integrated with the head-mounted visual display system

Methodology Applied
Scientific EffectEye-tracking:

Data Source

PatentEP3463084B1Method and apparatus for acquiring a spatial map of auditory perception of a subject
Publication Date: 2024.04.03 INST NAT DE LA SANTE & DE LA RECHERCHE MEDICALE (INSERM)
  • EP3463084B1 patent drawingFigure 1
  • EP3463084B1 patent drawingFigure 2~4
  • EP3463084B1 patent drawingFigure 5~7

AI summary

This method for acquiring a spatial map of auditory perception of a subject comprises a plurality of successive test sequences, each test sequence comprising steps of: a) calibration (1002) of the subject's position, by displaying instructions to the subject, using a head-mounted visual display system worn by the subject, in order to acquire a reference position of the subject, the subject's position being measured using a video motion capture system by measuring the spatial coordinates of a first optical marker worn by the subject, b) choosing (1004) spatial coordinates of a target location of a sound source, said target location being located around the subject, c) emitting (1006) a predefined sound, using a sound source placed at said target location, d) in response to acquisition instructions generated by the subject using an acquisition interface, acquiring (1008) an estimated location of said sound source, by using the video motion capture system to measure the spatial coordinates of a second optical marker held and pointed by the subject towards a perceived location of the sound source.