Spatial Audio Attitude Awareness in Visually Ambiguous Environments

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Individuals with reduced or absent vestibular function face challenges in maintaining attitude awareness, particularly in environments that require precise orientation and balance, such as operating remote vehicles or in disorienting environments, where existing technologies provide minimal feedback and overwhelm visual awareness.

Innovation Solution

The use of auditorily-induced vection (AIV) methods and systems that leverage auditory stimuli to enhance attitude awareness by projecting sound objects relative to the orientation of vehicles or users, utilizing head-related transfer functions (HRTFs) to simulate spatial sound and convey orientation information through earphones, thereby providing continuous and non-intrusive feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If visual feedback is provided to convey vehicle attitude information, then orientation awareness is improved, but visual field becomes encumbered and operator overload increases

Engineering Contradiction:
Improveattitude information feedbackVSAvoidvisual field availability
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent replaces visual feedback mechanisms with an auditory feedback system. Headphones deliver spatially-encoded audio signals that convey vehicle attitude information through sound direction and characteristics, substituting the visual channel with an auditory channel to avoid visual field encumbrance while maintaining information delivery.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces audio signals as an intermediary medium to transmit attitude information. Instead of directly presenting visual data that competes for visual attention, the system uses sound waves as a mediator to convey the same information through a different sensory modality, eliminating the conflict between information delivery and visual field availability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If auditory feedback is used to convey attitude information, then attitude awareness is enhanced without visual interference, but system complexity increases

Engineering Contradiction:
Improveattitude information feedbackVSAvoidaudio processing system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent makes the audio system perform multiple functions: it conveys vehicle attitude information, provides spatial orientation cues, and delivers feedback about vehicle state all through a single auditory channel. This multi-functionality reduces the need for separate visual displays and other feedback mechanisms, ultimately simplifying the overall system despite the sophistication of the audio processing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent manipulates audio parameters such as sound direction, intensity, and spectral characteristics to encode different aspects of vehicle attitude. By varying these acoustic parameters dynamically based on vehicle state, the system conveys complex information through simple auditory variations that the human ear can naturally interpret, avoiding the need for complex visual interfaces.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If spatial audio projection is implemented to indicate vehicle orientation, then attitude perception accuracy is improved, but computational requirements increase

Engineering Contradiction:
Improveattitude perception accuracyVSAvoidcomputational energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by focusing computational resources on processing only the most critical attitude parameters that need spatial encoding. Rather than computing full six-degree-of-freedom attitude information with equal detail, the system selectively processes the orientation components most relevant to safe operation, reducing computational load while maintaining sufficient accuracy for the application.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent applies different levels of processing detail to different aspects of attitude information. Critical orientation parameters receive higher-fidelity spatial audio processing, while less critical parameters use simpler encoding. This local differentiation of quality allows the system to achieve high perception accuracy where needed while conserving computational energy in other areas.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

AIV systems effectively enhance attitude awareness by inducing a sense of direction and motion, improving balance and orientation in impaired environments without encumbering the visual field, and can be applied to various scenarios including remote vehicle operation and vestibular prostheses, reducing the risk of disorientation and motion sickness.

Implementation Method 1

projecting the auditory object includes applying a head-related transfer function (HRTF) corresponding to the projection source location to the auditory object

Methodology Applied
Scientific EffectHead-related transfer function (HRTF):

Implementation Method 2

The method includes obtaining an auditory object associated with the remote vehicle, determining an orientation of the remote vehicle, projecting the auditory object relative to the orientation of the remote vehicle

Methodology Applied
Scientific EffectAuditorily-induced vection (AIV):

Data Source

PatentUS12003944B2Systems and methods for enhancing attitude awareness in ambiguous environments
Publication Date: 2024.06.04 RTX BBN TECH INC
  • US12003944B2 patent drawing
  • US12003944B2 patent drawing
  • US12003944B2 patent drawing

AI summary

Systems and methods for using auditorily-induced vection (AIV) to enhance a person's attitude awareness are provided herein. In at least one embodiment, an auditory object is projected based on the orientation of the person or a vehicle and the projected auditory is provided to the person. By projecting the auditory object, the attitude of the person or the vehicle can be conveyed to the person to enhance the person's attitude awareness.