Spatial Audio Helmet System for Extravehicular Activity Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Astronauts performing extravehicular activities face challenges with limited field of vision and flexibility in space suits, making it difficult to perceive the surrounding environment, and existing augmented reality displays can overwhelm with too much information, potentially distracting and increasing risk.

Innovation Solution

A device that uses audio-based assistance by generating audible sounds with specific spatial origins to indicate the presence and location of objects outside the astronaut's field of vision, allowing intuitive awareness without visual obstruction, and an illumination system that projects user instructions onto detected objects to guide tasks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If an augmented reality display is provided in the helmet to inform the individual about the surrounding environment, then the individual gains awareness of objects outside the field of vision, but the display may obstruct the field of vision and distract the individual from the task to be performed

Engineering Contradiction:
Improveenvironmental awarenessVSAvoidfield of vision clarity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent replaces the visual AR display system with an audio-based spatial sound system. The array of speakers inside the helmet generates audible sounds with spatial origins that correspond to the location of objects in the detection space, allowing the individual to perceive environmental information through hearing rather than sight, thus avoiding visual obstruction while maintaining environmental awareness

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces audio signals as an intermediary medium to convey environmental information. Instead of directly presenting visual information through AR displays that block vision, the system uses spatial audio cues as a mediator to indicate object locations and characteristics, allowing the individual to maintain clear vision while receiving environmental feedback

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If an augmented reality display presents many different types of information, then the individual receives comprehensive environmental data, but the environmental information may go unnoticed and put the individual at risk

Engineering Contradiction:
Improveenvironmental information completenessVSAvoidinformation perception reliability
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent applies local quality by providing differentiated audio feedback based on the specific characteristics and locations of detected objects. Each object generates spatially localized sound cues with distinct acoustic properties, allowing the individual to selectively attend to relevant environmental information based on its spatial origin and acoustic characteristics, rather than presenting a uniform stream of information that may be overlooked

Inventive Principle:
Principle #3Local quality

3Object-affected harmful factors

If the space suit includes a rigid helmet to protect the individual, then the individual is protected from environmental hazards, but the helmet inhibits the vision of the user and requires the individual to turn its torso to look around

Engineering Contradiction:
Improveprotection from environmental hazardsVSAvoidmobility and vision flexibility
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

The patent substitutes the mechanical visual scanning mechanism (turning torso to look around) with an electronic audio-based detection and indication system. The monitoring sensor continuously scans the detection space, and the array of speakers provides real-time spatial audio feedback about objects in all directions, allowing the individual to maintain a fixed head position while still obtaining comprehensive environmental awareness without the need for physical movement

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12084208B2Audio-based assistance during extravehicular activity
Publication Date: 2024.09.10 SONY GROUP CORP
  • US12084208B2 patent drawing
  • US12084208B2 patent drawing
  • US12084208B2 patent drawing

AI summary

A device is configured to assist an individual during extravehicular activity. The device obtains and operates on first data indicative of a detection space around the individual, and second data indicative of a pose of the head of the individual relative to a helmet, which is worn over the head of the individual with spacing to the head. The device is configured to process the first data to detect an object in the detection space and determine a first position of the object with respect to the helmet; determine, based on the first position and the second data, a second position of the object with respect to the head, and cause an array of speakers in the helmet to generate an audible sound inside the helmet with a spatial origin given by the second position.