Wearable Sound Localization Display for Auditory Task Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing work education systems using head-mounted wearable displays are unable to present knowledge of auditory tasks to learning workers.

Innovation Solution

A wearable terminal equipped with an image obtainer, sound obtainer, specifier, and presenter that identifies and presents a point of interest where a predetermined sound occurs, allowing for the presentation of auditory tasks through augmented reality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a head-mounted wearable display is used for work education, then visual work actions can be presented to the learning worker, but auditory tasks cannot be presented

Engineering Contradiction:
Improvecapability to present auditory tasksVSAvoidauditory task information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The wearable terminal is enhanced with multiple functional modules including sound obtainer, image obtainer, specifier, and presenter. This multi-functional design enables the device to handle both visual and auditory task presentation, transforming it from a single-purpose visual display device into a versatile work education tool that can present comprehensive task information including auditory elements

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The specifier module acts as an intermediary that processes sound information and image data to identify points of interest where specific sounds occur. This mediator connects the raw sensory inputs (sound and image) with the presentation output, enabling the system to translate auditory information into visually presentable forms through the presenter module

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If sound information is obtained and processed to specify points of interest, then auditory task knowledge can be presented, but device complexity increases

Engineering Contradiction:
Improveauditory task information preservationVSAvoidsystem structure complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system is divided into distinct functional modules: sound obtainer for capturing audio, image obtainer for capturing visual data, specifier for processing and identifying points of interest, and presenter for displaying results. This segmentation allows each module to perform its specific function independently, making the complex task of auditory information processing manageable and maintainable

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The wearable terminal integrates multiple previously separate functions (sound acquisition, image acquisition, sound analysis, and visual presentation) into a single unified device. This merging consolidates the system into one wearable unit, reducing the need for multiple separate devices while maintaining the capability to process and present both auditory and visual task information

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12603016B2Wearable terminal, presentation method, and recording medium
Publication Date: 2026.04.14 PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
  • US12603016B2 patent drawing
  • US12603016B2 patent drawing
  • US12603016B2 patent drawing

AI summary

A wearable terminal is a wearable terminal that can be worn by a user, and includes: an image obtainer that obtains an image of a subject appearing in a field of view of the user; a sound obtainer that obtains sound information including a sound occurring in a vicinity of the wearable terminal and a direction of occurrence of the sound; a specifier that, based on the sound information and the image, specifies a point of interest, the point of interest being a location, in the subject, where a sound in a predetermined band included in the sound has occurred; and a presenter that presents, to the user, an object indicating the point of interest.