Acoustic Environment Representation for Accessibility

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users with visual or hearing impairments face challenges in accessing and navigating their environment due to the reliance on visual displays and auditory cues in wireless communication devices, which can lead to undetected obstacles and threats.

Innovation Solution

An acoustic representation system that captures environmental data using sensors and audio devices, processes it to identify objects and paths, and provides acoustic feedback to users, enabling them to perceive their surroundings through audio, tactile, or visual means.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If visual displays and auditory cues are used in wireless communication devices, then information can be presented to users, but users with visual or hearing impairments cannot access functionality

Engineering Contradiction:

ImproveAccessibility to users with impairmentsVSAvoidAbility to detect obstacles and threats

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces an intermediary system that captures environmental data through sensors (camera, microphone, accelerometers) and translates it into accessible formats (acoustic representations, haptic feedback, simplified visual displays). This intermediary layer enables users with impairments to perceive their environment and interact with devices by converting sensory information into alternative modalities they can access.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces reliance on traditional sensory channels (vision and hearing) with alternative mechanisms including acoustic representations generated from environmental audio data, haptic feedback from motion sensors, and tactile interfaces. This substitution allows users with visual or hearing impairments to access environmental information through different sensory modalities.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If traditional display generated by navigation application is used, then navigation information can be conveyed, but blind or low vision users cannot use the functionality

Engineering Contradiction:

ImproveUsability for blind or low vision usersVSAvoidEnvironmental awareness information

Core Design Contradiction:

Ease of operationVSLoss of information

Solution Approach 1:

The system acts as an intermediary between the environment and the user, capturing visual and spatial information through camera and sensors, then converting it into acoustic representations and haptic feedback that convey environmental awareness to blind or low vision users in an accessible format.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms environmental parameters (visual scene data, audio signals, motion information) into different parameter formats suitable for alternative sensory channels. Visual information is converted to acoustic parameters (frequency, volume, spatial positioning), and spatial relationships are encoded in audio cues that preserve environmental context for users with visual impairments.

Inventive Principle:

Principle #35Parameter changes

3Ease of operation

If touchscreen with dynamic keyboard is used, then input functionality can be provided, but blind users cannot detect key locations and configurations

Engineering Contradiction:

ImproveInput capability for blind usersVSAvoidDetection of key locations

Core Design Contradiction:

Ease of operationVSMeasurement precision

Solution Approach 1:

The system introduces an intermediary layer that uses camera and sensor data to detect the physical state of the touchscreen and keyboard, then communicates key locations and configurations to blind users through acoustic representations and haptic feedback, enabling precise detection without visual input.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent implements feedback mechanisms where the system continuously monitors environmental data and device state, then provides real-time acoustic and haptic feedback to guide users. This feedback loop allows blind users to detect key locations and configurations through auditory and tactile signals that respond to their interactions and environmental context.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS10163368B2Acoustic representations of environments

Publication Date: 2018.12.25 AT&T INTELLECTUAL PROPERTY I L P

AI summary

Concepts and technologies are disclosed herein for acoustic representations of environments. A processor can execute an acoustic representation service. The processor can receive a request to provide acoustic representation data to a device. The processor can obtain input data from the device. The input data can include captured data. The processor can analyze the input data to recognize an object represented in or by the input data and a path associated with the object. The processor can generate acoustic representation data representing the object and the path, and provide the acoustic representation data to the device.