3D Audio Cloud Spatial Representation for Visually Impaired Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing assistive technologies for visually impaired individuals primarily provide task-based assistance and do not offer an interactive and responsive presentation of spatially-associated information based on the user's context and needs.

Innovation Solution

A 3D audio cloud system that captures environmental information using various devices and generates a spatial audio representation of entities, providing audible cues that are dynamically updated based on the user's location and context, allowing for interactive exploration and retrieval of additional information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If specific task-based assistive technologies are used, then discrete functional aspects such as obstacle avoidance and navigation are improved, but interactive and responsive presentation of spatially-associated information based on user context is not achieved

Engineering Contradiction:
Improvediscrete functional assistanceVSAvoidinteractive responsive presentation
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system dynamically adapts the audio cloud presentation based on real-time user context, location, and needs. The spatial audio representation is not static but continuously updates and reconfigures itself according to changing environmental conditions and user interactions, enabling both discrete functional assistance and interactive responsive presentation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The audio cloud system serves multiple functions simultaneously: it provides obstacle detection, navigation guidance, entity identification, and contextual information presentation all through a single unified spatial audio interface. This multi-functional approach eliminates the need for separate discrete assistive technologies while maintaining ease of operation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If traditional assistive technologies are used, then navigation and obstacle avoidance are supported, but spatially-aware contextual information presentation is limited

Engineering Contradiction:
Improvenavigation supportVSAvoidspatial contextual information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system transitions from traditional 1D linear navigation guidance to 3D spatial audio cloud representation. By mapping contextual information onto a three-dimensional spatial framework, the system preserves both reliable navigation support and rich spatial contextual information simultaneously, allowing users to perceive entities and obstacles in their actual spatial positions.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The spatial audio cloud acts as an intermediary layer between the physical environment and the user's perception. It processes and transforms raw environmental data into meaningful spatial audio representations, preserving navigation reliability while enriching it with contextual information that would otherwise be lost.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10586106B2Responsive spatial audio cloud
Publication Date: 2020.03.10 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10586106B2 patent drawing
  • US10586106B2 patent drawing
  • US10586106B2 patent drawing

AI summary

An interactive and responsive presentation of spatially-associated information related to a user's environment based on the user's context is provided. Aspects of a 3D audio cloud system extract information about entities in the user's environment, and generate and provide the user with a 3D audio cloud that presents a spatial audio representation of entities in the user's environment that gives the user cues as to where the entities are located with respect to the user. An entity can be represented in a descriptive manner that provides the user with various types of information about the entity (e.g., shape, size, color, others' opinions, actions, emotions). Further, aspects of the 3D audio cloud system dynamically update the 3D audio cloud based on the user's location, position, or orientation, receive selection input from the user associated with the 3D audio cloud, and retrieve and present additional information as requested by the user.