Spatial Anchor Creation Using Audio Feedback for Visually Impaired Users

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users with low or limited vision face challenges in creating robust spatial anchors for navigation systems, as existing methods rely heavily on visual cues and require users to capture features from different perspectives, which can be difficult for individuals with visual impairments.

Innovation Solution

A method that involves receiving image information from a user device, determining the need for further image data, providing guidance to capture complete and high-quality image information, and generating a spatial anchor point in a model of the real-world environment, which can be used for navigation, utilizing techniques like Simultaneous Localization and Mapping (SLAM) and object recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If visual cues and feature capture methods are used for creating spatial anchors, then navigation accuracy is improved, but accessibility for blind or low vision users deteriorates

Engineering Contradiction:
Improvespatial anchor accuracyVSAvoidusability for blind or low vision users
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces visual-based spatial anchor creation with audio-based methods. Users with visual impairments can create spatial anchors by making sounds (e.g., clapping, speaking) which are captured by microphones, eliminating the need for visual feature capture while maintaining spatial mapping accuracy

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces audio signals as an intermediary medium between the user and the spatial environment. Instead of directly viewing and capturing visual features, users interact with the environment through sound production and audio feedback, which the system processes to create accurate spatial anchors

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If comprehensive image information is captured from multiple perspectives, then spatial anchor robustness is improved, but complexity of the capture process increases

Engineering Contradiction:
Improvespatial anchor robustnessVSAvoidcapture process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the essential spatial information requirement from the complex visual capture process. Instead of requiring multiple perspective images, the system uses audio signals captured from the user's location to create spatial anchors, simplifying the capture process while maintaining reliability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system allows users to automatically create spatial anchors through their natural movement and sound production in the environment. The mobile device's sensors and microphone automatically capture the necessary data without requiring the user to manually position the device or capture images from specific angles

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12182943B2Guidance system for the creation of spatial anchors for all users, including those who are blind or low vision
Publication Date: 2024.12.31 MICROSOFT TECHNOLOGY LICENSING LLC
  • US12182943B2 patent drawing
  • US12182943B2 patent drawing
  • US12182943B2 patent drawing

AI summary

Disclosed herein are various methods for supporting guidance systems. In one example, a method receives image information of a surrounding environment of the user device at a first real-world location. Thereafter, the method determines, based on the received image information, what further information is needed to generate a spatial anchor point in the model. Subsequently, the method provides guidance information to the user device for capturing the further image information that is required to create a spatial anchor point, after which point the user device may implement the guidance information. Next, the method receives further information required from the user device for generating a spatial anchor point, and then a spatial anchor point is generated based on the exchanged information.