Spatial Sound Generation for Indoor Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current navigation technologies for visually impaired individuals, such as GPS-based systems, struggle with reliable indoor navigation and fail to effectively convey spatial information, limiting their ability to explore and navigate unfamiliar environments.

Innovation Solution

A spatial exploration system that uses a sensor system, processor, and memory to generate spatial sound by constructing a 3D spatial model of the environment, instantiating audio-labeled 3D objects, and providing vocalized information through modified audio clips, allowing users to perceive the location and orientation of objects using spatial sound cues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If GPS-based navigation systems are used, then outdoor navigation capability is provided, but indoor navigation reliability deteriorates

Engineering Contradiction:
Improveindoor navigation reliabilityVSAvoidenvironmental adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements a multi-sensor fusion system that combines camera, GPS, compass, accelerometer, and barometer sensors to create a universal navigation solution that functions reliably both indoors and outdoors. The system adapts its operation mode based on environmental conditions, using visual features when GPS is unavailable and GPS data when available, thus achieving cross-environment reliability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces intermediate computational layers including visual feature extraction algorithms, SLAM (Simultaneous Localization and Mapping) processing, and sensor fusion algorithms that mediate between raw sensor data and navigation output. These intermediaries transform diverse sensor inputs into coherent spatial information that works reliably in both indoor and outdoor environments.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If traditional audio navigation aids are used, then basic obstacle detection is provided, but spatial information conveyance effectiveness deteriorates

Engineering Contradiction:
Improvespatial information conveyanceVSAvoiduser interaction complexity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent applies local quality by providing differentiated audio feedback for different spatial locations and object types. The system generates distinct audio cues based on the direction, distance, and nature of detected features, allowing users to extract detailed spatial information from audio signals without requiring complex interaction protocols.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent replaces mechanical cane-based obstacle detection with electronic vision and sensor systems that process environmental data computationally. This substitution enables rich spatial information conveyance through audio feedback while maintaining simple user interaction through automatic feature detection and annotation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If simple obstacle detection systems are used, then basic safety guidance is provided, but exploration capability in unfamiliar environments deteriorates

Engineering Contradiction:
Improveexploration efficiencyVSAvoidenvironmental context information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent performs preliminary actions by pre-processing visual scenes to extract and annotate salient features before navigation occurs. The system identifies and labels environmental features (doorways, corridors, landmarks) in advance, storing this contextual information for use during navigation and exploration, thereby enabling efficient exploration without losing environmental context.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements continuous feedback loops where the system monitors user progress, re-detects environmental features, and updates navigation guidance based on current position and orientation. This feedback mechanism maintains exploration efficiency by providing real-time spatial information while preserving environmental context through ongoing scene analysis and feature tracking.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10362429B2Systems and methods for generating spatial sound information relevant to real-world environments
Publication Date: 2019.07.23 CALIFORNIA INST OF TECH
  • US10362429B2 patent drawing
  • US10362429B2 patent drawing
  • US10362429B2 patent drawing

AI summary

Spatial exploration systems and methods of spatial exploration utilizing spatial sound in accordance with various embodiments of the invention are disclosed. In one embodiment, a spatial exploration system acquires sensor data and constructs a 3D spatial model of a surrounding real world environment. The system can instantiate a 3D object at a location within the 3D spatial model corresponding to the location of a real world feature, determine a location and orientation of a user within the 3D spatial model, and generate an audio clip containing vocalized information describing the feature. The spatial exploration system can then output a spatial sound describing the identified feature by modifying an audio clip based upon the position of the 3D object relative to the location and orientation of the user within the 3D spatial model to encode audio cues as to the location of the feature in the surrounding real world environment.