Adaptive Non-Visual Navigation via Spatial Audio and Haptics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional navigational guidance systems rely on two-dimensional maps and GPS, failing to provide effective non-visual navigation, especially in complex environments with obstructing objects or for visually impaired individuals, as they do not account for real-time object detection and adaptation.

Innovation Solution

The system employs electronic devices with sensors and haptic feedback to generate three-dimensional maps of physical environments, providing spatial audio and haptic outputs for non-visual navigation, allowing for real-time detection and adaptation around obstacles, and enabling navigation in unfamiliar or dynamic spaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If two-dimensional maps and GPS are used for navigational guidance, then the system is simple and easy to implement, but it fails to provide effective non-visual navigation in complex environments with obstructing objects

Engineering Contradiction:
Improvenavigational guidance effectivenessVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines multiple sensing modalities (cameras, depth sensors, LiDAR) with traditional GPS and map data to create a unified navigation system. This merging of 2D map-based navigation with 3D real-time environmental sensing enables the system to provide both simplicity of use and reliability in complex environments by integrating diverse data sources into a cohesive navigational guidance framework

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary processing layer that translates complex sensor data from multiple sources into simplified navigational instructions for the user. This intermediary layer processes raw sensor inputs, identifies obstacles, and generates adaptive route guidance, thereby maintaining system simplicity while improving navigational reliability through sophisticated environmental awareness

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If real-time object detection and adaptation are implemented, then navigation in complex environments improves, but the device complexity increases

Engineering Contradiction:
Improveenvironmental adaptation capabilityVSAvoidsensor and processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent employs multi-functional sensors that can perform multiple detection tasks simultaneously. For example, camera systems capture both visual imagery for obstacle detection and environmental mapping, while depth sensors provide both distance measurement and spatial structure information. This multi-functionality enables environmental adaptation without proportionally increasing device complexity, as single components serve multiple navigational purposes

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent divides the complex task of environmental adaptation into segmented processing stages: initial environmental scanning, real-time obstacle detection, route recalculation, and guidance adjustment. This segmentation allows the system to handle complex adaptation requirements through modular processing steps, reducing overall system complexity by breaking down sophisticated functions into manageable discrete operations

Inventive Principle:
Principle #1Segmentation

3Ease of operation

If non-visual navigation cues are provided through spatial audio and haptic feedback, then accessibility for visually impaired individuals improves, but the device complexity increases

Engineering Contradiction:
Improvenon-visual navigation accessibilityVSAvoidoutput mechanism complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces traditional visual display mechanisms with spatial audio and haptic feedback systems. Instead of requiring users to visually interpret map data and navigate interfaces, the system uses sound spatialization to convey directional information and haptic patterns to indicate obstacles and route changes. This substitution improves accessibility for visually impaired users while managing device complexity by leveraging audio and tactile channels that require different hardware configurations compared to visual display systems

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20240361128A1Adaptive non-visual navigational guidance for electronic devices
Publication Date: 2024.10.31 APPLE INC
  • US20240361128A1 patent drawing
  • US20240361128A1 patent drawing
  • US20240361128A1 patent drawing

AI summary

Implementations of the subject technology provide adaptive non-visual navigational guidance for electronic devices. The non-visual navigational guidance may be provided in the form of spatialized audio and/or spatialized haptic output from an electronic device. The non-visual navigational guidance may be based on a three-dimensional map of a portion of a physical environment, and may adapt to physical objects detected in the path of the guidance, in real time, during providing of the non-visual navigational guidance.