AR AI Perception Mapping for Multimodal Navigation Assistance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies for aiding individuals with sensory impairments, such as blindness or visual impairment, often fail to provide comprehensive sensory inputs, including haptic feedback and depth perception, making everyday tasks like navigating environments dangerous and stressful.
Innovation Solution
Implementing augmented reality (AR), artificial intelligence (AI), and machine-learning (ML) techniques to enhance user perception and experience by providing contextual and object-oriented identification, translating visual inputs into audio and touch modalities, and offering enhanced depth sensing through hardware devices like AR-enhanced eyeglasses and canes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If existing technologies for aiding individuals with sensory impairments are used, then basic assistance is provided, but comprehensive sensory inputs including haptic feedback and depth perception are not provided
Solution Approach 1:
The patent combines multiple sensing modalities (visual, auditory, haptic) and processing functions (AI analysis, spatial mapping, real-time translation) into an integrated system that provides comprehensive sensory feedback through a single wearable device platform, resolving the contradiction by merging functionality rather than using separate devices
Solution Approach 2:
The wearable device performs multiple functions simultaneously: capturing visual data via cameras, processing spatial information through AI models, providing haptic feedback, and delivering audio output, thereby providing comprehensive sensory assistance through a single multi-functional device that reduces overall system complexity
2Reliability
If comprehensive sensory inputs are provided through multiple modalities, then navigation safety is improved, but device complexity increases
Solution Approach 1:
The patent introduces an AI processing intermediary that receives raw data from multiple sensors, processes and integrates the information through spatial mapping and object recognition, then translates it into coordinated haptic and audio feedback, thereby managing hardware complexity through intelligent software mediation
Solution Approach 2:
The patent replaces complex mechanical sensing systems with AI-based virtual sensing that processes visual and spatial data through machine learning models to infer depth, distance, and environmental context, substituting physical depth sensors with computational approaches that reduce hardware complexity while maintaining navigation safety
3Loss of information
If visual inputs are translated into audio and touch modalities, then user perception is enhanced, but processing requirements increase
Solution Approach 1:
The system performs preliminary processing by pre-training AI models offline and pre-computing spatial maps of environments, so that during real-time operation, the device only needs to execute pre-planned translation routines from visual to audio/touch modalities, significantly reducing real-time energy consumption while maintaining comprehensive perceptual information
Data Source
AI summary
According to examples, a system for supplementing user perception and experience via augmented reality (AR), artificial intelligence (AI), and machine-learning (ML) techniques is described. The system may include a processor and a memory storing instructions. The processor, when executing the instructions, may cause the system to receive data associated with at least one of a location, context, or setting and determine, using at least one artificial intelligence (AI) model and at least one machine learning (ML) model, relationships between objects in the at least one of the location, context, or setting. The processor, when executing the instructions, may then apply an artificial intelligence (AI) agent to analyze the relationships and generate a three-dimensional (3D) mapping of the at least one of the location, context, or setting and provide an output to aid a user's perception and experience.