AR Head-Mounted Device Orientation Tracking via Sonar and Reference Database
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing navigation systems in poor visibility conditions, such as rain, fog, or water environments, fail to provide continuous and accurate real-time visual information about the user's orientation and surroundings, relying on limited sensor data that cannot correct errors or improve image quality, leading to dangerous and difficult navigation.
Innovation Solution
A head-mountable device with sensors like sonar, inclination, and environmental sensors, combined with a reference database, processes and displays a continuous augmented reality view by matching sensor data with spatially oriented reference data, using an integrated computing unit and external processing for enhanced image quality and orientation tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If fixed sensors or mobile devices with sonar are used to map the environment in poor visibility conditions, then 2-dimensional or 3-dimensional depth/relief images can be provided, but the images cannot be updated in real-time and the user cannot see continuous visual information about their current orientation and surroundings
Solution Approach 1:
The system performs preliminary actions by pre-generating 360-degree images and storing them as reference data in a reference database before the user needs navigation assistance. These pre-captured images from multiple orientations are ready for immediate retrieval and fusion when the user enters poor visibility conditions, eliminating the need to capture images in real-time during navigation.
Solution Approach 2:
The system introduces an intermediary processing layer that fuses sensor data (sonar, cameras, LIDAR) with pre-stored reference images to generate augmented reality views. This intermediary process matches current sensor measurements against the reference database to create accurate real-time representations of the user's orientation and surroundings without requiring direct real-time image capture from all directions.
2Loss of information
If standard 2-dimensional or 3-dimensional maps are used for navigation in poor visibility, then environmental structure can be represented, but the user must rely on memory and cannot see continuous visual feedback about their orientation and position
Solution Approach 1:
The system creates accurate copies of the physical environment by capturing 360-degree images and storing them as reference data in a reference database. These digital copies preserve the complete environmental structure and can be retrieved and displayed as needed, providing the user with visual feedback that accurately represents their surroundings without requiring them to memorize the environment.
Solution Approach 2:
The system transitions from traditional 2-dimensional maps to immersive 360-degree panoramic views that provide three-dimensional spatial representation. By displaying 360-degree images that match the user's current orientation, the system creates a virtual reality environment that preserves all environmental structure information while dramatically improving ease of navigation through continuous visual feedback.
3Illumination intensity
If night vision or thermal cameras are used to improve visibility in poor lighting conditions, then visual perception can be enhanced, but the image quality remains poor when rain, fog, dust, or smoke are present
Solution Approach 1:
The system merges data from multiple sensor types including sonar, cameras, and LIDAR to create a comprehensive environmental representation. By fusing information from these different sensing modalities with pre-stored reference images, the system overcomes the limitations of any single sensor type in extreme conditions such as rain, fog, dust, or smoke, providing reliable navigation information when individual sensors fail.
4Measurement precision
If the system uses 360-degree images and reference databases to create augmented reality views, then real-time orientation tracking and image quality can be improved, but the device complexity and data processing requirements increase
Solution Approach 1:
The system performs data capture and processing in advance by pre-generating 360-degree images and storing them as reference data in a reference database before navigation is needed. This preliminary action reduces the computational burden during real-time navigation, as the system only needs to retrieve and fuse data with current sensor readings rather than processing raw images from all directions in real-time.
Solution Approach 2:
The system extracts only the essential navigation-relevant information from the complete 360-degree reference images by matching current sensor data with corresponding portions of the reference database. This extraction process creates streamlined augmented reality views that maintain high orientation tracking accuracy while reducing the amount of data that needs to be processed and displayed in real-time.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system provides a real-time, accurate augmented reality view that improves navigation by enhancing image quality and maintaining orientation awareness even in zero visibility conditions, enabling safer and more efficient movement in challenging environments.
Implementation Method 1
sensors for detecting the physical characteristics of a user and an environment
Implementation Method 2
inclination sensor for determine the spatial orientation
Data Source
AI summary
The invention is an augmented reality-based system for generating and displaying a continuous and real-time augmented reality view corresponding to a current orientation of a user. The system has a head-mountable device worn by a user, with a mount to stably affix on the head, sensors for detecting physical characteristics of the user and their environment, a display for displaying an augmented reality view, and an integrated computing and communication unit. The system has a database with reference data from sonar images and/or 2-dimensional camera images with different spatial orientations, wherein the data detected by the sensors in one spatial orientation can be matched with reference data in one spatial orientation. The invention further relates to a method for generating and displaying a continuous and real-time augmented reality view according to a current orientation of a user.