Portable Imaging Localization with 3D Map Feature Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing localization technologies struggle to provide real-time apparatus positioning in complex environments, particularly indoors, and maintain up-to-date information about the environment, due to the complexity of structures and changing surroundings.
Innovation Solution
A computer-implemented method using a portable imaging apparatus that captures data, matches object features with a prior map linked to a 3D model, and outputs overlay information for augmented reality, allowing real-time localization and data updating through Lidar and visual data integration, with features registered and aligned for accurate positioning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If vision and lidar-based localization methods are used in complex indoor environments, then localization capability is provided, but the complexity of processing and maintaining up-to-date computer imaging data increases
Solution Approach 1:
The system segments the environment into multiple map tiles or zones, each with its own processed imaging data. This divides the complex task of processing the entire environment into manageable chunks, reducing the computational burden while maintaining comprehensive localization capability across the whole space.
Solution Approach 2:
The system performs preliminary processing of imaging data to create and update a database of environmental features, objects, and spatial relationships before actual localization operations. This pre-processing includes extracting key features, building 3D models, and establishing reference frames, which then accelerate real-time localization without requiring complex processing during operation.
2Measurement precision
If real-time localization is implemented in dynamic environments, then positioning accuracy is improved, but the ability to maintain up-to-date environmental information deteriorates
Solution Approach 1:
The system continuously compares current imaging data with stored reference data and automatically updates the environmental model based on detected changes. This feedback loop enables the system to maintain up-to-date information about environmental modifications, new objects, or altered conditions while preserving positioning accuracy through consistent reference frames.
Solution Approach 2:
The system dynamically adapts its processing and mapping strategies based on the operational context and detected environmental changes. It can switch between different localization algorithms, adjust the level of detail in processed data, and modify update frequencies to balance positioning precision with keeping environmental information current in real-time.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables real-time localization and data flow in dynamic environments, providing accurate positioning and augmented reality information, even in challenging conditions like building sites or indoor spaces, with the ability to update and store data efficiently.
Implementation Method 1
Lidar data obtained by a Lidar of the portable imaging apparatus
Implementation Method 2
visual data obtained by a visual camera of the portable imaging apparatus
Data Source
AI summary
Examples disclosed herein provide computer-implemented methods and apparatus of localization of a portable imaging apparatus in an environment, the method comprising: receiving image data indicative of the environment, the image data captured by the portable imaging apparatus located at a position within the environment; identifying a location of the portable imaging apparatus in the environment by matching an identified object feature in the image data with a corresponding object feature in a prior map of the environment, the prior map linked to a three-dimensional model of the environment; and outputting overlay information of the environment viewed from the identified location of the portable imaging apparatus, the overlay information retrieved from the prior map and indicative of prior stored data relating to a three-dimensional model feature in the three-dimensional model.