Live Camera Overlay Mapping via 3D Object Identity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current techniques for mapping between images captured at different viewpoints of an object are ineffective, leading to inconsistent analysis across different objects and views.
Innovation Solution
The system determines an object identity in a live camera feed, generates augmented reality overlay data with tags characterizing object features, and maps these tags across multiple frames and views using correspondence between reference and live camera frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If current techniques for mapping between images captured at different viewpoints are used, then the system can process visual data, but the mapping is ineffective and analysis is inconsistent across different objects and views
Solution Approach 1:
The patent introduces a three-dimensional representation of the object as an intermediary between multiple two-dimensional images captured from different viewpoints. This 3D model serves as a mediator that enables consistent mapping and analysis across all views by providing a unified reference framework, thereby resolving the inconsistency problem in current mapping techniques
2Speed
If real-time processing is performed on mobile devices, then the system can provide live overlays, but computational resources are limited
Solution Approach 1:
The patent segments the image processing task into distinct phases: an initialization phase that performs computationally intensive operations (triangulating points, determining correspondences) to establish a 3D representation, and a presentation phase that uses this pre-computed model for real-time overlay operations. This segmentation allows heavy computations to be performed offline while enabling real-time processing on mobile devices during actual use
3Measurement precision
If multiple frames are processed to determine tag locations, then mapping accuracy improves, but processing time increases
Solution Approach 1:
The patent applies preliminary action by performing the computationally intensive task of determining correspondences between the reference view and multiple camera frames during an initialization phase before actual use. This pre-computation establishes a precomputed correspondence model that can be quickly queried during the presentation phase, thereby achieving high tag location accuracy without the time penalty of processing all frames in real-time
Data Source
AI summary
A live camera feed may be analyzed to determine the identify of an object, and augmented reality overlay data may be determined based on that identity. The overlay data may include one or more tags that are each associated with a respective location on the object. The live camera feed may be presented on a display screen with the tags being positioned as the respective location.