Volumetric Feature Descriptor Data for Augmented Reality Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality technologies face challenges in accurately and efficiently accounting for real-world elements within the scene, leading to suboptimal integration of virtual elements with real-world environments.
Innovation Solution
The use of volumetric feature descriptor data, which includes 2D feature descriptors and 3D structure datapoints, allows for the creation of datasets that enable accurate tracking and spatial relationship determination of volumetric targets, enabling immersive and accurate presentation of virtual elements within augmented reality experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional augmented reality tracking methods are used, then the system complexity is reduced, but the measurement precision and reliability of real-world element tracking deteriorate
Solution Approach 1:
The patent segments the tracking problem into two independent parts: 2D feature detection (using traditional image processing) and 3D structure analysis (using volumetric feature descriptors). This segmentation allows each component to use optimized algorithms for its specific task, improving overall precision without requiring a complete system redesign.
Solution Approach 2:
The patent introduces volumetric feature descriptors as an intermediary data structure that bridges 2D image features and 3D spatial relationships. These descriptors act as a mediator that encodes both appearance and spatial information, enabling precise tracking without direct complex 3D processing of raw images.
2Reliability
If volumetric feature descriptor data is processed, then the measurement precision and reliability improve, but the processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary computation of volumetric feature descriptors during an offline or pre-processing phase, where 3D structure data is captured and processed in advance. This preliminary action creates ready-to-use descriptor databases that can be quickly queried during real-time tracking, reducing online processing time while maintaining high reliability.
Solution Approach 2:
The patent creates a simplified representation (copy) of the 3D scene using volumetric feature descriptors that capture essential spatial relationships without storing complete 3D geometry. This compressed representation allows fast matching and tracking operations while maintaining the reliability needed for accurate virtual element placement.
3Manufacturing precision
If accurate tracking of volumetric targets is achieved, then the immersion and realism of augmented reality experiences improve, but the difficulty of detecting and measuring real-world elements increases
Solution Approach 1:
The patent transitions from 2D image-based tracking to 3D volumetric tracking by incorporating depth information and spatial coordinates into the feature descriptors. This dimensional change enables accurate detection of three-dimensional real-world elements and precise placement of virtual elements in 3D space, directly improving positioning precision and immersion.
Data Source
AI summary
An illustrative augmented reality tracking system obtains a volumetric feature descriptor dataset that includes: 1) a plurality of feature descriptors associated with a plurality of views of a volumetric target, and 2) a plurality of 3D structure datapoints that correspond to the plurality of feature descriptors. The system also obtains an image frame captured by a user equipment (UE) device. The system identifies a set of image features depicted in the image frame and detects, based on a match between the set of image features depicted in the image frame and a set of feature descriptors of the plurality of feature descriptors, that the volumetric target is depicted in the image frame. In response to this detecting and based on 3D structure datapoints corresponding to matched feature descriptors, the system determines a spatial relationship between the UE device and the volumetric target. Corresponding methods and systems are also disclosed.