Alternating Projection and Capture Frames for AR Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality systems, projected content can obscure objects in the field of view, making it difficult for image capture devices to recognize and track objects, as the projector's algorithms struggle to maintain accuracy due to the introduction of additional lines, colors, and text by the projection.
Innovation Solution
A method and system where a projection device projects content at a first rate and a capture frame at a second, lower rate, allowing the image capture device to capture images without projected content, using a blank or neutral-colored capture frame that does not obscure object features, facilitating object recognition and tracking by performing computer vision functions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the projection device continuously projects content at a high rate, then the augmented reality display is smooth and immersive, but the image capture device cannot capture clear images of objects because the projected content obscures object features
Solution Approach 1:
The system alternates between projecting content and projecting blank capture frames in a periodic sequence. The projector projects content at a first rate and blank capture frames at a second rate, creating periodic intervals where the image capture device can capture images without projected content obscuring object features. This periodic action allows both high-quality projection and clear image capture to coexist.
Solution Approach 2:
The system projects blank capture frames in advance of when images need to be captured. By preparing the projection device to display blank frames before the image capture device needs to take pictures, the system ensures that objects are visible and unobscured when capture occurs, while still maintaining high projection rates during content display intervals.
2Adaptability or versatility
If the projection device projects content continuously, then user immersion is maintained, but the image capture device introduces additional lines, colors, and text that interfere with object recognition algorithms
Solution Approach 1:
The system implements periodic switching between content projection and blank frame projection. During blank frame intervals, the image capture device captures images without interference from projected content. The processor then uses these uncrowded images for object recognition and tracking, eliminating the harmful interference of projected lines, colors, and text while maintaining AR functionality during content projection intervals.
Solution Approach 2:
The system extracts and removes projected content from the field of view during specific time intervals by projecting blank capture frames. This extraction allows the image capture device to capture clean images of objects without the interfering elements of projected content, enabling accurate object recognition while preserving the ability to project immersive content during other intervals.
3Measurement precision
If the system captures images at a high rate to maintain tracking accuracy, then object tracking is precise, but the projection device cannot complete its content projection cycle, reducing immersion quality
Solution Approach 1:
The system uses periodic action to alternate between high-speed image capture and content projection. The image capture device captures images at the second rate during blank frame intervals, providing sufficient data for accurate object tracking. Meanwhile, the projection device projects content at the first rate during content projection intervals, maintaining high immersion quality. The periodic synchronization ensures both rates can coexist without compromising either function.
Data Source
AI summary
Systems and methods are provided for alternating projection of content and capturing an image. The method includes steps of projecting, by a projection device, content at a first rate, projecting, by the projection device, a capture frame at a second rate, and capturing, by an image capture device, an image including the capture frame at the second rate, wherein capturing the image comprises capturing the image when the capture frame is projected. Systems and methods provided herein may provide increased tracking accuracy by a projecting a capture frame that does not obscure features in the image.