AR Image Processing Apparatus for Real-Time CG Composition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing AR image processing technologies face challenges in accurately compositing and displaying computer-generated (CG) objects on natural landscapes in real time, especially when the camera is moved, as they require manual positioning and struggle to determine accurate size and posture without prior registration of feature points.
Innovation Solution
An AR image processing method and apparatus that combines marker-based and natural feature tracking techniques, using a first AR analyzer to determine the position, posture, and scale of an AR marker, and a second analyzer to calculate the appearance of a CG object in subsequent camera views, allowing for real-time composition and display without manual positioning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If marker-based AR technique is used to accurately determine position and posture, then measurement precision is improved, but the system cannot track when no recognizable feature points exist in the digital image
Solution Approach 1:
The patent combines marker-based AR technique and natural feature tracking based AR technique into a single system. The marker-based approach provides accurate position and posture estimation when markers are visible, while the natural feature tracking provides continuous tracking capability when markers are not visible or when manual positioning is needed, thus resolving the contradiction between measurement precision and adaptability
2Ease of operation
If natural feature tracking based AR technique is used to allow free camera movement, then ease of operation is improved, but manufacturing precision of base plane determination deteriorates
Solution Approach 1:
The patent uses an AR marker as an intermediary object to establish accurate spatial relationships. The marker serves as a reference that bridges the gap between free camera movement and accurate base plane determination, allowing the system to maintain both ease of operation and manufacturing precision by providing a known reference frame for positioning
3Manufacturing precision
If manual positioning operation is required to set CG object parameters, then manufacturing precision is improved, but productivity deteriorates
Solution Approach 1:
The system performs automatic positioning and sizing of CG objects by detecting AR markers and calculating their position, posture, and scale in the real world. This self-service capability eliminates the need for manual positioning operations while maintaining accuracy, thus resolving the contradiction between manufacturing precision and productivity by enabling real-time automatic composition
Data Source
AI summary
A first AR analyzer (3A) analyzes a first captured image including an AR marker image captured by a camera (1), determines the appearance of the AR marker image in the field of view in the first captured image, and virtually places a corresponding CG at an appropriate position in the field of view corresponding to the AR marker image; a second AR analyzer (3B) calculates appearance of the CG object in another field of view of the camera in a second captured image subsequently captured by the camera; a CG rendering unit (5) composites an image of the CG object at an appropriate position in the second captured image corresponding to the appropriate appearance; and a display unit (7) displays the composite image, so that the apparatus can composite and display a CG object in real time on a digital image of a natural landscape captured by a camera.