AR Imaging System Segmentation for Pose and Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional Augmented Reality systems face limitations in generating images that are well-suited for both camera pose determination and visualization, as they often use the same image with imaging parameters optimized for visual appeal rather than specific needs for pose determination and visualization, leading to suboptimal focus and exposure variations.
Innovation Solution
A method and system that determine imaging parameters considering both environment and virtual object properties to generate images suitable for Augmented Reality applications, allowing for separate or combined imaging parameters for pose determination and visualization, using light field cameras to capture and process light field datasets for flexible focus and viewpoint adjustments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If imaging parameters are optimized for visual appeal (high contrast, sharp focus in central part), then the image looks nice for visualization, but the image is not well-suited for camera pose determination
Solution Approach 1:
The patent divides the imaging process into separate components: a first imaging system optimized for pose determination and a second imaging system optimized for visualization. This segmentation allows each system to have specialized imaging parameters without compromising the other, resolving the contradiction between visual appeal and measurement precision.
Solution Approach 2:
The patent applies different imaging qualities to different parts of the system. The first camera system uses imaging parameters tailored for accurate pose determination (e.g., specific focus distances, exposure settings), while the second camera system uses parameters optimized for visual appeal. This local differentiation of quality allows both requirements to be satisfied simultaneously.
2Device complexity
If the same image is used for both pose determination and visualization, then device complexity is reduced, but the image cannot be optimized for both purposes
Solution Approach 1:
The patent segments the imaging function into two separate camera systems, each with dedicated imaging parameters. This segmentation improves reliability by ensuring that pose determination uses images optimized for that specific task, while visualization uses images optimized for aesthetic quality, without compromising either function.
3Manufacturing precision
If focus distance is set for a specific plane, then that plane appears sharp, but other parts of the environment are out of focus
Solution Approach 1:
The patent assigns different focus requirements to different camera systems. The first camera system uses focus settings optimized for pose determination (e.g., focusing on specific planes where features are detected), while the second camera system uses focus settings optimized for visualization. This segmentation allows both precision and flexibility requirements to be met without compromise.
Solution Approach 2:
The patent enables dynamic adjustment of focus parameters for different imaging tasks. The first camera system can dynamically adjust focus distance based on the specific requirements of pose determination, while the second camera system dynamically adjusts focus for visualization purposes. This dynamic capability provides flexibility in meeting different operational requirements.
Data Source
AI summary
A method of generating at least one image of a real environment comprises providing at least one environment property related to at least part of the real environment, providing at least one virtual object property related to a virtual object, determining at least one imaging parameter according to the at least one provided virtual object property and the at least one provided environment property, and generating at least one image of the real environment representing information about light leaving the real environment according to the determined at least one imaging parameter, wherein the light leaving the real environment is measured by at least one camera.