Dynamic Perspective Video Window for AR Viewpoint Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality technologies fail to accurately reflect the user's viewpoint by not considering the user's position in the physical environment, leading to mismatched live video images and virtual graphics.
Innovation Solution
A dynamic perspective video window system that captures a scene-facing image and a user-facing image, determines the user's position relative to the display, and crops and adjusts the scene-facing image accordingly to render a perspective-matched view, incorporating user position data for accurate and interactive augmented reality experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If live video images are captured and presented to a user in augmented reality, then the user can interact with the physical environment, but the images do not accurately reflect the user's viewpoint because the user's position is not taken into account
Solution Approach 1:
The system performs preliminary actions by capturing a user-facing image to determine the user's position relative to the display device before processing the scene-facing image. This preliminary detection of user position enables subsequent accurate cropping and perspective adjustment of the scene image, ensuring the final augmented reality view accurately reflects the user's viewpoint without requiring complex real-time adjustments during image presentation.
2Measurement precision
If the user's position is determined and the scene-facing image is cropped and adjusted dynamically, then the viewpoint accuracy is improved, but the processing complexity and time increase
Solution Approach 1:
The system determines the user's position relative to the display device as a preliminary step before cropping the scene-facing image. By performing this position determination in advance, the system enables efficient image processing during augmented reality operation, as the cropping parameters can be calculated directly from the pre-determined position data without requiring complex real-time computations.
Solution Approach 2:
The system captures a user-facing image to create a representation of the user's position and orientation. This copied information from the user-facing image is then used to guide the cropping and perspective adjustment of the scene-facing image, enabling accurate viewpoint matching through information transfer rather than complex geometric calculations.
3Adaptability or versatility
If additional images, graphics, and text are composited with the cropped image based on user position, then the adaptability and user experience are improved, but the device complexity increases
Solution Approach 1:
The system applies local quality by compositing additional images, graphics, and text at specific locations within the cropped scene-facing image based on the determined user position. Rather than uniformly processing the entire image, the augmentation elements are strategically placed in relevant portions of the image that correspond to the user's viewpoint, enhancing adaptability while managing processing complexity through targeted local modifications.
Data Source
AI summary
Systems and methods are disclosed for generating an image for a user based on an image captured by a scene-facing camera or detector. The user's position relative to a component of the system is determined, and the image captured by the scene-facing detector is modified based on the user's position. The resulting image represents the scene as seen from the perspective of the user. The resulting image may be further modified by augmenting the image with additional images, graphics, or other data.