Augmented Reality Rendering Parallax Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality technologies face challenges in seamlessly integrating and rendering contextual, real-time augmented reality content with video content items, particularly in environments where the camera's orientation and position relative to the display device are dynamic, leading to parallax issues and inconsistent user experiences.
Innovation Solution
A method and system that enable an electronic device to communicate with a client device and a video database, allowing users to select and view augmented reality content associated with video scenes by performing an automatic calibration procedure, which adjusts the rendering of video frames and surrounding content on the electronic device's screen based on its orientation and position relative to the display device, ensuring accurate and parallax-free rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If augmented reality content is rendered on a mobile device without calibration, then the system is simpler to operate, but the rendering accuracy and parallax-free display deteriorate
Solution Approach 1:
The system performs automatic calibration before rendering augmented reality content. The calibration process captures images of the display device, detects its geometry and orientation, and stores this information for subsequent accurate rendering. This preliminary action ensures that when content is rendered, the system already has the necessary geometric data to maintain accuracy without requiring manual intervention during actual use.
Solution Approach 2:
The calibration process is performed automatically by the system itself without requiring manual measurement or user input. The mobile device captures images of the display device, processes these images to determine geometric parameters, and configures the rendering system automatically. This self-service approach maintains high rendering accuracy while preserving ease of operation.
2Adaptability or versatility
If the electronic device is moved or rotated during viewing, then user flexibility and adaptability improve, but parallax issues and rendering consistency deteriorate
Solution Approach 1:
The system dynamically adjusts the rendering of augmented reality content based on the mobile device's real-time position and orientation. The calibration data captures the geometric relationship between the display device and the mobile device's camera, allowing the system to compute accurate transformations even when the device is moved or rotated. This dynamic adaptation maintains rendering consistency across different viewing conditions.
Solution Approach 2:
The system uses orientation sensors (gyroscope, accelerometer) to continuously monitor the mobile device's position and orientation during viewing. This feedback information is fed back to the rendering system, which adjusts the display parameters in real-time to compensate for device movement, maintaining consistent and accurate augmented reality rendering despite changes in device position.
3Manufacturing precision
If manual calibration is performed, then rendering accuracy improves, but the complexity of the system and user burden increase
Solution Approach 1:
The calibration process is automated to perform itself without manual intervention. The system automatically captures images of the display device using the mobile device's camera, processes these images to extract geometric information, and configures the rendering parameters automatically. This eliminates the need for manual measurement, alignment procedures, or user input during calibration, thereby maintaining high rendering accuracy while reducing system complexity and user burden.
4Ease of operation
If real-time rendering adjustment is performed, then user experience and contextual relevance improve, but processing time and computational resources increase
Solution Approach 1:
The system performs calibration and captures geometric relationship data in advance before rendering begins. By pre-determining the spatial relationship between the display device and the mobile device's camera, the system eliminates the need for continuous complex calculations during rendering. This preliminary action allows for real-time rendering adjustments to be made efficiently with minimal processing overhead during actual viewing.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In one embodiment, a method includes: displaying an event on a first display device associated with a client device, the event comprising at least one video scene; enabling an electronic device to communicate with the client device; receiving a user input requesting augmented reality content associated with the at least one video scene; identifying a relevant portion of the augmented reality content to render on a second display associated with the electronic device, wherein the relevant portion comprises video frames corresponding to the at least one video scene and additional content surrounding the video frames; and rendering the relevant portion on the second display device.