MR Display Control Apparatus Synchronizing Imaging and Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing MR systems experience discomfort due to asynchronous operation between imaging and display units, leading to frame discrepancies and a sense of discomfort for the user, hindering a realistic MR experience.
Innovation Solution
A display control apparatus and method that includes processing to acquire and correct virtual images based on the attitude of the imaging apparatus at a later time point, allowing for the composition and display of composite images with reduced delay times, using a correcting unit to synchronize imaging and display cycles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the imaging unit and display unit operate asynchronously, then the system can have flexible processing cycles, but frame discrepancies and discomfort occur due to time variations in imaging to display
Solution Approach 1:
The patent applies preliminary action by capturing images at multiple time points (first captured image at time T1, second captured image at time T2) before final composition. The virtual image is generated based on the first captured image, then corrected using the second captured image to account for attitude changes. This advance preparation and correction mechanism ensures synchronization without requiring the imaging and display units to operate at identical cycles, thus maintaining flexibility while improving user comfort.
2Loss of time
If the virtual image is generated and displayed without correction for attitude changes, then the processing time is reduced, but the composite image imparts a sense of discomfort to the user
Solution Approach 1:
The patent performs preliminary correction by capturing a second image at a later time point (T2 > T1) and using it to correct the virtual image generated from the first image. This advance correction approach accounts for attitude changes that occur during processing, ensuring the final composite image is synchronized and comfortable for the user while minimizing additional processing time through efficient correction algorithms.
Solution Approach 2:
The patent implements feedback by using the second captured image (taken after the first) to correct and refine the virtual image. The correction process compares the virtual image with the second captured image and adjusts accordingly, creating a feedback loop that ensures synchronization. This feedback mechanism maintains user comfort by eliminating discomfort caused by asynchronous operation, while the correction is performed efficiently to minimize time loss.
3Manufacturing precision
If multiple captured images are used for correction and composition, then the synchronization and realism are improved, but the processing complexity increases
Solution Approach 1:
The patent uses preliminary action by capturing images at predetermined time points (first captured image at T1, second captured image at T2) before final composition. The virtual image is generated from the first image and then corrected using the second image. This structured approach to multi-image capture and processing improves synchronization precision while managing complexity through clear temporal ordering and defined correction steps.
Solution Approach 2:
The patent applies segmentation by dividing the image processing into distinct segments: first image capture at T1, virtual image generation, second image capture at T2, correction processing, and final composition. This segmentation of the processing pipeline into manageable stages improves synchronization precision by ensuring each stage is completed accurately, while reducing overall complexity through modular processing steps that can be optimized independently.
Data Source
AI summary
A display control apparatus acquires a captured image of a real space captured by an imaging apparatus. The display control apparatus acquires a virtual image based on a position and attitude of the imaging apparatus, estimated using a first captured image. The display control apparatus generates a first corrected image by correcting the virtual image, based on a first attitude, which is an attitude of the imaging apparatus at a first time point that is later than an imaging time point of the first captured image. The display control apparatus generates a first composite image by compositing a second captured image having been captured after the first captured image and the first corrected image. The display control apparatus controls a display so as to display the first composite image.