Virtual Object Image Processing for Natural MR Compositing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing MR technology fails to account for image quality deterioration due to optical factors like blurring and light intensity drop in captured images, leading to unnatural and discomforting composite images when combined with virtual objects.
Innovation Solution
An image processing device that includes a display control unit, acquisition unit, and image processing unit to adjust virtual object images based on captured image deterioration, such as peripheral light attenuation and blur, to create a natural-looking composite image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a CG image is combined with a captured image without adjusting for optical deterioration, then the processing is simple and fast, but the composite image becomes unnatural and causes user discomfort
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing blur amounts and light intensity drop amounts for various positions in the captured image before composite image generation. When generating the composite image, the system simply retrieves these pre-computed values and applies them to the CG image, avoiding complex real-time calculations while achieving natural blending between captured and virtual images
Solution Approach 2:
The patent applies parameter changes by adjusting blur amount and light intensity parameters of the CG image based on the combination position. The image processing unit modifies these parameters according to pre-acquired deterioration information, allowing the CG image to dynamically adapt its appearance to match the optical characteristics of the captured image at different positions
2Reliability
If image processing is applied to match optical deterioration, then the composite image becomes natural, but the processing time and computational load increase
Solution Approach 1:
The patent resolves the time-quality contradiction by performing blur amount and light intensity drop amount calculations in advance, before the composite image generation process. These pre-computed deterioration characteristics are stored and quickly referenced during composite image creation, significantly reducing real-time processing time while maintaining high image quality
Solution Approach 2:
The patent applies partial action by selectively applying image processing only to the CG image portion that needs to match the captured image's optical characteristics. The processing focuses specifically on adjusting blur and light intensity parameters at combination positions, rather than processing the entire composite image, thus reducing overall computational load and processing time
3Object-affected harmful factors
If blur and light intensity adjustments are applied to CG images, then visual comfort is improved, but the device complexity and processing requirements increase
Solution Approach 1:
The patent reduces device complexity by pre-acquiring and storing blur amount information and light intensity drop amount information for different positions in the captured image. This preliminary preparation allows the image processing unit to simply retrieve and apply these values during composite image generation, avoiding the need for complex real-time optical deterioration analysis
Solution Approach 2:
The patent introduces intermediary data structures (blur amount information and light intensity drop amount information) that mediate between the captured image and the CG image. These intermediaries contain pre-computed deterioration characteristics that guide the adjustment of CG image parameters, simplifying the overall processing system while achieving the desired visual comfort
Data Source
AI summary
An image processing device includes: a display control unit that controls a display device to display a composite image obtained by combining an image of a virtual object with a captured image captured by an imaging device; an acquisition unit that acquires a combination position for combining the image of the virtual object in the captured image; an image processing unit that subjects the image of the virtual object to image processing, based on information on image deterioration of the captured image at the combination position; and a control unit that controls the image processing according to a motion amount of the display device.