Mixed Reality Noise Matching via Light-Shielding Region Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In mixed reality systems using video see-through head-mounted displays, the superimposition of real and virtual space images often results in an unnatural sense of noise due to differences in image quality characteristics, such as gradation, white balance, and resolution, leading to visually undesirable outcomes.
Innovation Solution
An information processing apparatus and method that adds noise to virtual space images based on the noise characteristics of the real space image, using a light-shielding region to determine the noise characteristics of the imaging unit and applying these to the virtual space image to match the noise level of the real space image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If noise is added to the virtual space image at a predetermined fixed standard, then the virtual space image can be generated, but the sense of noise becomes different from that of the real space image, resulting in an unnatural appearance
Solution Approach 1:
The patent applies preliminary action by measuring the noise characteristics of the real space image before generating the virtual space image, and using these measured characteristics to guide the noise addition process. The imaging unit captures the real space image and extracts noise characteristics (standard deviation) in advance, which are then used to determine the noise addition amount for the virtual space image, ensuring natural noise matching without complex iterative adjustments
Solution Approach 2:
The patent replaces complex mechanical or manual noise adjustment mechanisms with an automated information processing system. The noise addition amount determination unit automatically calculates the appropriate noise level by substituting the measured real space noise characteristics into a predetermined formula, eliminating the need for manual trial-and-error adjustment and achieving precise noise matching through computational methods
2Ease of operation
If the real space image and CG image are superimposed and displayed without being modified, then the display process is simple, but the image appears visually unnatural due to different noise characteristics
Solution Approach 1:
The patent applies parameter changes by modifying the noise characteristics parameter of the virtual space image to match the real space image. The system measures the standard deviation of the real space image and uses this parameter to adjust the noise addition amount in the virtual space image, thereby achieving visual consistency between the two images while maintaining a relatively simple processing workflow
Data Source
AI summary
An information processing apparatus according to the present invention includes at least one memory and at least one processor which function as: a generating unit configured to generate an image of a virtual space that is superimposed on an image of a real space captured by an image sensor; and an adding unit configured to add noise to the image of the virtual space, wherein the image sensor includes a region for capturing an image of the real space and a light-shielding region, and the adding unit adds noise to the image of the virtual space, based on an image acquired in the light-shielding region.