Image Processing Apparatus Virtual Object Tint Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for generating virtual viewpoint images by combining captured images and computer graphics (CG) images fail to naturally align the perceived tint and resolution of real and virtual objects, leading to unnaturalness in the composite image due to varying illumination conditions and capturing conditions.
Innovation Solution
An image processing apparatus that adjusts the tint and resolution of CG images based on the color information and texture data of real objects in the captured images, ensuring that the virtual objects match the environmental conditions, thereby creating a more natural composite image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If CG images are superimposed on captured images to generate virtual viewpoint images, then virtual objects can be displayed in the captured scene, but the perceived tint and resolution of real and virtual objects do not align, causing unnaturalness
Solution Approach 1:
The patent applies parameter changes by adjusting the tint and resolution parameters of CG images based on the characteristics of captured images. The processing apparatus modifies color information and other parameters of virtual objects to match the environmental conditions and capturing conditions reflected in the captured images, thereby aligning the perceived characteristics of real and virtual objects.
Solution Approach 2:
The patent implements local quality by differentiating the processing of real objects and virtual objects. The system identifies regions corresponding to real objects in captured images and applies different color and resolution characteristics to virtual objects in those regions, ensuring that each object's appearance is optimized for its specific context within the scene.
2Reliability
If noise processing is performed to align perceived noise of captured image and CG image, then unnaturalness is reduced, but the perceived tint and resolution alignment is not achieved
Solution Approach 1:
The patent extends parameter changes beyond noise alignment to explicitly address tint and resolution alignment. The system adjusts color information parameters and resolution characteristics of CG images to match the captured image properties, ensuring comprehensive alignment of multiple visual characteristics including tint, resolution, and noise characteristics.
Data Source
AI summary
An image processing apparatus obtains one or plurality of images based on capturing by one or plurality of image capturing apparatuses, obtains information related to a virtual object, and generates a two-dimensional image including the virtual object, based on the one or plurality of obtained images and the obtained information related to the virtual object. The image processing apparatus generates the two-dimensional image by determining color information of the virtual object based on color information of a real object included in the one or plurality of images.