Image Generation Apparatus Texture Mapping via Reference Map
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing techniques for generating virtual viewpoint images require significant calculation resources due to the need for projective transformation of each camera image based on complex three-dimensional shape data, leading to increased processing loads as the complexity of the data increases.
Innovation Solution
An image generation apparatus that acquires three-dimensional shape data and a two-dimensional map image, and generates color information images based on these, allowing for the association of texture with three-dimensional shape data using a reduced number of calculation resources by processing the images in a way that minimizes the need for extensive projective transformations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If projective transformation is performed for each camera image based on complex three-dimensional shape data, then texture association accuracy is improved, but calculation resources and processing load increase
Solution Approach 1:
The patent divides the complex projective transformation process into two stages: first performing projective transformation only on the reference camera image to generate a reference texture map, then using this reference map to guide texture association for other camera images. This segmentation reduces the computational complexity from transforming all images completely to transforming only the reference image and using its results for others.
Solution Approach 2:
The patent performs projective transformation on the reference camera image in advance to generate a reference texture map before using it to associate textures with other camera images. This preliminary action eliminates the need to perform full projective transformations on all camera images, thereby reducing overall calculation resources while maintaining texture association accuracy.
2Manufacturing precision
If projective transformation is performed for each camera image, then texture mapping precision is improved, but processing time increases
Solution Approach 1:
The patent segments the texture mapping process by performing projective transformation only on the reference camera image and using the resulting reference texture map to guide the texture association for multiple other camera images. This reduces the number of transformation operations from processing each image independently to processing the reference image once and reusing the result, thereby reducing processing time while maintaining precision.
Solution Approach 2:
The patent performs the computationally intensive projective transformation on the reference camera image as a preliminary step, generating a reference texture map that can be reused for multiple other camera images. This preliminary computation eliminates the need to repeat the full transformation process for each image, significantly reducing total processing time while preserving texture mapping precision through the reference map guidance.
Data Source
AI summary
The image generation apparatus is an image generation apparatus having: a first acquisition unit configured to acquire three-dimensional shape data of a background; a second acquisition unit configured to acquire a two-dimensional map image; a third acquisition unit configured to acquire a first image and a second image; and a generation unit configured to generate a first color information image indicating color information on an element configuring the three-dimensional shape data of the background and generate a second color information image indicating color information on an element configuring the three-dimensional shape data of the background.