Light Intensity Image Generation via Depth-Weighted Texture Blending
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for generating images from new view points based on texture maps and meshes from different view points often result in suboptimal quality, depth distortions, and incorrect filling of de-occluded areas due to limitations in handling occlusions and depth interpolation.
Innovation Solution
A method that receives texture maps and meshes from multiple view points and generates a light intensity image for a new view point by determining corresponding image positions and depth values for each mesh, then combines light intensity values from multiple texture maps based on depth values, increasing the weighting of light intensity values further towards the background.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional methods combine texture maps and meshes from multiple view points to generate images for new view points, then view point flexibility is improved, but image quality deteriorates due to depth distortions and incorrect filling of de-occluded areas
Solution Approach 1:
The patent performs preliminary depth comparison and occlusion analysis before generating the final light intensity image. By pre-identifying de-occluded areas and comparing depth values from multiple view points, the system prepares the necessary data structures and selects appropriate texture map contributions in advance, preventing depth distortions and incorrect filling artifacts in the final image
Solution Approach 2:
The patent applies different processing strategies to different regions of the image based on local depth characteristics. For de-occluded areas, it uses depth-based weighting to select the most appropriate texture map contribution, while for occluded areas it applies different blending rules. This local differentiation maintains image quality while preserving view point flexibility
2Device complexity
If conventional methods use simple depth interpolation to combine texture maps from different view points, then computational complexity is reduced, but depth consistency deteriorates leading to artifacts around foreground objects
Solution Approach 1:
The patent changes the interpolation parameter from simple linear depth interpolation to a weighted combination approach where weights are determined by depth value comparisons. Instead of uniformly interpolating depth values, the system adjusts the contribution of each view point's texture map based on its depth relationship with other view points, maintaining depth consistency while managing computational complexity through efficient weighting schemes
3Ease of operation
If conventional methods process each polygon separately to generate light intensity images, then processing simplicity is improved, but processing speed deteriorates due to redundant computations
Solution Approach 1:
The patent merges the processing of multiple polygons that share common vertices or edges by performing depth comparisons and texture map selections at the vertex level rather than for each individual polygon. This combining of processing operations eliminates redundant computations while maintaining the simplicity of the overall approach, significantly improving processing speed without complicating the algorithm
Data Source
Figure 1a~1c
Figure 2
Figure 3
AI summary
An apparatus comprises receivers (201, 203) receiving texture maps and meshes representing a scene from a first and second view point. An image generator (205) determines a light intensity image for a third view point based on the received data. A first view transformer (207) determines first image positions and depth values in the image for vertices of the first mesh and a second view transformer (209) determines second image positions and depth values for vertices of the second mesh. A first shader (211) determines a first light intensity value and a first depth value based on the first image positions and depth value, and a second shader (213) determines a second light intensity value and a second depth value from the second image positions depth values. A combiner (215) generates an output value as a weighted combination of the first and second light intensity values where the weighting of a light intensity value increases for an increasing depth value.