Multi-View Rendering via Pixel Transformation and Occlusion Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multi-view 3D display technologies require repeated and resource-intensive calculations to render 3D objects from multiple viewpoints, leading to inefficiencies in rendering operations and potential gaps in image representation.
Innovation Solution
A method and apparatus for multi-view rendering that transforms pixel values from a first viewpoint to a second viewpoint, detects occlusion regions, and renders these regions to ensure complete image representation across multiple viewpoints, utilizing a rendering unit, pixel value transformation unit, occlusion detecting unit, and image generating unit to generate images from multiple viewpoints efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If images are obtained from multiple viewpoints by rendering 3D objects from each viewpoint, then complete image representation is achieved, but computational load increases significantly
Solution Approach 1:
The image generation process is segmented into two parts: (1) transform pixel values from a first viewpoint to a second viewpoint using coordinate transformation, and (2) render only the occlusion regions that cannot be obtained through transformation. This segmentation reduces the overall computational load while maintaining complete image representation.
Solution Approach 2:
Pixel values are transformed from the first viewpoint to the second viewpoint before rendering. This preliminary transformation allows the system to identify and render only the occlusion regions that need additional rendering, rather than rendering the entire image from scratch for each viewpoint.
2Reliability
If rendering is performed for each viewpoint of multi-view 3D display, then quality 3D images are provided, but rendering time increases
Solution Approach 1:
The rendering process is divided into: (1) transforming pixel values from the first viewpoint to the second viewpoint, and (2) rendering only the detected occlusion regions. This segmentation significantly reduces rendering time while maintaining 3D image quality.
Solution Approach 2:
Pixel value transformation is performed as a preliminary step before rendering occlusion regions. This allows the system to prepare transformed pixel values in advance and only render the necessary occlusion areas, reducing overall rendering time.
3Productivity
If pixel values are transformed from first viewpoint to second viewpoint, then computational efficiency is improved, but image fidelity may be compromised
Solution Approach 1:
The image is segmented into transformed regions (from pixel value transformation) and occlusion regions (rendered separately). This ensures that both transformed and rendered regions contribute to the final image, maintaining fidelity while improving efficiency.
Solution Approach 2:
The final image is generated by merging transformed pixel values with rendered occlusion region pixel values. This combination ensures that the complete image maintains high fidelity by incorporating both transformed and freshly rendered regions.
Data Source
AI summary
Provided is an apparatus and method of multi-view rendering. A method of multi-view rendering includes rendering one or more 3D objects based on a first viewpoint, transforming pixel values of pixels of the first viewpoint, which are obtained by the rendering of the 3D objects, into pixel values of pixels based on a second viewpoint that is different from the first viewpoint, detecting an occlusion region that is a remaining region other than a region represented by the pixel values obtained by the transforming of the pixel values in an image based on the second viewpoint, and rendering the detected occlusion region based on the second viewpoint.