Multi-Viewpoint Image Generation via Pixel Multiplexing and Occlusion Interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating multi-viewpoint images require unnecessary steps and rearrangement of individual viewpoint images, which can be time-consuming and resource-intensive, and do not optimize image quality or stereoscopic effects for the output device.
Innovation Solution
A direct view multiplexing method that calculates and multiplexes individual pixels or sub-pixels of virtual-viewpoint images with reference-viewpoint images, performing interpolation on occluded areas using adjacent image information, thereby generating a multi-viewpoint image that directly affects image quality and stereoscopic effect based on the output device's structure and characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If individual viewpoint images are completed and rearranged separately before multiplexing, then each viewpoint image can be processed independently, but unnecessary processing steps and time are consumed
Solution Approach 1:
The patent merges the completion and multiplexing steps into a single integrated process. Instead of completing individual viewpoint images separately and then rearranging them, the method directly multiplexes pixels from reference viewpoint images according to virtual viewpoint coordinates, eliminating the intermediate step of completing and rearranging individual images.
Solution Approach 2:
The patent performs preliminary calculation of virtual viewpoint coordinates and pixel mapping positions before the actual multiplexing operation. By pre-calculating where each pixel should be placed in the multi-viewpoint image based on depth information and viewpoint geometry, the system avoids unnecessary processing steps during the multiplexing phase.
2Manufacturing precision
If interpolation is performed on occluded areas using adjacent image information, then image quality in occluded regions is improved, but additional processing steps are required
Solution Approach 1:
The system uses the multiplexed image data itself to perform interpolation. By utilizing adjacent pixel information already present in the multiplexed structure, the interpolation process is simplified and does not require external or complex processing mechanisms.
3Productivity
If direct multiplexing of pixels from reference viewpoint images is performed, then processing steps are reduced and efficiency is improved, but image quality must be maintained through proper interpolation
Solution Approach 1:
The patent changes the processing parameter from completing full images to directly multiplexing individual pixels based on calculated virtual viewpoint coordinates. This parameter change enables efficient processing while maintaining image quality through the interpolation step that handles occluded areas using adjacent pixel information.
Data Source
AI summary
Method and device for generating a multi-viewpoint image are provided. The method of generating a multi-viewpoint image includes the steps of: acquiring at least one reference-viewpoint image; generating unit image information of a virtual-viewpoint image on the basis of unit image information of the reference-viewpoint image; multiplexing the unit image information of the reference-viewpoint image and the unit image information of the virtual-viewpoint image; and generating a multi-viewpoint image by performing an interpolation process on occluded areas between the multiplexed unit image information using the multiplexed unit image information. As a result, it is possible to avoid unnecessary processes of completing and rearranging individual viewpoint images in the course of generating a multi-viewpoint image.