Pixel-Ray MPI View Plane Filling for Distortion-Free Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing MPI-based spatial expression methods suffer from image distortion due to blank areas in the view plane when generating images from arbitrary views, particularly when using multi-view input images with varying color values based on the angle of incidence.
Innovation Solution
A method and apparatus that calculate pixel values for each view based on multiple input images, generate a view plane at specific points where pixel paths intersect MPI layers, and record pixel values at these intersections to fill blank areas, ensuring consistent color values across views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If MPI-based spatial expression method is used to achieve high image quality at arbitrary views, then image quality is improved, but blank areas appear in the view plane causing distortion when generating images from arbitrary views
Solution Approach 1:
The patent performs preliminary action by calculating pixel values for multiple views in advance and storing them in the MPI data structure before actual rendering is needed. This allows the system to have pre-computed view information available when arbitrary view rendering is required, preventing blank areas and distortion during the rendering process itself
Solution Approach 2:
The patent introduces an intermediary mechanism (pixel ray path tracing and view plane projection system) that mediates between the input multi-view images and the final arbitrary view output. This intermediary process maps pixel values from multiple input views to appropriate positions in the output view plane, filling blank areas and eliminating distortion through systematic projection and interpolation
2Adaptability or versatility
If multi-view input images with varying color values based on angle of incidence are used, then spatial expression capability is improved, but color value inconsistency occurs when compositing at arbitrary views
Solution Approach 1:
The patent applies local quality by processing different regions of the image separately based on their specific characteristics. Each pixel or pixel group is processed according to its local viewing angle and spatial position, with color values adjusted and interpolated locally to maintain consistency with the original image while adapting to the arbitrary view direction
Solution Approach 2:
The patent changes parameters (color values, viewing angles, projection coordinates) dynamically during the rendering process. When generating an arbitrary view, the system adjusts color values based on the relationship between the original multi-view images and the target view, transforming parameters to maintain color consistency while preserving spatial expression capability
Data Source
AI summary
The present invention relates to a method and apparatus for filling a blank area of MPI view plane based on a pixel ray path. A method for generating multi plane image (MPI) data according to an embodiment of the present disclosure may comprise: calculating a pixel value according to each view for each photographed object, based on a plurality of input images photographed from a plurality of views; generating a view plane at a specific point by recording the calculated pixel value on one MPI layer determined based on the spatial position of the corresponding photographed object among a plurality of MPI layers; and generating MPI data by additionally recording the pixel value for the view.