Virtual Image Resolution via Light Field and High-Res Data Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for acquiring virtual image data using light field photography techniques struggle to achieve high resolution when the image sensor is positioned virtually, especially when the object has few edges or is flat, as they rely on micro lens arrays or variable apertures, which limit the accuracy of distance maps and image resolution.
Innovation Solution
An image processing apparatus that acquires light ray information and virtual position data to generate high-resolution virtual image data by combining low-resolution light field data with high-resolution image data, using a variable aperture and image reconfiguration units to estimate degradation models and interpolate high-resolution images on a virtual image sensor.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a micro lens array is arranged in front of the image sensor to acquire light field data, then light field information can be obtained, but the resolution of the virtual image will be lower compared to the resolution of the image sensor
Solution Approach 1:
The patent divides the image sensor into multiple regions, with some regions dedicated to capturing light field data and other regions maintaining full resolution for standard imaging. This segmentation allows simultaneous acquisition of both light field information and high-resolution images without compromising either function
Solution Approach 2:
The patent combines light field data with high-resolution image data through image synthesis processing. By merging these two data sources, the system generates virtual images at high resolution that incorporate the depth and parallax information from the light field data
2Loss of information
If a variable aperture is used to acquire light field data, then light field information can be obtained, but it is substantially impossible to acquire virtual image data with high resolution when the object has few edges or is substantially flat
Solution Approach 1:
The patent uses a distance map generated from light field data as an intermediary to guide the image synthesis process. This distance map serves as a mediator that transfers depth information to the final virtual image, enabling accurate depth representation even for objects with few edges or flat surfaces
Solution Approach 2:
The patent changes the parameters used in image synthesis by incorporating both light field data and high-resolution image data. By adjusting the synthesis parameters to utilize multiple data sources, the system overcomes the limitation of insufficient edge information in traditional methods
3Manufacturing precision
If view interpolation is used to generate high-quality images from light field data, then image quality can be improved, but accurate distance maps cannot be generated when the object has few edges or is substantially flat
Solution Approach 1:
The patent performs preliminary acquisition of both light field data and high-resolution image data before the image synthesis step. This preliminary action ensures that all necessary information is captured in advance, allowing the synthesis process to compensate for insufficient edges or flat surfaces by utilizing the pre-captured high-resolution data
Data Source
AI summary
The present invention is directed to a method for generating virtual image data at high resolution which is obtained when imaging is performed using a light ray incident on an imaging apparatus at a virtual position different from the actual position of an image sensor. A method for image processing includes acquiring light ray information, inputting virtual position information, generating first virtual image data which is obtained if the light ray is imaged at the virtual position with first resolution based on the light ray information and the virtual position information and inputting high resolution image data with second resolution higher than the first resolution, and generating second virtual image data which is obtained if the light ray is imaged at the virtual position with third resolution higher than the first resolution, based on the first virtual image data and the high resolution image data.