Light field image space super-resolution reconstruction method

Abstract

The invention discloses a light field image spatial super-resolution reconstruction method, which constructs a spatial super-resolution network and comprises an encoder, an aperture level feature registration module, a light field feature enhancement module, a decoder and the like. Extracting multi-scale features of the up-sampled low-spatial-resolution light field image, the 2D high-resolution image and the blurred image by using an encoder; the correspondence between the 2D high-resolution features and the low-resolution light field features is learned through an aperture-level feature registration module, so that the 2D high-resolution features are registered to each sub-aperture image, and registered high-resolution light field features are formed; enhancing the extracted shallow light field features by using the registered high-resolution light field features through a light field feature enhancement module to obtain enhanced high-resolution light field features; reconstructing the enhanced high-resolution light field features into a high-spatial-resolution light field image by using a decoder; the method has the advantages that the high-spatial-resolution light field image can be reconstructed with high quality, and texture and detail information can be recovered.

Description

technical field [0001] The invention relates to an image super-resolution reconstruction technology, in particular to a light-field image space super-resolution reconstruction method. Background technique [0002] Different from conventional digital cameras, light field cameras can capture the intensity (ie, spatial information) and direction information (ie, angle information) of light in the scene, thereby recording the real world more realistically. At the same time, the rich information contained in 4-dimensional (4D) light field images captured by light field cameras facilitates many applications, such as refocusing, depth estimation, virtual / augmented reality, and so on. Current commercial-grade light field cameras use a microlens array to separate light from different directions passing through the same point in the scene, thereby simultaneously recording spatial and angular information at the sensor plane. However, due to the limited resolution of the sensor sharing...

AI Technical Summary

Problems solved by technology

Boominathan et al. proposed a space super-resolution reconstruction method for light field images using mixed input, which improves the spatial resolution of 4D light field images by introducing an additional high-resolution 2D image as supplementary information, but this method The average fusion mechanism in , tends to blur the reconstruction results, and processing each SAI independently destroys the parallax structure of the reconstructed light field image

[0006] In summary, although the current related research has achieved good spatial super-resolution reconstruction results of light field images at low reconstruction scales, there are still some deficiencies in dealing with large reconstruction scales (such as 8×), especially , there is still room for improvement in restoring the high-frequency texture information of the reconstructed light field image, avoiding visual artifacts, and preserving the parallax structure

Images