Light field image multi-magnification spatial super-resolution method and device

A technology of spatial super-resolution and light field images, which is applied in the field of image processing, can solve problems such as the inability to fully consider the distribution of spatial information

Active Publication Date: 2021-05-07
BEIHANG UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, on the one hand, the existing learning-based light field image space super-resolution algorithms need to retrain the network parameters for different magnifications; The problem that the d...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Light field image multi-magnification spatial super-resolution method and device
  • Light field image multi-magnification spatial super-resolution method and device
  • Light field image multi-magnification spatial super-resolution method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

[0039] In describing the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", " Back", "Left", "Right", "Vertical", "Horizontal", "Top", "Bottom", "Inner", "Outer", "Clockwise", "Counterclockwise", "Axial" , "radial", "circumferential" and other indicated orientations or positional relationships are based on the orientations or positional relationships shown in the drawings, which are only for the convenience of describing the present ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a light field image multi-magnification spatial super-resolution method and device. The method comprises the following steps: S1, training a single-image super-resolution network based on an EDSR structure; s2, using the trained single-image super-resolution network model to carry out single-image super-resolution with the magnification of m on all view angle images of the low-spatial-resolution light field image; s3, extracting a polar plane image before restoration from a single-image super-resolution result to form a polar plane image cube; s4, constructing a U-shaped polar plane image cube multi-magnification repair network based on an attention residual structure; s5, training the multi-magnification repair network of the polar plane image cube, repairing the information of the polar plane image cube by using the trained network model, and obtaining the polar plane image cube in which the geometric continuity of the space target in the visual angle dimension is recovered; and S6, reconstructing the repaired polar plane image cube into a light field image space super-resolution result with the multiplying power of m. According to the method provided by the invention, the super-resolution effect of the network is improved.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a method and device for multi-magnification spatial super-resolution of light field images. Background technique [0002] Light field imaging technology can capture light direction information, and obtain multi-view images of space scenes by taking a single photo. Compared with traditional imaging technology, light field imaging technology can not only obtain the position information and light intensity information of objects in the scene on the detector, The angle information of the light rays can also be obtained. Therefore, light-field cameras have advantages in tasks such as depth estimation and post-capture refocusing. [0003] In the case of generalized focusing of a light field camera based on a microlens array, the product of the viewing angle resolution and the spatial resolution cannot exceed the resolution of the camera sensor. However, the number of detecto...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40
CPCG06T3/4076Y02A90/10
Inventor 苏丽娟袁艳叶子沐
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products