Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Angular super-resolution reconstruction method on basis of perception loss for images of light fields

A super-resolution reconstruction, light field image technology, applied in image analysis, image enhancement, image data processing and other directions, can solve problems such as blurring, and achieve good visual effects

Active Publication Date: 2018-07-13
CHONGQING UNIV OF POSTS & TELECOMM
View PDF6 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The above methods estimate the model by minimizing the mean square error between the new perspective image and the target image, but the pixel-level loss is not consistent with the visual loss observed by the human eye. It is possible that the pixel-level loss is higher. more blurred than the one with the lower loss

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Angular super-resolution reconstruction method on basis of perception loss for images of light fields
  • Angular super-resolution reconstruction method on basis of perception loss for images of light fields
  • Angular super-resolution reconstruction method on basis of perception loss for images of light fields

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0024] Such as figure 1 As shown, the input is images of four observation angles, and the present invention generates new angle images through three different angle super-resolution models, and improves the angle resolution of light field images. The model consists of two parts, one is the light field image angle super-resolution network f W , and the second is the perceptual loss network φ, such as figure 2 .

[0025] Angular Super-Resolution Network f W is a deep residual convolutional neural network as shown in Table 1:

[0026] Floor

active size

input layer

6×36×36 or 12×36×36

Convolution layer 1, filter size 64×9×9

64×36×36

Residual block 1, 64 filters

64×36×36

Residual block 2, 64 filters

64×36×36

Residual block 3, 64 filters

64×36×36

Residual block 4, 64 filt...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an angular super-resolution reconstruction method on the basis of perception loss for images of light fields, and belongs to the field of light field imaging. The angular super-resolution reconstruction method includes that mean square errors of image high-dimensional features extracted by pre-training models are used as loss functions, a network model which comprises fourresidual blocks is built, nonlinear mapping relations between observation images and target viewing angle images are learned, and accordingly new viewing angle images can be reconstructed. The angular super-resolution reconstruction method has the advantages that the perception loss for expressing the high-dimensional features is introduced, accordingly, texture details of the super-resolution reconstructed new viewing angle images can be effectively kept, and excellent visual effects can be realized by the angular super-resolution reconstruction method.

Description

technical field [0001] The invention belongs to the field of light field imaging, and relates to a method for super-resolution reconstruction of light field image angles based on perceptual loss. Background technique [0002] Light field imaging has become a focus in the research of next-generation imaging systems. The light field image contains the spatial information and angle information of the light, so the light field camera can capture images from multiple perspectives at one time. Several studies have shown that light field images have good application prospects in many fields, such as image saliency detection, image depth estimation, etc. The basic principle of the full light field camera is to insert a microlens array at the primary image plane of the general imaging system, and the light recorded by each microlens corresponds to the scene image at the same position and different angles of view, so as to obtain a 4-dimensional light field information, including 2 ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00
CPCG06T2207/20081G06T2207/20084G06T2207/10052G06T5/00
Inventor 秦红星王孟辉
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products