Stereo image comfort quality evaluation method and system based on convolutional autoencoder

A convolutional self-encoding, stereo image technology, applied in stereo systems, image communication, TV and other directions, to achieve the effect of removing redundant image information, with significant effects and improved effects

Active Publication Date: 2019-11-19
SHANGHAI JIAO TONG UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

While improving the viewing experience, it will also cause discomfort such as dizziness, nausea, and chest tightness to the audience.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Stereo image comfort quality evaluation method and system based on convolutional autoencoder
  • Stereo image comfort quality evaluation method and system based on convolutional autoencoder
  • Stereo image comfort quality evaluation method and system based on convolutional autoencoder

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0043] Such as Figures 1 to 3 As shown, a method for evaluating the comfort quality of stereoscopic images based on convolutional autoencoders provided by the present invention includes:

[0044] 1. Model building steps: build a convolutional autoencoder model and conduct unsupervised learning training. All the pictures in the database are used for unsupervised training with a convolutional self-encoder. During the training process, the encoder will compress and encode the original image into a three-...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a system for evaluating the quality of stereoscopic image comfort based on a convolutional self-encoder, which comprises the following steps: a convolutional self-encoder model is established and unsupervised learning training is carried out; the basic features of left and right stereoscopic images are extracted by using the trained convolutional self-encoder model; by using the extracted basic features, the depth features corresponding to the stereoscopic images of left and right viewpoints are extracted; the dimension of the extracted basic features and depth features is reduced, and the dimension- reduced basic features and depth features are spliced and expanded into one-dimensional vectors; the obtained one-dimensional vector is processed, and the stereo image comfort model is obtained by learning. The invention introduces a convolution self-encoder to carry out initial feature extraction, effectively removes redundant information of an image, is very efficient in feature extraction, and matches the depth extraction algorithm and the SVR regressor, so that the effect is improved remarkably.

Description

technical field [0001] The invention relates to the field of image comfort quality evaluation, in particular to a method and system for stereo image comfort quality evaluation based on a convolutional autoencoder. Background technique [0002] In recent years, stereoscopic (3D) video industries such as stereoscopic movies and stereoscopic televisions have developed rapidly, and 3D video resources have increasingly entered people's daily lives. While improving the viewing experience, it will also cause the audience to experience discomfort such as dizziness, nausea, and chest tightness. In order to improve the discomfort of watching stereoscopic images and further enhance the viewing experience, a large number of researches on the comfort quality evaluation methods of stereoscopic images have emerged as the times require. Stereoscopic image comfort quality evaluation methods can be divided into subjective evaluation and objective evaluation. The former is very time-consuming...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N17/00H04N13/106
CPCH04N17/00H04N2013/0074
Inventor 周军臧博
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products