An Objective Quality Assessment Method for Panoramic Video Based on Spatiotemporal Pipeline Modeling

A panoramic video and objective quality technology, applied in the field of video coding and processing, can solve problems such as time domain transformation without consideration, and achieve the effect of increasing accuracy

Active Publication Date: 2020-11-03
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method only considers the spatial characteristics of the panoramic video, and does not consider the time-domain transformation of distortion, and there is still room for improvement in accuracy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An Objective Quality Assessment Method for Panoramic Video Based on Spatiotemporal Pipeline Modeling
  • An Objective Quality Assessment Method for Panoramic Video Based on Spatiotemporal Pipeline Modeling
  • An Objective Quality Assessment Method for Panoramic Video Based on Spatiotemporal Pipeline Modeling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0072] The present invention will be further described in detail below in combination with a specific embodiment. For the convenience of explanation and without loss of generality, the following assumptions are made:

[0073] The method proposed by the present invention is intended to be tested on the public panoramic video data set VQA48, which contains 12 original video sequences and 36 corresponding distorted video sequences, and includes a subjective quality score MOS ( Mean opinion score). Take one of the video sequences Dianying and its corresponding three videos with different degrees of distortion, Dianying_1, Dianying_2, and Dianying_3 as an example. The resolution is 4096×2048, the frame rate is 25fps, a total of 300 frames, and the mapping format is ERP. The distorted videos Dianying_1, Dianying_2, and Dianying_3 are generated by compressing the original video sequence with quantization parameters QP of 27, 37, and 42, respectively, and the corresponding MOSs are 3...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a panoramic video objective quality evaluation method based on space-time pipeline modeling, and the method comprises the steps: firstly adding a concept of time domain distortion according to a human eye visual mechanism, and building a video quality evaluation model based on a space-time pipeline; secondly, realizing the establishment of a space-time pipeline by a block search algorithm for motion estimation, the video content segmented spatially being associated front and back in time; the distortion of the space-time pipeline being decomposed into average distortionand time domain distortion, the average distortion being used for reasonably averaging the space distortion of blocks in the space-time pipeline through a recursive filter, and the recursive filter being used for consolidating the space-time pipeline distortion calculation by combining the frequency and amplitude of the distortion change gradient between the blocks; and finally, performing spatial domain pooling and time domain pooling calculation on all spatial-temporal pipeline distortions to obtain a final video quality score. By adopting the method provided by the invention, the accuracyof panoramic video objective quality evaluation can be greatly improved, so that the panoramic video objective quality evaluation better conforms to the subjective quality evaluation result of human eyes.

Description

technical field [0001] The invention belongs to the field of video coding and processing, and in particular relates to an objective quality evaluation method of panoramic video based on spatio-temporal pipeline modeling. Background technique [0002] With the continuous development of virtual and augmented reality technology, the formulation and improvement of technical standards for panoramic video media systems is becoming more and more important. Panoramic video (that is, 360-degree video) is to capture the image information of the entire scene through a professional camera, use software to splicing, and use a special player to play. When watching a 360-degree video, viewers usually need to wear a virtual helmet to watch video images in different positions through the movement of the head, so as to achieve the immersive and immersive sense of watching. However, since panoramic video contains a lot of viewing information, and usually has a large image resolution (such as ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N17/00H04N13/106
CPCH04N13/106H04N17/00H04N2013/0074
Inventor 高攀张鹏伟
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products