Unlock instant, AI-driven research and patent intelligence for your innovation.

A scalable video rate control method and device combined with visual perception

A rate control and visual perception technology, applied in the video field, can solve the problem of poor subjective visual quality of scalable video

Active Publication Date: 2016-06-15
SHENZHEN INSTITUTE OF INFORMATION TECHNOLOGY
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Embodiments of the present invention provide a scalable video rate control method and device combined with visual perception, aiming to solve the problem of poor subjective visual quality of scalable video obtained after scalable coding in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A scalable video rate control method and device combined with visual perception
  • A scalable video rate control method and device combined with visual perception
  • A scalable video rate control method and device combined with visual perception

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] figure 1 It shows the implementation flow chart of the scalable video rate control method combined with visual perception provided by the first embodiment of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, and the details are as follows:

[0031] In step S101, the input video file is received, on the one hand, the video file is subjected to scalable coding to obtain the coding rate of each macroblock, and on the other hand, the saliency map calculation is performed on the video frame of the video file to obtain each Visual saliency maps for video frames.

[0032] In the embodiment of the present invention, the spatio-temporal saliency map is a three-dimensional saliency map, which comprehensively considers the temporal and spatial characteristics of the video, and reflects the mapping relationship between the gaze area of ​​the human eye and the gaze time. The calculation process of...

Embodiment 2

[0057] figure 2 It shows the implementation flow chart of the scalable video rate control method combined with visual perception provided by the first embodiment of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, and the details are as follows:

[0058] In step S201, the input video file is received, on the one hand, the video file is subjected to scalable coding to obtain the coding rate of each macroblock, and on the other hand, the saliency map calculation is performed on the video frame of the video file to obtain each Visual saliency maps for video frames.

[0059] In step S202, a gaze transfer matrix is ​​constructed, and a spatio-temporal saliency map of the visual saliency map is calculated according to the gaze transfer matrix, combined with the playback duration of the shot and the visual characteristics of human eyes.

[0060] In step S203, a two-dimensional fitting curve of th...

Embodiment 3

[0073] Figure 4 It shows the implementation flowchart of the scalable video rate control method combined with visual perception provided by the third embodiment of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, and the details are as follows:

[0074] In step S401, the input video file is received, on the one hand, the video file is subjected to scalable coding to obtain the coding rate of each macroblock, and on the other hand, the saliency map calculation is performed on the video frame of the video file to obtain each Visual saliency map of video frames.

[0075] In step S402, a gaze transition matrix is ​​constructed, and a spatio-temporal saliency map of the visual saliency map is calculated according to the gaze transition matrix, combined with the playback duration of the shot and the visual characteristics of human eyes.

[0076] In step S403, a two-dimensional fitting curve of t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention is applicable to the field of video technology, and provides a scalable video bit rate control method and device combined with visual perception. The method includes: receiving an input video file, and performing scalable coding on the video file on the one hand to obtain Encoding code rate of each macroblock, on the other hand carries out saliency map calculation to the video frame of described video file, obtains the visual saliency map of each video frame; Constructs and fixes a transfer matrix, according to described gazing transfer matrix, in conjunction with shot playing duration and According to human visual characteristics, the spatiotemporal saliency map of the visual saliency map is calculated; according to the saliency information of each macroblock in the spatiotemporal saliency map, the importance of the coding rate of each macroblock is sorted; according to the sorting result, the The coding rate of each macroblock is controlled. In the present invention, the code rate of the area with low possibility of attention is preferentially reduced, and the code rate of the area with high salience is increased, so that the perceptual quality of the area with high salience is obviously improved.

Description

technical field [0001] The invention belongs to the field of video technology, and in particular relates to a scalable video code rate control method and device combined with visual perception. Background technique [0002] With the development of network technology and various terminal devices, new video applications require video coding to provide temporal, spatial and quality scalability with relatively low complexity. Scalable Video Coding (Scalable Video Coding, SVC) adopts a multi-layer coding method to encode a video sequence into a set of interdependent scalable layers. Different terminal devices can extract and decode the data of the scalable layer according to the broadcast capability, processing capability and network quality. part. How to meet the individual needs of users through video bit rate control and maximize the broadcast quality has become a key problem to be solved in video compression and transmission. [0003] Most of the existing rate control metho...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N19/154H04N19/36
Inventor 柳伟陈旭梁永生张基宏
Owner SHENZHEN INSTITUTE OF INFORMATION TECHNOLOGY