Scalable video code rate controlling method and device combined with visual perception

A rate control and visual perception technology, applied in the video field, can solve the problem of poor subjective visual quality of scalable video

Active Publication Date: 2013-12-18
SHENZHEN INSTITUTE OF INFORMATION TECHNOLOGY
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Embodiments of the present invention provide a scalable video rate control method and device combined with visual perceptio

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Scalable video code rate controlling method and device combined with visual perception
  • Scalable video code rate controlling method and device combined with visual perception
  • Scalable video code rate controlling method and device combined with visual perception

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] figure 1 It shows the implementation flow chart of the scalable video rate control method combined with visual perception provided by the first embodiment of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, and the details are as follows:

[0031] In step S101, the input video file is received, on the one hand, the video file is subjected to scalable coding to obtain the coding rate of each macroblock, and on the other hand, the saliency map calculation is performed on the video frame of the video file to obtain each Visual saliency maps for video frames.

[0032] In the embodiment of the present invention, the spatio-temporal saliency map is a three-dimensional saliency map, which comprehensively considers the temporal and spatial characteristics of the video, and reflects the mapping relationship between the gaze area of ​​the human eye and the gaze time. The calculation process of...

Embodiment 2

[0057] figure 2 It shows the implementation flow chart of the scalable video rate control method combined with visual perception provided by the first embodiment of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, and the details are as follows:

[0058] In step S201, the input video file is received, on the one hand, the video file is subjected to scalable coding to obtain the coding rate of each macroblock, and on the other hand, the saliency map calculation is performed on the video frame of the video file to obtain each Visual saliency maps for video frames.

[0059] In step S202, a gaze transfer matrix is ​​constructed, and a spatio-temporal saliency map of the visual saliency map is calculated according to the gaze transfer matrix, combined with the playback duration of the shot and the visual characteristics of human eyes.

[0060] In step S203, a two-dimensional fitting curve of th...

Embodiment 3

[0073] Figure 4 It shows the implementation flowchart of the scalable video rate control method combined with visual perception provided by the third embodiment of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown, and the details are as follows:

[0074] In step S401, the input video file is received, on the one hand, the video file is subjected to scalable coding to obtain the coding rate of each macroblock, and on the other hand, the saliency map calculation is performed on the video frame of the video file to obtain each Visual saliency maps for video frames.

[0075] In step S402, a gaze transition matrix is ​​constructed, and a spatio-temporal saliency map of the visual saliency map is calculated according to the gaze transition matrix, combined with the playback duration of the shot and the visual characteristics of human eyes.

[0076] In step S403, a two-dimensional fitting curve of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of videos and provides a scalable video code rate controlling method and device combined with visual perception. The method comprises the steps of receiving an input video file, conducting scalable coding on the video file to obtain the coding rate of each micro block on one hand, and conducting saliency map calculation on video frames of the video file to obtain a visual saliency map of each video frame on the other hand; constructing a watch transfer matrix, and calculating a time-space saliency map of the obtained visual saliency map according to the watch transfer matrix and with combination of lens display duration and human eye visual characteristics; sequencing the importance of the code rates of the micro blocks according to saliency information of the micro blocks in the time-space saliency map; controlling the code rates of the micro blocks according to a sequencing result. According to the scalable video code rate controlling method and device combined with visual perception, the code rate of an area with a low watch possibility is preferably decreased, and the code rate of an area with high saliency is increased, so that the perception quality of the area with the high saliency is obviously improved.

Description

technical field [0001] The invention belongs to the field of video technology, and in particular relates to a scalable video code rate control method and device combined with visual perception. Background technique [0002] With the development of network technology and various terminal devices, new video applications require video coding to provide temporal, spatial and quality scalability with relatively low complexity. Scalable Video Coding (Scalable Video Coding, SVC) uses a multi-layer coding method to encode video sequences into a set of interdependent scalable layers. Different terminal devices can extract and decode scalable layers according to their broadcast capabilities, processing capabilities, and network quality. a part of. How to meet the individual needs of users through video bit rate control and maximize the broadcast quality has become a key problem to be solved in video compression and transmission. [0003] Most of the existing rate control methods are...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N7/26
Inventor 柳伟陈旭梁永生张基宏
Owner SHENZHEN INSTITUTE OF INFORMATION TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap