Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Compressed video stream re-encoding method based on deep learning and saliency perception

A deep learning and re-encoding technology, applied in the fields of digital video signal modification, image communication, electrical components, etc., can solve the problems of long compression time, waste of computing, cache resources, and difficulty in real-time processing.

Active Publication Date: 2021-03-26
HENAN UNIVERSITY
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has achieved a certain effect on the compression ratio, but this "full decompression and full compression" structure cannot make good use of the information obtained from the first compression, which not only wastes computing and cache resources, but also takes a long time to compress, making it difficult to do real-time processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Compressed video stream re-encoding method based on deep learning and saliency perception
  • Compressed video stream re-encoding method based on deep learning and saliency perception
  • Compressed video stream re-encoding method based on deep learning and saliency perception

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0072] The technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0073] Such as figure 1 Shown: the compressed video stream re-encoding method based on deep learning and saliency perception of the present invention, comprises the following steps:

[0074] Step 1. Construct and train a compressed domain video image saliency detection deep learning model, specifically using the following methods:

[0075] Step 1.1, carrying out batch normalization to the discrete cosine transform (DCT) residual coefficient of the compressed domain video image used for training and the corres...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a compressed video stream recoding method based on deep learning and significance perception. The compressed video stream recoding method comprises the following steps: constructing and training a compressed domain video image significance detection deep learning model; inputting a compressed video image X to be recoded into the compressed domain video image saliency detection deep learning model CDVNet trained in the step 1; decoding the X part of the compressed video image to be recoded by using the compressed domain video image saliency detection deep learning model CDVNet; performing video image recoding by using an HEVC coding technology and combining the updated quantization parameter of each coding unit. According to the method, saliency feature extraction based on a compressed domain is adopted; data information obtained by partial decoding is used for saliency detection in a compressed code stream, the defect that in the prior art, feature extraction andsaliency detection can be carried out only after all compressed videos are decompressed to a pixel domain in saliency detection based on the pixel domain is overcome, and the method has the advantages of being small in calculation amount and low in time consumption.

Description

technical field [0001] The present invention relates to the technical field of video image processing, in particular to a method for re-encoding compressed video streams based on deep learning and saliency perception in the technical field of video image compression. Background technique [0002] The systematization and standardization of video image compression technologies, such as JPEG, JPEG2000, H.264 / AVC, HEVC, etc., have made it normal to store and transmit massive video image data in compressed form. Limited by objective conditions such as business, confidentiality, or bandwidth, in some compressed image data applications, it is necessary to provide or transmit image data with different resolutions. For example, the transmission of high-definition video images on a network with limited bandwidth needs to reduce the resolution and transmission rate; The grades of hyperspectral images of soldiers are also different. In addition, the display accuracy of various display...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N19/61H04N19/625H04N19/177H04N19/124
CPCH04N19/124H04N19/177H04N19/61H04N19/625
Inventor 李永军李莎莎杜浩浩邓浩陈立家曹雪王赞陈竞李鹏飞
Owner HENAN UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com