Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video coding method based on deconstruction compression and fusion

A technology of video encoding and deconstruction, which is applied in the fields of digital video signal modification, image communication, electrical components, etc., to achieve the effect of improving compression performance

Active Publication Date: 2021-01-12
NANJING UNIV
View PDF6 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This prerequisite somewhat limits further reduction of sequence redundancy, especially spatial resolution redundancy under temporal coherence

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video coding method based on deconstruction compression and fusion
  • Video coding method based on deconstruction compression and fusion
  • Video coding method based on deconstruction compression and fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0023] refer to figure 1 , a video encoding method based on deconstruction compression and fusion in this embodiment, first deconstructing the video into spatial texture frames and temporal motion frames, encoding the spatial texture frames using the intra-frame coding mode of the encoder, and firstly encoding the temporal motion frames Downsampled by bi-cubic interpolation, and then encoded using the encoder's inter-frame coding mode. At the decoding end, a super-resolution network composed of a motion compensation network and a texture transfer network is used to restore the image texture and motion at the original resolution of the temporal motion frame. details, improving overall video encoding performance. Specific steps are as follows:

[0024] Step 1. Deconstruct each collected training video frame into a high-resolution spatial doma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video coding method based on deconstruction compression and fusion. According to the method, based on redundancy of resolution information in video coding, a video sequence frame is deconstructed into a high-resolution spatial domain texture frame and a low-resolution time domain motion frame for coding, and the decoded low-resolution time domain motion frame is recoveredto a high-fidelity original resolution by using a super-resolution method based on deep learning, thereby improving the encoding efficiency enhancement. The method comprises the following specific steps: (1) generating an image block combination used for training as a supervised training data set; (2) constructing a loss function, and independently training the super-resolution networks under different compression ratios by using an optimizer; (3) constructing a loss function, and optimizing the whole network end to end by using an optimizer; (4) using the optimized super-resolution network to perform super-resolution on the low-resolution time domain motion frame in the deconstructed and encoded video, recovering the image texture and motion details under the original resolution, and improving the overall video encoding efficiency.

Description

technical field [0001] The invention relates to the field of video compression and the technical field of image and video super-resolution, in particular to a video encoding method based on deconstruction compression and fusion. Background technique [0002] Video applications are ubiquitous in the field of streaming media services based on the Internet, and its growing popularity has brought more and more video transmission and storage requirements, and efficient video compression technology is the most important to realize this demand one of the links. Based on this, in the past thirty years, well-known video coding standards have been successively proposed and carried out corresponding stages of work, including H.264 / AVC, H.265 / HEVC and the recently emerging H.266 / VVC, all of which are in the forefront. On the basis of modern coding standards, a leap in performance has been achieved, which meets certain transmission and storage requirements. On the other hand, with the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N19/103H04N19/13H04N19/176H04N19/59
CPCH04N19/103H04N19/176H04N19/13H04N19/59
Inventor 陆明马展
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com