Video sequence mixed encoding and decoding method and system

Abstract

The invention relates to a video sequence mixed encoding and decoding method, which divides an input video into two parts of a video object and a background by image segmentation against a multi-angle shot static scene video sequence. Parameters of a video camera, a three-dimensional wire-frame model of the object and a texture image are reconstructed from the input video by a technology which is based on image modeling, the parameters are also extracted for carrying out compression for realizing compressed encoding of the video object, and the background adopts the prior standard for carrying out the compressed encoding. The invention also provides a video sequence mixed encoding and decoding system. The video sequence mixed encoding and decoding method and the system have the advantages that in addition to the situation that the encoding efficiency at low bit rate is superior to H.264, as the technology which is based on the image modeling can obtain the complete wire-frame model, content-based mixed encoding and decoding can also be carried out on the whole scene video sequence, and a virtual image under any visual angle is generated at a decoding end, so that the method and the system can be widely applied in heritage conservation, commodity virtual display, immersion interconnection experience and other fields.

Description

technical field [0001] The invention relates to the technical field of video compression, in particular to a method and system for video sequence hybrid encoding and decoding. Background technique [0002] At present, although video has been popularized on the network and wireless devices, low bit rate video coding methods are still technical issues worth exploring. [0003] The International Organization for Standardization (ISO) and the International Technology Union (ITU-T) have formulated a series of international standards for different applications, different transmission bit rates, different image formats and different image quality requirements since the late 1980s . The H.264 standard was officially approved by ITU-T in March 2003 and officially promulgated internationally. Compared with H.263 or MPEG4, under the same quality, its bit rate can be reduced by about half, so it is internationally recognized. It has been widely valued and welcomed. [0004] There is ...

AI Technical Summary

Problems solved by technology

[0008] The encoding model of MPEG-4 has achieved great success in video teleconferencing. However, this method needs to predict the video content, that is to say, it is known that the video contains a human face during encoding; in addition, the method needs to establish a three-dimensional model, a model of a human face

[0009] In short, the H.264 video coding standard compression rate based on Shannon's information theory is limited by the rate-distortion theory. Under a certain image quality, the bit rate cannot be very low; while the model-based coding scheme in MPEG-4 can Meet the requirements of low bit rate, but it is necessary to predict the content of the video and establish a model of the object in advance

For the entire large scene, especially the static scene video sequence with unknown content captured from multiple angles, image modeling techniques usually cannot obtain a complete wireframe model

In other words, content-based coding is difficult to model the entire scene is still a difficult problem in the existing technology, and exploring and solving new methods for low-bit-rate video coding is an important issue currently facing

Images