Online real-time three-dimensional model video encoding and decoding method

Abstract

The invention provides an online real-time three-dimensional model video encoding and decoding method. A three-dimensional model is compressed via the Meshsequential algorithm and is embedded into a self-defined NAL unit in a video stream, then an encoded texture map NAL unit and a self-defined model NAL unit are packaged into a ts code stream packet, the ts code stream packet is sent to a clientby a network, and the client performs decoding and displaying. For the three-dimensional model with a certain number of vertices and a certain number of surface patches, a frame of data is encoded anddecoded within 30s by the method, online real-time display of the three-dimensional model can be implemented, and the three-dimensional model is displayed in the form of a video code stream, and an ordinary player can play the texture part of the code stream; and compared with the FVV and Holopoetation of the Microsoft, the online real-time three-dimensional model video encoding and decoding method provided by the invention has the advantages of being able to realize online real-time live broadcast, being also able to realize video encoding and decoding, being more suitable for stream transmission of the network, and being able to achieve 360-degree video viewing, so that the viewing experience is greatly improved.

Description

technical field [0001] The invention relates to the technical field of three-dimensional model video encoding and decoding, in particular to an online real-time three-dimensional model video encoding and decoding method. Background technique [0002] In the field of 3D model video, it mainly includes two parts: texture map codec and 3D model codec. At present, there are few articles, technologies or patents related to 3D model video encoding and decoding. Existing articles include Microsoft FVV, Holoportation, etc. [0003] Microsoft FVV encodes the texture map into a video stream according to the H.264 video coding method; for the 3D model, firstly, with the help of grid tracking, the 3D model is divided into key frames and prediction frames. The key frame contains geometric information (vertex coordinates and texture coordinates) and connection information. The geometric information encoding adopts the quantitative 16bit method, and the connection information adopts delta...

AI Technical Summary

Problems solved by technology

This method can achieve delayed display, but cannot achieve video codec, which is not conducive to the transmission and playback of 3D models on the network

[0005] In addition, the patent application number CN 201280033913.2 discloses a "system and method for encoding and decoding bit streams for 3D models with repetitive structures", which mainly compresses, encodes and decodes 3D (three-dimensional) models with Compress, encode and decode 3D models without repetitive structures

The patent application number CN201010155134.2 discloses "a method for 3D model transmission and interactive rendering in a wireless local area network". This patent is a method suitable for 3D model transmission and interactive rendering in a wireless local area network. Realize the interactive real-time rendering function of any resolution of the model on the terminal, mainly for the transmission and rendering of the 3D model under the wireless LAN, and cannot compress and transmit the texture

Images