18 results about "Inter frame" patented technology

In various examples, systems, devices and methods are disclosed relating to enhancing the efficiency and reducing the delay of error resilience in multimedia communication systems. The systems, devices and methods can include a computer system determining a sliding frame window (or a sliding reference window) for a video stream. The size of the sliding frame window represents a minimum separation between reference frames and corresponding inter frames. The computer system can encode a plurality of video frames of the video stream according to the size of the sliding frame window, such that a separation between any pair of video frames of the plurality of video frames including a reference frame and a corresponding inter-frame is greater than or equal to the size of the sliding frame window.

Methods and apparatuses are provided for processing video data. An exemplary method includes: decompressing a compressed frame to generate a key frame representing a face; generating, for the key frame, a first set of parameters associated with a 3-dimensional (3D) face representation of the face; reconstructing, for each of one or more inter frames, a second set of parameters associated with a 3D face representation of the face according to compressed inter-predicted residuals of the second set of parameters; and generating a video comprising the face based on the key frame, the first set of parameters, and the second set of parameters.

A mesh decoding device 200 includes: an intra decoding unit 202B that decodes coordinates of a vertex and connectivity information in an intra frame from a bit stream of the intra frame; and an inter decoding unit 202E that decodes coordinates of a decoding target vertex by adding a motion vector decoded from a bit stream of an inter frame and coordinates of a vertex corresponding to the decoding target vertex in a reference frame. the number of submeshes can be different in each of the intra frames, and the number of submeshes can be different in each of the inter frames.

A mesh decoding device 200 includes: an intra decoding unit 202B that decodes a base mesh from a bit stream of an intra frame; and an inter decoding unit 202E that decodes a motion vector from a bit stream of an inter frame, adds the motion vector to a base mesh of a reference frame, and decodes the base mesh, wherein the intra decoding unit 202B or the inter decoding unit 202E includes a duplicate vertex search unit 202E6 that acquires information related to a duplicate vertex of a vertex to be decoded from a decoded vertex.

There is provided an encoder for face videos, which includes a video codec for compressing an initial frame of a face video sequence, a compact feature extraction module for extracting a motion code and expression attributes across subsequent inter frames, and a feature encoding module for feature compression with feature-level inter prediction based on the motion code and the expression attributes.

The present invention makes it possible to decode a basic mesh of a current frame in inter prediction encoding even when the number of vertices of the basic mesh of the current frame differs from the number of vertices of a reference frame or a reference submesh, and to avoid a situation in which the number of vertices of the basic mesh of the current frame differs from the number of vertices of the reference frame or the reference submesh. In a mesh decoding device 200 according to the present invention, an inter decoding unit 202E decodes the number of vertices of a current frame or a current submesh from a bitstream of an inter frame.

An encoder includes memory and circuitry. The circuitry: derives a first motion vector in a unit of a prediction block using a first inter frame prediction mode that uses a degree of matching between two reconstructed images of two regions in two difference pictures, the prediction block being obtained by splitting an image included in a video; and performs, in the unit of the prediction block, a first motion compensation process that generates a prediction image by referring to a spatial gradient of luminance in an image generated by performing motion compensation using the first motion vector derived.

The invention provides an intra-frame and inter-frame mode selection method and related equipment, and relates to the technical field of video coding and decoding, video data to be coded are input into a video codec, and the video data to be coded comprise a plurality of video frames; respectively judging each video frame to obtain a judgment result; selecting an optimal coding mode according to a judgment result; when the judgment result is the I frame or the first P frame or the B frame, selecting an optimal coding mode through a conventional mode selection mode; when the judgment result is that the video frame is not the I frame or the first P frame or the B frame, classifying all coding modes according to known coding information of the video frame to obtain classification results, and selecting an optimal coding mode from the classification results; the number of modes needing to be traversed is reduced, so that the execution efficiency of coding mode selection is improved, and the time overhead of a video codec on mode selection is reduced.

In various examples, systems, devices and methods are disclosed relating to enhancing the efficiency and reducing the delay of error resilience in multimedia communication systems. The systems, devices and methods can include a computer system determining a sliding frame window (or a sliding reference window) for a video stream. The size of the sliding frame window represents a minimum separation between reference frames and corresponding inter frames. The computer system can encode a plurality of video frames of the video stream according to the size of the sliding frame window, such that a separation between any pair of video frames of the plurality of video frames including a reference frame and a corresponding inter-frame is greater than or equal to the size of the sliding frame window.

A mesh decoding device 200 according to the present invention includes a circuit, wherein the circuit: generates a motion vector residual and a motion vector prediction mode from a bit stream of an inter frame; calculates, using a motion vector of a decoded vertex around a vertex to be decoded, a motion vector of a vertex in a reference frame corresponding to the vertex to be decoded, and a motion vector of a vertex in the reference frame corresponding to a decoded vertex around the vertex to be decoded, a predicted value of a motion vector of the vertex to be decoded by a prediction method identified by the prediction mode from among a plurality of prediction methods; and adds the predicted value of the motion vector and the motion vector residual.

An encoder includes memory and circuitry. The circuitry: derives a first motion vector in a unit of a prediction block using a first inter frame prediction mode that uses a degree of matching between two reconstructed images of two regions in two difference pictures, the prediction block being obtained by splitting an image included in a video; and performs, in the unit of the prediction block, a first motion compensation process that generates a prediction image by referring to a spatial gradient of luminance in an image generated by performing motion compensation using the first motion vector derived.

The application provides an intra-inter frame mode selection method and related equipment, and relates to the technical field of video coding and decoding. The method comprises the following steps: inputting to-be-coded video data into a video coding and decoding device, wherein the to-be-coded video data comprises multiple video frames; judging each video frame respectively to obtain a judgment result; selecting an optimal coding mode according to the judgment result; when the judgment result is an I frame or a first P frame or a B frame, selecting the optimal coding mode through a conventional mode selection mode; when the judgment result is a non-I frame or a first P frame or a B frame, classifying all coding modes according to known coding information of the video frame to obtain a classification result, and selecting the optimal coding mode in the classification result; the number of modes that need to be traversed is reduced, the execution efficiency of the coding mode selection is improved, and the time cost of the video coding and decoding device in mode selection is reduced.

A mesh decoding device 200 includes: an intra decoding unit 202B that decodes coordinates of a vertex and connectivity information in an intra frame from a bit stream of the intra frame; and an inter decoding unit 202E that decodes coordinates of a decoding target vertex by adding a motion vector decoded from a bit stream of an inter frame and coordinates of a vertex corresponding to the decoding target vertex in a reference frame. The intra decoding unit 202B and the inter decoding unit 202E include a duplicate vertex search unit 202E6 that acquires the number of vertices having a duplicate vertex from decoded vertices, and the intra decoding unit 202B and the inter decoding unit 202E decode a control signal indicating the number of vertices having the duplicate vertex from a bit stream.

A method of signing prediction-coded video data comprises: obtaining a coded video sequence comprising a set of frames including at least one intra frame having independently decodable image data, and at least one inter frame, containing image data decodable by reference to another frame; generating a group hash of the coded video sequence by hashing the image data of the coded video sequence; generating a plurality of individual hashes of frame subsets including at least one frame by hashing the image data derived from each of the frame subsets, reducing the length of each of the individual hashes to a length shorter than a total length of the group hash, generating a digital signature by encrypting at least the group hash and the individual hashes with reduced lengths; providing the group hash and the reduced length individual hashes together with the digital signature and the coded video sequence.

Embodiments of this application disclose a bi-directional inter prediction method and apparatus, and relate to the field of video picture coding technologies. The method includes: determining a reference picture index i1 of a first reference picture list as a first reference picture index that corresponds to a current block and that is of the first reference picture list; determining a reference picture index i2 of a second reference picture list as a second reference picture index that corresponds to the current block and that is of the second reference picture list; and predicting the current block based on the first reference picture index and the second reference picture index. A POC corresponding to the reference picture index i1 is a POC, closest to a POC of a current picture, in all POCs that are in the first reference picture list and that are less than the POC of the current picture, a POC corresponding to the reference picture index i2 is a POC, closest to the POC of the current picture, in all POCs that are in the second reference picture list and that are greater than the POC of the current picture, and the current picture includes the current block. Bitstream resources can be saved, and coding efficiency can be improved.

A video decoding method includes: decoding an image bitstream associated with a video sequence to reconstruct a key frame of the video sequence and obtain extracted features of the reconstructed key frame; decoding a feature bitstream associated with the video sequence to obtain extracted features of one or more inter frames of the video sequence; obtaining motion information and occlusion information based on the extracted features of the reconstructed key frame and the extracted features of the one or more inter frames; resampling, by a neural network, the reconstructed key frame based on the motion information and occlusion information by a neural network; and reconstructing, by the neural network, the video sequence based on the resampled reconstructed key frame. A network width and a network depth of the neural network is adjusted in response to an input resolution.

An intra frame and inter frame joint prediction method is provided. The method includes determining at least one joint intra frame prediction mode of current coding block based on intra frame prediction mode of at least one encoded block of current frame, or determining the at least one joint intra frame prediction mode of the current coding block based on content characteristics of the current coding block, or taking at least one first specified intra frame prediction mode as the at least one joint intra frame prediction mode of current coding block; obtaining a joint intra frame prediction value of the current coding block based on the at least one joint intra frame prediction mode; and obtaining at least one intra frame and inter frame joint prediction value based on at least one candidate motion vector and the joint intra frame prediction value of the current coding block.

The present disclosure may relate to systems and methods for inter frame prediction of a video. A method may include setting, based on a block to be predicted of an image frame, a search template. The method may also include searching for, based on a search strategy, an optimal search block of the search template in a reference frame of the image frame. The method may further include determining, based on the optimal search block, prediction information of the block to be predicted.