13 results about "Inter frame" patented technology

Methods and apparatuses are provided for processing video data. An exemplary method includes: decompressing a compressed frame to generate a key frame representing a face; generating, for the key frame, a first set of parameters associated with a 3-dimensional (3D) face representation of the face; reconstructing, for each of one or more inter frames, a second set of parameters associated with a 3D face representation of the face according to compressed inter-predicted residuals of the second set of parameters; and generating a video comprising the face based on the key frame, the first set of parameters, and the second set of parameters.

A mesh decoding device 200 includes: an intra decoding unit 202B that decodes coordinates of a vertex and connectivity information in an intra frame from a bit stream of the intra frame; and an inter decoding unit 202E that decodes coordinates of a decoding target vertex by adding a motion vector decoded from a bit stream of an inter frame and coordinates of a vertex corresponding to the decoding target vertex in a reference frame. the number of submeshes can be different in each of the intra frames, and the number of submeshes can be different in each of the inter frames.

A mesh decoding device 200 includes: an intra decoding unit 202B that decodes a base mesh from a bit stream of an intra frame; and an inter decoding unit 202E that decodes a motion vector from a bit stream of an inter frame, adds the motion vector to a base mesh of a reference frame, and decodes the base mesh, wherein the intra decoding unit 202B or the inter decoding unit 202E includes a duplicate vertex search unit 202E6 that acquires information related to a duplicate vertex of a vertex to be decoded from a decoded vertex.

There is provided an encoder for face videos, which includes a video codec for compressing an initial frame of a face video sequence, a compact feature extraction module for extracting a motion code and expression attributes across subsequent inter frames, and a feature encoding module for feature compression with feature-level inter prediction based on the motion code and the expression attributes.

An encoder includes memory and circuitry. The circuitry: derives a first motion vector in a unit of a prediction block using a first inter frame prediction mode that uses a degree of matching between two reconstructed images of two regions in two difference pictures, the prediction block being obtained by splitting an image included in a video; and performs, in the unit of the prediction block, a first motion compensation process that generates a prediction image by referring to a spatial gradient of luminance in an image generated by performing motion compensation using the first motion vector derived.

The invention provides an intra-frame and inter-frame mode selection method and related equipment, and relates to the technical field of video coding and decoding, video data to be coded are input into a video codec, and the video data to be coded comprise a plurality of video frames; respectively judging each video frame to obtain a judgment result; selecting an optimal coding mode according to a judgment result; when the judgment result is the I frame or the first P frame or the B frame, selecting an optimal coding mode through a conventional mode selection mode; when the judgment result is that the video frame is not the I frame or the first P frame or the B frame, classifying all coding modes according to known coding information of the video frame to obtain classification results, and selecting an optimal coding mode from the classification results; the number of modes needing to be traversed is reduced, so that the execution efficiency of coding mode selection is improved, and the time overhead of a video codec on mode selection is reduced.

In various examples, systems, devices and methods are disclosed relating to enhancing the efficiency and reducing the delay of error resilience in multimedia communication systems. The systems, devices and methods can include a computer system determining a sliding frame window (or a sliding reference window) for a video stream. The size of the sliding frame window represents a minimum separation between reference frames and corresponding inter frames. The computer system can encode a plurality of video frames of the video stream according to the size of the sliding frame window, such that a separation between any pair of video frames of the plurality of video frames including a reference frame and a corresponding inter-frame is greater than or equal to the size of the sliding frame window.

An encoder includes memory and circuitry. The circuitry: derives a first motion vector in a unit of a prediction block using a first inter frame prediction mode that uses a degree of matching between two reconstructed images of two regions in two difference pictures, the prediction block being obtained by splitting an image included in a video; and performs, in the unit of the prediction block, a first motion compensation process that generates a prediction image by referring to a spatial gradient of luminance in an image generated by performing motion compensation using the first motion vector derived.

The application provides an intra-inter frame mode selection method and related equipment, and relates to the technical field of video coding and decoding. The method comprises the following steps: inputting to-be-coded video data into a video coding and decoding device, wherein the to-be-coded video data comprises multiple video frames; judging each video frame respectively to obtain a judgment result; selecting an optimal coding mode according to the judgment result; when the judgment result is an I frame or a first P frame or a B frame, selecting the optimal coding mode through a conventional mode selection mode; when the judgment result is a non-I frame or a first P frame or a B frame, classifying all coding modes according to known coding information of the video frame to obtain a classification result, and selecting the optimal coding mode in the classification result; the number of modes that need to be traversed is reduced, the execution efficiency of the coding mode selection is improved, and the time cost of the video coding and decoding device in mode selection is reduced.

A mesh decoding device 200 includes: an intra decoding unit 202B that decodes coordinates of a vertex and connectivity information in an intra frame from a bit stream of the intra frame; and an inter decoding unit 202E that decodes coordinates of a decoding target vertex by adding a motion vector decoded from a bit stream of an inter frame and coordinates of a vertex corresponding to the decoding target vertex in a reference frame. The intra decoding unit 202B and the inter decoding unit 202E include a duplicate vertex search unit 202E6 that acquires the number of vertices having a duplicate vertex from decoded vertices, and the intra decoding unit 202B and the inter decoding unit 202E decode a control signal indicating the number of vertices having the duplicate vertex from a bit stream.

A method of signing prediction-coded video data comprises: obtaining a coded video sequence comprising a set of frames including at least one intra frame having independently decodable image data, and at least one inter frame, containing image data decodable by reference to another frame; generating a group hash of the coded video sequence by hashing the image data of the coded video sequence; generating a plurality of individual hashes of frame subsets including at least one frame by hashing the image data derived from each of the frame subsets, reducing the length of each of the individual hashes to a length shorter than a total length of the group hash, generating a digital signature by encrypting at least the group hash and the individual hashes with reduced lengths; providing the group hash and the reduced length individual hashes together with the digital signature and the coded video sequence.

A video decoding method includes: decoding an image bitstream associated with a video sequence to reconstruct a key frame of the video sequence and obtain extracted features of the reconstructed key frame; decoding a feature bitstream associated with the video sequence to obtain extracted features of one or more inter frames of the video sequence; obtaining motion information and occlusion information based on the extracted features of the reconstructed key frame and the extracted features of the one or more inter frames; resampling, by a neural network, the reconstructed key frame based on the motion information and occlusion information by a neural network; and reconstructing, by the neural network, the video sequence based on the resampled reconstructed key frame. A network width and a network depth of the neural network is adjusted in response to an input resolution.

The present disclosure may relate to systems and methods for inter frame prediction of a video. A method may include setting, based on a block to be predicted of an image frame, a search template. The method may also include searching for, based on a search strategy, an optimal search block of the search template in a reference frame of the image frame. The method may further include determining, based on the optimal search block, prediction information of the block to be predicted.