29 results about "Interframe coding" patented technology

This application provides a video decoding method, a video encoding method, and a computer-readable storage medium. Video encoding and decoding techniques for bidirectional prediction with weighted averaging are disclosed. According to some embodiments, a computer-implemented video decoding method includes the following steps: decoding a bitstream associated with a target coding block; reconstructing the target coding block based on a merge candidate list, the merge candidate list including one or more merge candidates associated with one or more inter-frame coding blocks other than the target coding block, each of the one or more merge candidates being motion information associated with the corresponding inter-frame coding block, wherein at least one of the one or more merge candidates includes bidirectional prediction weights.

The invention discloses an early termination method and device for inter-frame coding segmentation, equipment and a storage medium. The method comprises the following steps: calculating a feature distance between to-be-segmented regions based on coding block features; inputting the feature distance into a pre-trained neural network classification model for segmentation threshold prediction, and outputting a target segmentation threshold of the target coding block; based on the feature distance and the target segmentation threshold, judging whether the target coding block meets a segmentation termination condition or not; and if yes, stopping segmentation of the target coding block. According to the embodiment of the invention, features highly related to CU segmentation are selected by using a machine learning algorithm, features having the greatest influence on a segmentation decision are selected by analyzing texture and depth map information of the CU, and early termination of CU segmentation of a texture video and a depth map is realized based on a threshold value extracted from a training model.

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. In the method, for a conversion between a current video block of a video and a bitstream of the video, usage information of a plurality of template-based approaches is determined for the current video block based on at least one syntax element at a first level. The first level is higher than a coding unit level. The conversion is performed based on the usage information. The plurality of template-based approaches comprises at least two coding tools associated with at least one of: intra coding, inter coding, or intra block copy (IBC) coding.

Systems and methods for encoding data for low-latency streaming are disclosed herein. The system encodes a plurality of frames of a video. The encoded frames of the video comprise at least one intra-coded key frame and at least one inter-coded frame. A subset of the plurality of encoded frames, along with a corresponding identifier for each frame in the subset, is added to a reference frame data structure. The system encodes a first frame as a first inter-frame referencing at least one encoded frame from the data structure and determines, based at least in part on properties of a stream, a probability of the first inter-frame being dropped during at least one of transmission or decoding. Based on the calculated probability, the system omits the first inter-frame from the data structure and encodes a second frame subsequent to the first frame using the data structure that omits the first inter-frame.

This disclosure provides a video decoding method. For example, receiving an encoded video stream. The encoded video stream includes encoded information from multiple images. Based on the encoded information, determining that a current block in the current image is encoded using an inter-frame prediction mode, and generating prediction samples of the current block in the inter-frame prediction mode based at least in part on reference blocks in a reference image different from the current image. Furthermore, obtaining an intra-frame prediction mode associated with the current block in the current image. Determining at least one transform kernel based on the intra-frame prediction mode associated with the current block. Reconstructing the current block based on the at least one transform kernel.

The invention discloses a dynamic picture file processing method and device, equipment and a storage medium, and relates to the technical field of image processing, and the method comprises the steps: obtaining a dynamic picture file containing a dynamic picture track and a static picture data item; and determining a target image frame in the dynamic picture track and coding characteristics and coding types of the target image frame. If the coding characteristic is intra-frame coding or inter-frame coding and the coding type is an intra-frame coding image, keeping the media data of the target frame in a dynamic picture track, setting metadata in a static picture data item, establishing an incidence relation and obtaining a first packaging result, and if the coding characteristic is inter-frame coding and the coding type is an inter-frame coding image, keeping the media data of the target frame in the dynamic picture track, and setting metadata in the static picture data item and establishing an incidence relation to obtain a second packaging result; and if not, recoding the target frame, and storing the media data into a file independent of the track to obtain a second packaging result. The target presentation picture and the packaging result type thereof are determined according to user requirements, and the picture is presented in a corresponding mode, so that the dynamic picture file processing efficiency is improved.

An apparatus includes processing circuitry that is configured to receive a bitstream including coded information of a current block. The processing circuitry is configured to partition the current block into a first partition and a second partition based on a geometric partition mode (GPM). The processing circuitry is configured to determine a first prediction mode for the first partition based on a first number of direct neighboring reconstructed samples of the current block being larger than a threshold value. The processing circuitry is configured to, when the first number of direct neighboring reconstructed samples of the current block is less than the threshold value, infer that the first prediction mode is inter prediction mode, a flag indicating whether the current block is intra coded or inter coded not being signaled in the bitstream, and reconstruct the first partition of the current block based on the first prediction mode.

Systems, methods, and instrumentalities associated with video coding (e.g., encoding and decoding) are disclosed herein. A video encoding apparatus or a video decoding apparatus according to the present disclosure may acquire an inter-coded video block associated with a current picture and divide the inter-coded video block into at least a first sub-partition and a second sub-partition. The video encoding apparatus or video decoding apparatus may reconstruct the first sub-partition based on a first motion vector associated with the inter-coded video block, determine a second motion vector based on the first motion vector and one or more reconstructed samples of the first sub-partition, and reconstructing the second sub-partition based on the second motion vector.

This invention relates to a VVC inter-frame coding rate control method based on a linear model, belonging to the field of video coding technology. This invention combines convex optimization techniques and rate control to achieve a significantly improved and enhanced rate control scheme. It transforms the original bitrate-distortion relationship into a linear model, converting the problem into a convex optimization problem for optimal solution. Using the improved rate control scheme, quantization parameters are calculated at both the frame level and the coding tree unit level, achieving control over both bitrate and quality. This invention achieves bitrate and quality control by performing frame-level and coding tree unit-level bitrate control on each image group of the initial video. Extensive experiments demonstrate that the algorithm provides significantly improved and enhanced rate control coding performance, illustrating the effectiveness of this method.

A method and apparatus for predicting motion vector for inter-frame encoding are provided. An implementation scheme of the method includes: acquiring first and second sets of motion vectors; dividing, in response to the number of valid adjacent PUs being greater than or equal to a preset number, the second set of motion vectors into at least one motion vector subset; calculating a correlation between the first set of motion vectors and each motion vector subset respectively, to obtain a priority of each adjacent PU; calculating, sequentially according to the priority in descending order, a rate distortion based on a motion vector of each adjacent PU, and stop calculating until a rate distortion smaller than a predetermined threshold is obtained; and determining a motion vector of an adjacent PU used when the rate distortion smaller than the predetermined threshold is obtained as the motion vector of the current PU.

The application discloses a volumetric video coding method based on inter-frame multiplexing, and relates to the field of volumetric video coding.The method mainly comprises the following steps: picture similarity detection, point cloud block similarity detection, inter-frame multiplexing, octree optimization coding algorithm, inverse Morton order rearrangement, 2D video coding algorithm, inter-frame decoding, octree optimization decoding algorithm and 2D video decoding algorithm.The application solves the problem of insufficient decoding frame rate of the decoding algorithm based on inter-frame multiplexing in a mobile terminal, realizes the target of greatly reducing the required bandwidth of transmission by adopting the inter-frame multiplexing technology in the field of volumetric video streaming media system, uses the deep learning point cloud registration model based on geometric information and color information to perform motion estimation between adjacent frames of the volumetric video for the first time, and realizes fast and accurate elimination of redundant information, and uses the 2D video coding algorithm to compress the color information of the volumetric video for the first time, thereby realizing inter-frame coding of the color information of the volumetric video.

Embodiments of the present application provide a point cloud data encoding method and apparatus, a point cloud data decoding method and apparatus, a computer device, and a readable storage medium. The encoding method comprises: acquiring a child node to be encoded in point cloud data; acquiring a predicted encoding state of said child node, wherein the predicted encoding state comprises an inter-frame encoding state and an intra-frame encoding state; determining, on the basis of the predicted encoding state, a first context probability model corresponding to said child node; and encoding placeholder information of said child node by means of the first context probability model, so as to obtain target encoded data of the placeholder information. In this way, the predicted encoding state can be effectively used to accurately determine the corresponding first context probability model, thereby improving the accuracy of encoding said child node of the point cloud data.

Methods and apparatus are provided for Laplacian Pyramid based decomposition for feature-based implicit neural representation. In one embodiment, the COOL-CHIC method is used with a Laplacian Pyramid decomposition of a video frame into levels of varying resolutions for encoding of a video in intra mode. In another embodiment, COOL-CHIC is used with a Laplacian Pyramid for inter coding.

Systems and methods for encoding data for low-latency streaming are disclosed herein. The system encodes a plurality of frames of a video. The encoded frames of the video comprise at least one intra-coded key frame and at least one inter-coded frame. A subset of the plurality of encoded frames, along with a corresponding identifier for each frame in the subset, is added to a reference frame data structure. The system encodes a first frame as a first inter-frame referencing at least one encoded frame from the data structure and determines, based at least in part on properties of a stream, a probability of the first inter-frame being dropped during at least one of transmission or decoding. Based on the calculated probability, the system omits the first inter-frame from the data structure and encodes a second frame subsequent to the first frame using the data structure that omits the first inter-frame.

A method for video decoding performed by at least one processor of an encoding device is provided.SOLUTION: An improved scheme of intra-inter prediction mode and adaptive intra-inter prediction mode for video coding / decoding, including selecting a set of weights in the intra-inter mode, and applying position dependent intra prediction combination (PDPC) to modify at least one of inter prediction samples and reconstructed samples of an inter-coded coding unit.SELECTED DRAWING: Figure 10

Disclosed herein are exemplary embodiments of innovations in the area of point cloud encoding and decoding. Example embodiments can reduce the computational complexity and / or computational resource usage during 3D video encoding by selectively encoding one or more 3D-point-cloud blocks using an inter-frame coding (e.g., motion compensation) technique that allows for previously encoded / decoded frames to be used in predicting current frames being encoded. Alternatively, one or more 3D-point-cloud block can be encoded using an intra-frame encoding approach. The selection of which encoding mode to use can be based, for example, on a threshold that is evaluated relative to rate-distortion performance for both intra-frame and inter-frame encoding. Still further, embodiments of the disclosed technology can use one or more voxel-distortion-correction filters to correct distortion errors that may occur during voxel compression. Such filters are uniquely adapted for the particular challenges presented when compressing 3D image data. Corresponding decoding techniques are also disclosed.

A decoding device includes: an entropy decoder configured to decode a bitstream and generate prediction information and sequence information of each of the plurality of coding units; an inter predictor configured to perform inter prediction on each of inter coding units among the plurality of coding units based on the prediction information; an intra predictor configured to perform intra prediction on each of intra coding units among the plurality of coding units, based on the prediction information, and generate intra prediction data of each of the intra coding units; a memory for storing the inter prediction data of each of the inter coding units; and a reconstructor configured to reconstruct each of the inter coding units, based on the inter prediction data stored in the memory, and reconstruct each of the intra coding units based on the intra prediction data.

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. In the method, for a conversion between a current video block of a video and a bitstream of the video, usage information of a plurality of template-based approaches is determined for the current video block based on at least one syntax element at a first level. The first level is higher than a coding unit level. The conversion is performed based on the usage information. The plurality of template-based approaches comprises at least two coding tools associated with at least one of: intra coding, inter coding, or intra block copy (IBC) coding.

An example method of video decoding includes receiving a video bitstream including at least two blocks corresponding to at least two pictures, wherein the at least two blocks include a first block. When the first block is an inter-coded block, the method includes determining whether to signal transform information for the first block based on coding information including an end of block (EOB) value, wherein the transform information includes at least one of a transform type and a transform set. The method further includes parsing the transform information from at least one indicator of the video bitstream when the transform information for the first block is signaled, and deriving the transform information without parsing the at least one indicator when the transform information for the first block is not signaled. The method further includes decoding the first block by applying an inverse transform to the first block using the transform information.

The present invention discloses an image decoding method that includes steps outlined below. Error report information related to an error block in an N-th image frame generated according to an inter-frame coding technology is received by an image encoding apparatus at a time spot that the image decoding apparatus receives a corresponding block of an N+P−1-th image frame and an N+P-th image frame is encoded according to an intra-frame coding technology. Blocks in the N-th image frame before the occurrence of the error block are decoded according to the inter-frame coding technology. Motion vector information and residue information are set to be zero to decode the blocks from the error block to the N+P−1-th image frame according to the inter-frame coding technology. The residue information of the intra-frame coding blocks in the N+P-th image frame is retrieved to decode the intra-frame coding blocks according to the intra-frame coding technology.

The application belongs to the technical field of video image coding, and discloses a remote sensing image interframe optimization coding method and system based on H.265, which comprises the following steps: S1, motion search: an optimized spiral search algorithm is used to determine the best motion vector MV; S2, motion estimation: based on the SAD criterion and the rate-distortion cost model, the optimal candidate MV is selected from the candidate MVs; S3, mode selection: the rate-distortion cost of different division modes is compared by using a fast estimation model to determine the best division of the current coding unit CU; and S4, motion compensation: a predicted image is generated according to the optimal division and the MV, and the residual error is calculated. The number of division modes required to be traversed by the application is less than 1% of the number of division modes required to be traversed by the H.265 algorithm, but the decoding end reconstruction video quality decreases a little compared with H.265, and the code stream increases is limited; therefore, the interframe coding rate-distortion optimization calculation complexity and the cache resource consumption are significantly reduced under the premise of basically guaranteeing the coding performance.

In a method of video decoding at a video decoder, a first high level syntax (HLS) element and a second HLS element can be received. The first HLS element can indicate whether an explicit multiple transform selection (MTS) is enabled or disabled for an intra coded block. The second HLS element can indicate whether the explicit MTS is enabled or disabled for an inter coded block. The first and second HLS elements can control a same set of coding blocks that include the intra coded block and the inter coded block. An implicit MTS can be enabled for the intra coded block when the first HLS element indicates the explicit MTS is disabled for the intra coded block, and the second HLS element indicates the explicit MTS is enabled for the inter coded block. 20 24 20 58 49 16 A ug 2 02 4A B S T R A C T O F T H E D I S C L O S U R E 2 0 2 4 2 0 5 8 4 9 1 6 2 0 2 4 A u g

The embodiment of the present application discloses a coding acceleration method and system based on pre-coding information splitting. The technical scheme provided by the embodiment of the present application obtains first coding cost information of a first fixed-size coding block obtained by pre-coding a current frame, splits the first coding cost information to obtain second coding cost information of a corresponding number of second fixed-size coding blocks, determines a frame type of the current frame, selects corresponding second coding cost information for coding analysis based on the frame type and a block size of a current coding block, and codes the current coding block according to a coding analysis result, wherein the coding analysis includes intra-frame coding analysis and / or inter-frame coding analysis. By using the above technical means, the coding analysis of small-size coding blocks is performed by using the split coding cost information to assist in coding mode decision of the corresponding coding blocks, the coding efficiency is improved while the coding quality is ensured, and the coding acceleration effect of small-size coding blocks is realized.

Disclosed herein are exemplary embodiments of innovations in the area of point cloud encoding and decoding. Example embodiments can reduce the computational complexity and / or computational resource usage during 3D video encoding by selectively encoding one or more 3D-point-cloud blocks using an inter-frame coding (e.g., motion compensation) technique that allows for previously encoded / decoded frames to be used in predicting current frames being encoded. Alternatively, one or more 3D-point-cloud block can be encoded using an intra-frame encoding approach. The selection of which encoding mode to use can be based, for example, on a threshold that is evaluated relative to rate-distortion performance for both intra-frame and inter-frame encoding. Still further, embodiments of the disclosed technology can use one or more voxel-distortion-correction filters to correct distortion errors that may occur during voxel compression. Such filters are uniquely adapted for the particular challenges presented when compressing 3D image data. Corresponding decoding techniques are also disclosed.

Provided is an apparatus intended to improve motion coding for vertices in an inter-coded base grid frame. The apparatus receives a compressed bitstream including deduplication method information indicating whether repetition vertex information for identifying repetition vertices exists in the compressed bitstream, and a syntax element indicating whether flags for repetition vertices in a subgrid frame exist in the compressed bitstream, the deduplication method information indicating whether repetition vertex information for identifying repetition vertices exists in the compressed bitstream, and the syntax element indicating whether flags for repetition vertices in the subgrid frame exist in the compressed bitstream. And the flag indicates whether motion information for repeating vertices in the sub-grid frame is present in the compressed bitstream. If the syntax element indication flag is present in the compressed bitstream, the deduplication method information indicates that duplicate vertex information for identifying duplicate vertices is not present in the compressed bitstream.

A volumetric video transmission method based on viewport adaptation and hybrid coding, belonging to the field of volumetric video transmission, includes: viewport adaptation: predicting the viewport from which the user will view the next frame of volumetric video and transmitting only the volumetric video within that viewport; hybrid coding: segmenting the current frame into tiles and specifying either an inter-frame entropy coding algorithm or an intra-frame entropy coding algorithm for encoding each tile; adaptive multi-threaded decoding: employing an adaptive multi-threaded decoding method, where multiple threads simultaneously decode using different decoding methods based on the different encoding methods of the received tiles. This invention utilizes viewport adaptation technology to transmit only the content within the user's viewport, significantly reducing the amount of data transmitted; since there is redundant information between volumetric video frames, this invention uses inter-frame coding technology to further compress the volumetric video size, reducing the amount of data that needs to be transmitted; this invention achieves low-bandwidth, high-quality transmission of volumetric video, improving the user's viewing experience.

The invention relates to a lightweight multi-source information combined V-PCC inter-frame mode rapid selection method, which comprises the following steps that: geometric videos and attribute videos generated by a V-PCC encoder for a target point cloud frame are obtained, each type of video comprises a near layer and a far layer, and four encoding layers are formed in total; respectively constructing a binary classification model and a multi-classification model for coding units CU of different scales in each coding layer; predicting the probability that a coding unit CU in a coding layer belongs to the MERGESKIP mode by using a binary classification model, skipping other mode detection if the probability value is greater than a first set threshold, and taking the MERGESKIP mode as a final mode of the coding unit CU; otherwise, utilizing a multi-classification model to carry out probability prediction on other inter-frame modes of a coding unit CU in the coding layer, rejecting the inter-frame modes of which the probabilities are lower than a second set threshold value according to a probability prediction result, and reserving the inter-frame modes of which the probabilities are higher than the second set threshold value to construct a candidate inter-frame mode set; and submitting the candidate inter-frame mode set to a V-PCC encoder for mode detection, and determining a final mode of a coding unit (CU) in the candidate inter-frame mode set by the V-PCC encoder. According to the method, the rationality of mode selection can be effectively guaranteed, the coding quality loss caused by rapid decision is avoided, the balance of efficiency and quality is realized in V-PCC inter-frame coding, and the requirements of scenes such as immersive multimedia and three-dimensional vision on efficient and high-quality V-PCC coding are met.

The present invention discloses an image decoding method that includes steps outlined below. Error report information related to an error block in an N-th image frame generated according to an inter-frame coding technology is received by an image encoding apparatus at a time spot that the image decoding apparatus receives a corresponding block of an N+P−1-th image frame and an N+P-th image frame is encoded according to an intra-frame coding technology. Blocks in the N-th image frame before the occurrence of the error block are decoded according to the inter-frame coding technology. Motion vector information and residue information are set to be zero to decode the blocks from the error block to the N+P−1-th image frame according to the inter-frame coding technology. The residue information of the intra-frame coding blocks in the N+P-th image frame is retrieved to decode the intra-frame coding blocks according to the intra-frame coding technology.

The invention relates to a VVC inter-frame coding rate control method based on a linear model, and belongs to the technical field of video coding. According to the method, a convex optimization technology and code rate control are combined, so that a code rate control scheme which is obviously improved and enhanced is realized; according to the method, an original bit rate-distortion relation is converted into a linear model, and a problem is converted into a convex optimization problem for optimization solution; an improved code rate control scheme is utilized, quantization parameter calculation is carried out on the frame level and the coding tree unit level, and code rate and quality control is achieved. According to the invention, code rate and quality control is realized by carrying out frame-level and coding tree unit-level code rate control on each image group of the initial video. A large number of experiments show that the algorithm provides significantly improved and enhanced code rate control coding performance, which indicates the effectiveness of the method.