127 results about "Interframe coding" patented technology

Methods and systems are described for end-to-end video coding and decoding using deep learning. Proposed fusion schemes for reference pictures and motion vector features allow single-prediction models for deep-learning video coding (DLVC) to be extended to support multi-reference prediction coding as well. Example high-level syntax to support a variety of deep learning models for bi-prediction is described as well.

An example method of video decoding includes receiving a video bitstream comprising a plurality of blocks corresponding to a plurality of pictures, the plurality of blocks including a first block. When the first block is an inter coded block, the method includes determining, based on coded information including an end of block (EOB) value, whether transform information is signaled for the first block, the transform information including at least one of a transform type and a transform set. The method also includes, when the transform information is signaled for the first block, parsing the transform information from one or more indicators of the video bitstream, and, when the transform information is not signaled for the first block, deriving the transform information without parsing the one or more indicators. The method further includes decoding the first block by applying an inverse transform to the first block using the transform information.

This invention discloses a bitrate control method at the image block level for P-frames and / or B-frames. Step S1: Obtain the inter-frame coding mode candidates and their prediction costs for each image block to be encoded. Step S2: Select the minimum prediction cost to characterize the inter-frame coding complexity of the image block to be encoded; use the sum of the inter-frame coding complexities of all image blocks within a video frame as the inter-frame coding complexity of that video frame. Step S3: Calculate the target number of coding bits for each image block to be encoded within the P-frame or B-frame to be encoded. Step S4: Calculate the Lagrange multipliers for the image block to be encoded within the P-frame or B-frame to be encoded. Step S5: Perform video encoding on the image block to be encoded, and then adjust the target number of coding bits for the next image block to be encoded within the P-frame or B-frame to be encoded. This invention has low hardware overhead and low implementation cost; it does not introduce a large number of complex floating-point operations, reducing the difficulty and cost of hardware implementation.

The invention provides a video coding method and system based on screen sharing, and the method comprises the steps: carrying out the video coding at a corresponding first moment through a quantization parameter value under the condition that first terminal equipment is detected to be started or a new scene appears; in a time period after the first moment and under the condition that the scene is kept unchanged, adjusting the quantization parameter value; under the condition that the quantization parameter value reaches a first preset threshold value, constructing a long-term reference frame group based on the corresponding image frame; under the condition that scene switching of the first terminal equipment is detected, judging whether a reference frame meeting a preset condition exists in the long-term reference frame group or not; if the current frame to be coded exists, coding the current frame to be coded in a mode of combining inter-frame coding and intra-frame coding based on the reference frame to obtain coded data; sending the coded data to a second terminal device for decoding; according to the method and the device, the network congestion condition during scene switching of screen sharing can be avoided.

A method and apparatus for padding out-of-boundary pixels are disclosed. According to the method, input data associated with a current block located at or near a picture boundary are received, wherein the input data comprise prediction data and reconstructed residual data related to the current block. An extended motion-compensated reconstructed block for the current block is generated based on the prediction data and the reconstructed residual data, wherein the extended motion-compensated reconstructed block for the current block is inter coded and comprises a padded area located outside the picture boundary and a reconstructed current block. At least one in-loop filter is applied to the extended motion-compensated reconstructed block.

An aspect of the disclosure provides a method of video decoding. For example, a coded video bitstream is received. The coded video bitstream includes coded information of a plurality of pictures. Based on the coded information, a current block in a current picture is determined to be coded using an inter prediction mode, prediction samples of the current block in the inter prediction mode are generated at least partially based on a reference block in a reference picture that is different from the current picture. Also, intra prediction mode associated with the current block in the current picture is obtained. One or more transform kernels are determined based on the intra prediction mode associated with the current block. The current block is reconstructed based on the one or more transform kernels.

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. In the method, for a conversion between a current video block of a video and a bitstream of the video, a first prediction of the current video block is determined. The first prediction is determined based on a neural network-based intra coding tool. A combined prediction of the first prediction and a second prediction of the current video block is determined. The second prediction is determined based on a inter coding tool. The conversion is performed based on the combined prediction.

An example method of video decoding includes receiving a video bitstream that includes a plurality of encoded blocks including a current block. The example includes determining that the current block is inter-coded using a prediction block and a motion vector (MV). When an adaptive motion vector difference (AMVD) resolution mode is active for the current block, a reference motion vector (RMV) index is determined for a dynamic reference list (DRL), where the RMV index for the DRL has a first range when the AMVD resolution mode is active. When the AMVD resolution mode is inactive for the current block, the RMV index for the DRL is extracted from the video bitstream, where the RMV index for the DRL has a second range, greater than the first range.

Intra prediction modes are determined for entry in most probable mode lists for encoding in video encoders and decoding in video decoders. In at least one embodiment, coding modes are derived to determine reference samples to use from inter coded neighboring blocks. In one embodiment, up to five neighboring blocks are used. The reference samples are used in an intra prediction mode to determined prediction samples. The reference samples are used for prediction in encoding or decoding. In at least one embodiment, one of several motion models can be used to extract the intra motion mode. The intra motion modes are used to fill a most probable mode list. The motion model, intra mode, or reference frame can be signaled from an encoder to a decoder.

The present invention discloses an image decoding method. Error report information related to an error block in an N-th image frame generated according to an inter-frame coding technology is received by an image encoding apparatus when the image decoding apparatus receives a block of an N+P−1-th image frame. The N+P-th image frame is encoded according to the inter-frame coding technology. Blocks in the N-th image frame before the error block are decoded according to the inter-frame coding technology. A panning motion vector of an N−1-th image frame serves as the motion vector information and the residue information is set to be zero to decode the blocks from the error block to the N+P−1-th image frame according to the inter-frame coding technology. The motion vector information and the residue information of the inter-frame coding blocks in the N+P-th image frame are retrieved to perform decoding according to the inter-frame coding technology.

A method is provided for inter-coding video in which transmission bandwidth requirements associated with second motion vectors for bi-directional temporal prediction is reduced. In the method, vector information for one of motion vectors for multi-directional temporal prediction can be transmitted together with information on how to derive or construct the second motion vectors. Thus, rather than sending express information regarding each of the plurality of motion vectors, express information related to only one motion vector along with information related to reconstruction / derivation of the second motion vectors is transmitted, thus reducing bandwidth requirements and increasing coding efficiency.

Motion compensation requires a significant amount of memory bandwidth, especially for smaller prediction unit sizes. The worst case bandwidth requirements can occur when bi-predicted 4×8 or 8×4 PUs are used. To reduce the memory bandwidth requirements for such smaller PUs, methods are provided for restricting inter-coded PUs of small block sizes to be coded only in a uni-predictive mode, i.e., forward prediction or backward prediction. More specifically, PUs of specified restricted sizes in bi-predicted slices (B slices) are forced to be uni-predicted.

This application provides a video decoding method, a video encoding method, and a computer-readable storage medium. Video encoding and decoding techniques for bidirectional prediction with weighted averaging are disclosed. According to some embodiments, a computer-implemented video decoding method includes the following steps: decoding a bitstream associated with a target coding block; reconstructing the target coding block based on a merge candidate list, the merge candidate list including one or more merge candidates associated with one or more inter-frame coding blocks other than the target coding block, each of the one or more merge candidates being motion information associated with the corresponding inter-frame coding block, wherein at least one of the one or more merge candidates includes bidirectional prediction weights.

A block vector (BV) of an intra-coded and / or inter-coded block may be used for building a BV candidate list. A device may generate a candidate list(s) for a current block. The device may determine a neighboring block to the current block is intra-coded and / or inter-coded. The device may determine a BV is associated with the neighboring block. The device may, e.g., on condition that the neighboring block is intra-coded and the BV is associated with the neighboring block, add the BV to the at least one candidate list. The device may, e.g., on condition that the neighboring block is inter-coded and the BV is associated with the neighboring block, add the BV to the at least one candidate list. The device may, e.g., on condition that the neighboring block is intra-coded and / or inter-coded, and the BV is associated with the neighboring block, add the BV to the candidate list.

The present application discloses a video coding method, system, apparatus, and device. The method utilizes the inter-coding mode information of neighboring CUs of a target coding unit and employs a weighted scoring mechanism for voting by neighboring CUs to make decisions on skipping the inter-coding mode of the target coding CU. This early termination of inter-coding mode decisions allows for rapid selection of merge mode or skip mode as the optimized inter-coding mode, and premature termination of the time-consuming search process for inter-coding and other modes. This effectively reduces the complexity of inter-coding for large-sized CUs, thereby improving overall coding efficiency.

Systems, methods, and instrumentalities are disclosed for constructing a template-based intra mode derivation (TIMD) merge mode from collocated block. Based on the determination that the collocated block of the previous inter-coded frame is coded in TIMD mode, TIMD information associated with the collocated block may be obtained. TIMD merge list may be generated based on at least the TIMD information associated with the collocated block. A TIMD candidate may be selected from the TIMD merge list for decoding a current block of a current inter-coded frame. The current block of the current inter-coded frame may be decoded based on the selected TIMD candidate.

An aspect of the disclosure provides a method of video decoding. For example, a coded video bitstream is received. The coded video bitstream includes coded information of a plurality of pictures. Based on the coded information, a current block in a current picture is determined to be coded using an inter prediction mode, prediction samples of the current block in the inter prediction mode are generated at least partially based on a reference block in a reference picture that is different from the current picture. Also, intra prediction mode associated with the current block in the current picture is obtained. One or more transform kernels are determined based on the intra prediction mode associated with the current block. The current block is reconstructed based on the one or more transform kernels.

The invention discloses an early termination method and device for inter-frame coding segmentation, equipment and a storage medium. The method comprises the following steps: calculating a feature distance between to-be-segmented regions based on coding block features; inputting the feature distance into a pre-trained neural network classification model for segmentation threshold prediction, and outputting a target segmentation threshold of the target coding block; based on the feature distance and the target segmentation threshold, judging whether the target coding block meets a segmentation termination condition or not; and if yes, stopping segmentation of the target coding block. According to the embodiment of the invention, features highly related to CU segmentation are selected by using a machine learning algorithm, features having the greatest influence on a segmentation decision are selected by analyzing texture and depth map information of the CU, and early termination of CU segmentation of a texture video and a depth map is realized based on a threshold value extracted from a training model.

An apparatus directed to improvements to motion coding for vertices in an inter-coded base mesh frame is provided. The apparatus receives a compressed bitstream comprising a base mesh sub-bitstream and a syntax element. The apparatus decodes the syntax element to generate a prediction error. The apparatus decodes the base mesh sub-bitstream to generate a base mesh frame. The apparatus determines neighboring vertices of a vertex based on the base mesh frame. The apparatus determines a first predictor based on the neighbors of the vertex. The apparatus determines the vertex based on the first predictor and the prediction error.

Methods, apparatus, and non-transitory computer-readable storage media for video decoding and encoding are provided. In a video decoding method, a decoder may obtain a target motion vector of a current interframe coding block from a candidate list based on a plurality of first reconstruction sample points adjacent to the current interframe coding block, the candidate list including a plurality of motion vector candidates of the current interframe coding block; obtaining a plurality of first prediction sample points based on the target motion vector of the current inter-frame coding block; and in response to determining that adaptive motion compensation filtering is applied to the current inter-coded block, obtaining a plurality of filtered prediction samples based on the at least one template filter and the plurality of first prediction samples.

A methods and apparatuses for encoding or decoding a segment in a coded picture. The decoding may include obtaining from a bitstream a value of a first codeword that indicates whether the coded picture may contain bi-directional inter coded segments or not. The decoding may include, based on the value of the first codeword, deriving one or more parameter values by either (a) decoding one or more parameters from the bitstream to obtain the one or more parameter values or (b) inferring the one or more parameter values. The decoding may include decoding the segment in the coded picture based on the one or more parameter values. The encoding may include encoding the first codeword to the bitstream and determining whether to encode one or more parameter values in the bitstream based on a determination of whether the coded picture will contain bi-directional inter coded segments or not.

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. In the method, for a conversion between a current video block of a video and a bitstream of the video, usage information of a plurality of template-based approaches is determined for the current video block based on at least one syntax element at a first level. The first level is higher than a coding unit level. The conversion is performed based on the usage information. The plurality of template-based approaches comprises at least two coding tools associated with at least one of: intra coding, inter coding, or intra block copy (IBC) coding.

This application provides a video encoding method and system based on screen sharing. The method includes: when a first terminal device is detected to start or a new scene appears, video encoding is performed at a corresponding first moment using quantization parameter values; during a period of time after the first moment, while the scene remains unchanged, the quantization parameter values ​​are adjusted; when the quantization parameter values ​​reach a first preset threshold, a long-term reference frame group is constructed based on the corresponding image frames; when a scene switch is detected in the first terminal device, it is determined whether there is a reference frame in the long-term reference frame group that meets preset conditions; if so, the current frame to be encoded is encoded based on the reference frame using a combination of inter-frame coding and intra-frame coding to obtain encoded data; and the encoded data is sent to a second terminal device for decoding. This application can avoid network congestion when a scene switch occurs during screen sharing.

Disclosed herein are systems, methods, and instrumentalities associated with dual tree coding modes and chroma intra prediction modes reordering. A video coding device as described herein may determine whether a chroma video block is located in an intra-coded region of an inter-coded video slice. Based at least on a determination that the chroma video block is located in the intra-coded region of the video slice and a further determination that a dual tree partition mode is enabled for the intra-coded region, the video coding device may be further configured to determine a plurality of intra prediction modes for the chroma video block, calculate, for each of plurality of intra prediction modes, a respective combined cost associated with predicting the chroma video block and a luma video block co-located with the chroma video block using the intra prediction mode, and reorder the plurality of intra prediction modes based on the respective combined cost calculated for each of the plurality of intra prediction modes. The video coding device may then code the chroma video block based on the reordering of the plurality of intra prediction modes.

This disclosure provides methods, devices, and systems for video coding. The present implementations more specifically relate to hybrid coding techniques that combine aspects of inter-frame coding with aspects of intra-frame coding. In some aspects, a video encoder may perform inter-frame coding in a weighted manner so that the coded video frames (also referred to as “residual frames”) may include contributions from the current video frame to be transmitted over a communication channel and also may include contributions from the previous video frame transmitted over the communication channel. More specifically, any pixel value (r(n)) in the residual frame can be expressed as a weighted combination of a respective pixel value (x(n)) in the current video frame and a co-located pixel value (x(n−1)) in the previous video frame, where r(n)=x(n)−α·x(n−1) and where 0≤α≤1 is a scaling factor representing the degree of contribution by the previous video frame.

The present application relates to a method of decoding a video picture by means of motion compensated temporal bi-prediction of an inter coded block using two reference video pictures in two separate reference video picture lists, and two affine motion fields defined by at least two control point motion vectors, denoted CPMVs, associated to each reference picture, refined CPMVs being obtained as output of the following first step (171) or, optionally of the second step (172) that follows the first step (171), - in said first step (171), for each CPMV, a bilateral matching being performed for a block centred on the CPMV to derive at least two refined CPMVs at an integer precision, and a set of CPMVs comprising either non-refined and / or refined CPMVs at an integer precision being selected to lead to an overall predicted block with a minimum bilateral matching cost, - in said second step (172), for each successive CPMV of the selected set of CPMVs that is associated with a block, each CPMV is refined at a sub-sample precision to minimize a bilateral matching cost of said block, wherein the second step (172) is bypassed according to a comparison between a bilateral matching cost associated with a CPMV that is performed in the first step and a threshold.

The invention provides a video coding method and device, equipment and a storage medium, and belongs to the field of image processing, and the method comprises the steps: in a video coding process, obtaining a target quantization parameter corresponding to a current to-be-coded image frame in a video based on a first reference frame of a target frame number obtained each time during inter-frame coding, the target quantization parameter is smaller than a quantization parameter adopted for encoding the first reference frame; and performing inter-frame coding on the current to-be-coded image frame according to the target quantization parameter to obtain a second reference frame until video coding is completed. According to the method, the high-quality reference frame is inserted during inter-frame coding, so that the video quality of the whole video can be effectively improved, and the video watching experience of a user is improved.

Systems and methods for encoding data for low-latency streaming are disclosed herein. The system encodes a plurality of frames of a video. The encoded frames of the video comprise at least one intra-coded key frame and at least one inter-coded frame. A subset of the plurality of encoded frames, along with a corresponding identifier for each frame in the subset, is added to a reference frame data structure. The system encodes a first frame as a first inter-frame referencing at least one encoded frame from the data structure and determines, based at least in part on properties of a stream, a probability of the first inter-frame being dropped during at least one of transmission or decoding. Based on the calculated probability, the system omits the first inter-frame from the data structure and encodes a second frame subsequent to the first frame using the data structure that omits the first inter-frame.

The application provides a video coding method and system based on screen sharing, the method comprising: in the case of detecting that a first terminal device starts or a new scene occurs, coding a video at a corresponding first time with a quantization parameter value; in the case of a time period after the first time and the scene remaining unchanged, adjusting the quantization parameter value; in the case of the quantization parameter value reaching a first preset threshold, constructing a long-term reference frame group based on a corresponding image frame; in the case of detecting that the first terminal device undergoes scene switching, judging whether a reference frame meeting a preset condition exists in the long-term reference frame group; if so, coding a current frame to be coded in a manner combining inter-frame coding and intra-frame coding based on the reference frame to obtain coding data; and sending the coding data to a second terminal device for decoding; the application can avoid the occurrence of network congestion in the case of screen sharing scene switching.

The present disclosure relates to an inter-frame coding motion vector processing method and apparatus. The method includes: acquiring an estimated motion vector between a current coded image block and a reference frame coded image block and a position number of the estimated motion vector; reading merge motion vector information corresponding to the position number from a target merge table according to the position number of the estimated motion vector; the target merge table including a relationship between position numbers of estimated motion vectors and merge motion vector information corresponding to the position numbers of the estimated motion vectors; and replacing the estimated motion vector corresponding to the 10 position number with the merge motion vector information, and coding the merge motion vector information. By use of the method, the time of deciding a candidate motion vector in a video inter-frame coding merge mode can be reduced, thereby improving computing efficiency.