4711 results about "Video encoding" patented technology

Systems, methods, and instrumentalities are disclosed for template based cross component linear model / multimode linear model (CCLM / MMLM) adjustment. In an example, a device, such as a video decoding device, or a video encoding device, may obtain a prediction model for predicting a coding block. The device may select an adjustment model, from multiple adjustment models, for adjusting the prediction model. The device may adjust the prediction model based on the selected adjustment model. The device may process (e.g., encode and / or decode) the coding block based on the adjusted prediction model.

The invention discloses an extreme compressed video coding method based on an intelligent reference frame, comprising the following steps: S1, acquiring an original video stream, dividing the original video stream into frame groups according to a time sequence, each group comprising a current frame and a candidate reference frame; s2, carrying out region positioning on the candidate reference frame, extracting motion, edge and background regions, and generating a mapping graph; s3, calculating a quality score based on the mapping graph according to a motion vector, gradient change and a region overlapping rate; s4, selecting three frames with highest scores to form a reference set, and establishing an index structure; s5, predicting the current frame by using the reference set to generate a predicted frame and a residual error; s6, multi-path coding cost is calculated, and a path with the minimum cost is selected; and S7, entropy coding is carried out on the reference index, the motion vector, the residual error and the control parameter, a code stream is output, and calling information is recorded. According to the method, the compression ratio and prediction precision of video coding are improved, the image quality is maintained while the code rate is reduced, and the method is suitable for efficient transmission and storage of high-resolution videos.

An example device for decoding video data includes a memory configured to store video data; and a processing system comprising one or more processors implemented in circuitry, the processing system being configured to: generate a prediction block for a current block of video data using a neural network; determine an equivalent intra mode for the prediction block from a set of available intra-prediction modes using decoder-side intra mode derivation (DIMD), the equivalent intra mode representing one of the intra-prediction modes that would generate an intra-prediction block that would best match the prediction block generated using the neural network; decode a residual block for the current block of the video data based on the equivalent intra mode; and combine the prediction block with the residual block to decode the current block of the video data.

A method comprising: receiving an image block unit of a frame, the image block unit comprising samples in color channels comprising at least one chrominance channel and one luminance channel; reconstructing samples of said luminance channel of the image block unit; determining a reference area for predicting target samples of at least one color channel of the image block unit, wherein said reference area comprises one or more reference samples in a neighboring block in current color channel / frame, in the neighboring of a co-located block in reference color channel / frame; and / or inside the co-located block in reference color channel / frame; determining weights for predicting said target samples based on a ratio between a normalized luminance histogram in said reference area and a normalized luminance histogram co-locating said target samples; determining filter coefficients of a filter for said predicting based on the weights, the reference samples and a shape of the filter; and predicting samples of at least one color channel of the image block unit based on the samples of said luminance channel and the filter coefficients.

A video encoder and video decoder may determine to code a block of video data using a non-directional intra mode. The video encoder and video decoder may determine a secondary transform from a secondary transform set for the block, and perform a transform process on the block of video data using the secondary transform. For non-directional intra prediction modes, the secondary transform set has a first number of transform kernels that is less than a second number of transform kernels in the secondary transform set for other blocks coded using a directional intra mode.

There is provided a method for video encoding and decoding based on a picture of a video and a supplementary enhancement information (SEI) message which is associated with the at least one picture and indicates one or more parameters of an optical correction to be applied to the at least one picture.

The application provides a signal transmission method, a video encoder and a computer readable storage medium. A computer-implemented signal transmission method performed by an encoder comprises the following steps: a processor transmits a bitstream comprising weight information for a prediction coding unit (CU) to a video decoder, the weight information indicating that if weighted prediction is enabled for a bi-prediction mode of the CU, weighted averaging for the bi-prediction mode is disabled, and the weight information indicating that if weighted prediction is enabled for at least one of a luma component and a chroma component of a reference picture of the CU, weighted averaging for the bi-prediction mode is disabled, wherein the bitstream comprises a flag indicating whether weighted prediction is enabled for at least one of the luma component and the chroma component of the reference picture, and the flag comprises a flag luma_weight_lx_flag[i] transmitted for an i-th reference picture in a reference picture list Lx, wherein x is 0 or 1.

A video encoding method, a video decoding method and apparatus, and a storage medium are provided. The decoding method includes that: angular accuracy corresponding to the intra prediction mode candidate list is determined, the first angular accuracy is used for indicating a search range of an angular prediction mode in the intra-frame prediction mode candidate list; the intra prediction mode candidate list is constructed on the basis of the first angular accuracy; and the prediction for the current block is performed on the basis of the constructed intra prediction mode candidate list.

A video encoding or decoding apparatus and method perform existing inter prediction on a current block to generate a motion vector and predicted samples. The video encoding or decoding apparatus and method generate enhanced predicted samples for the current block using a deep learning-based video prediction network (VPN) on the basis of the motion vector, the reference samples, the predicted samples, and the like to improve encoding efficiency.

The invention particularly relates to a mobile camera management system capable of adaptively adjusting video coding quality. According to the mobile camera management system capable of adaptively adjusting the video coding quality, a network condition monitoring and predicting module is used for monitoring the current network bandwidth and packet loss rate in real time and predicting the network state; the video coding control module is used for dynamically adjusting video coding parameters according to the current network bandwidth and the ROI; and the adaptive adjustment strategy module is responsible for issuing a video coding strategy to the video coding control module according to the data fed back by the network state monitoring and prediction module so as to realize dynamic adjustment of the video coding quality. The mobile camera management system capable of adaptively adjusting the video coding quality can avoid video lagging and frame loss when the network bandwidth is relatively low, is suitable for various mobile devices such as a vehicle-mounted device, an unmanned aerial vehicle and a wearable camera, effectively improves the continuity and availability of video transmission, and realizes stable application in an environment with unstable signals.

To provide a video encoding / decoding method and apparatus for performing intra-prediction based on the availability of a reference pixel so as to improve encoding performance.SOLUTION: An intra-prediction method for a color copy mode checks a reference pixel region designated to obtain correlation information, determines a reference pixel processing setting based on a determination of availability of the reference pixel region, and performs intra-prediction according to the determined reference pixel processing. In addition, a candidate list for motion information prediction of the current block is generated, a control point vector of the current block is derived based on the candidate list and a candidate index, a motion vector of the current block is derived based on the control point vector of the current block, and inter prediction is performed on the current block using the motion vector.SELECTED DRAWING: Figure 14

Example devices, methods, and computer-readable media are disclosed. An example device includes one or more processors configured to determine a reference picture list for a current block of a current picture of the video data. The one or more processors are configured to determine that a reference picture of a collocated block is listed in the reference picture list for the current block, the collocated block being collocated with the current block in a collocated picture. The one or more processors are configured to select, in a condition where the reference picture of the collocated block is listed in the reference picture list for the current block, a reference picture for the current block to be the reference picture of the collocated block. The one or more processors are configured to and encode or decode the current block based on the reference picture for the current block.

Various embodiments provide methods, apparatuses, and computer program products. An example apparatus includes at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: defining an information message for carrying text descriptions within a coded video, wherein the text descriptions comprise one or more purposes, wherein the one or more purposes comprise at least one of an encoder name, an encoder version, or a tag uniform resource identifier (URI) for identifying the coded video content; and signaling the information message to a decoder.

To provide a video encoding / decoding method and apparatus for performing intra-prediction based on the availability of a reference pixel, which can improve encoding performance.SOLUTION: An intra-prediction method for a color copy mode checks a reference pixel region designated to obtain correlation information, determines a reference pixel processing setting based on a determination of availability of the reference pixel region, and performs intra-prediction according to the determined reference pixel processing. In addition, a candidate list for motion information prediction of the current block is generated, a control point vector of the current block is derived based on the candidate list and a candidate index, a motion vector of the current block is derived based on the control point vector of the current block, and inter prediction is performed on the current block using the motion vector.SELECTED DRAWING: Figure 14

A method and apparatus for generating an extended MPM (Most Probable Modes) list by adding the target DIMD candidate and said at least one neighbouring mode of the target DIMD candidate to an initial MPM list. A target DIMD candidate is determined for the current block based on a DIMD process using statistics or histogram of angle field derived from a template of the current block. At least one neighbouring mode of the target DIMD candidate is generated by adding an offset to a corresponding mode number of the target DIMD candidate, and wherein the offset corresponds to a non-zero integer. An extended MPM (Most Probable Modes) list is generated by adding the target DIMD candidate and said at least one neighbouring mode of the target DIMD candidate to an initial MPM list. The current block is encoded or decoded using information comprising the extended MPM list.

A method and apparatus for video coding using dependent quantization (DQ) with sign hiding. At the decoder side, for a current segment, a sign-hiding state of a selected coefficient, or parity information of the quantized transform coefficients associated with the current segment, or both are determined. The current segment comprises a sign-hiding coefficient. The signs associated with one or more sign-hiding quantization coefficients corresponding to one or more target coefficients in the current segment are determined based on the sign-hiding state, the parity information of the current segment, or both. The quantization coefficients with the signs recovered are dequantized using respective quantizers from the plurality of quantizers. A method and apparatus for a corresponding encoder are also disclosed.

Network services encode multimedia content, such as video, into multiple adaptive bitrate streams of encoded video and a separate trick play stream of encoded video to support trick play features. The trick play stream is encoded at a lower encoding bitrate and frame rate than each of the adaptive bitrate streams. The adaptive bitrate streams and the trick play stream are stored in the network services. During normal content streaming and playback, a client device downloads a selected one of the adaptive bitrate streams from network serviced for playback at the client device. To implement a trick play feature, the client device downloads the trick play stream from the network services for trick play playback.

To provide a video encoding / decoding method and apparatus for performing intra-prediction based on the availability of a reference pixel so as to improve encoding performance.SOLUTION: An intra-prediction method for a color copy mode checks a reference pixel region designated to obtain correlation information, determines a reference pixel processing setting based on a determination of availability of the reference pixel region, and performs intra-prediction according to the determined reference pixel processing. In addition, a candidate list for motion information prediction of the current block is generated, a control point vector of the current block is derived based on the candidate list and a candidate index, a motion vector of the current block is derived based on the control point vector of the current block, and inter prediction is performed on the current block using the motion vector.SELECTED DRAWING: Figure 14

A method for implicitly deriving region-based intra-prediction is provided. A video coder receives data for a block of pixels to be encoded or decoded as a current block of a current picture of a video. The video coder identifies an above template region and a left template region of the current block among already-reconstructed pixels of the current picture. The video coder derives a first intra-prediction mode based on the above template region and a second intra-prediction mode based on the left template region. The video coder generates first and second predictors for the current block based on the first and second intra prediction modes. The video coder encodes or decodes the current block by using the first and second predictors to reconstruct the current block.

A video coder may code a flag indicating whether or not a neural network (NN)-based intra prediction mode is enabled before coding a decoder side intra mode derivation (DIMD) flag, and code a block of video data based on whether or not the NN-based intra prediction mode is enabled.

An intra frame prediction method and apparatus based on interpolation filtering, a video encoding method and apparatus, a video decoding method and apparatus, and a system. The intra prediction method based on interpolation filtering comprises: determining, based on a determined filtering window and a reconstructed value of a sample in a reconstruction area neighboring to a current block, a filtering coefficient used to perform interpolation filtering on the current block; and performing interpolation filtering based on a sample value of a reference sample neighboring to a current sample and the filtering coefficient, to determine a predicted value of the current sample.

To provide a video encoding / decoding method for performing intra-prediction on the basis of availability of a reference pixel so as to improve encoding performance.SOLUTION: An intra-prediction method for a color copy mode checks a reference pixel region designated to obtain correlation information, determines a reference pixel processing setting based on a determination of availability of the reference pixel region, and performs intra-prediction according to the determined reference pixel processing. In addition, a candidate list for motion information prediction of the current block is generated, a control point vector of the current block is derived based on the candidate list and a candidate index, a motion vector of the current block is derived based on the control point vector of the current block, and inter prediction is performed on the current block.SELECTED DRAWING: Figure 14

Embodiments of the present application relates to the technical field of video decoding, and provide a video en / decoding method and apparatus and a storage medium, which are beneficial to improving the en / decoding efficiency. The method comprises: acquiring complexity information of a current block in an image to be processed, wherein the complexity information of the current block is obtained by calculating at least one angular gradient of the current block according to at least pixel values of the current block; determining quantization parameters of the current block according to the complexity information of the current block; en / decoding the current block on the basis of the quantization parameters.

A method of signaling neural network post-loop filter information for video data is disclosed. The method comprising: signaling a neural network post-filter characteristics message; signaling a syntax element specifying a padding type corresponding to the neural network post-filter characteristics message, wherein the syntax element includes a value specifying a wrap-around padding type and a value specifying a fixed padding type; and signaling a syntax element indicating a sample value to be used for padding in a case where the fixed padding type is specified.

Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block according to a rule, where the rule specifies a relationship between applicability of a matrix based intra prediction (MIP) mode or a transform mode during the conversion, where the MIP mode includes determining a prediction block of the current video block by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation, and where the transform mode specifies use of a transform operation for the determining the prediction block for the current video block.

The invention relates to the technical field of video coding and image processing, and discloses a code rate control method and system based on video image segmentation, and the method comprises the steps: carrying out the pixel-level semantic segmentation of a to-be-coded video frame sequence; extracting a foreground region of interest; calculating a corresponding segmentation uncertainty parameter; establishing semantic mutation parameters of the foreground region of interest; generating a semantic perception weight; executing region-level target code rate redistribution and quantization parameter mapping; and executing partition coding control. In the prior art, code rate control mainly depends on motion intensity or pixel complexity, and especially when a foreground target suddenly appears or disappears in a monitoring scene, a technical problem that a key target is blurred or a background code rate is wasted is easily caused. Due to the fact that the uncertainty modeling and semantic mutation sensing mechanism of the semantic segmentation result is introduced, priority coding of the foreground interest area is achieved under the frame-level code rate constraint condition, and the video coding quality and the code rate utilization efficiency are improved.

The invention provides a video coding method and device, electronic equipment and a storage medium, relates to the technical field of image processing, in particular to the field of video coding and the like, and can be applied to application scenes such as video live broadcast and the like. The specific implementation scheme is as follows: acquiring a reference frame which is adjacent to a current frame and has established initial ROI hierarchical division; multiplexing a motion vector generated by the reference frame in a motion compensation time domain filtering process, and determining an ROI position predicted value of the current frame; extracting feature points of the five sense organs of the current frame, and correcting an ROI position predicted value based on a feature point spatial topological relation in the initial ROI; respectively configuring differential quantization parameters for the corrected main face region, the corrected secondary face region and the corrected background region; dynamically allocating a three-layer area code rate according to a real-time network bandwidth; and outputting the coded frame of the current frame and the associated ROI level metadata. According to the scheme, the coding efficiency and quality can be improved.

The invention discloses a video reasoning method based on a long sequence image encoder, which belongs to the field of computer vision and comprises the following steps of: constructing and training the long sequence image encoder based on an expert autonomous network layer AoE, intensive learnable residual connection and mixed attention; using the trained long sequence image encoder to initialize a video encoder, and further training the video encoder; training the video thinking chain reasoning model to obtain a trained video thinking chain reasoning model; and performing video reasoning based on the trained video thinking chain reasoning model. According to the method, the calculation complexity can be effectively reduced, the image feature extraction efficiency and the video reasoning accuracy are improved, the dependence on the sampling technology is reduced, and the model availability and safety are improved.

A method includes performing scene detection on a current frame of picture to obtain a scene status of the current frame of picture; determining, based on the scene status, a reference frame structure corresponding to the current frame of picture, where the reference frame structure indicates a reference frame of picture of the current frame of picture and an encoding layer of the current frame of picture; and encoding the current frame of picture into a bit stream based on the reference frame structure. In a process of encoding a video, a reference frame of picture and an encoding layer of each frame of picture are adjusted in real time with reference to features such as whether scene switching occurs or whether a scene is kept stable in each frame of picture.

Systems and methods for video coding and decoding using region packing are provided. At an encoder, a region detection module receives a video frame for encoding, identifies regions of interest in the video frame, and generates a bounding box for each region of interest. A region extractor module obtains the pixels within the bounding box from the video frame. A region packing module receives the identified regions of interest and arranges the bounding boxes within a packed frame substantially reducing the data to be encoded outside the identified regions of interest. A video encoder receives the packed frame and generates an encoded bitstream therefrom. At the decoder, the encoded bitstream is decoded and parameters sufficient to place the regions within a reconstructed frame are extracted. A reconstructed frame is generated which substantially maintains the spatial relationship and size of regions of interest in the original video frame.