1623 results about "Video decoding" patented technology

A video encoding method, a video decoding method and apparatus, and a storage medium are provided. The decoding method includes that: angular accuracy corresponding to the intra prediction mode candidate list is determined, the first angular accuracy is used for indicating a search range of an angular prediction mode in the intra-frame prediction mode candidate list; the intra prediction mode candidate list is constructed on the basis of the first angular accuracy; and the prediction for the current block is performed on the basis of the constructed intra prediction mode candidate list.

An intra frame prediction method and apparatus based on interpolation filtering, a video encoding method and apparatus, a video decoding method and apparatus, and a system. The intra prediction method based on interpolation filtering comprises: determining, based on a determined filtering window and a reconstructed value of a sample in a reconstruction area neighboring to a current block, a filtering coefficient used to perform interpolation filtering on the current block; and performing interpolation filtering based on a sample value of a reference sample neighboring to a current sample and the filtering coefficient, to determine a predicted value of the current sample.

The invention relates to the technical field of image processing, and further relates to a video decoding and unreal engine rendering method based on GPU full-link zero copy, which comprises the following steps of: 1, performing hardware decoding on an input video code stream on a GPU, and constructing a motion vector description buffer region for storing compressed domain motion vector information according to a macro block sequence; step 2, reading the motion vector description buffer area on the GPU through a calculation shader, and generating dynamic special effect control buffer areas in one-to-one correspondence with the macro blocks; and step 3, in a post-processing material of the unreal engine rendering module, taking the shared video texture resource as an input texture, and outputting a video picture. On the premise of not depending on a host processor and not excessively occupying video memory bandwidth, unified management of pixel data and motion data is achieved, delay is remarkably reduced, and special effect stability and direction consistency are improved.

A video decoding method includes: determining first motion information of a current block; refining the first motion information based on motion information of a reference picture of the current block to obtain second motion information of the current block; and determining a prediction value of the current block based on the second motion information.

Embodiments of the present application relates to the technical field of video decoding, and provide a video en / decoding method and apparatus and a storage medium, which are beneficial to improving the en / decoding efficiency. The method comprises: acquiring complexity information of a current block in an image to be processed, wherein the complexity information of the current block is obtained by calculating at least one angular gradient of the current block according to at least pixel values of the current block; determining quantization parameters of the current block according to the complexity information of the current block; en / decoding the current block on the basis of the quantization parameters.

A video decoding method includes obtaining a to-be-entropy-decoded syntax element in a current block by parsing a received bitstream, where the to-be-entropy-decoded syntax element includes a syntax element 1 or a syntax element 2 in the current block, obtaining a context model corresponding to the to-be-entropy-decoded syntax element, where both of a context model corresponding to the syntax element 1 and a context model corresponding to the syntax element 2 are determined from the same preset context model set, entropy decoding the to-be-entropy-decoded syntax element based on the context model corresponding to the to-be-entropy-decoded syntax element, and obtaining a reconstructed image of the current block based on the syntax element obtained by entropy decoding.

Implementations are described for determining, for a block being encoded in a picture, at least one predictor candidate, determining for the at least one predictor candidate, one or more corresponding control point generator motion vectors, based on motion information associated to the at least one predictor candidate, determining for the block being encoded, one or more corresponding control point motion vectors, based on the one or more corresponding control point generator motion vectors determined for the at least one predictor candidate, determining, based on the one or more corresponding control point motion vectors determined for the block, a corresponding motion field, and encoding the block based on the corresponding motion field.

The invention provides a cross-platform video decoding method and device, computing equipment and a computer readable storage medium, and the method is combined with a factory mode to completely package bottom layer differences of all platform types, and an application layer developer does not need to care about the bottom layer platform differences. The optimal implementation can be automatically selected on different engines and platforms through a uniform API (Application Program Interface); during rendering, a single-frame memory management strategy is used, and only one frame which is currently displayed is reserved in a memory; and in the aspect of performance, the advantages of a multi-thread platform and the parallel computing characteristics of the GPU are fully utilized. According to the embodiment of the invention, through deep fusion of a cross-platform soft decoding architecture, single-frame memory optimization, multi-thread parallel, GPU acceleration and other technologies, perfect balance of cross-platform, high performance and low memory is realized, and the development efficiency of the whole project is improved.

Disclosed herein are a video decoding method and apparatus and a video encoding method and apparatus. In the encoding and decoding of a video, a prediction mode may be selected from among multiple prediction modes using prediction mode information for a target block, and prediction may be performed on the target block based on the selected prediction mode, wherein the prediction mode information includes information related to a reference block, and wherein the reference block comprises one or more of a spatially neighboring block that is spatially adjacent to the target block and a temporally neighboring block that is temporally adjacent to the target block. When the selected prediction mode includes a plurality of prediction modes, a prediction mode to be used for prediction of the target block may be decided on among the plurality of selected prediction modes through signaling of the prediction mode decision information.

Provided are an image decoding method and an image decoding apparatus, and an image encoding method and an image encoding apparatus which correspond thereto, the image decoding method including: selecting a current block from among a plurality of blocks obtained by dividing a current image; determining a plurality of transform blocks including a first transform block and a second transform block based on the current block; scaling a first direct current (DC) transform coefficient value of the first transform block using a size of the first transform block and a reference transform size to obtain a scaled first DC transform coefficient value; obtaining a prediction transform coefficient value for the second transform block based on a size of the second transform block and the scaled first DC transform coefficient value; determining a second DC transform coefficient value of the second transform block based on the prediction transform coefficient value; and restoring the current block by performing an inverse transform on the second transform block based on the second DC transform coefficient value

Methods for video decoding and encoding, apparatuses and non-transitory computer-readable storage media thereof are provided. In one method for video decoding, a decoder may obtain fractional motion information for a current block in an intra block copy (IBC) mode. Additionally, the decoder may obtain a final block vector (BV) for the current block based on the fractional motion information. Furthermore, the decoder may obtain a final prediction block for the current block based on the final BV.

The present invention provides a method and an apparatus for optimized post-processing that can be used in the area of video encoding and decoding. A video decoding method, according to one embodiment of the present invention, may comprise the steps of: receiving a bitstream including an encoded video and supplemental enhancement information related to the encoded video; extracting the encoded video and the supplemental enhancement information from the bitstream; decoding the encoded video to obtain a decoded video; and performing post-processing on the decoded video on the basis of the supplemental enhancement information, wherein the supplemental enhancement information includes post-processing information according to physical characteristics of a display device.

The invention relates to a video coding method and device, a video decoding method and device, electronic equipment and a storage medium. The video coding method comprises the following steps: acquiring difference information between a plurality of reference frames of a current frame and the current frame; determining weights corresponding to the plurality of reference frames based on the difference information; fusing the coding information of each reference frame in the plurality of reference frames based on the weights corresponding to the plurality of reference frames to obtain fused coding information; and coding the current frame based on the fused coding information to obtain a coding frame of the current frame.

The invention provides a video coding method and device, a video decoding method and device and a storage medium, and the video coding method comprises the steps: obtaining a video frame sequence; for any video frame in the video frame sequence, calculating an inter-frame optical flow change index of the video frame; the inter-frame optical flow change index represents the motion change degree between the video frame and the previous video frame; dividing the video frame sequence into a key frame set and a redundant frame set; performing image coding on each key frame in the key frame set to obtain an image code stream; performing semantic text recognition on each redundant frame in the redundant frame set through various recognition models, and generating a semantic text code stream according to a plurality of semantic text recognition results corresponding to the plurality of redundant frames one by one; and sending the image code stream and the semantic text code stream to a cloud server. According to the embodiment of the invention, different downstream tasks can be flexibly adapted by extracting information of different dimensions.

Aspects of the disclosure provide methods and apparatuses for video encoding / decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. The processing circuitry receives a bitstream carrying a plurality of pictures, and determines at least a motion compensation padding (MCP) block that is located in an MCP area outside of a picture and next to a picture boundary of the picture. The processing circuitry derives, according to a plurality of candidates with positions located at the picture boundary within the picture, a motion vector of the MCP block for motion compensated boundary padding, and reconstructs at least a sample in the MCP block according to the derived motion vector for the motion compensated boundary padding.

An aspect of the disclosure provides a method of video decoding. For example, a coded video bitstream is received. The coded video bitstream includes coded information of a plurality of pictures. Based on coded information of a current block in a current picture, it is determined that the current block is coded using an intra prediction that generates prediction samples of the current block based on reference samples in the current picture. At least a first transform kernel set is determined based on a histogram of occurrence (HoC) of intra prediction modes in neighboring samples of the current block. Based on the coded information of the current block, a residual block of the current block is calculated according to at least the first transform kernel set. The current block is reconstructed based on the residual block and the intra prediction of the current block.

An apparatus of video decoding is provided. The apparatus includes processing circuitry. The processing circuitry is configured to receive a video bitstream including coded information of a current block and a template of the current block in a current picture. The template of the current block includes samples adjacent to the current block, and the current block includes a first subblock and a second subblock adjacent to the first subblock. The processing circuitry is configured to determine a template of the second subblock based on at least one of (i) the template of the current block and (ii) reconstructed samples of the first subblock. The processing circuitry is configured to reconstruct the second subblock based on the determined template according to intra template matching prediction (intraTMP).

The invention relates to the technical field of computer vision, in particular to a text-guided creativity and time consistency-oriented video coloring method and system. By introducing a time deformable attention block, according to the position and shape change dynamic state of an object in a video frame, dynamic features of an instance are captured in the time dimension, so that feature representation consistency is kept, and color flickering and shifting in the coloring process are effectively prevented; semantic representation of a text noun concept is adjusted through a cross-modal pre-fusion module, mask cross attention in the module is used for enhancing understanding of the model on the noun concept and instance perception, and color distribution accuracy is improved; the global structure of the colored video is maintained through gray level video information introduced in the video decoding process; a cross-fragment fusion mechanism is introduced during reasoning, so that the long-term consistency of video coloring is maintained; through text guidance, the user can color the video according to own demands and creativity.

Methods and apparatuses for video decoding and video encoding and a method of processing visual media data are disclosed. The apparatus for video decoding includes processing circuitry that receives coded information indicating that a current block in a current picture is coded with a decoder-side intra mode derivation (DIMD) mode. A template of the current block includes reconstructed samples in the current picture and is adjacent to the current block. The template includes one of a left template and a top template. The processing circuitry determines a filter type from a plurality of filter types associated with the one of the left template and the top template, applies the DIMD mode to the template based on the determined filter type to determine one or more intra prediction modes for the current block, and reconstructs the current block according to the one or more intra prediction modes.

Aspects of the disclosure provide methods and apparatuses for video encoding / decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. The processing circuitry extracts, from a bitstream, a signal indicative of an application of a template matching based block vector refinement for coding a current block in a current picture referencing (CPR) mode. The processing circuitry derives a first refined block vector associated with the current block according to the template matching based block vector refinement. The first refined block vector includes a first block vector refinement offset applied on a first block vector associated with the current block. The processing circuitry reconstructs the current block according to a first reference block in a same picture as the current block, the first reference block being indicated by the first refined block vector.

The invention discloses an RTSP video stream AI processing method and system based on a tsn network, which realize end-to-end deterministic transmission and processing, guarantee low-delay and low-jitter transmission of a video stream from a source to an AI unit through a TSN, meet the industrial-grade real-time requirement and perform efficient edge AI processing. The problem that a traditional CPU is low in efficiency or a GPU is high in power consumption is solved, real-time analysis of the high energy efficiency ratio and high system integration are achieved, network transmission, video decoding, AI reasoning and result visualization are integrated into a single embedded platform, and hardware complexity and cost are reduced.

Aspects of the disclosure provide methods and apparatuses for video encoding / decoding. In some examples, an apparatus for video decoding includes processing circuitry. For example, the processing circuitry decodes prediction information of a current block from a coded video bitstream. The prediction information indicates that a prediction of the current block is at least partially based on an inter prediction. Then, the processing circuitry reconstructs at least a sample of the current block as a combination of a result from the inter prediction and neighboring samples of the block that are selected based on a position of the sample.

An example apparatus for decoding media data includes: a memory configured to store video data; and a processing system comprising one or more processors implemented in a circuit, the processing system configured to instantiate a first number of video decoder instances to be executed by the processing system; determining an attribute of the plurality of video media streams, the attribute indicating that each of the plurality of video media streams is available for stream selection; selecting the second number of input video media streams from the plurality of video media streams according to the determined attributes of the second number of input video media streams; executing the video decoder instance to decode the second number of input video media streams to form a second number of decoded video media streams; and outputting data of the second number of decoded video media streams.

The invention discloses a Web end video monitoring distributed decoding method and system, and belongs to the technical field of network video playing. The method comprises the following steps of: actively initiating WebSocket connection by a browser end through a local loopback address port (127.0. 0.1: 19022), and detecting whether a distributed decoding program is installed in a user terminal or not; calling a local FFmpeg library by a distributed decoding program, decoding a video stream in real time by utilizing a terminal CPU (Central Processing Unit), and converting decoded video key frames into an image format originally supported by a browser frame by frame through OpenCV; the distributed decoding program packages binary data of each frame of image and an address identifier of the binary data into a WebSocket message, the WebSocket message is actively pushed to the browser, and the browser refreshes and displays the WebSocket message in a specified area of a page in real time according to the address identifier; according to the method, zero-plug-in, low-delay, cross-platform, safe and controllable Web end video decoding is realized, the server load and the network delay are remarkably reduced, and the user experience and the system compatibility are improved.

A method is disclosed for selecting a reference sample for deriving a cross-component relation model in intra prediction. In the disclosed embodiments, a video decoding device derives temporary sampling positions from neighboring samples of the current block by using characteristics of a reconstructed luma component or neighboring samples of the current block. The video decoding device evaluates and adjusts the temporary sampling positions to select final positions and derives the cross-component relation model by using samples of the final positions. The video decoding device generates chroma prediction values of the chroma component by applying the cross-component relation model to the luma component.

Provided are a video encoding method, a video decoding method, and a bitstream generating method using an identifier indicating whether a corresponding chroma component is filtered by an adaptive loop filter (ALF).SOLUTION: The video encoding method includes encoding an image to generate a bitstream. In the bitstream, a first syntax element is configured to indicate whether the first chromaticity component is filtered with an adaptive loop filter (ALF), and a second syntax element is configured to indicate whether the second chromaticity component is filtered with the ALF.SELECTED DRAWING: Figure 5

A video encoding and decoding method and apparatus for training models with quantization constraint optimization. The method obtains training video frames and extracts feature maps using a video encoding and decoding model. Scale parameter values are determined for each feature element and mapped to obtain scale parameter mapping values within a preset range. Constraint reference mapping values are obtained with distances to rounding boundary values greater than corresponding scale parameter mapping values. A quantization constraint loss is determined based on differences between scale parameter mapping values and constraint reference mapping values. Model parameters are updated using this quantization constraint loss to obtain a trained video encoding and decoding model with improved quantization performance and compression efficiency.

To provide a method and apparatus for improving image coding efficiency.SOLUTION: An image decoding method includes the steps of: acquiring a sign data hiding enable flag; acquiring a transform skip residual coding (TSRC) enable flag based on the sign data hiding enable flag; acquiring residual information for a current block based on the TSRC enable flag; deriving a residual sample of the current block based on the residual information; and generating a reconstructed picture based on the residual sample. The sign data hiding enable flag is a flag indicating whether sign data hiding is enabled, the TSRC enable flag is a flag indicating whether TSRC is enabled, and the TSRC enable flag is acquired based on the sign data hiding enable flag having a value of zero.SELECTED DRAWING: Figure 10

Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of video processing includes performing a conversion between a video and a bitstream of the video. The bitstream includes network abstraction layer (NAL) units for multiple video layers according to a rule. The rule defines a sub-bitstream extraction process by which NAL units are removed from the bitstream to generate an output bitstream, and specifies to remove all supplemental enhancement information (SEI) NAL units that contain a non-scalable-nested SEI message with a particular payload type, responsive to a list of NAL unit header layer identifier values in an output layer set (OLS) with a target OLS index not including all values of NAL unit header layer identifiers in all video coding layer (VCL) NAL units in the bitstream that is input to the sub-bitstream extraction process.