2962 results about "Video decoding" patented technology

A video decoding method, including: obtaining a first index by decoding a bitstream, where the first index is used to indicate a first combination, the first combination includes a weight derivation mode and K prediction modes, and K is a positive integer greater than 1; determining a first weight derivation mode and K first prediction modes included in the first combination according to the first index; and obtaining a prediction value of a current block by predicting the current block according to the first weight derivation mode and the K first prediction modes.

The invention discloses a gesture action video generation method and device based on fine-grained semantic description, and the method comprises the steps: carrying out the preprocessing and data enhancement of an original video, and constructing sample data composed of a video frame and a fine-grained semantic description text used for describing a gesture action in the video frame; constructing a training architecture consisting of a video coding module, a text coding module, a noise reduction generation module and a video decoding module; a loss function is constructed based on the difference between added noise in the video coding module and de-noised noise in the de-noising generation module, only parameters of the de-noising generation module are optimized by using the loss function, and a video generation model is formed by the text coding module, the de-noising generation module and the video decoding module after the parameters are optimized; and generating a gesture action video based on the input random vector and the fine-grained semantic description text for describing the gesture action by utilizing a video generation model. In this way, a high-quality general digital human video containing gesture actions is generated based on the fine-grained semantic description text.

A method for video decoding is provided. The method includes obtaining, from a video bitstream, a coding unit in a current picture, wherein the coding unit comprises a luma block and at least one chroma block; and in response to a determination that reconstructed luma samples in the luma block are not to be down-sampled: determining one or more cross-component prediction models based on a luma filter, wherein the one or more cross-component prediction models comprise a convolutional cross-component model (CCCM); obtaining, based on the luma filter, at least one reconstructed luma sample in the luma block that corresponds to a chroma sample in the at least one chroma block; and applying at least one of the one or more cross-component prediction models to the at least one reconstructed luma sample to predict the chroma sample.

Systems, methods, and instrumentalities are disclosed for template based cross component linear model / multimode linear model (CCLM / MMLM) adjustment. In an example, a device, such as a video decoding device, or a video encoding device, may obtain a prediction model for predicting a coding block. The device may select an adjustment model, from multiple adjustment models, for adjusting the prediction model. The device may adjust the prediction model based on the selected adjustment model. The device may process (e.g., encode and / or decode) the coding block based on the adjusted prediction model.

Systems, methods, and instrumentalities are disclosed for video encoding and / or video decoding using artificial neural networks (e.g., convolutional neural networks or recurrent neural networks), attention, and / or attention with spatial attributes. For example, an apparatus may be configured to perform one or more of the following: obtaining a context block, a current block, and a latent vector associated with the context block; performing at least one convolution on the context block, the reference block, and the latent vector; generating motion flow data associated with the current block based on the at least one convolution; or generating a bitstream the comprises an indication of the motion flow data. The motion flow data may be quantized. The generated bitstream may comprise an indication of the quantized motion flow data.

Methods for video decoding and encoding, apparatuses and non-transitory computer-readable storage media thereof are provided. In one method for video decoding, a decoder may obtain a plurality of prediction blocks based on a current inter coding block; obtain a current template of the current inter coding block, wherein the current template comprises a plurality of reconstructed samples neighboring to the current inter coding block; obtain a plurality of template predictions of the current template respectively corresponding to the plurality of prediction blocks of the current inter coding block; obtain at least one filter based on the plurality of template predictions and the current template; and obtain a filtered block based on the at least one filter and the plurality of prediction blocks.

Methods for video decoding and encoding, apparatuses and non-transitory computer-readable storage media thereof are provided. In one method for video decoding, a decoder may obtain a current coding unit (CU) that is coded based on Intra Block Copy (IBC) mode combined with Geometric Partitioning Mode (GPM). Additionally, the decoder may obtain from at least one of regular merge candidates, Template Matching (TM) refined merge candidates, or merge candidates with block vector difference (MBVD candidates), a first IBC merge prediction and a second IBC merge prediction. Further, the decoder may obtain a prediction for the current CU based on the first IBC merge prediction and the second IBC merge prediction.

The present disclosure provides a method for video decoding, comprising: obtaining first predicted sample values of a current block coded with Extrapolation Filter-based intra Prediction (EIP) mode; obtaining second predicted sample values of the current block coded with at least one of an intra prediction mode and an inter prediction mode; obtaining final predicted sample values of the current block based on the first predicted sample values and the second predicted sample values; and reconstructing the current block based on the final predicted sample values.

The invention relates to the technical field of video decoding, in particular to a fast decoding transmission method and system for a video live broadcast image. The method comprises the following steps: acquiring a video live broadcast picture stream; performing image group division on the video live broadcast image flow to generate image group images; analyzing an inter-frame relationship of the picture grouping images, defining priorities of the picture grouping images according to the inter-frame relationship, and generating decoding priority mark data; entropy data fragmentation is carried out on the picture grouping images, and a picture basic entropy slice and a picture increment entropy slice are generated; stage picture transmission is carried out on the picture grouping images based on the picture basic entropy slice and the picture increment entropy slice, and an image streaming preloading strategy is generated; and performing terminal transmission feedback on the picture grouping images by using an image stream type preloading strategy to obtain terminal transmission feedback data. According to the invention, through optimization of video picture grouping, priority scheduling, bandwidth management, decoding acceleration and fault-tolerant reconstruction, the rapid decoding transmission performance of the video live broadcast image is improved.

A road traffic event analysis method and system, and a device and a medium. The traffic event analysis method comprises: decoding and coding the current monitoring video, so as to obtain a target video picture (S102); calibrating the target video picture, so as to obtain a calibrated video picture (S103); performing preliminary analysis on the calibrated video picture, so as to obtain a preliminary analysis result (S104); determining state change data on the basis of the preliminary analysis result (S105); compiling statistics on a traffic flow, so as to determine peak time periods and plateau time periods of a road traffic site (S106); performing preliminary detection on frame scenes on the basis of pre-determined detection parameters corresponding to the peak time periods and the plateau time periods, so as to obtain a preliminary detection result (S107); excluding congestion events from the preliminary detection result (S108); and tracking targets, and determining motion state features, so as to obtain a final detection result and report same (S109). The scale of a traffic accident event triggered in the detection result and the statistical result are used for adjusting the detection parameters corresponding to the peak time periods and the plateau time periods. The traffic event analysis method can improve the detection accuracy of road traffic events.

ObjectA video coding and decoding apparatus that can enhance coding efficiency is provided.SolutionA video decoding apparatus includes an OOB determination unit configured to determine whether a reference block is a target of OOB processing by comparing coordinates of the reference block with coordinates of a picture, and an OOB mask derivation unit configured to derive mask data indicating whether a pixel is available by comparing coordinates of the pixel included in the reference block with the coordinates of the picture. The OOB determination unit determines whether the reference block is the target of the OOB processing based on presence or absence of processing to be applied to a reference picture including the reference block.

A method for video decoding is provided. The method includes obtaining, from a bitstream, a coding unit in a current picture, the coding unit including a luma block and a chroma block; obtaining a reconstructed luma sample in the luma block; determining one or more cross-component prediction models based upon a block size, the block size being a size of the luma block or a size of a reconstructed neighbouring block located on a top of or a left of the luma block; and applying at least one of the one or more cross-component prediction models to at least the reconstructed luma sample to predict a chroma sample in the chroma block.

A method and an apparatus are disclosed for video coding using an improved inloop filter for chroma components. In the disclosed embodiments, a video decoding device performs obtaining a reconstructed frame that includes luma samples and chroma samples, subsequently obtaining a scale value representing a resolution difference between the reconstructed frame and an original frame. Responsive to the reconstructed frame having a resolution that is based on the scale value and is less than a resolution of the original frame, the video decoding device generates an upsampled chroma frame by inputting the luma samples and the chroma samples into a cross component resampling inloop filter (CC-RIF).

The invention discloses a control management method and system for an LED backlight source, and relates to the technical field of backlight source control. The video decoding module is used for analyzing an input video signal and extracting an image brightness distribution entropy value and a color gamut coverage degree; the backlight partition regulation and control unit is used for dynamically adjusting a backlight partition topological structure; the prediction compensation module is used for generating a future frame brightness change trend and correcting a current backlight driving signal by using a feedforward compensation coefficient; the photoelectric sensing array is used for measuring the reflection characteristic of ambient light in real time; and the collaborative dimming controller is used for acquiring the type information of the playing equipment and loading a differential dimming strategy library. By dynamically analyzing video content characteristics, ambient light conditions and equipment information source types and adjusting a backlight partition structure and brightness output in real time, the HDR scene switching response speed is remarkably improved, the dark field gray scale identification degree is enhanced, backlight instantaneous peak power consumption is reduced, the non-linear brightness requirement of streaming media content is met at the same time, and the real-time performance of the system is improved. And better visual experience is provided for the user, and energy consumption optimization is realized.

A video encoding method, a video decoding method and apparatus, and a storage medium are provided. The decoding method includes that: angular accuracy corresponding to the intra prediction mode candidate list is determined, the first angular accuracy is used for indicating a search range of an angular prediction mode in the intra-frame prediction mode candidate list; the intra prediction mode candidate list is constructed on the basis of the first angular accuracy; and the prediction for the current block is performed on the basis of the constructed intra prediction mode candidate list.

Methods for video decoding and encoding, apparatuses and non-transitory storage media are provided. In one decoding method, the decoder obtains a geometric partition mode (GPM) blending area index at a certain level associated with a picture, where the GPM blending area index indicates a blending area width from a set of blending area widths. The decoder obtains one or more weighting values that are used to blend prediction samples of a GPM mode based on the blending area width indicated by the GPM blending area index. Furthermore, the decoder obtains a GPM predictor based on the one or more weighting values.

The invention relates to the technical field of force operation robots, in particular to a VR video return system and method based on a bionic operation robot, and the system comprises a bionic operation robot end and a VR end, and the bionic operation robot end comprises a video collection module, a video preprocessing module, a video coding module and a communication transmission module. The VR end comprises a communication receiving module, a video decoding module and a VR display and interaction module. According to the immersive experience provided by the VR technology, an operator can observe the working environment and the operation target of the bionic operation robot more intuitively and accurately, so that an operation instruction is sent more accurately. For example, in the operation of the bionic robot, an operator can see the detailed situation of the transformer substation through VR video return, and the bionic operation robot is accurately controlled to carry out fine operation.

The embodiment of the invention provides a video coding method and device and a video decoding method and device, and relates to the technical field of video coding and decoding. Comprises: obtaining a target image block; segmenting the target image block into a first sub-image block and a second sub-image block based on the texture edge in the target image block; obtaining a first prediction block of the first sub-image block and a second prediction block of the second sub-image block; combining the first prediction block and the second prediction block to obtain an initial prediction block, and obtaining a boundary line of the first prediction block and the second prediction block in the initial prediction block; determining the filtering intensity of each pixel point in the initial prediction block according to the minimum distance from the pixel point to the boundary line; filtering each pixel point in the initial prediction block based on the filtering intensity of each pixel point to obtain a fused prediction block; calculating the residual error of the target image block and the fusion prediction block to obtain residual error data; and generating coded data of the target image block according to the residual data. Some embodiments of the invention are used for solving the problem that boundary pixels of a synthesized prediction block are not smooth.

The present invention provides a video quality detection method, device, equipment and medium, which relates to the field of digital media technology. The method obtains a marked video by superimposing marking information on each frame image in the original video, and plays the marked video, then collects each frame image during the playback process as a test image, and finally detects whether there are mosaics, flower screens, static frames, frame skipping, freezes, fast forwards and rewinds in the video decoding process based on the test image, thereby detecting the video quality. The video quality detection method provided by the present invention does not need to rely on video player software to detect video quality, so that the detection result is true and reliable, and accurate and efficient detection of video quality is achieved.

A video decoding method and a video decoding apparatus are configured to decode video. To efficiently code residual blocks obtained from block-based motion compensation, a video encoding apparatus and the video decoding apparatus divide a relevant residual block of a current block into two subblocks in a horizontal or vertical direction and encode one residual subblock alone out of the two residual subblocks.

Disclosed herein is a video decoding method including: obtaining a transform skip mode flag indicating whether transform / inverse transform is skipped in a current block; when transform / inverse transform is skipped in the current block according to the transform skip mode flag, determining that secondary transform / inverse transform is skipped in the current block; and when transform / inverse transform is not skipped in the current block according to the transform skip mode flag, obtaining a transform matrix index for secondary transform / inverse transform of the current block and, determining whether secondary transform / inverse transform is skipped in the current block based on the transform matrix index.

An intra frame prediction method and apparatus based on interpolation filtering, a video encoding method and apparatus, a video decoding method and apparatus, and a system. The intra prediction method based on interpolation filtering comprises: determining, based on a determined filtering window and a reconstructed value of a sample in a reconstruction area neighboring to a current block, a filtering coefficient used to perform interpolation filtering on the current block; and performing interpolation filtering based on a sample value of a reference sample neighboring to a current sample and the filtering coefficient, to determine a predicted value of the current sample.

The invention relates to the technical field of image processing, and further relates to a video decoding and unreal engine rendering method based on GPU full-link zero copy, which comprises the following steps of: 1, performing hardware decoding on an input video code stream on a GPU, and constructing a motion vector description buffer region for storing compressed domain motion vector information according to a macro block sequence; step 2, reading the motion vector description buffer area on the GPU through a calculation shader, and generating dynamic special effect control buffer areas in one-to-one correspondence with the macro blocks; and step 3, in a post-processing material of the unreal engine rendering module, taking the shared video texture resource as an input texture, and outputting a video picture. On the premise of not depending on a host processor and not excessively occupying video memory bandwidth, unified management of pixel data and motion data is achieved, delay is remarkably reduced, and special effect stability and direction consistency are improved.

A video decoding method includes: determining first motion information of a current block; refining the first motion information based on motion information of a reference picture of the current block to obtain second motion information of the current block; and determining a prediction value of the current block based on the second motion information.

A training method, a training device, methods for video decoding and encoding, apparatuses and non-transitory computer-readable storage media thereof are provided. In one training method, a device may collect sample blocks offline, cluster the sample blocks offline into multiple block groups according to attribute information of each sample block, and train a non-separable transform core set offline based on the multiple block groups. The non-separable transform core set comprises multiple non-separable transform cores respectively corresponding to the multiple block groups.

A video decoder decodes a video from a video bitstream encoded using Versatile Video Coding (VVC). The video decoder determines a bit depth of samples of the video based on Sequence Parameter Set (SPS) syntax element sps_bitdepth_minus8 whose value is in the range of 0 to 8. The decoder further determines the size of a decoded picture buffer (DPB) based on a Video Parameter Set (VPS) syntax element vps_ols_dpb_bitdepth_minus8 whose value is in the range of 0 to 8. The decoder allocates a storage space with the determined size of the DPB, decodes the video bitstream based on the determined bit depth, and thus obtains and stores a decoded picture in the DPB. The decoder further outputs the decoded picture.

Embodiments of the present application relates to the technical field of video decoding, and provide a video en / decoding method and apparatus and a storage medium, which are beneficial to improving the en / decoding efficiency. The method comprises: acquiring complexity information of a current block in an image to be processed, wherein the complexity information of the current block is obtained by calculating at least one angular gradient of the current block according to at least pixel values of the current block; determining quantization parameters of the current block according to the complexity information of the current block; en / decoding the current block on the basis of the quantization parameters.

Methods for video decoding and encoding, apparatuses and non-transitory computer-readable storage media thereof are provided. In one method for video decoding, a decoder may obtain a motion compensated chroma sample and a plurality of motion compensated luma samples for a current inter coding block. Furthermore, the decoder may obtain an adaptive cross-component filter and obtain a filtered motion compensated chroma sample based on the adaptive cross-component filter, the motion compensated chroma sample, and the plurality of motion compensated luma samples.

A video decoding method includes obtaining a to-be-entropy-decoded syntax element in a current block by parsing a received bitstream, where the to-be-entropy-decoded syntax element includes a syntax element 1 or a syntax element 2 in the current block, obtaining a context model corresponding to the to-be-entropy-decoded syntax element, where both of a context model corresponding to the syntax element 1 and a context model corresponding to the syntax element 2 are determined from the same preset context model set, entropy decoding the to-be-entropy-decoded syntax element based on the context model corresponding to the to-be-entropy-decoded syntax element, and obtaining a reconstructed image of the current block based on the syntax element obtained by entropy decoding.

An apparatus configured to decode video data includes a shared memory and one or more processors configured to execute a plurality of video decoding cores. At least one of the plurality of video decoding cores is in communication with the shared memory, and each of the plurality of video decoding cores is configured to: track completion of decoding samples of one or more regions of a frame of video data; writing information to the shared memory, the information indicating completion of decoding the samples of the one or more regions of the frame of video data; reading the information in the shared memory before decoding a subsequent region of the video data frame; and determining whether to decode the subsequent region of the frame of video data based on the information.