755 results about "Video decoder" patented technology

A video encoder and video decoder may determine to code a block of video data using a non-directional intra mode. The video encoder and video decoder may determine a secondary transform from a secondary transform set for the block, and perform a transform process on the block of video data using the secondary transform. For non-directional intra prediction modes, the secondary transform set has a first number of transform kernels that is less than a second number of transform kernels in the secondary transform set for other blocks coded using a directional intra mode.

The application provides a signal transmission method, a video encoder and a computer readable storage medium. A computer-implemented signal transmission method performed by an encoder comprises the following steps: a processor transmits a bitstream comprising weight information for a prediction coding unit (CU) to a video decoder, the weight information indicating that if weighted prediction is enabled for a bi-prediction mode of the CU, weighted averaging for the bi-prediction mode is disabled, and the weight information indicating that if weighted prediction is enabled for at least one of a luma component and a chroma component of a reference picture of the CU, weighted averaging for the bi-prediction mode is disabled, wherein the bitstream comprises a flag indicating whether weighted prediction is enabled for at least one of the luma component and the chroma component of the reference picture, and the flag comprises a flag luma_weight_lx_flag[i] transmitted for an i-th reference picture in a reference picture list Lx, wherein x is 0 or 1.

A video decoder may be configured to receive a block of video data that was encoded using a coding mode that includes a search process in one or more reference frames. The video decoder may prefetch reference samples in a fixed search region of at least one reference frame of the one or more reference frames, and decode the block of video data using the coding mode, including performing the search process for the coding mode using the prefetched reference samples.

A video decoder is configured to determine a minimum sample value for one or more blocks of video data, the minimum sample value being greater than 0; determine a maximum sample value for the one or more blocks of video data, the maximum sample value being less than 2{circumflex over ( )}bd−1 and bd being a bit depth of samples in the one or more blocks; in response to determining that a process applied to a block of the one or more blocks of video data results in a sample value that is outside a range of the minimum sample value to the maximum sample value, clip the sample value to one of the minimum sample value or the maximum sample value to generate a clipped sample value; determine a decoded version of the block based on the clipped sample value.

Systems, methods, and instrumentalities are disclosed herein for reducing the amortization gap in end-to-end image compression and / or video compression. In examples, a video decoder may obtain an entropy model indication in video data. Based on the entropy model indication, the decoder may determine an entropy model to use for decoding a current picture. The current picture may be decoded based on the determined entropy model. In examples, the entropy model indication may indicate whether to use an updated entropy model or a prior entropy model for decoding the current picture. In examples, the entropy model indication may indicate an updated entropy model or a learned entropy model to use for decoding the current picture.

A video decoder reconstructs a current frame of a video from a video bitstream based on a reconstructed reference frame. For a block of the current frame, the video decoder identifies a reference block in the reference frame based on a motion vector associated with the block. The decoder determines the slope and offset parameters of a local illumination compensation model based on reconstructed pixels in the current frame and the reference frame. The video decoder decodes, from the video bitstream, an adjustment to the slope and updates the slope by applying the decoded adjustment. The decoder further determines an adjusted offset parameter for the local illumination compensation model. The decoder generates predicted pixels for the block by at least applying, to the reference block, the local illumination compensation model with the updated parameters.

A video decoder decodes a video from a video bitstream encoded using Versatile Video Coding (VVC). The video decoder determines a bit depth of samples of the video based on Sequence Parameter Set (SPS) syntax element sps_bitdepth_minus8 whose value is in the range of 0 to 8. The decoder further determines the size of a decoded picture buffer (DPB) based on a Video Parameter Set (VPS) syntax element vps_ols_dpb_bitdepth_minus8 whose value is in the range of 0 to 8. The decoder allocates a storage space with the determined size of the DPB, decodes the video bitstream based on the determined bit depth, and thus obtains and stores a decoded picture in the DPB. The decoder further outputs the decoded picture.

A video encoder, decoder, system, and method for coding a video are presented. The video encoder for encoding a video is configured to encode frames of the video using intra coding and differential inter-frame coding into a data stream, measure a quality loss resulting from coding loss, and signal, as side information, information on the quality loss in the data stream. Further is presented a video decoder configured to decode frames of the video using intra decoding and differential inter-frame decoding from a data stream into which the video is encoded at a coding loss, estimate information on a quality loss resulting from the coding loss, and output, at an output interface of the video decoder, meta data revealing the information on the picture loss, and / or modify a reconstructed version of the video.

A video decoding method includes obtaining a to-be-entropy-decoded syntax element in a current block by parsing a received bitstream, where the to-be-entropy-decoded syntax element includes a syntax element 1 or a syntax element 2 in the current block, obtaining a context model corresponding to the to-be-entropy-decoded syntax element, where both of a context model corresponding to the syntax element 1 and a context model corresponding to the syntax element 2 are determined from the same preset context model set, entropy decoding the to-be-entropy-decoded syntax element based on the context model corresponding to the to-be-entropy-decoded syntax element, and obtaining a reconstructed image of the current block based on the syntax element obtained by entropy decoding.

Systems, methods, and instrumentalities are disclosed herein for the field of video coding. Examples herein may focus on the most probable mode (MPM) list. In examples, a video decoder device and / or a video encoder device may generate an MPM list for a current block. The encoder and / or decoder may reorder the MPM based on a reordering process for each mode of the MPM list. The decoder may perform prediction for the current block based on the reordered MPM list. The encoder may encoder the current block based on the reordered MPM list.

The invention relates to the technical field of video acquisition coding and transmission, and provides a WebRTC-based method for reducing transmission bandwidth and improving transmission stability, which comprises the following steps: S1, a video acquisition module acquires a video frame from a camera and sends the video frame to a video coding module; s2, performing AI scene detection on the video frame to obtain a picture scene of the video frame, and performing region-of-interest ROI detection on the video frame to obtain a region-of-interest ROI range of the video frame; s3, optimizing the original funnel algorithm, setting different code rates for different video frames according to different video frame scenes, and setting different code rates for different areas of the video frames according to different ROI (Region of Interest) ranges of the video frames; s4, encoding the video frame, and sending the encoded video frame to a receiving end; s5, the receiving end decodes the received compressed video data into original video frames by using a video decoder; and S6, transmitting the decoded video frame to a rendering module for video rendering and display. The transmission bandwidth is reduced, and the transmission stability is improved.

Techniques are described for decoding video data. A video decoder may determine chroma blocks in a chroma quantization group (QG) of the video data, determine a quantization parameter predictor that is the same for each of the chroma blocks of the chroma QG, determine an offset value that is the same for two or more of the chroma blocks of the chroma QG, determine a quantization parameter value for each of the two or more of the chroma blocks in the chroma QG based on the quantization parameter predictor and the offset value inverse quantize coefficients of one or more residual blocks for the chroma blocks based on the determined quantization parameter value, generate the one or more residual blocks based on the inverse quantized coefficients, and reconstruct the chroma blocks based on the one or more residual blocks.

A video decoder may be configured to derive an initial motion vector for a current block of video data; determine whether to apply multi-iterative bi-directional optical flow (BDOF) or one-pass BDOF to the initial motion vector based on a size of the current block; in response to determining to apply the one-pass BDOF to the initial motion vector, determine a modified motion vector for the current block using the one-pass BDOF; determine a prediction block, for the current block, corresponding to the modified motion vector; and use the prediction block to determine a decoded version of the current block.

A video decoder can be configured to determine that a current block of the video data is coded in a bi-prediction inter mode; receive a first syntax element identifying a motion vector predictor from a first candidate list of motion vector predictors; receive a second syntax element identifying a motion vector difference; determine a first motion vector for the current block based on the motion vector predictor and the motion vector difference; determine a second motion vector for the current block from a second list of candidate motion vector predictors based on bilateral matching; and determine a prediction block for the current block using the first motion vector and the second motion vector.

This disclosure provides a video decoding apparatus and method for transform coefficient sign prediction on a video decoder side. The method may include: receiving, by a decoder, a bitstream comprising encoded data of transform coefficients of a transform block of a video frame; determining, by the decoder, multiple regions in the transform block, where the multiple regions include a sign prediction area for performing the sign prediction and at least one other region; parsing the bitstream, by the decoder, to obtain signs of transform coefficients associated with the multiple regions of the transform block according to a region-based order used to signal the signs of the transform coefficients; estimating, by the decoder, original signs for a set of candidate transform coefficients associated with the sign prediction area of the transform block; and updating the transform coefficients associated with the sign prediction area based on the estimated original signs.

A video dynamic mesh coding (v-DMC) decoding system, includes a de-multiplexer that receives and demultiplexes an encoded v-DMC bitstream into: a parameter set and mesh data, geometry, atlas data, and attribute video substreams. The decoding system also includes: a mesh data substream decoder; a video decoder that decodes the geometry data substream; an atlas data substream decoder; a mesh subdivision component that subdivides the one or more base meshes into one or more resampled base meshes based upon the decoded atlas data; a displacement decoder that outputs one or more displacements to verticies of the one or more resampled base meshes; a mesh position refinement component that applies the one or more displacements to the one or more resampled base meshes and outputs one or more resultant meshes; and a video decoder that decodes the attribute video substream into one or more texture images.

A method for in-loop sample offset filtering in a video decoder is disclosed. The method includes obtaining at least one statistical property associated with reconstructed samples of at least a first color component in a current reconstructed data block of a video stream, selecting a target sample offset filter among a plurality of sample offset filters based on the at least one statistical property, the target sample offset filter comprising a nonlinear mapping between sample delta measures and sample offset values, and filtering a current sample in a second color component of the current reconstructed data block using the target sample offset filter and reference samples in a third color component of the current reconstructed data block to generate a filtered reconstructed sample of the current sample.

The invention discloses a DVFS method of a hardware video decoder. The DVFS method comprises the following steps. And S31, counting the number of to-be-decoded code stream caches and the number of to-be-filled video frame caches in the video decoding system, calling a'to-be-decoded code stream cache 'and a'to-be-filled video frame cache' as a'to-be-decoded cache pair ', and representing the workload of a hardware video decoder at a moment by using the number of the'to-be-decoded cache pair' at the moment. And S32, according to the real-time working load of the hardware video decoder, determining the relative relationship between the decoding performance and the decoding demand of the hardware video decoder at the moment, and calculating the new working frequency of the hardware video decoder according to the relative relationship. And step S33, adjusting the working frequency of the hardware video decoder to a new working frequency. The method has the advantages of being small in calculation amount, good in adaptability and high in real-time performance.

A video encoder and video decoder may include a video syntax processing (VSP) engine configured to process the video data at a syntax element level, and a video pixel processing (VPP) engine configured to process the video data at a pixel level. The video encoder and video decoder may further include a controller configured to control a power of the VSP engine based on the VSP engine being idle.

A video decoder may be configured to receive a first instance of a flag for a first block, with a first value for the flag indicating that a cross-component prediction (CCP) mode is derived without signaling and a second value for the flag indicating that the CCP mode is signaled; in response to determining that the first instance of the flag is set to the first value, derive a first CCP mode for the first block; determine a first predicted chroma block for the first block using the first CCP mode; determine a decoded version of the first block based on the first predicted chroma block; and output a picture of decoded video data that includes the decoded version of the first block.

A video encoder is configured to determine to filter video data using a neural network (NN)-based filter and a fixed block size inference, and encode a flag that indicates the fixed block size inference is used for the NN-based filter. Reciprocally, a video decoder is configured to decode a flag that indicates whether a fixed block size inference is used for an NN-based filter, and filter video data using the NN-based filter based on the flag. The flag may be signaled at a sequence parameter set (SPS) level.

Systems, methods, and instrumentalities are disclosed herein for the field of video compression. In examples, a video decoder or encoded may determine that a region dependence mode is enabled for a picture. The picture may include a number of regions. Based on the determination that the region dependence mode is enabled, for a block (e.g., a current block) in region of the number of regions, whether a neighboring block is available for intra prediction may be determined based on a location of the neighboring block relative to the region. The block (e.g., current block) may be decoded or encoded based on the determination of whether the neighboring block is available for intra prediction.

A method performed by at least one processor of a video decoder includes receiving a coded video bitstream including at least one picture and one or more syntax elements encoded in accordance with multi-hypothesis arithmetic coding. The method further includes decoding each syntax element from the one or more syntax elements based on the multi-hypothesis arithmetic coding. The method further includes selecting a probability update rate from a plurality of probability update rates based on a predetermined condition, the plurality of probability update rates including a first probability update rate that is higher than a second probability update rate. The method further includes updating at least one probability model utilized in the multi-hypothesis arithmetic coding based on the selected probability update rate. The method further includes decoding at least one block in the at least one picture based on the decoded one or more syntax elements.

The invention relates to a set top box technology, and discloses a Hybrid DVB (Digital Video Broadcasting) broadcast control system and a broadcast control method, which can realize the broadcast control on a DVB signal and an IPTV (Internet Protocol Television) source on a traditional set top box and expand the processing capacity of the traditional set top box so as to adapt to more application scenes. In the scheme of the invention, a user selects an IPTV mode or a DVB mode through a remote controller; the playing control system creates a corresponding player according to the selection of a current user, and creates an audio and video playing channel, and the audio and video playing channel is associated with a bottom audio and video decoder and a DMX cache channel D0; different players start corresponding program searching processes, process corresponding data sources, restore the data sources into TS data streams and introduce the TS data streams into a DMX cache channel D0; and the CA control module associates and processes the data stream of the DMX cache channel D0 according to the program authorization information, and injects the audio and video metadata into a decoder for decoding and playing after descrambling. The method and the device are suitable for a traditional set top box of a non-Android system.

A system configured to improve audio processing by performing audio-visual target speech enhancement. The system may include a deep neural network (DNN) configured to jointly mitigate additive noise, reverberation, and / or residual echo. The DNN may include an audio encoder / decoder network, which may correspond to a convolutional recurrent network configured to process complex-valued spectrograms corresponding to the isolated audio data generated during echo cancellation. In addition, the DNN may also include a video encoder / decoder network configured to process image data, enabling the DNN to make use of audio and visual modalities to enhance a target speech signal. Thus, the DNN may include (i) audio / video encoders that generate audio / image features, (ii) a fusion network that combines the audio / image features, and (iii) audio / video decoders that generate output data. By processing these multimodal inputs, the DNN may distinguish between desired speech associated with a face represented in the image data and interfering speech.

An example apparatus for decoding media data includes: a memory configured to store video data; and a processing system comprising one or more processors implemented in a circuit, the processing system configured to instantiate a first number of video decoder instances to be executed by the processing system; determining an attribute of the plurality of video media streams, the attribute indicating that each of the plurality of video media streams is available for stream selection; selecting the second number of input video media streams from the plurality of video media streams according to the determined attributes of the second number of input video media streams; executing the video decoder instance to decode the second number of input video media streams to form a second number of decoded video media streams; and outputting data of the second number of decoded video media streams.

Embodiments of the present disclosure provide video decoding method, a video encoding method, and a video decoder. A decoding end operates as follows. A bitstream is decoded and a reconstructed block of a current block is determined. The bitstream is decoded and a first quantization parameter (QP) of the current block is determined, where the first QP is determined based on a second QP predicted through a QP prediction model. The reconstructed block of the current block is filtered with a neural network-based filter according to the first QP, to obtain a filtered reconstructed block.

Described embodiments provide systems and methods for latency optimization for cloud applications. An agent of a client device comprising an audio decoder and a video decoder can monitor video and audio data paths of an application communicating audio / video (A / V) data from one or more servers to the client device. The agent can measure, using the audio decoder and the video decoder, an A / V latency and a lip-sync status of the video and audio data paths of the application. The agent can determine, based on at least one or more measurements of the A / V latency and the lip-sync status, to enable a low latency mode for at least one of the video decoder or the audio decoder. The agent can configure, responsive to the determination, the low latency mode on one of the video decoder or the audio decoder.

A decoding method, system and storage medium are disclosed. In the method, a video decoder decodes a video from a bitstream of the video. The video decoder decodes, from the bitstream, an additional bit count M indicating a quantity of additional general constraints information (GCI) bits included in the bitstream. The additional bits include flag bits indicating respective additional coding tools to be constrained for the video, and an expected value of the additional bit count is 0, 6 or greater than 6. The decoder decodes M−6 bits that follow six flag bits in the bitstream in response to determining that the decoded additional bit count M is greater than 6. The decoder further decodes the remaining portion of the bitstream into images independent of the decoded M−6 bits and based, at least in part, upon constraints specified for the respective additional coding tools by the six flag bits.

A video encoder and video decoder are configured to perform neural network (NN)-based filtering. The video encoder and video decoder may receive a picture of video data, reconstruct the picture of video data, and perform an NN-based filter process on one or more blocks of the reconstructed picture of video data using an NN-based filter, wherein the NN-based filter includes a pair of backbone blocks, each of the pair of backbone blocks comprising a three-component one-dimensional (1D) decomposition of a multi-dimensional convolution, wherein the 1D decomposition includes at least one layer with feature channel reduction.