14results about How to "Improve codec performance" patented technology

The invention discloses a video decoding method, device and equipment and a storage medium, and relates to the field of video analysis, and the method comprises the steps: locally installing a target component corresponding to a media processing software platform based on a coding and decoding library of the media processing software platform, adding an executable command corresponding to the media processing software platform to a preset environment variable based on the target component; receiving a data stream address of the to-be-decoded data through the video stream processing function, and calling an executable command in a preset environment variable so as to execute a corresponding stream pulling operation according to the data stream address through the streaming media server to obtain the to-be-decoded data; and decoding the to-be-decoded data by using a preset decoding interface of the media processing software platform, and executing a corresponding video processing task based on a target video obtained after decoding. The efficient hardware decoding capability is provided through the coding and decoding library of the media processing software platform of the hardware decoding chip, the computing resources can be effectively released, and the energy consumption of the chip is reduced.

The embodiment of the invention provides a point cloud processing method and device, equipment, a storage medium and a product. The method comprises the following steps: when a to-be-coded point in a point cloud needs to be coded, setting a limit parameter of the point cloud, acquiring attribute information of the to-be-coded point in the point cloud, coding the attribute information of the to-be-coded point, and controlling a coding process according to the limit parameter; when the to-be-decoded point in the point cloud needs to be decoded, the encoding code stream of the to-be-decoded point in the point cloud and the limit parameter of the point cloud can be acquired, the encoding code stream of the to-be-decoded point is decoded, and the decoding process is controlled according to the limit parameter. According to the embodiment of the invention, the coding and decoding process of the attribute information of each point in the point cloud is controllable through the limiting parameters of the point cloud, and the coding and decoding performance of the attribute information of the point cloud is improved.

This application provides a feature map encoding and decoding method and apparatus, and relates to the field of artificial intelligence (AI)-based data encoding and decoding technologies, and specifically, to the field of neural network-based data encoding and decoding technologies. The feature map decoding method includes: obtaining a bitstream of a to-be-decoded feature map, where the to-be-decoded feature map includes a plurality of feature elements; obtaining a first probability estimation result corresponding to each feature element based on the bitstream, where the first probability estimation result includes a first peak probability; determining a first feature element set and a second feature element set from the plurality of feature elements based on a first threshold and the first peak probability corresponding to each feature element; and obtaining the decoded feature map based on the first feature element set and the second feature element set. A decoding manner of each feature element is determined based on the probability estimation result and the first peak probability corresponding to each feature element, thereby reducing encoding and decoding complexity, and improving encoding and decoding performance.

The application discloses a training method and device of a coding and decoding model, equipment and a storage medium, and relates to the technical field of computers. The method comprises the following steps: obtaining a pre-training coding and decoding model; wherein the pre-training coding and decoding model comprises a pre-training encoder and a pre-training decoder; performing pruning processing on the pre-training decoder to obtain a pruned decoder; performing encoding processing on second sample multimedia data through the pre-training encoder to obtain encoded feature data, and performing decoding processing on the encoded feature data through the pruned decoder to obtain reconstructed multimedia data; performing parameter optimization on the pruned decoder based on the difference between the reconstructed multimedia data and the second sample multimedia data to obtain a target decoder; and obtaining a target coding and decoding model according to the pre-training decoder and the target decoder. Through the stage-by-stage training mode, the application realizes a large-encoder+small-decoder coding and decoding model, and improves the performance of the coding and decoding model.

The embodiment of the invention provides a video encoding and decoding method and device, a computer readable medium and electronic equipment. The video decoding method comprises the following steps: decoding a video code stream, and determining a reference weight derivation function used by a coding block adopting a weighted prediction mode according to code stream information obtained by decoding; calculating a reference weight corresponding to the coding block according to the reference weight derivation function; determining a weight matrix corresponding to the coding block according to the reference weight; and performing weighted prediction according to the weight matrix to obtain a predicted value corresponding to the coding block. According to the technical scheme provided by the embodiment of the invention, the coding block can adaptively select the reference weight derivation function, and indication is carried out through the code stream information, so that a more accurate weight matrix can be derived for different coding blocks, and the coding and decoding performance can be improved.

The application discloses a brain-computer interaction device with steady-state visual stimulation function and a brain-computer interaction method thereof, and comprises four parts of a control module (1), a partitioned backlight module (2), a liquid crystal module (3) and an electroencephalogram interaction module (4). Wherein, the output end of a partitioned backlight control circuit of the control module is connected with an LED driving circuit of the partitioned backlight module, the output end of a liquid crystal panel control circuit of the control module is connected with a liquid crystal driving circuit of the liquid crystal module, and the input end of the control module is connected with the output end of a signal processing module in the electroencephalogram interaction module. The application combines the steady-state visual stimulation brain-computer interaction and the partitioned backlight liquid crystal display technology, generates different frequency and phase coding space-time coding visual stimulation through the interaction interface based on the steady-state visual stimulation for different time and space, and improves the accuracy of the brain-computer interaction and the information transmission rate.

A method of processing video data performed by an encoder is provided. The method comprises the following steps: acquiring a plurality of original images from original video data; a plurality of reference images are obtained, each reference image in the plurality of reference images corresponds to an original image in original video data, and the resolution of the plurality of reference images is lower than the resolution of the plurality of original images in the original video data; performing up-sampling on the plurality of reference images to obtain a plurality of up-sampled reference images; a weighted filter is obtained to reduce overall error between the plurality of up-sampled reference images and corresponding original images by determining a weighted mapping for each reference image using a weighted mapping function, the weighted mapping comprising a plurality of weights mapped to respective spatial locations of the plurality of up-sampled reference images, and determining a filter that is applied to the plurality of up-sampled reference images by respective weighted mappings to obtain a filtered up-sampled reference image such that the filter is applied to different spatial positions of the plurality of up-sampled reference images with different weights; performing inter prediction on a plurality of blocks of the first image based on a plurality of reference blocks in one or more of the plurality of up-sampled reference images; and encoding the video data encoding information into a code stream, the encoding information comprising information on the weight mapping function and / or the filter to be used at a decoder, where the method further comprises applying the weight filter to the plurality of upsampled reference pictures prior to performing the inter prediction, and applying the weight filter to the plurality of upsampled reference pictures prior to performing the inter prediction. Or during the inter prediction, applying the weighting filter to an up-sampled reference block of the plurality of reference pictures.

The invention provides a video decoding method and device, a video coding method and device, equipment and a storage medium, and relates to the technical field of video coding and decoding. The method comprises the following steps: decoding a code stream to obtain a binary symbol string of string length information of a current string; performing reverse binarization processing on the binary symbol string according to the string length resolution of the current string to obtain string length information; and determining the string length of the current string according to the string length information. According to the invention, the length of the pixel string in the coding and decoding block can be limited to be the multiple of the string length resolution, the uniformity of the pixel string is improved, a coding and decoding end can carry out coding and decoding under the condition of memory alignment, and the coding and decoding efficiency of the pixel string is improved. Besides, in consideration of the influence of the string length resolution on string length information encoding and decoding, a binarization and anti-binarization processing method for string length information is provided, the encoding and decoding mode of the string length information under different string length resolutions is improved, and the encoding and decoding performance can be improved.

This application provides a video encoding method, a video decoding method, an apparatus, a device, and a storage medium, relating to the field of video encoding and decoding technology. The method includes: for a current block within a video frame, acquiring at least one first matching block; acquiring at least one second matching block based on the at least one first matching block, wherein at least one first matching block corresponds to a second matching block with a quantity greater than or equal to one, and the second matching blocks are encoded blocks that match the first matching blocks based on a second prediction mode; determining a prediction block corresponding to the current block from the at least one first matching block and the at least one second matching block; and encoding the current block based on the prediction block corresponding to the current block. The above method improves the accuracy of intra-frame prediction, thereby improving the performance of video encoding and decoding.

The invention discloses a dynamic frequency modulation method for video coding and decoding, an architecture thereof, equipment and a medium, and relates to the technical field of video coding and decoding. The method comprises the following steps: performing performance test processing according to a preset frequency modulation gear to create an optimal frequency index table; at least one to-be-processed video is received, and video information of the to-be-processed video is acquired and a video processing mode is determined under the condition that the dynamic frequency modulation function is enabled; recording or updating the received video information to the node information of the corresponding user node; acquiring node information of each user node; performing matching processing according to the information of each node and the optimal frequency index table, and determining the user frequency of each user node; determining the maximum frequency value in the plurality of user frequencies as a target frequency; and the hardware coding and decoding module performs coding and decoding processing on the video to be processed according to the target frequency and the video processing method. The working frequency of the video coding and decoding hardware module can be dynamically adjusted, so that the power consumption is reduced, and the coding and decoding performance is improved.

The embodiments of the present application disclose a coding method, a decoding method, an encoder, a decoder and a storage medium. When a prediction mode parameter indicates that a geometric partitioning mode GPM is used to determine an inter-frame prediction value of a current block, two partitions of the current block are determined; the motion information of the two partitions is determined from a motion information candidate list, a first motion information index value is set to an index sequence value of the motion information of the first partition in the motion information candidate list, and a second motion information index value is set to an index sequence value of the motion information of the second partition in the motion information candidate list; the first motion information index value and the second motion information index value are binarized respectively to obtain a first symbol string and a second symbol string; different context probability models are used to entropy encode the first binary symbol of the first symbol string and the second symbol string respectively; and a preset model is used to entropy encode the binary symbols other than the first binary symbol in the first symbol string and the second symbol string respectively.

The present application provides a video encoding method, a video decoding method, a device, a system, and a storage medium. A secondary transform coefficient of a current block is obtained by decoding a code stream, the secondary transform coefficient being a transform coefficient formed by an encoding terminal performing secondary transform on a residual block of the current block; if it is determined that the use of a weighted prediction mode is allowed for an intra-frame prediction mode of the current block, a target transform kernel corresponding to the current block is selected from transform kernels of preset M types of secondary transform, M being a positive integer greater than 1; inverse secondary transform is performed on the secondary transform coefficient by using the target transform kernel to obtain a primary transform coefficient of the current block; and inverse primary transform is performed on the primary transform coefficient to obtain the residual block of the current block. That is, in the present application, a target transform kernel corresponding to a current block is selected from transform kernels of preset M types of secondary transform, instead of always using a transform kernel corresponding to a certain mode, so that the flexibility of selecting the transform kernel is improved, the transform effect is improved, and the overall encoding and decoding performance is improved.

The embodiment of the application discloses a coefficient coding and decoding method, an encoder, a decoder and a computer storage medium, which are applied to the decoder, and the method comprises the following steps: based on the position of a to-be-decoded quantization coefficient, a first context model adaptive binary arithmetic coding mode is used to analyze a code stream to obtain the value of non-zero identification information; in the case that the value of the non-zero identification information is a first value, a second context model adaptive binary arithmetic coding mode is used to analyze the code stream to obtain the value of X preset identification information; in the case that the value of the Xth preset identification information is the first value, the target order of the exponential golomb code is determined, and the code stream is analyzed by using the exponential golomb decoding algorithm of the target order to obtain the residual value of the reconstructed quantization coefficient absolute value; and the value of the non-zero identification information, the value of the X preset identification information and the residual value of the reconstructed quantization coefficient absolute value are used to determine the reconstructed quantization coefficient absolute value corresponding to the quantization coefficient position.