44results about How to "Improve codec efficiency" patented technology

The invention discloses a virtualized coding method and device based on a hardware video image coding and decoding system, the hardware video image coding and decoding system comprises a plurality of physically isolated video coding and decoding devices, each video coding and decoding device comprises a plurality of video coding and decoding cores, each video coding and decoding core is bound with a coding and decoding interface, and the coding and decoding interfaces are connected with the hardware video image coding and decoding system. In a memory used by the hardware video image coding and decoding system, an independent storage space is created for each virtual machine, and the method comprises the following steps: when a coding and decoding processing message sent by the virtual machine is received, sending the coding and decoding processing message to the virtual machine; the target video code determines an address of context data of a to-be-processed video session according to the equipment mapping relation and the video mapping relation; reading the context data of the to-be-processed video session from a target storage space of the storage space according to the address of the context data of the to-be-processed video session; and coding and decoding according to the context data of the to-be-processed video session, and writing a processing result back to the target storage space.

The invention provides a semantic communication method and system for an ultra-high-definition video, and relates to the technical field of semantic communication, and the method comprises the steps: obtaining semantic features based on a to-be-coded video P frame and a channel state through employing a video P frame semantic feature extractor; based on the semantic features, obtaining four-step semantic importance by using a quadtree-based spatial domain entropy model; based on the semantic features and the four-step semantic importance, utilizing a four-way semantic feature codec to obtain the received semantic features; and reconstructing a video P frame by using a semantic information restorer and a de-noising enhancement module based on the received semantic features, the received channel state and the multi-scale reference context features. According to the method, the semantic features of the video frames are extracted and recovered by using the module constructed by the CNN, and the semantic features of the video frames are processed by using the coding and decoding module constructed by the Swinin-Transform, so that the coding and decoding efficiency is improved, the understanding ability of the model to the video content is enhanced, the high-quality video content can be better reconstructed, and the size of the model parameter is controlled.

This application proposes an image decoding method, an image encoding / decoding apparatus, and a computer storage medium. The image decoding method includes: acquiring the original motion vector of a block to be decoded; acquiring a first offset of the original motion vector using a preset motion vector thinning technique; adding the first offset to the original motion vector to obtain a thinned motion vector; acquiring a bidirectional prediction value of the thinned motion vector in response to the thinned motion vector being a bidirectional prediction motion vector; acquiring a second offset of the bidirectional prediction value using a preset prediction value thinning technique; obtaining a thinned prediction value based on the bidirectional prediction value and the second offset; and decoding the block to be decoded using the thinned prediction value to obtain a decoded block. This application can improve the efficiency of encoding and decoding.

This application provides a video image component prediction method and apparatus, and a computer storage medium. The method may include: acquiring a reference value set of a first image component of the current block; determining multiple first image component reference values ​​from the reference value set of the first image component; performing a first filtering process on the sample values ​​of the pixels corresponding to the multiple first image component reference values ​​respectively to obtain multiple filtered first image reference sample values; determining the image component reference value to be predicted corresponding to the multiple filtered first image reference sample values; determining the parameters of a component linear model based on the multiple filtered first image reference sample values ​​and the image component reference value to be predicted; performing a mapping process on the reconstructed value of the first image component of the current block according to the component linear model to obtain a mapping value; and determining the predicted value of the image component to be predicted of the current block based on the mapping value.

The embodiment of the present invention provides a method and device for encoding and decoding three-dimensional data points, which determines the maximum value of the range value of the initial block of the three-dimensional data points to be encoded in the radial distance direction, the azimuth direction and the height direction according to the position coordinates of the three-dimensional data points to be encoded, performs at least one octree division on the initial block to obtain multiple first-class sub-blocks, performs at least one quadtree division and / or binary tree division on at least one first-class sub-block in the first-class sub-blocks, and encodes the three-dimensional data points to be encoded according to the division result of the initial block. Since the range values ​​in the three directions of the initial block constructed to divide the distribution of the three-dimensional data points in space are different, the number of divisions in which the range values ​​in the three directions reach the minimum precision is different during the division process. When the direction reaches the minimum precision, quadtree division or binary tree division is then used for division until the range values ​​in the three directions reach the minimum precision, thereby reducing the number of divisions and improving the encoding and decoding efficiency.

The embodiment of the present application discloses an image encoding and decoding method, an encoder, a decoder and a storage medium. Before the encoder performs encoding processing according to the MIP mode, the encoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameter; wherein the offset parameter is used to indicate the number of right shift bits of the predicted value; and when the encoding processing is performed according to the MIP mode, the encoding processing is performed according to the offset parameter. Before the decoder performs decoding processing according to the MIP mode, the decoder uniformly modifies the initial right shift parameters corresponding to different sizes and different MIP mode numbers according to the offset parameter; wherein the offset parameter is used to indicate the number of right shift bits of the predicted value; and when the decoding processing is performed according to the MIP mode, the decoding processing is performed according to the offset parameter.

An example apparatus for encoding and decoding video data includes a memory configured to store video data and one or more processors implemented in circuitry and communicatively coupled to the memory. The one or more processors are configured to determine whether the scaling matrix can be applied to a low frequency non-separable transform (LFNST) codec block. The one or more processors are further configured to not apply the scaling matrix to the LFNST codec block based on a determination that the scaling matrix cannot be applied to the LFNST codec block. The one or more processors are further configured to encode the video data without applying a scaling matrix to the LFNST codec block.

The embodiment of the present application discloses a division method, an encoder, a decoder and a computer storage medium, the method comprising: calculating and acquiring the Morton code of the point cloud to be divided, determining the point cloud to be divided as the input point cloud of the first iteration, when performing the i-th iteration, judging whether the number of points in the input point cloud of the i-th iteration is equal to 0, when it is not equal to 0, shifting the Morton code of the input point cloud of the i-th iteration right by K bits, selecting a point from the points whose Morton code values ​​are equal after the right shift by K bits, and using the selected point to form the i-th LOD layer.

The embodiment of the invention discloses a transformation method, an encoder, a decoder and a storage medium. The method comprises the following steps: determining a prediction mode parameter of a current block; when the prediction mode parameter indicates that the current block determines an intra prediction value using matrix-based intra prediction (MIP), determining an MIP parameter; determining an intra-frame prediction value of the current block according to the MIP parameter, and calculating a prediction difference value between the current block and the intra-frame prediction value; when the current block uses low-frequency inseparable secondary transform (LFNST), determining an LFNST transform kernel used by the current block according to the MIP parameter, setting an LFNST index sequence number, and writing the LFNST index sequence number into a video code stream; and carrying out transformation processing on the prediction difference value by using the LFNST transformation kernel.

The embodiment of the invention provides an image prediction method, an encoder, a decoder and a storage medium, if a current block uses an MIP mode to determine an intra-frame prediction value of the current block, the encoder sets the value of an MIP mode parameter to indicate to use the MIP mode and writes the value into a code stream; determining an MIP mode of the current block, and determining predicted values of a luminance component and a chrominance component corresponding to the current block according to the MIP mode; and writing the MIP mode of the current block into the code stream. The decoder analyzes the code stream and determines an MIP mode parameter of the current block; if the value of the MIP mode parameter indicates that the current block uses an MIP mode to determine an intra-frame predicted value of the current block, analyzing the code stream, determining the MIP mode of the current block, and determining predicted values of a luminance component and a chrominance component corresponding to the current block according to the MIP mode; and decoding the current block according to the predicted value.

The application discloses a video decoding method, a video encoding method and a device. The video decoding method comprises the following steps: generating a weight matrix of a current block; constructing a motion information candidate list of the current block; adjusting the motion information candidate list based on a template region of the current block, and determining first motion information and second motion information of the current block; performing weighted prediction on the current block by using the weight matrix, the first motion information and the second motion information, so as to obtain a prediction value of the current block; and obtaining a decoding result of the current block based on the prediction value of the current block. The application can improve the coding and decoding efficiency.

The embodiment discloses a method and a device for video coding and decoding by utilizing meta information. In this embodiment, an image decoding device decodes compression parameters for a current block, and then generates meta-information by combining one or more of the compression parameters. Here, the meta-information includes each original compression parameter, or includes a meta-information vector generated from each compression parameter. The image decoding apparatus inputs meta-information into a deep learning-based extraction model to generate a meta-information feature vector, and then performs a decoding process on a current block using the meta-information feature vector.

The present disclosure relates generally to video coding, and in particular, to methods and systems for deriving and scaling motion vector differences (MVDs) in joint MVD scaling for composite inter prediction of video blocks and their signaling. In one example implementation, a method and video device for processing video blocks of a video stream are disclosed. For example, the method may include scaling the joint motion vector differences and quantizing the scaled motion vector differences to derive a predicted motion vector according to a pixel resolution of the predicted motion vector.

This application discloses a method, apparatus, and medium for video encoding and decoding, and a method for processing visual media data. A template region associated with a location is an aligned template region used for contextual deduction of a set of latent syntax elements for encoding the quantization transform coefficient level at that location. The set of latent syntax elements includes: a first latent syntax element for encoding a basic range level, a second latent syntax element for encoding a lower range level, and a third latent syntax element for encoding a higher range level. For a first location of a transform block, at least one context model is determined based on the first template region associated with the first location, for at least one syntax element. The at least one syntax element is decoded from the encoding information of the transform block based on the at least one context model. A first quantization transform coefficient level at the first location is determined based on the at least one syntax element.

The embodiment of the invention provides a video encoding and decoding method and device, a computer readable medium and electronic equipment. The video decoding method comprises the following steps: determining a plurality of pixel regions in a current frame based on a preset pixel region size, wherein each pixel region comprises at least one pixel; determining a skipped area in the current frame according to whether each pixel area is processed in a skipped mode or not; and generating reconstruction data corresponding to the current block according to the position relationship between the current block to be decoded and the skipping region. According to the technical scheme of the embodiment of the invention, the coding and decoding efficiency can be improved, and the coding and decoding complexity can be reduced.

The embodiment of the present application discloses a video decoding method, apparatus, computer equipment and storage medium. The method includes: receiving a video code stream; extracting an inter-frame prediction syntax element from the video code stream to determine whether to signal an ADAPTMV mode for at least one video block in the video code stream, the ADAPTMV mode refers to a single reference inter-frame prediction mode with an adaptive motion vector difference MVD pixel resolution; based on whether the ADAPTMV mode is signaled in the inter-frame prediction syntax element, determining the current MVD pixel resolution associated with the at least one video block; and, based on whether the ADAPTMV mode is signaled in the inter-frame prediction syntax element and the current MVD pixel resolution, extracting at least one MVD-related syntax element associated with the at least one video block from the video code stream, and decoding the at least one MVD-related syntax element.

The embodiment of the present application discloses an inter-frame prediction method, an encoder, a decoder and a computer storage medium. The decoder parses a code stream to obtain a prediction mode parameter of a current block; when the prediction mode parameter indicates that an inter-frame prediction value of the current block is determined using the inter-frame prediction mode, a first motion vector of a sub-block of the current block is determined; wherein the current block includes multiple sub-blocks; based on the first motion vector, a first prediction value of the sub-block and a first motion vector deviation between each pixel position in the sub-block and the sub-block are determined; according to the first motion vector deviation, a center position and a second motion vector deviation corresponding to each pixel position are determined; based on the first prediction value, secondary prediction or PROF processing is performed according to the center position and the second motion vector deviation to determine a second prediction value of the sub-block, and the second prediction value is determined as the inter-frame prediction value of the sub-block.

The embodiment of the present application discloses a coding method, a decoding method, an encoder, a decoder and a storage medium, the method comprising: determining prediction parameters of a current block, the prediction parameters comprising prediction mode parameters; when the prediction mode parameters indicate that a matrix-based intra-frame prediction MIP mode is used to determine an intra-frame prediction value for a chroma component of the current block, obtaining adjacent sampling values ​​of the current block, and determining a MIP input sampling value of the current block according to the adjacent sampling values ​​of the current block; determining a MIP prediction value of the chroma component of the current block according to the MIP input sampling value, a MIP weighting matrix and a shift parameter; filtering the MIP prediction value to determine an intra-frame prediction value of the chroma component of the current block; determining a prediction residual value of the chroma component of the current block according to the intra-frame prediction value of the chroma component of the current block; performing a low-frequency non-separable secondary transform LFNST on the prediction residual value to determine a LFNST parameter.

The embodiment of the invention provides an image prediction method, an encoder, a decoder and a storage medium, if a current block uses an MIP mode to determine an intra-frame prediction value of the current block, the encoder sets the value of an MIP mode parameter to indicate to use the MIP mode and writes the value into a code stream; determining an MIP mode of the current block, and determining predicted values of a luminance component and a chrominance component corresponding to the current block according to the MIP mode; and writing the MIP mode of the current block into the code stream. The decoder analyzes the code stream and determines an MIP mode parameter of the current block; if the value of the MIP mode parameter indicates that the current block uses an MIP mode to determine an intra-frame predicted value of the current block, analyzing the code stream, determining the MIP mode of the current block, and determining predicted values of a luminance component and a chrominance component corresponding to the current block according to the MIP mode; and decoding the current block according to the predicted value.

Methods for deriving an intra prediction mode based on an inter prediction signal are disclosed. In the present embodiments, an image decoding device determines a motion vector for a current block from a motion vector candidate list for the current block and generates an inter prediction signal for the current block based on a reference block indicated by the motion vector for the current block. The image decoding device derives an intra prediction mode for the current block based on the reference block and a template for the reference block and generates an intra prediction signal for the current block based on the intra prediction mode. The image decoding device generates a final prediction signal for the current block based on the inter prediction signal and the intra prediction signal.

Encoding or decoding syntax information associated with video information may involve identifying a codec context associated with a syntax element of a current codec unit of the video information, where the identifying occurs without using syntax elements of neighboring blocks, and encoding or decoding a syntax element of the current codec unit based on the codec context.

The embodiment of the invention provides a filtering method, a coding method, a decoding method, a filtering device, a coding device and an electronic device. The filtering method based on the neural network comprises the steps of generating an input parameter of a neural network filter based on a to-be-filtered image; the input parameters are input into a neural network filter, the neural network filter comprises a residual unit used for extracting image feature information, the residual unit comprises a plurality of residual blocks connected in sequence, and each residual block comprises a plurality of convolution layers which are arranged in parallel and have different convolution kernel sizes; the residual unit comprises different first set convolution layers and second set convolution layers which are alternately arranged; and obtaining a filtered image for the to-be-filtered image output by the neural network filter. According to the technical scheme provided by the embodiment of the invention, the filtering effect can be improved while the operation complexity of the neural network filter is reduced, so that the video coding and decoding efficiency can be improved.

Embodiments of this disclosure provide filtering, coding and decoding methods and apparatuses, a computer-readable medium, and an electronic device. A deep learning-based filtering method includes: obtaining a reconstructed image corresponding to a coded image and a quantization parameter of the coded image, the quantization parameter including at least one of a frame-level quantization parameter, a slice-level quantization parameter, and a block-level quantization parameter corresponding to the coded image; generating an input to a deep learning filter according to the reconstructed image and the quantization parameter; generating, by the deep learning filter and in response to the input, a filtered image corresponding to the reconstructed image. Technical solutions of the embodiments of this disclosure can improve a filtering effect, and thus are advantageous for improving video coding and decoding efficiency.

The application provides an image processing method, an electronic device, a storage medium and a program product. The method comprises the following steps: acquiring a pixel to be processed corresponding to an image block; filtering the pixel according to the correlation between the pixel and adjacent pixels to determine a filtered pixel; and filtering the pixel to be processed corresponding to the image block according to the correlation between the pixel and adjacent pixels. The method improves or eliminates the problem of low image processing accuracy caused by uneven pixel value distribution, and improves the coding and decoding efficiency of the image.

The invention discloses a phasor concentrator real-time data segment processing encoding and decoding method, which comprises the following steps of: determining state field decoding information and data block decoding information in a real-time data frame of a corresponding collector according to a configuration frame 1 of the collector; decoding state field data according to the state field decoding information, storing the state field data in a real-time data cache region, and copying a data block and storing the data block in the real-time data cache region according to the data block decoding information; verifying the validity of a configuration frame 2 issued by the master station, and forming a data segment mapping information table according to a verification result; and after starting to transmit the real-time data to the master station, acquiring the state field data and the data block from the real-time data cache region for processing to form a complete real-time data frame and uploading the complete real-time data frame. When the real-time data of the collector are processed, the real-time data are prevented from being completely decoded according to data measuring points; when real-time data is sent to a master station, the processes of searching according to data measuring points and complete coding are avoided; the analysis, coding and decoding efficiency of real-time data processing of the phasor concentrator is effectively improved.

The invention provides a video decoding method and device, a video coding method and device, equipment and a storage medium, and relates to the technical field of video coding and decoding. The method comprises the following steps: decoding a code stream to obtain a binary symbol string of string length information of a current string; performing reverse binarization processing on the binary symbol string according to the string length resolution of the current string to obtain string length information; and determining the string length of the current string according to the string length information. According to the invention, the length of the pixel string in the coding and decoding block can be limited to be the multiple of the string length resolution, the uniformity of the pixel string is improved, a coding and decoding end can carry out coding and decoding under the condition of memory alignment, and the coding and decoding efficiency of the pixel string is improved. Besides, in consideration of the influence of the string length resolution on string length information encoding and decoding, a binarization and anti-binarization processing method for string length information is provided, the encoding and decoding mode of the string length information under different string length resolutions is improved, and the encoding and decoding performance can be improved.

This application provides a video image component prediction method and apparatus, and a computer storage medium. The method may include: acquiring a reference value set of a first image component of the current block; determining multiple first image component reference values ​​from the reference value set of the first image component; performing a first filtering process on the sample values ​​of the pixels corresponding to the multiple first image component reference values ​​respectively to obtain multiple filtered first image reference sample values; determining the image component reference value to be predicted corresponding to the multiple filtered first image reference sample values; determining the parameters of a component linear model based on the multiple filtered first image reference sample values ​​and the image component reference value to be predicted; performing a mapping process on the reconstructed value of the first image component of the current block according to the component linear model to obtain a mapping value; and determining the predicted value of the image component to be predicted of the current block based on the mapping value.

The embodiment of the invention provides a coding and decoding method and device for a polygon mesh and a storage medium. The encoding method includes: receiving a polygon mesh, the polygon mesh including a plurality of vertices defining a plurality of faces; determining a mesh face type for at least a portion of the polygonal mesh; determining a first parameter corresponding to the surface mode according to the grid surface type; coding the first parameter according to the grid surface type; and generating a bitstream including the polygon mesh encoded according to the two-degree processing, the mesh face type, and the first parameter.

The application discloses an inter-frame prediction method and a terminal, and belongs to the technical field of video coding. The inter-frame prediction method comprises the following steps: obtaining target information; the target information comprises a prediction value derivation mode corresponding to a target image frame and / or a prediction value derivation mode corresponding to each first image block in the target image frame; and performing inter-frame prediction on each first image block based on the target information; wherein the target image frame is an image frame to be encoded, and the first image block is an image block to be encoded; or the target image frame is an image frame to be decoded, and the first image block is an image block to be decoded.