703 results about "Entropy encoding" patented technology

The present disclosure provides a variable-bit-rate image compression method and system, an apparatus, a terminal, and a storage medium. The variable-bit-rate image compression method includes: obtaining an initial feature map from a to-be-encoded image; quantizing the initial feature map by a dead-zone quantizer; performing entropy encoding on the quantized feature map and hyper-prior information to obtain a compressed bit-stream; performing entropy decoding on the compressed bit-stream, and recovering quantized hyper-prior information and the quantized feature map; performing inverse quantization on the quantized feature map to obtain a reconstructed feature map; obtaining a reconstructed image from the reconstructed feature map; and adjusting quantization and inverse quantization parameters according to a target bit-rate or target distortion. The present disclosure provides a precise bit-rate control solution, makes the bit-rate of the compressed bit-stream better adapt to the dynamic change of a network bandwidth, and has an extremely high actual application value.

The invention relates to the technical field of computer vision and image recognition, in particular to an image recognition method based on edge computing, which comprises the following steps: dynamically capturing an original image through a plurality of edge nodes, rejecting redundant regions through a multi-modal perception triggering mechanism, and establishing a cooperative processing group. Illumination equalization, noise filtering and resolution self-adaptive compression tasks are distributed according to dynamic role election, a standardized preprocessed image is generated, a lightweight convolutional neural network is operated in parallel to extract a dual-channel feature vector, and after entropy coding lossless compression and equipment identity tag and time sequence stamp attachment, the dual-channel feature vector is transmitted to a cloud end by adopting a lightweight encryption protocol. The cloud end analyzes the data packet, reconstructs a feature topological graph based on space-time relevance, loads a depth residual error recognition model to execute feature fusion and classification decision, feeds back and updates the weight of an edge node model, solves the problems of low collaborative efficiency and feature distortion, and improves the efficiency and precision of image recognition.

The invention discloses an extreme compressed video coding method based on an intelligent reference frame, comprising the following steps: S1, acquiring an original video stream, dividing the original video stream into frame groups according to a time sequence, each group comprising a current frame and a candidate reference frame; s2, carrying out region positioning on the candidate reference frame, extracting motion, edge and background regions, and generating a mapping graph; s3, calculating a quality score based on the mapping graph according to a motion vector, gradient change and a region overlapping rate; s4, selecting three frames with highest scores to form a reference set, and establishing an index structure; s5, predicting the current frame by using the reference set to generate a predicted frame and a residual error; s6, multi-path coding cost is calculated, and a path with the minimum cost is selected; and S7, entropy coding is carried out on the reference index, the motion vector, the residual error and the control parameter, a code stream is output, and calling information is recorded. According to the method, the compression ratio and prediction precision of video coding are improved, the image quality is maintained while the code rate is reduced, and the method is suitable for efficient transmission and storage of high-resolution videos.

Innovations in systems, methods, and software for features of a neural image or video codec are described herein. For example, a neural video encoder can receive a current video frame, encode the current video frame to produce encoded data, and output the encoded data as part of a bitstream. As part of the encoding, the encoder can determine a current latent representation for the current video frame, and encode the current latent representation using an entropy model network that includes one or more convolutional layers. As part of the encoding the current latent representation, the encoder can estimate statistical characteristics of a quantized version of the current latent representation based at least in part on a previous latent representation for a previous video frame, and entropy code the quantized version of the current latent representation based at least in part on the estimated statistical characteristics.

The invention relates to the technical field of video coding and decoding, and discloses a multi-mode large model-based generative video coding and decoding, which comprises a key frame selection module for determining a key frame by analyzing the semantic and motion characteristics of a video frame; the multi-modal semantic description generation module is used for generating semantic description according to the key frame and the video clip; the key frame compression module is used for realizing efficient compression through latent variable modeling and entropy coding; the key frame reconstruction module reconstructs a key frame by using a conditional diffusion model in combination with the compressed data and the semantic description information; and the video generation module generates a non-key frame by using the semantic description and the key frame, and reconstructs a complete video. Through key frame screening combining semantic and motion information, key frame compression and reconstruction based on a conditional latent variable diffusion model, and frame supplementation and frame insertion generation based on semantic description, efficient compression and high-quality video reconstruction can be realized under a low code rate, and the video storage efficiency and the visual quality are effectively improved.

The invention belongs to the field of image / video compression, and discloses an intelligent image compression encoder based on a conditional reversible neural network, which comprises an image enhancement module, a reversible multi-frequency fusion network RMFFN and an entropy model, and is characterized in that the image enhancement module comprises a multi-expansion channel refiner module MDCR and an expansion residual attention module RDAM; the image enhancement module optimizes input features and constructs a conditional reversible neural network by using a flow model, namely, multi-stage nonlinear mapping is realized by stacking four reversible multi-frequency fusion networks; the super-prior codec of the entropy model extracts hidden variable features by stacking multi-scale residual attention blocks, and introduces a discrete Gaussian mixture likelihood model in an entropy coding stage. According to the method, high-fidelity reconstruction is still kept at a low bit rate, and the technical problems of bit rate-distortion balance, high-frequency detail retention and calculation efficiency of a traditional method are solved.

The invention discloses a volume video intelligent coding method, and the method comprises the steps: a feature enhancement module based on view guidance is used for carrying out the feature enhancement of self-adaptive learning anchor features; the progressive entropy coding module based on context guidance is used for performing efficient compression coding on the enhanced anchor point features; the Gaussian attribute feature decoder is used for obtaining each neural Gaussian attribute; and through a neural Gaussian sputtering rendering technology, the neural Gaussian is mapped to a target visual angle, and a high-quality reconstructed viewpoint image is generated. According to the method, the scene information of each view angle is fused into the feature learning process, and the Gaussian attribute progressive coding strategy is constructed, so that the compression efficiency of the volume video is improved.

The invention provides an AI large model source network load storage optimization scheduling method and system, and relates to the technical field of intelligent scheduling, and the method comprises the steps: receiving power system source end power generation, power grid transmission, user load and energy storage equipment data, and carrying out the time label alignment and preprocessing to obtain a system feature data set; determining a current operation scene by using a multi-dimensional scene identifier of energy flow decomposition, and calling an expert model combination to generate an initial scheduling parameter; inputting the parameters into a pre-trained large language model, and generating an optimized scheduling parameter set through probability causal reasoning of variational entropy coding; constructing a differential Monte Carlo continuous sampling flow, adjusting the sampling probability density by adopting a neural optimal transmission theory, and screening parameter subsets meeting risk constraints; and according to the market price signal and the operation constraint, determining an optimal scheduling parameter to execute coordinated scheduling, and feeding back an execution result to the model to perform online iterative optimization. According to the invention, intelligent coordinated dispatching of the power system is realized, and the safety and economy of system operation are improved.

The invention relates to the technical field of voice processing, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a voice signal compression method, device, equipment and medium, which comprises the following steps: executing Fourier transform on an initial voice signal to extract an amplitude spectrum and a phase spectrum, respectively processing the amplitude spectrum and the phase spectrum to generate features, and splicing the features to obtain a compressed voice signal; the method comprises the following steps: carrying out quantization by adopting a residual vectorization mode to generate a compressed feature vector, executing entropy coding to obtain a compressed code stream, recovering the compressed feature vector at a decoding side, reconstructing a spliced feature through residual reverse quantization, enhancing feature expression through up-sampling operation, and restoring a voice signal through inverse Fourier transform. According to the method, a dual-path processing structure of amplitude features and phase features is constructed, feature compression is realized in combination with residual vectorization and entropy coding, inverse quantization and up-sampling enhancement are executed in a decoding stage, a spectrum energy structure and phase continuity are effectively reserved, and reconstruction precision and fidelity of voice signals are improved under the condition of low bit rate.

A device is configured to decode a mesh from a bitstream that includes the encoded mesh data, wherein, as part of decoding the mesh, one or more processors of the device are configured to determine, based on encoded mesh data, a base mesh that includes a set of vertices; apply the entropy decoding to first, second, and third entropy-encoded data comprises using a shared non-bypass context for entropy decoding at least one bin of each of the first truncated unary (TU) data, the second TU data, and the third TU data, where the first, second, and third TU data are included in binarized representations of syntax elements representing first and second residual values of components of normal vectors of vertices and a second residual value of a component of a normal vector of a vertex.

Decoding a current block includes receiving a compressed bitstream. A transform block of transform coefficients is decoded from the compressed bitstream. The transform coefficients are in a transform domain. The transform block is input to a machine-learning model to obtain a residual block that is in a pixel domain. The residual block is used to reconstruct the current block. Encoding a current block includes receiving a current residual block. The current residual block and a specified rate-distortion parameter are input to a machine-learning model to obtain a quantized transform block. The quantized transform block is entropy encoded into a compressed bitstream.

The invention relates to the technical field of data processing, in particular to a cloud database data compression method based on an adaptive quantization algorithm. The method comprises the following steps of: 1, regarding to-be-compressed original data in a cloud database as a matrix, dividing the data into a plurality of non-overlapped data blocks according to predefined statistical characteristics, and calculating a mean value and a variance of each data block; 2, defining the complexity of each data block, and calculating the self-adaptive quantization step length of each data block according to the mean value and variance of each data block; step 3, performing non-uniform adaptive quantization on each data item in each data block to obtain a quantized value; and 4, establishing a probability model for a quantization result of each data block, calculating a coding length, obtaining a compression ratio, and carrying out entropy coding. The quantization step size of the data block is dynamically adjusted to be matched with the local characteristic of the data, so that the quantization error is reduced, and the data recovery precision is improved.

In one implementation, we propose a scalable framework where a base layer uses NN-based methods to compress the content for computer vision machine tasks and enhancement layer(s) use traditional predictive coding for human viewing. Typically, the based layer performs NN-based analysis to generate a latent tensor, which is entropy coded to produce the base layer bitstream. By performing synthesis on the latent tensor, an inter-layer predictor can be obtained for the enhancement layer(s). Since many machine tasks are not required to be performed for each frame, the base layer may skip analysis for some frames. The synthesis may be performed at the base layer or the enhancement layer(s). In one example, the base layer compresses features optimized for a machine task and the enhancement layer(s) rely on predictive coding. In another example, the enhancement layer(s) can use traditional scalable video compression methods.

The invention discloses a dual-path three-dimensional point cloud compression reconstruction method fusing multi-scale geometric features. The method comprises the following steps: extracting representative skeleton anchor points from original point clouds by adopting farthest point sampling; predicting an octree node occupancy state by using an anchor encoder, and performing entropy coding to generate a skeleton bit stream; a skeleton condition feature encoder is introduced, probability distribution of local features is predicted by using skeleton context priori, cross-path context association is constructed, and a feature bit stream is generated; in the decoding stage, the sparse skeleton point set is restored from the skeleton bit stream, local features are recovered from the feature bit stream in combination with the skeleton structure context, fine-grained reconstruction is carried out on the point cloud through a geometric fusion point cloud up-sampling module, and finally the high-fidelity point cloud is obtained. According to the invention, the point cloud compression effect and reconstruction quality can be improved. The method can be widely applied to the point cloud field.

Provided is a method of decoding coefficients included in image data, the method including determining a Rice parameter for a current coefficient, based on a base level of the current coefficient; parsing coefficient level information indicating a size of the current coefficient from a bitstream by using the determined Rice parameter; and identifying the size of the current coefficient by de-binarizing the coefficient level information by using the determined Rice parameter.

The invention provides a voice reconstruction method and system based on entropy coding residual quantization and frequency spectrum restoration, and relates to the technical field of artificial intelligence voice signal processing, and the method comprises the steps: obtaining an original voice waveform, inputting the voice waveform into a neural voice coding and decoding model, firstly entering a coder to map the input voice waveform into acoustic potential representation, and then entering a frequency spectrum restoration model; performing residual quantization on the acoustic potential characterization layer by layer through a residual vector quantization module, introducing a gating-based dynamic layer number selection mechanism and entropy regularization constraint, enabling bits to be adaptively distributed among different voice segments, reconstructing reconstructed acoustic features of the potential characterization, inputting the reconstructed acoustic features into a decoder, restoring the reconstructed acoustic features into a time domain waveform, and outputting the time domain waveform. And mapping to a logarithmic magnitude spectrum domain through a spectrum repairing module, predicting a residual error in the logarithmic magnitude spectrum domain and performing confidence gating fusion to obtain a complex spectrum, and outputting after time domain synthesis to obtain reconstructed speech. According to the invention, high fidelity, intelligibility and transmission reliability of the voice can be considered at an extremely low bit rate.

The present application provides a data encoding and decoding method and related devices, and relates to the field of data processing. In the encoding method, side information feature extraction is performed on a first feature map of current data, and then quantization processing is performed to obtain a first quantized feature map. Entropy encoding is performed based on the first quantized feature map to obtain a first bitstream of current data. A scaling coefficient is obtained based on the first quantized feature map, and scaling processing is performed on a second feature map based on the scaling coefficient, and then quantization processing is performed to obtain a second quantized feature map. Scaling processing is performed on a first probability distribution parameter based on the scaling coefficient to obtain a second probability distribution parameter, and then entropy encoding is performed on the second quantized feature map based on the second probability distribution parameter to obtain a second bitstream of current data. The second feature map and the first probability distribution parameter are scaled by using the same scaling coefficient so that the degree of coincidence between the second probability distribution parameter and the second quantized feature map is higher, thereby improving the encoding accuracy of the second quantized feature map.

The embodiment of the invention provides a Gaussian point cloud rendering method and device, equipment and a storage medium, and relates to the technical field of computer vision. The method comprises the following steps: acquiring pixel points of foreground targets in two corresponding key frames, generating a double-view-angle Gaussian point cloud based on the pixel points, quantifying double-view-angle Gaussian parameters of the double-view-angle Gaussian point cloud based on different rate-distortion coefficients to obtain quantized Gaussian parameters corresponding to each rate-distortion coefficient, and obtaining the target foreground target in the two key frames according to the quantized Gaussian parameters of the double-view-angle Gaussian point cloud and the quantized Gaussian parameters of the double-view-angle Gaussian point cloud. At least entropy coding is carried out on the quantized Gaussian parameter to obtain a coded Gaussian parameter; and determining a target rate-distortion coefficient according to the definition requirement, selecting a coding Gaussian parameter corresponding to the target rate-distortion coefficient as a target coding Gaussian parameter, and sending at least one target coding Gaussian parameter corresponding to each dual-view sequence to a decoding end. The frame extraction operation is performed on the video frame, so that the data volume can be reduced. Secondly, quantitative Gaussian parameters corresponding to different definitions are obtained according to different rate distortion coefficients, and balance of data transmission and rendering quality is achieved.

The invention relates to the technical field of machine learning, and discloses a feature disassembly and compression method and device, equipment and a storage medium, and the method comprises the steps: obtaining an initial feature of to-be-predicted image data, determining an expert activation weight corresponding to a downstream prediction task based on a hybrid expert network, the initial features are processed through a plurality of expert networks in the hybrid expert network to generate disassembled features, the plurality of expert networks are networks constrained through a low-rank matrix, the disassembled features are quantized to generate quantized features, entropy coding is carried out on the quantized features through a hyper-prior network, and compressed features are obtained. According to the method, the expert activation weight is dynamically adjusted along with task requirements, different task scenes are adapted, initial features are disassembled based on a plurality of expert networks, task irrelevant information is explicitly stripped, task key features are reserved, redundant data volume is reduced, quantized coding is performed on disassembled feature input, code stream self-adaption is realized, and bandwidth occupation is reduced.

Variable width interleaved coding for graphics processing is described. An example of an apparatus includes one or more processors including a graphic processor; and memory for storage of data including data for graphics processing, wherein the graphics processor includes an encoder pipeline to provide variable width interleaved coding and a decoder pipeline to decode the variable width interleaved coding, and wherein the encoder pipeline is to receive a plurality of bitstreams from workgroups; perform parallel entropy encoding on the bitstreams to generate a plurality of encoded bitstreams for each of the workgroups; perform variable interleaving of the bitstreams for each workgroup based at least in part on data requirements for decoding received from the decoder pipeline; and compact outputs for each of the workgroups into a contiguous stream of interleaved data.

The invention discloses an entropy coding compression method for high-dimensional sparse data, which relates to the technical field of data compression, and comprises the following steps: reading an original high-dimensional sparse matrix, extracting a position index set and a corresponding non-zero value set of all non-zero elements, extracting active samples from the non-zero value set, and compressing the active samples. After an active sample matrix and an optimal mean value centralization matrix are constructed, principal component projection and a self-expression structure are introduced for joint modeling, a low-rank robust optimization objective function is formed, and a principal component feature matrix is finally output by alternately optimizing mean values, projection, weights and residual errors. According to the method, the compression efficiency and the processing pertinence of high-dimensional sparse data are effectively improved, self-expression structure modeling and residual regular optimization between samples are further combined, the structure consistency is kept in the dimension reduction process, a key information structure is kept while the compression ratio is guaranteed, and the high-fidelity and low-redundancy entropy coding compression effect is achieved.

The invention provides a lossless compression method and decompression method for power grid waveform data, equipment, a medium and a program product, and the method comprises the steps: carrying out the periodic feature analysis of the original sampling data of a power grid waveform, so as to determine the periodic structure of the original sampling data, and carrying out the segmentation processing of the original sampling data based on the periodic structure; for the sampling data in each segment, extracting differential information between adjacent sampling points to form a differential data sequence; dynamically determining a corresponding quantization parameter based on the statistical distribution characteristic of the differential data sequence, and performing adaptive quantization processing on the differential data sequence to generate quantized differential data; and entropy coding processing is carried out on the quantized differential data to generate compressed data used for representing the original sampling data, and characteristic parameters used for reconstructing the original sampling data are stored in the compressed data in an associated mode. Unification of high compression ratio, low power consumption and strict lossless reconstruction is realized, and the application requirements of long-term monitoring and remote transmission of the edge side can be met.

The invention discloses a millimeter wave radar point cloud compression method based on heterogeneous representation and an implicit neural network. Firstly, point cloud fine geometric features are extracted through a point-based compression network, global semantics are aggregated through a voxel-based compression network, and point-voxel heterogeneous joint representation and preliminary compression are realized. Secondly, constructing an adaptive octree to code a compressed data space structure to generate a partitioned bit stream, and performing statistical compression on the voxel-level high-dimensional features by using context-aware entropy coding to generate a feature bit stream; then, joint transmission is performed on the partition bit stream, the feature bit stream and the neural network weight for implicit representation. And finally, decoding and recovering the coarse-grained point cloud at a receiving end, inputting the coarse-grained point cloud and a neural network weight into a point-based synthesis network based on implicit neural representation, and finally reconstructing a high-fidelity point cloud through continuous surface modeling and detail compensation. According to the method, the compression efficiency and the reconstruction quality of the millimeter wave radar point cloud under the low code rate are remarkably improved.

The invention discloses a meteorological prediction data compression storage optimization method, which belongs to the technical field of meteorological data processing, and comprises the following steps: obtaining preprocessed meteorological prediction data; performing three-dimensional wavelet decomposition on the preprocessed meteorological prediction data by using an orthogonal wavelet basis function to obtain a tensor; performing high-order tensor decomposition on the tensor to obtain a core tensor and a plurality of modal feature matrixes; regularization constraint dynamic adjustment and sparse processing are carried out on the rank of the core tensor, dimension reduction processing is carried out on the multiple modal feature matrixes, and the core tensor with the reduced rank and the multiple modal feature matrixes with the reduced storage scale are obtained and entropy coding and quantization processing are carried out on the core tensor and the multiple modal feature matrixes; obtaining the core tensor subjected to entropy coding and quantization processing and the compressed representation of a plurality of modal feature matrixes; and dynamically calibrating the storage precision and the information loss of the compression representation of the core tensor and the plurality of modal feature matrixes after entropy coding and quantization processing by using variational inference to complete the compression storage optimization of the meteorological prediction data.

The invention provides a Mama-based image compression method and system simultaneously facing human eyes and machine vision, and the method comprises the steps: inputting an inputted RGB image into a preset analysis transformation network, and determining potential features; performing entropy parameter estimation, quantization and entropy coding on the potential features in sequence by adopting a preset super-prior entropy model, and determining a binary code stream; carrying out entropy decoding on the binary code stream by adopting a preset hyper-prior entropy model, and determining potential features; inputting the potential features into a preset synthetic transformation network, and determining a reconstructed image for human eyes to watch; performing Mama-based up-sampling processing on the potential features, and determining alignment features; and inputting the alignment features into a preset machine vision back-end network for knowledge distillation, and completing a preset machine vision task. According to the method and the device, the image reconstruction task and the machine vision task are realized at the same time by transmitting the single-stream code stream, high performance is kept, the cost is reduced, and the method and the device have flexibility and expandability.

A method for adaptive loop filtering is provided that includes determining a coefficient value for each coefficient position of an adaptive loop filter, applying the adaptive loop filter to at least a portion of a reconstructed picture using the coefficient values, and entropy encoding coefficient values into a compressed bit stream using predetermined short binary codes, wherein the short binary code used depends on the coefficient position of the coefficient value.

The embodiment of the invention discloses a coding method, relates to the technical field of media, and is used for reducing image decoding time delay. The method comprises the following steps: performing feature extraction on an input image to obtain a first feature map of the input image; and determining N groups of second feature maps of the input image according to the first feature map. And carrying out entropy coding on the at least one group of second feature maps of the input image to obtain a code stream. Wherein N is a positive integer. It can be seen that in the method provided by the embodiment of the invention, the partial feature map of the input image can be coded by adopting the progressive coding method. Compared with encoding of all the feature maps of the input image, encoding of part of the feature maps of the input image can reduce image encoding time delay. In addition, the first group of second feature maps of the input image are feature maps with the maximum channel entropy (variance) in the N groups of second feature maps of the input image, and a decoding end can obtain a complete reconstructed image based on the feature maps.

A method for encoding a point cloud to generate a bitstream of compressed point cloud data is provided. The point cloud's geometry is represented by an octree-based structure with a plurality of nodes having parent-child relationships by recursively splitting a volumetric space containing the point cloud into sub-volumes each associated with a node of the octree-based structure. The method includes: determining a coding mode, wherein the coding mode includes a planar coding mode and an angular coding mode; obtaining coding context information for a present child node, entropy encoding the present child node based on the obtained coding context information to produce encoded data for the bitstream.

The invention discloses a multi-modal feature adaptive fusion and compression semantic communication and classification method and device, and the method comprises the steps: carrying out the multi-modal feature extraction of a collected multi-modal signal, and obtaining a multi-modal feature; carrying out adaptive fusion on the multi-modal features to obtain fused features; and entropy coding compression is performed on the fused features to obtain fused compressed features, and the fused compressed features are converted into binary code streams through an encoder-decoder mechanism for realizing semantic communication with a task module. The method has the advantages of being high in fusion efficiency, friendly in compression, low in calculation overhead, small in communication cost and bandwidth occupation and the like, and the dual requirements for intelligent sensing and task execution capacity under the condition that the bandwidth is limited or the computing power is limited are met.

The embodiment of the invention provides an end-to-end image compression method and system based on window local attention and generalized chessboard space channel context, and belongs to the technical field of image processing. The method comprises the following steps: constructing a transformation network based on an attention module and a stacked residual block; the transformation network based on the attention module and the stacked residual block is used for executing adaptive transformation of contents through dynamic representation and neighborhood information embedding to obtain potential features; establishing a generalized chessboard space channel context model; the generalized chessboard space channel context model is used for carrying out entropy coding on the potential features; and obtaining image compression data according to the transformation network based on the attention module and the stacked residual block and the generalized chessboard space channel context model. According to the method, redundancy can be eliminated to the maximum extent, excellent rate distortion performance is achieved, and meanwhile high-throughput parallel computing efficiency is ensured.