Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1603 results about "Compression method" patented technology

Compression methods are otherwise known as algorithms, which are calculations that are used to compress files. Organisations that create file formats create their own algorithms and compete with each other to create the best format.

Time sequence database data compression method, system and device and storage medium

The invention relates to the technical field of wind power generation equipment data processing. The invention provides a time sequence database data compression method, system and device and a storage medium. The method comprises the steps of dynamically partitioning time sequence data based on a preset time window; hybrid coding compression is performed on each data block, and a composite strategy of difference coding and run length coding is adopted for numerical data; a metadata index of the compression blocks is established, the time range, the data feature statistics and the compression parameters of each data block are recorded, and the metadata index comprises extreme value distribution, variance features and data fluctuation frequency indexes; and dynamically adjusting a compression strategy according to a historical data feature analysis result, predicting data fluctuation modes of different equipment sensors through a machine learning model, and automatically selecting an optimal coding combination and compression granularity for subsequent data blocks. The problems that when wind power plant time sequence data are processed through an existing method, time sequence characteristics are difficult to adapt, the storage cost is high and the query efficiency is low are solved.
Owner:HUANENG DINGBIAN NEW ENERGY POWER GENERATION CO LTD +1

Large model reasoning efficiency dynamic optimization and hardware sensing compression method

The invention discloses a large model reasoning efficiency dynamic optimization and hardware sensing compression method. The method comprises the following five steps: S1, generating an input complexity signal representing calculation complexity; s2, synchronously monitoring a hardware resource index of the operation platform, and generating a hardware state signal reflecting a real-time load; s3, inputting the input complexity signal and the hardware state signal into a dynamic strategy selector, and generating a compression control signal through a pre-trained decision model; s4, according to the compression control signal, dynamic reconfiguration operation is executed on the large model weight and the activation value of the current reasoning task; and S5, performing reasoning calculation by using the reconfigured large model, and feeding back a hardware resource index to the step S2 in real time in the calculation process to form a closed-loop optimization link. According to the large model reasoning efficiency dynamic optimization and hardware perception compression method, the problems of low resource utilization rate, delay fluctuation and energy efficiency imbalance caused by a static compression method in dynamic input and heterogeneous hardware environments can be solved.
Owner:KARAMAY HONGYOU SOFTWARE

Variable-bit-rate image compression method and system, apparatus, terminal, and storage medium

The present disclosure provides a variable-bit-rate image compression method and system, an apparatus, a terminal, and a storage medium. The variable-bit-rate image compression method includes: obtaining an initial feature map from a to-be-encoded image; quantizing the initial feature map by a dead-zone quantizer; performing entropy encoding on the quantized feature map and hyper-prior information to obtain a compressed bit-stream; performing entropy decoding on the compressed bit-stream, and recovering quantized hyper-prior information and the quantized feature map; performing inverse quantization on the quantized feature map to obtain a reconstructed feature map; obtaining a reconstructed image from the reconstructed feature map; and adjusting quantization and inverse quantization parameters according to a target bit-rate or target distortion. The present disclosure provides a precise bit-rate control solution, makes the bit-rate of the compressed bit-stream better adapt to the dynamic change of a network bandwidth, and has an extremely high actual application value.
Owner:SHANGHAI JIAOTONG UNIV

Multi-scale semantic guidance image compression method and system and storage medium

The invention discloses a multi-scale semantic guidance image compression method and system and a storage medium, and the method comprises the following steps: obtaining input image data, carrying out the preprocessing of an input image, and obtaining standardized image data; inputting the standardized image data into a pre-trained semantic segmentation network to generate a multi-scale semantic feature map and a semantic weight map corresponding to the multi-scale semantic feature map; a three-stage pyramid encoder is constructed, and the standardized image data is subjected to the following steps of: sampling under depth separable convolution to generate multi-scale features; the reversible neural network carries out nonlinear transformation on the multi-scale features; the multi-scale feature subjected to nonlinear transformation is decomposed into a low-frequency sub-band and a high-frequency sub-band through adaptive discrete wavelet transformation, dynamic selective state space modeling is executed on the high-frequency sub-band based on a semantic weight map, and a compressed code stream is generated; and inputting the compressed code stream into a decoder, decoding based on a lightweight Mama module, and reconstructing an image in combination with inverse wavelet transform and a semantic weight map.
Owner:XIANGJIANG LAB

Frequency difference compressor based on precision perception, gradient compression method, equipment and medium

The invention provides a frequency difference compressor based on precision perception, a gradient compression method, equipment and a medium, which are used for carrying out data compression and transmission between a server and a client so as to reduce communication overhead in personalized federated learning, and relates to the technical field of data compression. The frequency difference compressor comprises an information bottleneck rarefaction unit, a frequency domain compression unit, a dynamic quantization unit and a differential coding unit. Non-key gradient redundant components of the original gradient data are removed through an information bottleneck rarefaction unit to generate sparse gradient data; generating a metadata packet containing the first N high-energy frequency domain coefficients and the positions and the number of the first N high-energy frequency domain coefficients through a frequency domain compression unit; performing adaptive bit width mapping on the high-precision floating point gradient data into low-order integer representation through a dynamic quantization unit to generate dynamic quantization gradient data; and the differential gradient is transmitted to the client through the differential coding unit, so that data compression and transmission are completed. The method solves the problems that the communication overhead is large and gradient information cannot be reserved as far as possible in gradient transmission.
Owner:XIAMEN UNIV OF TECH

Unified system for multi-modal data compression with relationship preservation and neural reconstruction

A unified platform for multi-modal data compression and decompression that enables efficient processing of correlated data streams while preserving relationships between different modalities. The platform employs a virtual management layer to analyze and route input streams, implementing correlation analysis to identify temporal and spatial relationships between streams. Multiple compression methods, including neural network-based approaches, are utilized to compress data sets while maintaining cross-modal dependencies. A neural upsampling system leverages learned correlations between streams to enhance reconstruction quality. The platform includes a synchronization manager that maintains temporal alignment and relationship preservation throughout processing. By integrating correlation-aware compression with neural upsampling techniques, the platform provides comprehensive multi-modal compression capabilities while preserving critical relationships between different data types. The system is particularly suited for applications involving synchronized audio-visual data, sensor streams, and other multi-modal content.
Owner:ATOMBEAM TECH INC

Context compression method based on multi-round dialogue intention graph construction

The invention provides a context compression method based on multi-round dialogue intention graph construction, which comprises the following steps: S1, dialogue data acquisition and preprocessing: carrying out natural language processing on each dialogue unit; s2, intention atlas construction is achieved through node design and edge design, and each node comprises original text content and structured semantic information; s3, carrying out context compression and graph structure cutting, and only retaining sub-graphs forming a core semantic link; s4, dynamic context management and topic jump processing: in a multi-topic dialogue, when a user jumps or switches to a new topic, a system records a sub-graph of a current active topic, and contextual nodes of an inactive topic are frozen; s5, context sequence generation and model input: linearizing node contents in the cut sub-graph according to a dependent link sequence to generate a compressed context sequence, and transmitting the context sequence and current user input to a large language model for reasoning; and S6, continuous updating and feedback optimization are carried out.
Owner:WUXI BAISHANG ZHONGWANG DATA TECHNOLOGY CO LTD

Train forward clearance target detection method and system based on point cloud feature aggregation enhancement

The invention provides a train forward clearance target detection method and system based on point cloud feature aggregation enhancement, and belongs to the technical field of train forward clearance target detection.The train forward clearance target detection method comprises the steps that vehicle-mounted point cloud data are obtained, and a scene point cloud data set is constructed; dividing sparse point clouds into regular voxel grids, converting point cloud information into compact feature representation by voxel feature coding, and extracting multi-scale voxel features by using 3D sparse convolution layer-by-layer downsampling; carrying out sampling, grouping and feature extraction on the extracted multi-level voxel features by using set sampling, and aggregating the multi-scale voxel features to a voxel center point; mapping the extracted layered multi-scale voxel features into BEV feature maps by adopting a completely sparse height compression method, and fusing the BEV feature maps with different resolutions through 2D sparse convolution processing and jump connection; the mass center offset loss of a 3D regression frame is introduced to optimize the multitask loss, and a detection head is guided to realize train forward clearance target classification and three-dimensional bounding box regression.
Owner:BEIJING JIAOTONG UNIV

System and method for secure data processing with privacy-preserving compression and quality enhancement

A unified platform for multi-type data compression and decompression is disclosed. The platform employs a virtual management layer to receive, organize, and route input data to corresponding compression subsystems. Multiple compression methods, including homomorphic encryption-based techniques, are utilized to compress data sets while maintaining data privacy. A data manager associates and manages related data sets throughout the compression and decompression processes. Compressed data is routed to appropriate decompression subsystems, where it is decompressed and reconstructed using advanced techniques, such as neural upsampling, to recover lost information and enhance data quality. The platform supports various data types and compression methods, enabling efficient and secure compression and decompression of data. By integrating homomorphic encryption and data reconstruction techniques, the platform provides a comprehensive solution for data compression and decompression while preserving data privacy and enhancing data quality.
Owner:ATOMBEAM TECH INC

TF-IDF and cross entropy-based cue word compression method and system

The invention discloses a cue word compression method and system based on TF-IDF and cross entropy, belongs to the technical field of large model cue word compression, and aims to solve the problems that redundant information is introduced into long cue words, the model efficiency is reduced and the cost is increased. To-be-compressed content is divided into sentences at the sentence level and then converted into embedded vectors, and the Euclidean distance is calculated in combination with problem vectors so as to screen related sentences; calculating a TF-IDF value at the word level through a word frequency and an inverse document frequency to extract keywords and recombine sentences; and selecting a reference model and a basic model at the Token level, identifying the key Token based on a cross entropy loss difference value, and splicing the key Token in sequence to generate a compressed cue word. According to the method, a complex calculation structure is avoided, the inference efficiency is improved while the semantic integrity is maintained, and the resource consumption is reduced.
Owner:ARTIFICIAL INTELLIGENCE INNOVATION RES INST OF ZHEJIANG UNIV OF TECH BINJIANG DISTRICT HANGZHOU

Intelligent data compression method and system based on multi-protocol heterogeneous device interconnection

The invention relates to the technical field of data compression, in particular to an intelligent data compression method and system based on multi-protocol heterogeneous equipment interconnection. The method comprises the following steps: when it is detected that a new heterogeneous device applies to join a network, carrying out communication protocol real-time analysis and protocol conversion adaptation to obtain a heterogeneous device adaptation protocol; carrying out multi-device data stream receiving according to a heterogeneous device adaptation protocol, and generating data streams of a plurality of time windows; adaptive coding and multi-level compression are carried out on the data streams of the multiple time windows, and a multi-device adaptive compression mechanism is constructed; identifying compression load characteristics of each heterogeneous device, and performing dynamic task allocation to obtain an intelligent task allocation strategy; and driving real-time data intelligent compression operation based on an intelligent task allocation strategy and a multi-device adaptive compression mechanism. According to the invention, efficient and adaptive data compression of different devices is realized, and the data transmission efficiency and quality are improved.
Owner:TANTRON TECH CO LTD

Audio data compression method and device, electronic equipment and storage medium

The invention discloses an audio data compression method and device, electronic equipment and a storage medium, relates to the technical field of voice processing, can be applied to financial science and technology and medical health business scenarios, and comprises the following steps: obtaining target audio data to be compressed; and inputting the target audio data into an audio coding and decoding quantization compression model to obtain a reconstructed audio signal corresponding to the target audio data, the audio coding and decoding quantization compression model being obtained through audio adversarial training. In the model, feature extraction and compression can be performed on target audio data by using a hierarchical neural network of an encoder to obtain a low-dimensional potential feature vector; a residual vector quantization module performs discrete quantization processing on the low-dimensional potential feature vector through a multi-layer cascaded codebook to obtain a discrete quantization code; and performing audio waveform reduction processing on the discrete quantization code by using a decoder to obtain a reconstructed audio signal corresponding to the target audio data. According to the invention, audio high-fidelity compression can be realized, and audio reconstruction tone quality is improved.
Owner:PING AN TECH (BEIJING) CO LTD

Large model compression method and device, task processing method and equipment and storage medium

The invention relates to the technical field of model compression, and provides a large model compression method and device, a task processing method and equipment and a storage medium, and the large model compression method comprises the steps: carrying out the layer-by-layer quantification of a linear layer of a to-be-compressed initial large model, and obtaining a first large model; the initial large model is a pre-trained large language model constructed based on an expert hybrid architecture; performing route calibration on each expert sub-model in the first large model to obtain a second large model; in the reasoning process of the second large model, based on the task type of a to-be-executed target task, the importance of each expert sub-model in the task type is evaluated; and performing dynamic pruning on each expert sub-model based on importance so as to compress the second big model. Through a compression mode of combining static quantification and dynamic pruning, on the basis of ensuring the model performance, the memory and calculation overhead required by large model reasoning can be reduced, and efficient operation of the large model on light-weight equipment with limited video memory resources is facilitated.
Owner:INST OF AUTOMATION CHINESE ACAD OF SCI

Real-time video image compression method based on deep learning

The invention provides a real-time video image compression method based on deep learning, and relates to the technical field of video image compression, and the method comprises the steps: carrying out the key feature recognition through employing an attention mechanism; performing convolution training optimization on the video image sample data set by using a deep learning network structure; a self-encoder structure is designed to carry out feature map encoding compression; a video image compression adaptive network is generated through series fusion; a real-time video image frame is collected for preprocessing, and feature compression processing is performed on a standard video image frame based on a video image compression adaptive network. According to the method and the device, the technical problem that the video compression quality is reduced due to the fact that the generalization ability is insufficient in the face of various scenes and the video compression strategy is difficult to adaptively adjust according to different scenes in the prior art can be solved, the adaptive network is constructed through the combination of deep learning and the auto-encoder, and the video compression quality is improved. And the video compression strategy is dynamically adjusted according to the contents of different video images, so that the video compression quality is improved.
Owner:NANJING STAR SHIELD INFORMATION TECH CO LTD

Data compression method and device

The invention provides a data compression method and device, and relates to the technical field of data processing and data compression. The method comprises the following steps: acquiring to-be-compressed data, and acquiring a data category of the to-be-compressed data; determining a plurality of candidate compression strategies corresponding to the to-be-compressed data based on the data category; the importance degree of the to-be-compressed data is obtained, and the equipment state parameter of the current equipment is obtained; determining a target compression strategy and a compression level corresponding to the target compression strategy from the candidate compression strategies based on the equipment state parameters and the importance; and executing the target compression strategy on the to-be-compressed data according to the compression level to obtain compressed data. According to the method, the target compression strategy can be dynamically determined according to the data type, the data importance and the equipment state, high flexibility and adaptability are achieved, the data storage and processing efficiency is improved, good balance between the data quality and the storage space is ensured, and the method adapts to modern changeable equipment environments and data requirements.
Owner:SHANGHAI INNOVATECH INFORMATION TECH

3D Gaussian sputtering compression method and system based on residual quantization and dynamic pruning

The invention belongs to the technical field of computer graphics and real-time 3D scene reconstruction, and relates to a real-time compression and optimization method based on a 3D Gaussian sputtering (3DGS) model, which realizes efficient storage, transmission and rendering of a three-dimensional scene through residual vector quantization (RVQ) and a dynamic pruning technology, and comprises the following steps: S1, residual quantization vector quantization; s2, enhancing a dynamic pruning strategy; and S3, index compression and coding optimization. The invention provides a real-time 3D Gaussian sputtering (3D Gaussian sputtering) model compression system combining residual vector quantization and dynamic pruning, which can realize high-quality real-time rendering and extremely high storage efficiency. Through three core technologies of a vector quantization strategy, dynamic pruning strategy enhancement and index compression and coding optimization, on the premise that the rendering quality is guaranteed, the purposes that the model storage amount is reduced by more than 45 times, and the rendering speed is increased by 3 times are achieved.
Owner:HUBEI UNIV OF TECH

Video specific dictionary learning for implicit neural compression

Methods and apparatus are provided for encoding and subsequent decoding of video data by using a learnt video specific dictionary for implicit neural compression. An implicit neural representation comprising a head layer and a tail layer is used with approximations to the head layer parameters. The approximations are determined with combinations of atoms of a learnt video specific dictionary. In one embodiment, the head layer approximations and tail layer parameters are encoded in a bitstream. The dictionary is learnt at the decoder. In another embodiment, a dictionary is sent in the bitstream. At decoding, a reconstructed image is computed using transmitted INR parameters.
Owner:INTERDIGITAL CE PATENT HOLDINGS SAS

Pleno-generation face video compression framework for generative face video compression

Methods and systems implement a pleno-generation face video compression framework with bandwidth intelligence for generative models and compression. Heterogeneous-granularity facial description regularizes long-term dependencies between video frames and compensates for motion estimation errors caused by compact representations of motion information. A generative decoder reconstructs heterogeneous-granularity visual representations, providing auxiliary visual signals for attention-based recalibration of a GFVC-reconstructed face signal. A coarse-to-fine generation strategy avoids error accumulation. High efficiency for heterogeneous-granularity signal compression is achieved by two different entropy-based signal compression methods: heterogeneous-granularities feature representation from the key-reference frame as hyperpriors to optimize the entropy model for compressing heterogeneous-granularity feature from subsequent inter frames, and a feature difference operation for heterogeneous-granularities feature representation between key-reference and subsequent inter frames, such that the entropy model only compresses heterogeneous-granularities feature residual for redundancy reduction. Mixed-model dataset generation and training and model-specific dataset generation and training are also provided.
Owner:SIM IP 5 LLC

Edge computing-oriented AI gateway video efficient compression method

The invention relates to the technical field of video compression, in particular to an edge computing-oriented AI gateway video efficient compression method. The method comprises the steps of obtaining a to-be-compressed target video; clustering all images in a target video to be compressed to obtain each cluster, obtaining a feature index value corresponding to each image in the cluster according to a difference index value between each image in the cluster and other images in the cluster, obtaining a block number parameter corresponding to the cluster according to the feature index value, and obtaining a block number parameter corresponding to the cluster; according to the block number parameter corresponding to the clustering cluster, dividing each image in the corresponding clustering cluster to obtain each sub-block on each image in the clustering cluster; and according to the pixel difference between any two sub-blocks in the clustering cluster, carrying out coding replacement on the sub-blocks on the image in the clustering cluster to obtain a replaced video, and compressing the replaced video to obtain compressed data. And the compression rate can be improved while the high fidelity of the key content is ensured.
Owner:BEIJING GUOWANG SHENGYUAN INTELLIGENT TERMINAL SCI & TECH CO LTD

Unstructured data compression method and device, equipment and storage medium

The invention provides an unstructured data compression method and device, equipment and a storage medium, and the method comprises the steps: carrying out the feature extraction and clustering processing of a to-be-compressed unstructured data set, and obtaining a data segment clustering group; performing semantic region segmentation processing on each data fragment in the data fragment clustering group to obtain a semantic important region and a semantic non-important region; performing differential coding processing on the semantic non-important regions in the same clustering group to obtain differential coding data; and performing high-quality compression processing on the semantic important regions in the same clustering group, and performing merging processing on the compressed important semantic data and the difference coding data to obtain an unstructured data compression result. According to the method, semantic region segmentation and differential compression processing are performed on the unstructured data, so that the data compression efficiency can be effectively improved on the premise of ensuring the quality of important information, and an efficient solution is provided for storage and transmission of large-scale unstructured data.
Owner:XINTU HETEROGENEOUS TECHNOLOGY (SHENZHEN) CO LTD

Space-time data compression method and system based on lightweight processing

The invention discloses a spatio-temporal data compression method and system based on lightweight processing, and relates to the technical field of image data processing, and the method comprises the steps: based on spatio-temporal data to be compressed, establishing standardized data entries, forming a window set through time axis segmentation, carrying out the periodic discrimination of windows according to the frequency domain energy distribution, and constructing spatio-temporal blocks, establishing an error control parameter table based on the global error budget; generating a time coding stream, performing integerization on the three-dimensional coordinates and the attribute values, generating a space coding stream through double difference and run length coding, performing edge folding lightweight and texture compression on the grid data, and generating a joint coding result; and based on a joint coding result, dividing the compressed data into a base layer and a plurality of enhancement layers, and establishing a relevance hierarchical storage structure and a block-level index table to generate the compressed data capable of being transmitted in a streaming manner. According to the method, collaborative compression can be carried out by utilizing spatial-temporal data internal relevance.
Owner:SHENYANG SURVEYING & MAPPING RES INST CO LTD

Layered hybrid structured compression method and device for large language model

The invention provides a hierarchical hybrid structured compression method and device for a large language model, and relates to the technical field of artificial intelligence, and the method comprises the steps: determining the compression ratio of each layer of a target model based on the importance degree of each layer of the target model; based on the compression ratio of each layer, compressing the target model to obtain a compressed model; wherein the compression of the target model comprises the following steps: for a current processing layer, calculating a two-norm of an input activation value corresponding to each weight of the current processing layer on a calibration data set to obtain a characteristic norm; under the condition that the current processing layer is the multi-head attention sub-layer, performing weighted low-rank decomposition and differential singular value distribution processing on the current processing layer based on the characteristic norm of the current processing layer and the compression ratio of each layer; and under the condition that the current processing layer is the feedforward network sub-layer, performing channel pruning and compensation processing on the current processing layer based on the characteristic norm of the current processing layer and the compression ratio of each layer. Therefore, the compression ratio and the performance balance of the LLM are realized.
Owner:INST OF AUTOMATION CHINESE ACAD OF SCI

Hardware-friendly visual Transform compression method based on quantization and Token pruning technology

The invention discloses a hardware-friendly visual Transform compression method based on a quantization and Token pruning technology. The hardware-friendly visual Transform compression method comprises the following steps: carrying out compression; the method comprises the following steps of: 1, selecting an image, training and quantifying a weight value and an activation value of a visual Transform model of an image classification task, and processing a quantization parameter into a power form of 2 to obtain a quantization model; step 2, inserting a Token compression module between a multi-head attention module and a feed-forward layer of each Block of the quantized model, and pruning unimportant tokens by the Token compression module; the quantized model inserted with the Token compression module is trained, pruning parameters are learned, and the searched pruning parameters achieve the balance between the quantization precision and the pruning rate. The method has the characteristics that hardware deployment is efficient, the integer reasoning computing power of end side equipment can be fully utilized, and the model reasoning calculation amount and the storage requirement are greatly reduced.
Owner:XI AN JIAOTONG UNIV

Audio compression with generative adversarial networks

An AI-based audio compression method for use with audio formats, alone or in combination with other audio compression and enhancement approaches. A combination of audio pre-processing, sound to visual transcoding of audio, and a sequence of AI-enabled methods enabling maximal entropy order extraction applied within the sound and dimensionally extended visual domain projection of the audio significantly increases the degree of compression of audio files, thereby reducing storage, transmission and processing overhead associated with audio. A unique AI-driven domain conversion is leveraged together with domain-specific AI processing stages to reduce file size, while supporting optional use of standard and proprietary audio encoding, decoding, compression, and other methods. Support for native mode photonic computer processing of the higher-dimensional order representation of media enables further optimization via photonic computing methods that would not be possible if the audio was not extended into higher order visual domain space.
Owner:ZON GLOBAL IP INC

Large language model-oriented adaptive KV cache compression method and system

The invention relates to the technical field of artificial intelligence and big language model reasoning optimization, and discloses a big language model-oriented adaptive KV cache compression method and system, and the method comprises the steps: constructing a lexical element importance measurement mechanism; analyzing an attention head distribution structure in large language model reasoning, and constructing a plurality of pruning strategies; based on a lexical element importance measurement mechanism and the attention head distribution structure, designing a self-adaptive key value cache compression hybrid strategy set based on a pruning strategy; constructing a static self-adaptive key value cache compression method, and automatically distributing a key value cache compression strategy in a pre-filling stage of large language model reasoning; and in a decoding stage, performing adaptive compression on the key value cache based on the allocated key value cache compression strategy. According to the method, the key value cache can be efficiently compressed on the premise of not depending on explicit attention score calculation, a system-level reasoning optimization framework is compatible, the generation performance is kept, meanwhile, the video memory consumption is remarkably reduced, and the long context reasoning capability is enhanced.
Owner:CENT SOUTH UNIV

Neighbor projection type gradient coordination compression method and device and federal learning system

The invention provides a neighbor projection type gradient coordination compression method and device and a federated learning system, and relates to the technical field of federated learning. According to the method, the uploading gradient of the client side is obtained, direction normalization is carried out, direction embedding updating of the client side is carried out through index moving average, then the similarity between the client sides is calculated, a neighbor set is generated, a similar graph is constructed, and then conflict detection and weight setting are executed. And performing weighted orthogonal projection in the frozen neighbor direction of each client to correct the gradient, and finally performing weighted aggregation on the gradient and updating global model parameters. According to the method, gradient conflicts are efficiently detected and corrected in a local range by constructing the client similar graph and combining a neighbor projection mechanism, the problems of high complexity and excessive information reduction caused by global processing are avoided, the convergence speed, stability and precision of a global model are improved under the condition that additional calculation and communication overhead of the client is not increased, and the user experience is improved. The method is suitable for large-scale non-independent identically distributed data scenes.
Owner:XIAMEN UNIV OF TECH

Code rate adaptive image compression method and system

The invention discloses a code rate adaptive image compression method and system, and the method comprises the steps: obtaining an input image, and calculating the local information entropy of the input image to generate a spatial adaptive mask; obtaining target code rate and actual code rate information to generate a code rate control signal; and dynamically selecting a calculation path by using a mask through a dynamic reversible neural network, and executing reversible quantization transformation according to the control signal to obtain a compressed bit stream and actual code rate information for closed-loop feedback. According to the method, a symmetric reversible framework with shared parameters is constructed, so that the model storage requirement is reduced; the calculation depth of the network is dynamically adjusted through entropy sensing gating, and the overall calculation amount is reduced; and a composite control and PID optimization mechanism is adopted, so that continuous and smooth code rate control is realized. The deployment and application efficiency of the compression system in a resource limited scene can be effectively improved.
Owner:NANJING ARTIFICIAL INTELLIGENCE CHIPS RES INST OF AUTOMATION CHINESE ACAD OF SCI

Adaptive Data Compression and Encryption System Using Reinforcement Learning for Pipeline Configuration

A system and method for optimizing data compression and encryption using reinforcement learning. The system analyzes incoming data streams to extract statistical features and data characteristics, which are processed by a reinforcement learning engine to automatically configure a multi-stage compression pipeline. Each compression stage transforms data into optimized distributions, applies Huffman coding, and maintains full encryption using homomorphic operations. A performance monitor tracks compression efficiency, processing speed, and output quality in real-time, providing feedback to continuously improve the reinforcement learning model's decisions. The system can dynamically adjust between one to five compression stages and select appropriate compression methods, including traditional algorithms or neural network-based approaches, based on data characteristics and performance requirements. All processing occurs on encrypted data without requiring decryption, ensuring complete data security throughout the pipeline. The adaptive nature of the system enables optimal compression performance across diverse data types while maintaining encryption integrity.
Owner:ATOMBEAM TECH INC

Hyperspectral remote sensing image compression method based on attention and quantization coding optimization

The invention provides a hyperspectral remote sensing image compression method based on attention and quantization coding optimization, and the method comprises the steps: carrying out a network model training process: carrying out the processing, cutting and enhancement of hyperspectral remote sensing image data, and constructing a sample set for training; extracting low-dimensional feature representation of the sample data by using a lightweight encoder, wherein the encoder integrates a convolutional layer and a spectrum multi-head self-attention module; a decoder fusing a space-spectrum attention mechanism is adopted to gradually reconstruct a hyperspectral remote sensing image from low-dimensional features; optimizing coding and decoding model parameters through a combined loss function; a quantization coding two-stage compression process: performing adaptive quantization on the features, and mapping the floating point type features into discrete integers based on a logarithm mapping strategy; performing two-stage coding compression on the quantized features; and recovering feature representation through decoding and inverse quantization, and inputting a trained decoder network to reconstruct a hyperspectral remote sensing image.
Owner:WUHAN UNIV

Cloud database data compression method based on adaptive quantization algorithm

The invention relates to the technical field of data processing, in particular to a cloud database data compression method based on an adaptive quantization algorithm. The method comprises the following steps of: 1, regarding to-be-compressed original data in a cloud database as a matrix, dividing the data into a plurality of non-overlapped data blocks according to predefined statistical characteristics, and calculating a mean value and a variance of each data block; 2, defining the complexity of each data block, and calculating the self-adaptive quantization step length of each data block according to the mean value and variance of each data block; step 3, performing non-uniform adaptive quantization on each data item in each data block to obtain a quantized value; and 4, establishing a probability model for a quantization result of each data block, calculating a coding length, obtaining a compression ratio, and carrying out entropy coding. The quantization step size of the data block is dynamically adjusted to be matched with the local characteristic of the data, so that the quantization error is reduced, and the data recovery precision is improved.
Owner:SHANDONG LIAOYUN INFORMATION TECHNOLOGY CO LTD