55 results about "Volume (compression)" patented technology

The invention discloses a digital textbook editing and transmitting system with a multilayer architecture. The digital textbook editing and transmitting system comprises a virtual node modeling module, a lightweight storage module, a function editing module, a resource ecological module and a client module, the virtual node modeling is as follows: Slate is used to construct a virtual node model containing elements such as texts, pictures, formulas, interaction components and the like, and each node carries content attributes, hierarchical relationships and interaction instructions; the lightweight storage module is used for converting a virtual node into a JSON format through global-jsdom after a user completes editing, and classifying binary files in the node into resource nodes in an editor. The invention relates to the technical field of data transmission, adopts an AES encryption transmission technology, avoids the data leakage risk caused by plaintext transmission, and improves the data transmission efficiency. And the digital asset security of the publisher and the user is effectively protected. Through node compression storage (JSON format), the server side can classify and store the JSON data, the data volume is greatly reduced, the storage space multiplexing is improved, and the transmission efficiency is improved.

The invention relates to the technical field of machine learning, and discloses a feature disassembly and compression method and device, equipment and a storage medium, and the method comprises the steps: obtaining an initial feature of to-be-predicted image data, determining an expert activation weight corresponding to a downstream prediction task based on a hybrid expert network, the initial features are processed through a plurality of expert networks in the hybrid expert network to generate disassembled features, the plurality of expert networks are networks constrained through a low-rank matrix, the disassembled features are quantized to generate quantized features, entropy coding is carried out on the quantized features through a hyper-prior network, and compressed features are obtained. According to the method, the expert activation weight is dynamically adjusted along with task requirements, different task scenes are adapted, initial features are disassembled based on a plurality of expert networks, task irrelevant information is explicitly stripped, task key features are reserved, redundant data volume is reduced, quantized coding is performed on disassembled feature input, code stream self-adaption is realized, and bandwidth occupation is reduced.

The embodiment of the invention provides a tag data processing method, RFID middleware and a storage medium. The method comprises the following steps: receiving and caching tag data of a plurality of tags; compressing the label data according to a predetermined compression mode to obtain compressed data; wherein the compression mode is determined according to a data compression level and a label inventory rate; and sending the compressed data. According to the embodiment of the invention, the data processing efficiency is improved, the equipment resource occupancy rate, the data traffic and the bandwidth occupancy of network transmission of middleware at a high inventory rate are greatly reduced, and meanwhile, the mass data processing pressure of an upper platform is reduced. According to the embodiment of the invention, the platform side can receive total label data, and algorithm application development is facilitated. In addition, according to the embodiment of the invention, the packet number and the data compression level are adjusted according to different service requirements, and the method is suitable for service scene requirements with different data volume and time delay sensitivity.

This invention discloses an efficient RNA data preprocessing method to address the problems of low processing efficiency and low information density in high-throughput sequencing data. Its core steps include: (1) introducing a parallel processing scheme for high-throughput sequence data, rapidly mapping RNA-seq data to a reference genome to generate a BAM file; (2) extracting base sequences and expression levels and storing them as compact PKL format files; (3) extracting all exon position information by parsing the genome annotation file; (4) combining multi-sample expression level data to screen for highly variable exons and constructing a high-information-density feature list based on the sample set; and (5) accurately extracting target sequences from the preprocessed file based on this list. Compared to traditional methods, this innovative approach achieves triple optimization: full-process parallel processing for accelerated computation, high-compression data storage, and adaptive feature selection. Processing speed is increased by 3-5 times, and data volume is reduced by more than 90%, making it suitable for high-throughput RNA-seq data analysis with large sample sizes.

The invention provides a data storage and reading method, device and equipment, and the data storage method comprises the steps: extracting the features of to-be-stored data, and applying for an index storage position in a traversed current data volume according to a level sequence from a higher level to a lower level, when it is determined that first to-be-stored data which does not meet the data similar compression condition exists, the first to-be-stored data is written into an applied target storage position, and the target storage position is written into an index storage position; when it is determined that second to-be-stored data meeting the data similar compression condition exists, the second to-be-stored data is compressed, the to-be-stored data is updated, the index storage position applied by the to-be-stored data in the next-level data volume is written into the current data volume, and if the level of the current data volume is the lowest level, the next-level data volume is created, and a data storage instruction is triggered. Through the method, the to-be-stored data is stored after being subjected to multi-stage compression based on the multi-stage data volume, so that the compression rate of the data is improved.

Embodiments of the present application provide a BIM model value-driven three-dimensional unit compression method and system, which comprises: obtaining an original BIM model containing geometric information and material information and a general compression target; and calculating a component value score of each component in the original BIM model; based on the original BIM model and the component value score, performing voxelization processing and compression unit division to obtain a plurality of compression units; independently compressing and adaptively entropy encoding the plurality of compression units respectively to generate code streams corresponding to the plurality of compression units respectively; collecting the code streams corresponding to the plurality of compression units respectively to obtain a total volume of the plurality of compression units; based on the total volume and the general compression target, determining an encoding parameter to complete compression and obtain final code streams corresponding to the plurality of compression units respectively; and storing the final code streams to obtain a final compression file. The above scheme can accurately balance the compression ratio and data fidelity, and improve the encoding and decoding efficiency.

The invention discloses a reverse debugging increment recording method based on dynamic layering and predictive filtering, which comprises the following steps of: analyzing a binary file division region of a target program, establishing a global region mapping table among an address range, a region type and debugging attributes, executing the binary file by a reverse debugger, constructing a first mapping table for modifying a record circular queue, according to the global region mapping table, performing differentiation recording on the region to form a first record, a stack frame snapshot, a second record and a register block snapshot, and performing repeated coverage filtering to reduce the recorded data volume to form an execution state track; and performing intelligent compression on stack frame snapshots, heap memories, global variable records, register snapshots and variable values in the execution state trajectory, and finally forming a low-overhead and accurate execution state trajectory to support reverse debugging backtracking.

Three-dimensional sensing data is transferred efficiently by applying compressed sensing using dictionary learning. Conventional image-based lossy compression improves a feature according to which power is concentrated on low-frequency components and deterioration of three-dimensional information increases. By changing the decimation rates for the depth information and the color information and using a dictionary vector created from the other restoration result for restoration, the original result is reconstructed using a small data volume.

The application relates to the technical field of CAE preprocessing and cloud cooperation, and discloses a lightweight CAE geometry engine and a cloud real-time cooperation method and system. A cloud server acquires an original CAE geometry model, performs topological simplification and data compression on the original CAE geometry model, and generates a lightweight geometry data file containing multiple resolution levels; the cloud server pushes the received difference data packet to other online cooperation terminals; the other cooperation terminals parse the unique version number carried by the difference data packet through a locally loaded WebAssembly geometry engine module, and perform operation replay updating on the local geometry model according to the differential data contained in the difference data packet. According to the scheme, the original CAE model data volume is reduced by 90%-95%, the WebAssembly engine realizes a 100,000-face model rendering frame rate of 30-60 fps, and the operation response delay is less than or equal to 100 ms, thereby breaking through the performance bottleneck of browser-side geometry processing.

The invention provides a real-time three-dimensional reconstruction method and system based on unmanned equipment. In order to solve the lag problem that in traditional reconstruction, collection needs to be conducted firstly and then reconstruction needs to be conducted, and the composite bottleneck that airborne computing power is limited and weak network bandwidth is insufficient, a unified time signal is generated through a hardware synchronization module, and microsecond-level synchronization of multi-source data is achieved; aiming at heterogeneous data characteristics, the airborne end respectively constructs batch processing assembly lines of point cloud octree compression, image JPEG coding and IMU byte alignment, so that the data volume is remarkably compressed while the computing power overhead is reduced; a QoS mechanism and local persistent cache of an MQTT protocol are introduced into a transmission layer, and reliable arrival of data during network fluctuation is guaranteed through a breakpoint resume technology. In conclusion, end-to-end real-time processing of software and hardware collaboration is realized, bandwidth occupation is effectively reduced, and stable and high-precision real-time three-dimensional reconstruction is realized in a weak network environment.

The invention relates to the technical field of computers, in particular to a picture custom cutting and volume compression method and system based on a Web end. The method comprises the following steps: acquiring a picture file, and loading and initializing the picture file to obtain a processed picture; performing incremental rendering on the processed picture based on a dynamic center anchor point scaling algorithm to obtain a rendered picture; selecting and intercepting a picture pixel data area based on the rendered picture to obtain a picture file stream of a lightweight screenshot area; and carrying out image dynamic quality compression and output on the picture file stream of the lightweight screenshot area to complete picture custom cutting and volume compression based on the Web end. According to the method, the problem that the size of the picture can be reduced by cutting the picture or reducing the resolution of the picture when the picture file is applied to the function requirements of uploading and downloading the picture file is solved, the problem that huge bandwidth resources are occupied in network transmission is solved, and the occupied storage space of a server is optimized and reduced.

This invention provides a data compression method, apparatus, electronic device, and storage medium. The method includes: segmenting the original data using a breakpoint detection algorithm; fitting each segment of data using a fitting algorithm; and obtaining the restored data using a decompression algorithm. This addresses the problem of excessively large data volumes and high storage and transmission costs in current massive data acquisition scenarios, thus promoting the further development of various data platforms for digital transformation in the big data era. The method of segmenting the original data using a breakpoint detection algorithm and fitting each segment of data using a fitting algorithm effectively achieves efficient data compression. The restoration of the data through a decompression algorithm further addresses the problem of excessively large data volumes and high storage and transmission costs in current massive data acquisition scenarios, thus promoting the further development of various data platforms for digital transformation in the big data era.

This invention discloses a method, apparatus, and electronic device for effectively adjusting the compression ratio of a reference frame image. The method includes: S1, dividing the reference frame image to be compressed into several n×n blocks; S2, initializing the target bit count of the n×n blocks according to the total data volume of the reference frame image to be compressed and the target compression ratio requirement, and obtaining the target bit count occupied by each pixel; S3, calculating the target bit rate weight parameter λ based on the obtained target bit count occupied by each pixel. real S4, calculate the quantization parameters based on the relationship between the quantization parameters and the target bit rate weight parameters, and perform encoding quantization; S5, complete the encoding process of the current n×n block and obtain the actual number of encoded bits for each pixel of the current n×n block; S6, calculate the actual bit rate weight parameters based on the actual number of encoded bits; S7, update the parameters related to the features of the reference frame image and update the remaining allocable bits, and return to step S2.

The embodiment of the invention provides a BIM (Building Information Modeling) value-driven three-dimensional unitization compression method and system. The method comprises the following steps: acquiring an original BIM containing geometric information and material information and an overall compression target; calculating a component value score of each component in the original BIM model; based on the original BIM model and the component value score, voxelization processing and compression unit division are carried out, and a plurality of compression units are obtained; performing independent compression and adaptive entropy coding on the plurality of compression units to generate code streams corresponding to the plurality of compression units; summarizing the code streams corresponding to the plurality of compression units to obtain the total volume of the plurality of compression units; determining coding parameters based on the total volume and the total compression target, and completing compression to obtain final code streams corresponding to the plurality of compression units; and storing the final code stream to obtain a final compressed file. According to the scheme, the compression ratio and the data fidelity can be accurately balanced, and meanwhile, the coding and decoding efficiency is improved.

The application discloses a data compression method and system for an SSD, and relates to the technical field of SSD data compression. The method comprises write IO path processing and read IO path processing. The write IO path processing comprises the following steps: after receiving host data, processing the data in 4K units, judging compressibility, performing compressed storage according to the remaining space of the cache, synchronously updating metadata, and when the data volume of the cache reaches a threshold, allocating NAND space, encoding and writing the data, and updating the address mapping. The read IO path processing comprises the following steps: receiving a read command, searching for the mapping to obtain a NAND physical address, judging whether the data is compressed through metadata after reading and decoding the data, transmitting the decompressed compressed data and uncompressed data to the cache, and transmitting the data to the host after passing the PI check. The application effectively avoids the problem that the current compression technology causes an increase in meta data, thereby excessively occupying LDPC parity space, leading to an increase in LDPC code rate and causing a decrease in LDPC error correction capability.

A file system volume's space is internally allocated as a set of containers, with each container corresponding to a different subset of storage clusters. The set of containers includes a first container corresponding to a first subset of storage clusters storing first data that is compressed according to a first set of compression attributes, a second container corresponding to a second subset of storage clusters storing second data that is uncompressed, and a third container corresponding to a third subset of storage clusters that are free. Based on determining that the second data of the second container is to be compressed, compressed second data is created based on a second set of compression attributes. The second set of compression attributes is different than the first set of compression attributes. The compressed second data is written to the third subset of storage clusters of the third container.

The invention relates to a video data processing method and system, electronic equipment and a storage medium. The method comprises the following steps: acquiring an original image frame; identifying a target object in the original image frame, and determining a target area where the target object is located; determining a background region based on the target region; acquiring a preset compression parameter; the preset compression parameters comprise a first compression parameter and a second compression parameter; according to a preset compression parameter, coding the target region and the background region to obtain a coded data packet; and generating target video data based on the coded data packet. According to the technical scheme provided by the invention, the target region and the background region are distinguished in the same original image frame, and different compression parameters are adopted for coding, so that the image presentation quality of the target region can be improved while the overall coding resource occupation and the data volume are controlled; and the comprehensive display effect of the video data can be improved in a scene with limited bandwidth or processing capability.

The invention provides a model training method and a document compression method for realizing AI Agent based on AI, RPA and LLM, and relates to the field of AI, RPA, LLM and AI Agent. The method comprises the steps of obtaining a sample document image and a sample original document corresponding to document content displayed by the sample document image; compressing the original sample document by adopting a compression representation grammar to obtain a compressed sample text; and training a visual language model (VLM) based on the sample document image and the sample compressed text, so that the trained VLM learns a compressed representation grammar. Therefore, the trained VLM can effectively filter redundant information corresponding to the meaningless visual elements (such as table null lines and the like), output the compressed text conforming to the compressed representation grammar, reduce the data volume of the generated text, reduce the resource burden of data transmission and storage, do not need subsequent extra redundant information removal operation, and improve the data processing efficiency in subsequent data processing. And the calculation overhead can be reduced, and the model reasoning accuracy and reliability can be improved.

The present application relates to a kind of model processing device of oblique photography model optimization, at least including at least one processor that can be connected with terminal in wired or wireless mode, it is characterized in that, the processor is configured as: based on the information of gathering oblique photography initial model constructs optimization model;With the mode of removing unnecessary basic body parameter of same level, realize first data compression;With halffloat data structure storage triangular net vertex position and normal data and load same triangular net with the halffloat data structure;Based on the level order of oblique photography initial model, layer by layer optimization.It is compared with other optimization mode, in the case where precision loss is less, the volume of model and the operation amount when loading are greatly reduced, so as to facilitate mobile terminal device and low performance device to load and show oblique photography model.

The application discloses a video image compression method, step one, marking: obtaining a plurality of frame images contained in a video, and marking each frame image according to original playing order in digital sequence; step two, optimization; step three, association; step four, frame extraction; step five, compression, and relates to the technical field of video images. The video image compression method can strip the same part in a plurality of static images in the association frame by extracting the feature part in the association frame, so that the single frame static volume is reduced, and the volume of a video file composed of a plurality of frame static images is also greatly reduced by reducing the volume of the frame static image, and the video file can be further reduced by compressing the file, so that the storage space can be reduced, and the video file can be quickly transmitted.

The invention discloses a dynamic three-dimensional data conversion method based on an open dynamic asset format, which solves the defects of the existing animation format in the aspects of compatibility, expansibility, file volume and dynamic support through a modularized layered structure, a dynamic animation system, physical and animation fusion, cross-medium compatibility, safety cooperation and efficient analysis technology. The converted data supports hierarchical compression, nodal program logic, real-time physical interaction and multi-platform efficient decoding, is suitable for the fields of games, movies and televisions, VR / AR and the like, and has remarkable technical advantages.

The invention relates to the technical field of data compression, and discloses a data storage method and system for a process program operation record and a storage medium, and the method comprises the following steps: S1, extracting an operation record text during operation of a process program, reading the operation record text, and determining a fixed character string; s2, fixed character strings of the running record text are removed through a maximum matching algorithm, and variable character strings of the running record text are reserved; s3, constructing the variable character and the fixed character string through a Huffman tree to obtain a Huffman code; and S4, performing compression processing on the operation record text by using Huffman coding, and storing the compressed operation record text in a database. The lossless compression technology is realized, the text volume of the operation record is reduced, the storage space occupation of the database is reduced, and the data storage pressure is relieved; and a sub-table storage strategy is adopted, compressed coded data is separated from dictionary data, and the bottleneck of single-table data expansion and big data field operation is avoided.

The invention relates to a data compression method and device, equipment, a storage medium and a program product. The method comprises the steps that a standard data volume threshold value and a data sampling amount of a data stream to be processed are obtained, the standard data volume threshold value and the data sampling amount are determined according to the data compression requirement of the data stream to be processed, and the data stream to be processed is processed according to the standard data volume threshold value, the data sampling amount and a reference data block with the determined data compression rate in a database; the data compression rate of each data block in the to-be-processed data stream is determined, compression processing is carried out on compressible data blocks according to the data compression requirement and the data compression rate of each data block in the to-be-processed data stream, and the compressible data blocks comprise each data block in the to-be-processed data stream. By adopting the method, the data compression processing can be ensured to be matched with the data compression requirement, so that the effective utilization of system resources and storage space is ensured.

The invention discloses a data dynamic compression and transmission system based on a multi-level storage model, and the system is characterized in that the system comprises a data preparation unit; a multi-level storage model unit; a data feature analysis unit; a dynamic data compression unit; a dynamic data transmission unit; wherein the multi-level storage model unit further comprises a data coding unit, a data structure unit and a data entity unit. According to the method, a multi-level storage model is designed, data is divided into three levels of'code-structure-entity ', and low-frequency synchronization and efficient coupling with a terminal are realized at a center end by taking a'code-structure' part in a data model as a constraint, so that efficient management and storage of the data are realized; in a data entity transmission process, data security, data volume and redundancy evaluation, network fluctuation monitoring and user real-time evaluation are performed on a transmission file, and dynamic switching between a compression tool and a transmission protocol is performed, so that the compression effect and the transmission efficiency are further improved.

The application discloses a method, device and electronic equipment for image compression. The method comprises the following steps: obtaining an original image to be compressed; dividing the original image into a plurality of pixel blocks, and performing quantization processing on each pixel point in each pixel block to obtain a quantization coefficient corresponding to each pixel point; determining a probability value corresponding to each pixel point in the original image by using a probability model, and determining a target compression algorithm from a plurality of compression algorithms according to the probability value, wherein the probability value is used to represent a gray scale corresponding to the pixel point, and the coding efficiency of different types of compression algorithms in the plurality of compression algorithms is different; and performing compression processing on the quantization coefficient corresponding to each pixel point according to the target compression algorithm to obtain a compressed image. The application solves the technical problems of large data volume and low transmission efficiency in related art when transmitting an image through a satellite.

The invention provides an image transmission method and device, and the method comprises the steps: obtaining a to-be-transmitted image, and segmenting the to-be-transmitted image into at least one image macro block; determining a compression algorithm corresponding to the at least one image macro block based on the complexity of the at least one image macro block; according to the current signal intensity, based on a compression algorithm and a compression parameter corresponding to the compression algorithm, performing compression processing on the at least one image macro block to generate compressed data; and when the data volume accumulation of the compressed data reaches a preset economic transmission batch or a key frame is detected, activating a preset transmission mode to transmit the compressed data based on an activation condition meeting the preset transmission mode, and controlling the transmission module to enter a dormant state after the compressed data transmission is completed. On-demand activation of a transmission mode can be realized, sleep power consumption is reduced, battery life is prolonged, and low-power-consumption scene requirements are met.

A method for operating a storage array includes: generating a per-chunk key and a deduplication key for a data chunk based on a hash value, wherein the per-chunk key is stored in a metadata file; obtaining a per-volume key for a volume of the storage array; encrypting a metadata folder associated with the volume to generate an encrypted metadata folder using the per-volume key, in which the encrypted metadata folder comprises at least the metadata file; compressing the data chunk to generate a compressed data chunk (CDC); encrypting the CDC to generate an encrypted compressed data chunk (ECDC) using the per-chunk key, in which the ECDC is stored in the volume; obtaining storage location information of the ECDC; updating a hash value lookup table based on the storage location information; and initiating notification of a user of a client about completion of a write request.

The invention discloses a data compression method and system based on block adaptive quantization, and the method comprises the steps: carrying out the data segmentation of a received continuous data flow according to a preset fixed length, and obtaining a plurality of continuous data blocks; respectively extracting statistical characteristics of each data block, and dynamically distributing a quantization bit number for the data block according to the statistical characteristics of each data block; performing uniform quantization on each sample in the data block based on the quantization bit number, and calculating a quantization index of each sample; according to the quantization index and the quantization bit number, data bit widths of all samples in the data block are converted and then combined, and a compressed data body is obtained; and packaging the compressed data body and the block header information of the data block into a data frame, and transmitting the data frame to an upper computer for storage. Through block adaptive quantization, according to the data statistical characteristics of the data block, the quantization bit number is dynamically allocated to the data block, the data volume is compressed to the dynamically quantized bit number for transmission, and the system data bandwidth bottleneck is effectively relieved.

The embodiment of the invention provides a content generation method, device, system and equipment and a computer readable storage medium, and relates to the technical field of artificial intelligence. The method comprises the following steps: a client decompresses a code stream to obtain content features corresponding to content description information; and generating reconstruction content corresponding to the content description information according to the features. As the data volume of the content features is far smaller than that of the content, the data volume of the code stream obtained by compressing the content features is smaller than that of the code stream obtained by compressing the content, and the compression rate of the code stream is effectively improved. Besides, due to the fact that the data size of the code stream is small and the occupied bandwidth is small, the code stream can be rapidly transmitted, the transmission delay is shortened, the code stream loss caused by code stream transmission is further reduced, the transmission delay is shortened, and the influence on the quality of the reconstructed content is reduced.

The invention discloses a character video compression method, system and device and a storage medium, and relates to the technical field of video processing, and the method comprises the steps: a coding end carries out the semantic decoupling of an input character video, and obtains the structure information representing the appearance texture of a character and the motion information representing the posture change of the character; performing layered compression coding on the structure information and the motion information to generate a corresponding structure code stream and a corresponding motion code stream; the decoding end carries out hierarchical decoding to obtain recovered structure information and motion information; calling the generative model to reconstruct Gaussian three-dimensional character representation; and driving the Gaussian three-dimensional character representation based on the motion information, and rendering to generate an output video. The problem of insufficient compression quality caused by mutual interference of appearance and motion information in a figure video is solved. By carrying out hierarchical compression coding on the structure information and the motion information and hierarchical decoding corresponding to a decoding end, the effective reduction of the figure video data volume and the retention of key information are realized.