Data compression method and device, computer equipment and storage medium

Abstract

The invention relates to a data compression method and device, computer equipment and a storage medium. The method comprises the steps of obtaining a to-be-compressed initial source file; according tothe frequency of each key name appearing in multiple pieces of source data in the initial source file, encoding the key name of each piece of source data, and converting the corresponding key name into a corresponding encoding sequence; updating the initial source file based on the coding sequence to obtain a first intermediate compressed file; performing merging and deduplication processing on the data meeting the key value repetition condition in the first intermediate compressed file to obtain a second intermediate compressed file; and performing encoding compression processing on the second intermediate compressed file by adopting a string table compression mode to obtain a target compressed file corresponding to the initial source file. The second intermediate compressed file is further compressed in a string table compression mode, and based on the encryption property of the string table compression mode, the data privacy can be guaranteed while the compression rate is considered.

Description

technical field [0001] The present application relates to the technical field of character string data processing, in particular to a data compression method, device, computer equipment and storage medium. Background technique [0002] Due to its advantages of easy portability, simple operation, quick response, rich load, wide range of missions, low environmental requirements for take-off and landing, and autonomous flight, UAVs have become more and more widely used in inspection scenarios of substation equipment in recent years. middle. However, due to the inspection system required for the above-mentioned inspection scenarios, the system components are complex, and the number of related intelligent hardware that makes up the system often reaches as many as dozens. Moreover, in order to achieve better inspection results, it is also necessary to maintain high-frequency inspections. In addition, in order to keep the recorded inspection equipment information traceable, it is...

AI Technical Summary

Problems solved by technology

Therefore, it is necessary to design a set of specific data processing protocols and compression algorithms for the above inspection scenarios to reduce storage and transmission costs. However, in this scenario, due to the large amount of substation data and the high security requirements High, traditional compression algorithms often cannot take into account the relevant requirements of compression rate and security

Images