Data compression method and device, computer equipment and storage medium

A technology of data compression and computer programs, applied in computing, digital data processing, input/output process of data processing, etc., to improve performance, ensure transactional performance, and avoid long-tail effects

Active Publication Date: 2020-07-28
PING AN TECH (SHENZHEN) CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the Ceph distributed storage system is aimed at block storage applications, especially databases and other application scenarios that require high storage delays. Reducing storage costs (data compression) and IO operation delays has become a fish and bear's paw, which cannot be combined. have to

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data compression method and device, computer equipment and storage medium
  • Data compression method and device, computer equipment and storage medium
  • Data compression method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058]In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0059] The data compression method provided by this application can be applied to such as figure 1 shown in the application environment. Wherein, the server 104 communicates with the storage system 102 through a network. The server 104 obtains the current load situation of the storage system 102, and then judges whether the current load situation meets the preset compression requirement, and if so, the server continues to judge whether the data of the object to be compressed stored in the non-compressed area is being read or written, if not If it is being read or written,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of data storage, in particular to a data compression method and device, computer equipment and a storage medium. The method comprises the steps of obtaining a current load condition of a storage system; when the current load condition meets a preset compression requirement, judging whether the data of the to-be-compressed object stored in the non-compression areais being read and written or not; when the data of the to-be-compressed object is not read and written, compressing the to-be-compressed object; forbidding the data of the to-be-compressed object from being read and written when the metadata corresponding to the to-be-compressed object is processed in the compressing process, and allowing the data corresponding to the to-be-compressed object to be read and written when the data of the to-be-compressed object is compressed; and storing the compressed data to a compression area. By adopting the method, data compression and read-write operationcan be both considered.

Description

technical field [0001] The present application relates to the technical field of data storage, in particular to a data compression method, device, computer equipment and storage medium. Background technique [0002] The traditional Ceph distributed storage system uses BlueStore as the back-end storage module, and the data compression function is implemented in BlueStore. The native BlueStore's compression function is online compression in the usual sense, that is, the data is compressed during the write operation to the storage system, and the data is compressed and written to the storage medium after the write operation is completed. [0003] The biggest disadvantage of the above-mentioned online compression is that it has a very large impact on the delay of the write operation. After the compression function is turned on, the write operation IOPS (input and output per second (or the number of reads and writes)) of the system drops significantly. Therefore, the Ceph distr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0631G06F3/064G06F3/0652G06F3/067
Inventor 姜文峰
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap