Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data compression method, device, computer equipment and storage medium

A data compression and data technology, which is applied in computing, electrical digital data processing, input/output process of data processing, etc., to achieve the effect of improving performance, improving experience, and avoiding long tail effect

Active Publication Date: 2022-05-17
PING AN TECH (SHENZHEN) CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the Ceph distributed storage system is aimed at block storage applications, especially databases and other application scenarios that require high storage delays. Reducing storage costs (data compression) and IO operation delays has become a fish and bear's paw, which cannot be combined. have to

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data compression method, device, computer equipment and storage medium
  • Data compression method, device, computer equipment and storage medium
  • Data compression method, device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058]In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0059] The data compression method provided by this application can be applied to such as figure 1 shown in the application environment. Wherein, the server 104 communicates with the storage system 102 through a network. The server 104 obtains the current load situation of the storage system 102, and then judges whether the current load situation meets the preset compression requirement, and if so, the server continues to judge whether the data of the object to be compressed stored in the non-compressed area is being read or written, if not If it is being read or written,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present application relates to the field of data storage, in particular to a data compression method, device, computer equipment and storage medium. The method includes: obtaining the current load condition of the storage system; when the current load condition meets the preset compression requirements, judging whether the data of the object to be compressed stored in the non-compressed area is being read or written; when the to-be-compressed When the data of the object is not being read and written, the data of the object to be compressed is compressed, and during the compression process, when the metadata corresponding to the object to be compressed is processed, the data of the object to be compressed is prohibited from being Read and write, when the data of the object to be compressed is compressed, the corresponding data to be compressed is allowed to be read and written; the compressed data is stored in the compressed area. Adopting this method can take into account both data compression and read and write operations.

Description

technical field [0001] The present application relates to the technical field of data storage, in particular to a data compression method, device, computer equipment and storage medium. Background technique [0002] The traditional Ceph distributed storage system uses BlueStore as the back-end storage module, and the data compression function is implemented in BlueStore. The native BlueStore's compression function is online compression in the usual sense, that is, the data is compressed during the write operation to the storage system, and the data is compressed and written to the storage medium after the write operation is completed. [0003] The biggest disadvantage of the above-mentioned online compression is that it has a very large impact on the delay of the write operation. After the compression function is turned on, the write operation IOPS (input and output per second (or the number of reads and writes)) of the system drops significantly. Therefore, the Ceph distr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0631G06F3/064G06F3/0652G06F3/067
Inventor 姜文峰
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com