Online compression method and device, computer equipment and storage medium

A compression method and technology for compressing data, applied in computing, instrumentation, electrical digital data processing, etc., can solve problems such as low compression efficiency and high compression cost

Pending Publication Date: 2019-08-20
PING AN TECH (SHENZHEN) CO LTD
View PDF2 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Embodiments of the present invention provide an online compression method, device, computer equipment, and storage medium to solve the problem of high compression cost and low compression efficiency caused by the compression of the copy data at the storage nodes where the copies are located

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Online compression method and device, computer equipment and storage medium
  • Online compression method and device, computer equipment and storage medium
  • Online compression method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0037] The online compression method provided by this application can be applied in such as figure 1 In the application environment of , the client communicates with the master replica server and the slave replica server through the network. Among them, clients include but are not limited to various personal computers, notebook computers, smart phones, tablet computers and portable wearable devices. The primary replica server refers to the server used...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an online compression method and device, computer equipment and a storage medium, and the method comprises the following steps executed by a main copy server: obtaining a datawriting request sent by a client, the data writing request comprising original data; compressing the original data to obtain compressed data, and writing the compressed data into object storage equipment, the compressed data carrying a compression label and a compression length; acquiring a corresponding original data attribute based on the original data; transmitting the compressed data, the compression label, the compression length and the original data attribute to the slave replica server through independent threads. The compression cost is saved, and the compression efficiency is improved.

Description

technical field [0001] The invention relates to the field of computer development, in particular to an online compression method, device, computer equipment and storage medium. Background technique [0002] In distributed storage, in order to improve data reliability, multiple copies (including one master copy and multiple slave copies) are often used to save an object / file in multiple places in the cluster corresponding to the multi-copy, such as : Ceph (distributed storage system) adopts three copies (one master copy and two slave copies) scheme by default. However, multi-copy storage increases the storage space and increases the cost of enterprise data storage. In order to reduce the cost of data storage and reduce the storage space occupied, many distributed storages provide compression functions. For example, ceph introduced bluestore in J version and provided online compression functions, but each copy data written must be stored in the respective copy location. The ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0608G06F3/0646G06F3/0643G06F3/067
Inventor 龚红斌
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap