Method, system and device for compressing data into disk and readable storage medium

A technology for compressing data and storage media, applied in the input/output process of data processing, electrical digital data processing, instruments, etc., can solve the problems of IO performance impact, achieve the effect of improving storage performance and avoiding impact

Active Publication Date: 2020-06-19
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF12 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, with the increasing expansion of data services, the requirements for high load and low latency of storage devices are getting higher and higher, which requires storage devices to have a sufficiently high read and write speed. In the existing data compressio

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, system and device for compressing data into disk and readable storage medium
  • Method, system and device for compressing data into disk and readable storage medium
  • Method, system and device for compressing data into disk and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0039] The core of this application is to provide a method, system, device, and readable storage medium for compressing data to disk, which are used to reduce the impact of compressed data on IO performance when the compressed data is dropped to disk.

[0040] In order to make the purpose, technical solutions and advantages of the embodiments of this application clearer, the technical solutions in the embodiments of this application will be described clearly and completely in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments It is a part of the embodiments of this application, but not all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of this application.

[0041] Please refer to figure 1 , figure 1 This is a flowchart of a method for compressing data to disk provided by an embodiment of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for compressing data into a disk, which comprises the steps of obtaining compressed data, and determining the length of the compressed data; storing the compressed data into a linked list, and adding the length of the compressed data into the length of the linked list; wherein the length of the linked list is the total length of all compressed data in the linked list; judging whether the linked list length exceeds a threshold value or not; and if yes, allocating idle threads to merge all the compressed data in the linked list, and performing disk falling operation on the merged compressed data. According to the method, the merging process of the compressed data is decoupled from the IO path, compressed data merging does not need to be carried out in the IOprocess of compression disk falling, and the idle threads are specially allocated to carry out the merging work of the compressed data, so that the influence on IO performance is avoided, CPU resources are fully utilized, and the storage performance is improved. Meanwhile, the invention further provides a system and equipment for compressing the data into the disk and a readable storage medium, and the system and equipment have the above beneficial effects.

Description

technical field [0001] The present application relates to the field of compressing data to disk, and in particular to a method, system, device and readable storage medium for compressing data to disk. Background technique [0002] Data compression refers to reducing the amount of data to reduce storage space without losing useful information, improving its transmission, storage and processing efficiency, or reorganizing data according to a certain algorithm to reduce data redundancy and storage space a technical method. With the development of data compression technology, the amount of data in the storage system has been greatly reduced, thereby reducing the storage space and improving the efficiency of system transmission, storage and processing. [0003] However, with the increasing expansion of data services, the requirements for high load and low latency of storage devices are getting higher and higher, which requires storage devices to have a sufficiently high read and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0608G06F3/0638G06F3/064G06F3/0676G06F3/0656G06F3/0659G06F3/0674
Inventor 亓国强
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap