Data storage method and device, data storage system and readable storage medium

A data storage system and data storage technology, applied in the direction of electric digital data processing, input/output process of data processing, redundant data error detection in operation, etc., can solve the problem of low data storage efficiency, and achieve The effect of improving storage space utilization, reducing redundancy, and fast data storage rate

Active Publication Date: 2018-06-22
NEW H3C TECH CO LTD
View PDF3 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, although the erasure code storage strategy can solve the problem of high redundancy, it is accompanied by a large number of calculations, so that the data storage efficiency of the erasure code storage method is much lower than that of the copy storage method.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device, data storage system and readable storage medium
  • Data storage method and device, data storage system and readable storage medium
  • Data storage method and device, data storage system and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0075]In the second implementation manner, the speed of sending data to the erasure code storage pool 12 is determined according to the business conditions of the copy storage pool 11 receiving data and the available resources of the data storage system 10 . Wherein, the available resources of the data storage system 10 may be CPU utilization, idle processes or threads, remaining I / O resources, remaining bandwidth, etc. of the data storage system 10 . The data storage system 10 can preferentially allocate resources according to the current available resource situation to perform data receiving services (to ensure that the data to be stored in the client 20 can be written in time), if the available resources are still idle after being allocated to the data receiving service, then Allocate the remaining free resources to the data sending service (download data to the erasure code storage pool 12). In this case, the speed of sending data to the erasure code storage pool 11 may be...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention provide a data storage method and device, a data storage system and a readable storage medium. The method comprises the following steps of: firstly, receiving to-be-storeddata sent by a client, and writing the to-be-stored data into a copy storage pool to carry out copy storage; secondly, when the to-be-stored data is successfully written in the copy storage pool, sensing a data writing success response to the client; and finally, sending at least a part of data stored in the copy storage pool to an erasure code storage pool and storing the part of data through erasure codes. According to the method, the to-be-stored data is firstly written into the copy storage pool with a high storage speed so as to ensure that the client can receive the data writing successresponse in time, so that favorable experience of high data storage speed is provided for the users; and meanwhile, data in the copy storage poo is sent to the erasure code storage pools to be stored, so that the data storage redundancy can be reduced, and the data storage space utilization rate can be improved.

Description

technical field [0001] The present application relates to the technical field of distributed storage, and in particular, to a data storage method, device, data storage system, and readable storage medium. Background technique [0002] In the prior art, distributed storage can realize the storage of massive data. For mass storage systems, data redundancy is an important indicator. Redundancy refers to the ratio of the actual stored data volume of a storage object to the data volume of the storage object itself. The copy storage method can improve data security and reliability, but there is a problem of high redundancy. While high redundancy brings high reliability, it means more space "waste" and higher storage costs. Compared with performance and reliability, many users pay more attention to cost, and the extravagant high performance and high reliability of replicas are unacceptable. So the erasure code storage strategy appeared. However, although the erasure code stora...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14G06F3/06
CPCG06F3/0608G06F3/0611G06F3/067G06F11/1448
Inventor 刘浩
Owner NEW H3C TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap