Data storage method and device and distributed storage system

A distributed storage and data storage technology, which is applied in electrical digital data processing, data processing input/output process, instruments, etc., can solve the problems of unbalanced storage load, data loss, affecting system storage efficiency, etc. The effect of unbalanced storage load

Active Publication Date: 2019-07-05
ZHEJIANG UNIVIEW TECH CO LTD
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the above-mentioned scheduling method, when a newly added logical storage volume or a previously failed logical storage volume resumes working status, the amount of stored data in this part of the logical storage volume will be significantly less than that of other logical storage volumes. Still following the method of scheduling files to be stored according to the hash value of the file name will lead to a serious imbalance in the storage load among the logical storage volumes, which will affect the storage efficiency of the system and may cause data loss at that time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method and device and distributed storage system
  • Data storage method and device and distributed storage system
  • Data storage method and device and distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. The components of the embodiments of the application generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations.

[0041] Accordingly, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the application. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art w...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data storage method and device and a distributed storage system, and the method comprises the steps: setting the distributed storage system to be in a first storage mode whenit is detected that the stored data volume of a logic storage volume is higher than a preset upper limit, and the stored data volume of the logic storage volume is lower than a preset lower limit; when the to-be-stored file is received, determining a storage address for the to-be-stored file; when the storage address determined for the to-be-stored file is the logic storage volume with the higheststored data volume in the plurality of logic storage volumes, taking the logic storage volume as a first logic storage volume, and selecting a second logic storage volume; and storing the to-be-stored file into a second logic storage volume, and establishing a link file corresponding to the to-be-stored file on the first logic storage volume. Therefore, under the condition that the original datascheduling strategy is not changed, the redistribution of the to-be-stored files can be automatically realized, and the problem of unbalanced storage load among the logical storage volumes is avoided.

Description

technical field [0001] The present application relates to the technical field of data storage, and in particular, to a data storage method, device, and distributed storage system. Background technique [0002] The distributed storage system is a storage cluster system composed of multiple physically independent storage node devices. Through the network, the physical resources on multiple storage nodes form a unified large storage pool to provide external storage services, which can effectively improve data Storage disaster recovery rate. In a distributed storage system, data or files to be stored are allocated to different logical storage volumes for storage through some preset scheduling policies. Wherein, one scheduling method of the existing distributed storage system is to determine a logical storage volume for the file to be stored according to the hash value of the file name, so as to realize storage load balancing. However, in the above-mentioned scheduling method, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
CPCG06F3/0607G06F3/0634G06F3/067
Inventor 陈继芬
Owner ZHEJIANG UNIVIEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products