Method and system used for data storage and used in distributed storage system

A distributed storage and data storage technology, applied in the field of data processing, can solve the problem of low reliability of data storage, and achieve the effects of avoiding occupation, improving reliability and ensuring security

Inactive Publication Date: 2013-02-20
JIANGNAN INST OF COMPUTING TECH
View PDF4 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The technical problem to be solved in this application is to provide a data storage method applied to a distributed storage system to solve the technical problem of low data storage reliability in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system used for data storage and used in distributed storage system
  • Method and system used for data storage and used in distributed storage system
  • Method and system used for data storage and used in distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0160] Corresponding to the method provided in Embodiment 1 of a data storage method applied in a distributed storage system of the present application, see Figure 4 , the present application also provides Embodiment 1 of a data storage device applied in a distributed storage system. In this embodiment, the device may include:

[0161] The data category determining module 401 is configured to determine the data category of the data to be stored.

[0162] The data to be stored may refer to metadata or file data. File data and metadata are two forms of stored data managed by the file system. File data includes directory data and actual data, while metadata is used to organize and manage file data.

[0163] The data category refers to a type feature used to distinguish different data. The data category can be divided according to the file format, file type, size, etc. of the data to be stored.

[0164] Wherein, when the data to be stored is a file to be stored, the data categ...

Embodiment 2

[0175] Corresponding to the method provided in Embodiment 2 of a data storage method applied in a distributed storage system of the present application, see Figure 5 , the present application also provides Embodiment 2 of a data storage device applied in a distributed storage system. In this embodiment, the device may include:

[0176] The data category determining module 501 is configured to determine the data category of the data to be stored.

[0177] When the data to be stored is a file to be stored, the data category determination module may include:

[0178] Obtaining a module for obtaining the file name suffix of the file to be stored;

[0179] The category determining submodule is used to determine the data category of the file to be stored according to the file name suffix.

[0180] A rule search module 502, configured to search for a preset storage rule corresponding to the data category, where the preset storage rule includes the number of copies and different st...

Embodiment 3

[0205] Corresponding to the method provided in Embodiment 3 of a data storage method applied in a distributed storage system of the present application, see Image 6 , the present application also provides Embodiment 3 of a data storage device applied in a distributed storage system. In this embodiment, the device may include:

[0206] A data category determination module 601, configured to determine the data category of the data to be stored;

[0207] A rule search module 602, configured to search for a preset storage rule corresponding to the data category, where the preset storage rule includes the number of copies and different storage location information;

[0208] A copy generation module 603, configured to generate a data copy of the data to be stored according to the number of copies;

[0209] The data storage module 604 is configured to store the data copies in storage nodes corresponding to different storage location information.

[0210] Since a distributed storag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a system used for data storage and used in a distributed storage system. The method comprises the steps of determining a data category of data to be stored; looking up a preset storage rule corresponding to the data category of the data to be stored, wherein the preset storage rule comprises the number of copies and different storage location information; generating data copies of the data to be stored according to the number of copies; and storing data copies at storage nodes corresponding to the different storage location information respectively. According to the method and the system, different numbers of data copies are generated for different data categories for storage, so that the safety, the expansibility, the operability and the like of the stored data are guaranteed, the occupancy of system resources is avoided, and the reliability of the storage system is effectively improved.

Description

technical field [0001] The present application relates to the technical field of data processing, in particular to a data storage method and system. Background technique [0002] The storage system refers to a computer system composed of various storage devices for storing programs and data, control components, and equipment (hardware) and algorithms (software) for managing information scheduling. With the application needs of large-scale data storage, distributed The storage system is to disperse and store data in multiple independent servers. Since multiple servers can be used to share the storage load and improve the reliability and storage efficiency of the system to a certain extent, it has become the main development mode of data storage. [0003] However, with the increasing scale of storage systems in systems such as high-performance computing centers, data centers, and cloud storage service centers, and the number of servers included, reliability is still one of the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
Inventor 蒋金虎李希何晓斌王红艳王晞阳魏巍余婷陈起郑翔杨京
Owner JIANGNAN INST OF COMPUTING TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap