Method and device for managing heterogeneous copy in distributed storage system

A distributed storage and copy technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as troublesome and heavy workload, and achieve the effect of improving reliability and improving work efficiency

Active Publication Date: 2015-11-25
ZTE CORP
View PDF4 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, if the business wants to analyze the data of each column, it will be more troublesome. It needs to be read out and re-integrated. The greater the amount of data, the greater the workload

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for managing heterogeneous copy in distributed storage system
  • Method and device for managing heterogeneous copy in distributed storage system
  • Method and device for managing heterogeneous copy in distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] According to one aspect of the present invention, a method for managing heterogeneous copies in a distributed storage system is disclosed. Firstly, obtain the write request parameters used to store the copies of files; location information; then convert the copy of the file according to the pre-specified format according to the write request parameters to obtain multiple heterogeneous copies of files in different formats; finally, according to the location information of the storage server obtained from the metadata server, convert the converted multiple Heterogeneous copies of files in different formats are stored separately on designated storage servers.

[0048]Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Disclosed are a method and apparatus for heterogeneous replica management in a distributed storage system. The method comprises: obtaining write request parameters of a replica for storing a file; obtaining from a metadata server the position information of each storage server in the distributed storage system according to the write request parameters; according to the write request parameters, converting the replica of the file into a plurality of heterogeneous replicas of the file in different formats on the basis of pre-designated formats; and storing the plurality of heterogeneous replicas of the file in different formats obtained from conversion, in the designated storage servers respectively according to the position information of the storage servers obtained from the metadata server. With the technical solution discussed above, a file can be used to store a plurality of different heterogeneous replicas respectively in a plurality of storage servers, and in case of reading the heterogeneous replicas of the file, the corresponding heterogeneous replicas can be read as needed, thus the working efficiency of users in data processing can be improved effectively.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a method and device for managing heterogeneous copies in a distributed storage system. Background technique [0002] Big data has applications in various fields such as communications, Internet, finance, medical care, military industry, and science. Compared with traditional data warehouse applications, big data analysis has the characteristics of large data volume and complex query and analysis. For distributed file systems, it is natural to manage massive amounts of data. Take the traffic analysis data of China Telecom as an example. There will be new data every day, and each region will have different data. Over time, the data of ten years, for example, will be a massive amount of data. If the operator wants to calculate rules based on these data and designate a more reasonable billing plan, then how to improve the reading efficiency of these huge data stored in the dis...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/00
Inventor 程宁韩盛中
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products