A data processing method and device

A technology for data and data storage, applied in the field of data processing, can solve problems such as data migration, and achieve the effect of avoiding data migration

Active Publication Date: 2022-03-08
CHINANETCENT TECH
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present invention provides a data processing method and device, which are used to solve the problem of data migration in the cluster caused by adding physical nodes in the cluster during capacity expansion in the prior art, and thus the efficiency of data storage and reading by users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method and device
  • A data processing method and device
  • A data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments . Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0031] figure 1 A schematic diagram of a distributed storage system applying an embodiment of the present invention is shown. Such as figure 1 As shown, the distributed storage system includes three layers, a business layer 101, an interface layer 102, and a storage backend 103; wherein, the interface layer 102 provides different interfaces for users, such as block storage interfaces, object storage interfaces, and file system interfaces;...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiments of the present invention relate to the field of data processing, and in particular to a data processing method and device, which are used for data migration in the cluster caused by adding physical nodes in the cluster during capacity expansion in the prior art, and then users store data and read data efficiently. . In the embodiment of the present invention, it is applicable to a distributed distributed storage system. The distributed storage system includes multiple clusters, and each cluster belongs to at least one virtual group; the method includes: obtaining the user identification of the data to be stored; The user identification of the data determines the virtual group that stores the data to be stored; according to the storage rules of the virtual group that stores the data, determines the target storage cluster that stores the data to be stored; the target storage cluster is one of the multiple clusters ; Store the data to be stored in the target storage cluster. In the embodiment of the present invention, capacity expansion or contraction is realized by adding or deleting clusters in a virtual group, so as to avoid data migration caused by adding or deleting nodes in a cluster.

Description

technical field [0001] The embodiments of the present invention relate to the field of data processing, and in particular, to a data processing method and device. Background technique [0002] The distributed storage system disperses and stores data on multiple independent physical servers, and multiple independent physical servers share the load of data stored in the system. However, in the distributed storage system of the prior art, if expansion is to be performed, physical servers are usually added horizontally; in order to maintain the balance of the storage structure in the distributed storage system, the system will spontaneously expand the physical server to other physical servers on the physical server. Part of the data is migrated to the newly added physical server. [0003] Moreover, with the expansion of the scale of the physical server, the occurrence rate of various physical failures such as unavailability of a physical server, abnormal network or disk damage ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06H04L67/1097
CPCH04L67/1097G06F3/061G06F3/0629G06F3/0655G06F3/0665G06F3/067
Inventor 郭金湖邹博引吴小云陈青龙
Owner CHINANETCENT TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap