Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A data processing method and device

A data processing and data technology, applied in the field of data processing, can solve problems such as data migration

Active Publication Date: 2019-04-09
CHINANETCENT TECH
View PDF5 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present invention provides a data processing method and device, which are used to solve the problem of data migration in the cluster caused by adding physical nodes in the cluster during capacity expansion in the prior art, and thus the efficiency of data storage and reading by users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method and device
  • A data processing method and device
  • A data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments . Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0031] figure 1 A schematic diagram of a distributed storage system applying an embodiment of the present invention is shown. Such as figure 1 As shown, the distributed storage system includes three layers, a business layer 101, an interface layer 102, and a storage backend 103; wherein, the interface layer 102 provides different interfaces for users, such as block storage interfaces, object storage interfaces, and file system interfaces;...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention relates to the field of data processing, in particular to a data processing method and device, and is used for solving the problems that in the prior art, physical nodes are added in a cluster during capacity expansion, data migration in the cluster is caused, and then the data storage and reading efficiency of a user is improved. In the embodiment of the invention,the method is suitable for a distributed storage system, the distributed storage system comprises a plurality of clusters, and each cluster belongs to at least one virtual group; The method comprisesthe steps of obtaining a user identifier to which to-be-stored data belongs; Determining a virtual group for storing the to-be-stored data according to the user identifier of the to-be-stored data; Determining a target storage cluster for storing the to-be-stored data according to a storage rule of the virtual group of the to-be-stored data, Wherein the target storage cluster is one of the plurality of clusters; And storing the to-be-stored data into the target storage cluster. According to the embodiment of the invention, the capacity expansion or reduction is realized by adding or deletingthe cluster in the virtual group, so that the data migration caused by adding or deleting the nodes in the cluster is avoided.

Description

technical field [0001] The embodiments of the present invention relate to the field of data processing, and in particular, to a data processing method and device. Background technique [0002] The distributed storage system disperses and stores data on multiple independent physical servers, and multiple independent physical servers share the load of data stored in the system. However, in the distributed storage system of the prior art, if expansion is to be performed, physical servers are usually added horizontally; in order to maintain the balance of the storage structure in the distributed storage system, the system will spontaneously expand the physical server to other physical servers on the physical server. Part of the data is migrated to the newly added physical server. [0003] Moreover, with the expansion of the scale of the physical server, the occurrence rate of various physical failures such as unavailability of a physical server, abnormal network or disk damage ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06H04L29/08
CPCH04L67/1097G06F3/061G06F3/0629G06F3/0655G06F3/0665G06F3/067
Inventor 郭金湖邹博引吴小云陈青龙
Owner CHINANETCENT TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com