Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for dragging and extracting data

A data and data management technology, applied in the computer field, can solve problems affecting data access services, etc., and achieve the effect of avoiding overload and improving concurrency

Inactive Publication Date: 2017-10-31
BEIJING QIHOO TECH CO LTD +1
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Depend on figure 2 It can be seen that data dragging will only cause the load of the three nodes H, A, and C to be significantly higher than other nodes, which will seriously affect the data access services provided by these three nodes.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for dragging and extracting data
  • Method and device for dragging and extracting data
  • Method and device for dragging and extracting data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0041] In order to solve the above-mentioned technical problems, the embodiment of the present invention provides a data dragging method, which is applied to a distributed storage system cluster. The distributed storage system cluster includes multiple original nodes, and the multiple original nodes are managed on the ring storage space. data. image 3 A flow chart of a data dragging method according to an embodiment of the present...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a method and device for dragging and fetching data. The method includes: obtaining a trigger event for adding a new node in a distributed storage system cluster, calculating the range of new nodes that the new node is about to manage data on the ring storage space; querying N sub-ranges that make up the new node range, where each original node manages data in the ring storage space is divided into multiple sub-ranges, and the data of each sub-range is stored in a different original node; N sub-ranges are stored from Among the original nodes of the data in the range, select the drag node that provides the data of N sub-ranges for the new node; drag the data of each sub-range in the corresponding N sub-ranges from each selected drag node, and drag the dragged The data of the N subranges are synthesized into the data of the new node range. The invention can ensure the load balance of each original node in the cluster, improve the concurrency of data dragging, and speed up the entire Streaming process.

Description

technical field [0001] The invention relates to the technical field of computers, in particular to a method and device for dragging and fetching data. Background technique [0002] Cassandra is a typical distributed storage system with a ring structure without a central node and implemented by relying on DHT (Distributed Hash Table, Distributed Hash Table) technology. The Cassandra data storage space can be abstracted into a ring structure, and the data is dispersed in this ring storage space through hash. Each node is responsible for managing a certain continuous Range (range) on this ring storage space, and the data falling on this Range space is stored on this node. [0003] Cassandra, like other distributed storage systems, ensures data reliability through a multi-copy redundant storage mechanism. In order to ensure that the service can continue to be provided in the case of one or several machine failures, the distributed storage system will try to distribute multiple...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
Inventor 王锋
Owner BEIJING QIHOO TECH CO LTD