Unlock instant, AI-driven research and patent intelligence for your innovation.

Data global processing system and method

A global processing and data technology, applied in the computer field, can solve problems such as inability to guarantee data storage efficiency, huge cost, and poor scalability of hash algorithm

Active Publication Date: 2018-02-06
BEIJING QIHOO TECH CO LTD
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the poor scalability of the hash algorithm itself, when the global storage needs to expand new clusters, it will inevitably involve the migration of data between clusters, which is very expensive
Secondly, since the data is stored through the hash algorithm, when the data is uploaded or written, the target cluster where the data is located has been determined by the hash rule, so there is no guarantee that the data can be uploaded or written nearby, and there is a possibility of telecom access data If it is stored in the Netcom cluster, the efficiency of data storage cannot be guaranteed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data global processing system and method
  • Data global processing system and method
  • Data global processing system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be more thoroughly understood, and will fully convey the scope of the present disclosure to those skilled in the art.

[0048] In order to solve the above technical problems, an embodiment of the present invention provides a global data processing system, figure 2 A schematic structural diagram of a global data processing system according to an embodiment of the present invention is shown. like figure 2 As shown, the system includes a global data location center (Center Locator), and the Center Locator is coupled to multiple distribute...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a global data processing system and method, the system includes a global data location center Center Locator, the Center Locator is coupled to a plurality of distributed storage system Cassandra clusters, wherein each Cassandra cluster is suitable for storing itself The mapping relationship between the data and the specific storage location is uploaded to the Center Locator; the Center Locator is adapted to receive and store the mapping relationship uploaded by each Cassandra cluster, and communicate with each Cassandra cluster according to the stored mapping relationship. The invention solves the problem of poor expansibility in the related art that uses the hash algorithm for global data storage and positioning.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data global processing system and method. Background technique [0002] Cassandra is a typical distributed storage system with a ring structure without a central node and implemented by relying on DHT (Distributed Hash Table, Distributed Hash Table) technology. The Cassandra data storage space can be abstracted into a ring structure, and the data is dispersed in this ring storage space through hash. Each node is responsible for managing a certain continuous Range (range) on this ring storage space, and the data falling on this Range space is stored on this node. [0003] First of all, since Cassandra is a distributed storage system without a central node, there is no central node to centrally manage the distributed information of the cluster. The distributed management information of the entire storage system is negotiated and synchronized by all nodes in the cluster throug...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30H04L29/08
Inventor 王锋
Owner BEIJING QIHOO TECH CO LTD