Data updating method, distributing node and mass storage cluster system

A technology for distributing nodes and data nodes, which is applied in the direction of electrical digital data processing, special data processing applications, instruments, etc. It can solve problems such as affecting the system, untimely updates, and multiple data copies are damaged, so as to improve processing efficiency and improve efficiency effect

Inactive Publication Date: 2011-06-01
CHINA MOBILE COMM GRP CO LTD
View PDF0 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 1. Due to the simultaneous update of multiple threads, the system needs to select one update thread and lock other update threads. There are random I/O operations during update processing, which makes it difficult to improve the overall efficiency. Most of the efficiency loss is due to I/O lock competition and update thread scheduling
[0005] 2. Query and update use the same thread, resulting in ambiguous permissions and uncertain data flow. If there is a problem with query or update, it will affect the entire system
[0006] 3. In order to ensure data security, many systems adopt multi-copy mode, which means that one copy is stored in 2 or 3 data nodes, thereby improving data security. This method seems safe but actually has data security risks. When the system When there is a bug in the code, multiple data copies may be damaged or lost; and when the data is synchronized, if A notifies B and B n...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data updating method, distributing node and mass storage cluster system
  • Data updating method, distributing node and mass storage cluster system
  • Data updating method, distributing node and mass storage cluster system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The present invention will be described in detail below with reference to the drawings.

[0032] Device embodiment

[0033] figure 1 It is a structural diagram of an embodiment of the distribution node of the present invention. Such as figure 1 As shown, this embodiment includes:

[0034] The command control module 102 is used to receive the update command sent by the management device through an update thread; the issuing module 104 is used to read the update command from the command control module 102 through multiple read threads, and separate the data according to the update command. Deliver to the corresponding data node.

[0035] In this embodiment, only one update thread is used to receive the update command, which avoids the lock problem of simultaneous update by multiple threads in the prior art; at the same time, in order to ensure the efficiency of data delivery, multiple read threads are set to read the update command and simultaneously Multiple update commands f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data updating method, a distributing node and a mass storage cluster system. The distributing node comprises an order control module and a distributing module, wherein the order control module is used for receiving an updated order sent by a thread receiving and managing device; and the distributing module is used for reading the updated order from the order control module via a plurality of reading threads, and respectively distributes data to the corresponding data nodes according to the updated order. The data updating method, the distributing node and the mass storage cluster system are characterized in that only one updating thread is required to receive the updated order, thereby avoiding the lock problem that multiple threads are simultaneously updated in the prior art, and improving the integral processing efficiency of the system. Meanwhile, a plurality of reading threads read the updated orders, data are distributed to a plurality of updated orders simultaneously, and the data distributing efficiency is improved.

Description

Technical field [0001] The invention relates to a data storage technology, in particular to a data update method, a distribution node and a mass storage cluster system. Background technique [0002] It is difficult to realize real-time query and synchronous update of massive data in various existing real-time systems. At present, common strategies are to increase the data carrying capacity by improving the performance of single-machine hardware, or by dividing the storage unit by data according to different usage methods. . [0003] The existing technology has the following defects: [0004] 1. Due to the simultaneous update of multiple threads, the system needs to select an update thread and lock other update threads. There are random I / O operations when processing updates, which makes it difficult to improve overall efficiency. Most of the efficiency loss lies in I / O lock competition and Update thread scheduling. [0005] 2. The same thread is used for query and update, resulting ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F3/06
Inventor 韩金宇罗治国兰建明孙少陵黄晓庆
Owner CHINA MOBILE COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products