A data distribution and parallel processing method and system

A parallel processing and data distribution technology, applied in the field of data processing, can solve the problems of poor data consistency, low data query speed and efficiency, and achieve the effect of shortening the corresponding time, ensuring consistency, and improving query efficiency

Active Publication Date: 2019-02-05
BEIJING CHINA POWER INFORMATION TECH +7
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Therefore, the inventor finds that the prior art has at least the following problems in the process of realizing the present invention: the consistency of the data in the database is not good and the query speed and efficiency of the data are low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data distribution and parallel processing method and system
  • A data distribution and parallel processing method and system
  • A data distribution and parallel processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0052] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are to distinguish two entities with the same name but different parameters or parameters that are not the same, see "first" and "second" It is only for the convenience of expression, and should not be construed as a limitation on the embodiments of the present invention, which will not be described one by one in the subsequent embodiments.

[0053] refer to figure 1 As shown, it is a flowchart of an embodiment of the data distribution and parallel processing method provided by the present invention. The data distribution and parallel processing methods include:

[0054] Step 101, receiving the initial ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data distribution and parallel processing method and system. The method comprises following steps: analyzing an initial query instruction to obtain an actual query instruction; distributing the actual query instruction to different data nodes through working distribution nodes; executing the received actual query instruction on each data node and returning query results to the work distribution nodes; at the same time, the data information table is kept updated on each server node; on each server node, performing backup on query table corresponding to the actual query instruction so that query table copies are kept in each server node; on each server node, when concurrent conflict is detected, performing concurrent execution on actual query instruction through calling the query table copies on the current server node. By means of the data distribution and parallel processing method and system, the data consistency is guaranteed and the speed and efficiency of data query are increased as well.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data distribution and parallel processing method and system. Background technique [0002] The method of parallel processing is a processing method that adopts parallel means in information processing to achieve efficient development and calculation. In other words, it refers to the completion of multiple tasks within the same time frame, which can be of the same or different nature. As long as there is overlap in time, it can be called parallelism. It is mainly used in high-performance processors, large-scale database management, complex mathematical modeling and other fields, and its application range is still expanding. It mainly includes three elements: simultaneity, concurrency, and flow. In order to achieve high performance and meet the needs of a large amount of calculation, a parallel computing model can be used for data processing. [0003] Big data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50
CPCG06F9/5027G06F9/5083G06F2209/5017
Inventor 孙乔付兰梅邓卜侨孙雷陆旭刘炜崔伟高阿朋裴旭斌吴舜聂晓波吴芃
Owner BEIJING CHINA POWER INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products