Multiplexed parallel big data system and processing method thereof
A technology of big data and data, which is applied to the big data system of multiplexing in parallel and its processing field, and can solve problems such as waste of computing resources.
Active Publication Date: 2019-11-22
TERMINUSBEIJING TECH CO LTD
View PDF13 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0007] In view of this, the purpose of this application is to propose a multi-channel parallel multiplexed big data system and its processing method to solve most of the computing tasks of nodes with strong data processing capabilities in the existing distributed big data node architecture. The resources are all in an idle state, resulting in a technical problem of waste of computing resources
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0033] The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, rather than to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.
[0034] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.
[0035] As an example of this application, such as figure 1 As shown in FIG. 1 , it is a schematic structural diagram of a multiplexed parallel multiplexed big data system according to Embodiment 1 of the present application. from figure 1 It can be seen from the figure tha...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
A multiplexed parallel big data system comprises a plurality of node groups, nodes of the same node group share the same data block hash chain, each node group comprises a common service node and a common consensus node, and the plurality of node groups share a first service node and a first consensus node; in the node group sharing the same data block hash chain, identifiers corresponding to theservice types are stored in the common service nodes and the common consensus nodes, and the service data generated by the common service nodes and the service data consensus by the common consensus nodes contain the identifiers; and the first service node processes the service data stored in the plurality of data block hash chains in parallel according to the identifier, and the first consensus node performs parallel consensus on the service data of the plurality of data block hash chains according to the identifier. According to the method, the same node is multiplexed by the plurality of data block hash chains to process or consensus the service data in the respective data block hash chains, so that the computing resources of the node with strong data processing capability are fully utilized.
Description
technical field [0001] The present application relates to the technical field of big data, and in particular to a multiplexed and multiplexed big data system and a processing method thereof. Background technique [0002] Big data technology is an important force that pushes human society into the era of intelligence. At present, the means of data collection are becoming more and more abundant. From online to offline, through various Internet services, digital payment platforms and smart devices, data are continuously collected from various source nodes, thus aggregated to form massive big data resources, and then Then they are sent to the destination nodes respectively to realize the analysis and application of the data. [0003] In traditional big data technology, the data center nodes of the network master all the big data receiving, storage, and forwarding processes, and other nodes obtain data directly or indirectly from the data center nodes. It can be seen that the d...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): H04L9/06H04L29/08
CPCH04L9/0643H04L67/10H04L67/1097
Inventor 王琪
Owner TERMINUSBEIJING TECH CO LTD