Configuration method of distributed statistical analysis system and distributed statistical analysis system
A statistical analysis and configuration method technology, applied in transmission systems, electrical components, etc., can solve the problems of difficult and long-time statistical tasks, and achieve the effects of improving computing power, ensuring safe transmission, and high safety performance
Inactive Publication Date: 2020-03-27
XUCHANG UNIV
View PDF7 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] However, the current distributed statistical system only distributes statistical analysis tasks through its own internal server equipment. As the tasks of statistical requests gradually increase, when the statistical analysis tasks are heavy, the traditional distributed system will take a long time, and , during data transmission, it is difficult to implement security for statistical tasks
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0018] The following describes the technical solutions in the embodiments of the present invention clearly and completely with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
[0019] See figure 1 , The present invention provides the following technical solutions:
[0020] A configuration method of a distributed statistical analysis system. The configuration method includes the following steps:
[0021] Step 1: Election of the leader node in the computing node cluster, shard the data in each computing node according to the data sharding principle, and elect the leader shard from the copy of the data shard;
[0022] Step 2: Af...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to the technical field of distributed statistical analysis systems, in particular to a configuration method of a distributed statistical analysis system and the distributed statistical analysis system, and the configuration method comprises the following steps: step 1, electing leader nodes in a computing node cluster, fragmenting data in each computing node according to a data fragmentation principle, and electing leader fragments in copies of data fragments; step 2, after receiving the statistical analysis request, the service node applying to the leader node for an internal computing node operated by the internal server, so that when the statistical analysis task is heavy, the external computing node based on the external server can be utilized to greatly improve the operational capability of the distributed statistical analysis system and accelerate the statistical analysis of the data; moreover, when the external computing nodes are transmitted, carrying outplaintext encryption and compression in sequence, so that safe transmission of statistical tasks can be guaranteed, meanwhile, the flow consumption during transmission is reduced, and the safety performance is high.
Description
Technical field [0001] The invention relates to the technical field of distributed statistical analysis systems, and specifically relates to a configuration method of a distributed statistical analysis system and a distributed statistical analysis system. Background technique [0002] A distributed system is a computer system with multiple processing resources connected to each other. These processing resources can also be called node devices, which perform the same task under unified control. For example, Chinese Patent CN102497280 discloses a distributed system, which can realize mutual perception between multiple device nodes. Improve management efficiency. Distributed systems usually need to have statistical analysis functions. A Chinese patent with application number 2017101050317 discloses a method for configuring a distributed statistical analysis system. The distributed statistical analysis system includes a ZooKeeper cluster, a service node, and a computing node clust...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & AuthorityApplications(China)
IPC IPC(8): H04L29/06H04L29/08
CPCH04L63/0428H04L63/0876H04L63/1408H04L67/1004H04L67/1097
Inventor杨林孟晓然
OwnerXUCHANG UNIV