System and method for realizing complicated event handling based on cloud computing architecture

Abstract

The invention relates to a system for realizing complicated event handling based on a cloud computing architecture. The system comprises event distribution nodes, a plurality of event handling nodes, an event handling node group, event de-weighting nodes and a node manager. The invention further relates to a method for realizing complicated event handling based on the cloud computing architecture. The system and the method for realizing complicated event handling based on the cloud computing architecture can allow the whole system to bear high-concurrent and large amount of event data, ensure the uniqueness of the output event, randomly select a normal node to copy from the corresponding event handling node group, ensure continuity of the upper-layer service, greatly improve the whole reliability of the complicated event handling system, and meet the requirements of large data stream, high concurrency, high real-time data analysis. During the system running process, when keeping continuity of the service, the dynamic adjustment to the system handling nodes is finished; the working performance is stable and reliable; and the application range is wide.

Description

technical field [0001] The present invention relates to the field of computer software, in particular to the field of enterprise-level high-real-time event flow analysis system, and specifically refers to a system and method for realizing complex event processing based on cloud computing architecture. Background technique [0002] Complex Event Processing (Complex Event Processing, CEP) technology is an emerging real-time data analysis and processing technology. Traditional data mining technology is to post-process massive data, which is characterized by huge data volume and complex analysis logic; traditional database analysis technology is to perform statistical analysis on a certain scale of data, which is characterized by moderate data volume and relatively simple analysis logic . The complex event processing technology can perform real-time analysis on high-speed data streams, and has the characteristics of large data volume and high real-time performance. Complex eve...

AI Technical Summary

Problems solved by technology

[0006] The complex event processing technology using relational database as the core, due to the constraints of the database architecture, when the high real-time data volume reaches a certain scale, on the one hand, the bottleneck of database I / O is easy to occur; The performance optimization in the scene is more complex, and the cost of adapting to changing business requirements is relatively high

[0007] The complex event processing technology with the JVM process as the core, because the relevant business data in the processing process is in the memory, so the impact on I / O operations is small, but due to the limited memory space that can be allocated to each process, when a large data flow occurs , it is easy to cause the memory of the JVM to run out, which will further lead to the stagnation of the business

Therefore, the performance bottleneck of the complex event processing technology with the JVM process as the core is the memory capacity

At the same time, it should be noted that the complex event processing technology with memory computing as the core does not have the persistence operation of business data. When the process exits abnormally due to various reasons, the data in the memory will be lost, which will directly lead to Unavailability of upper-layer business functions

Images