RTLogic big data processing system and method based on CEP technology

Abstract

The invention discloses an RTLogic big data processing system and method based on the CEP technology. The RTLogic big data processing system comprises a user editor, a data collection adapter, a central processing system and an output adapter. The user editor is used for editing business intelligence logics to define an inquiry target. The data collection adapter is used for collecting data from a data source according to the inquiry target and transmitting the data to the central processing system. The central processing system is used for analyzing and processing the collected data. The output adapter is used for transmitting the data analyzed and processed through the central processing system to a monitor for display. The RTLogic big data processing method can be used for carrying out real-time and effective analysis and processing on an event flow according to the inquiry target. According to the RTLogic big data processing system and method, the CEP engine technology is adopted, filtration, correlation, matching and integration can be carried out on the data in real time to generate information valuable to a user, the price advantage and the service advantage are realized, the data mining framework is relatively simple, and the RTLogic big data processing system and method have low relay, high output and expansibility.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a CEP technology-based RTLogic (Real Time Logic, real-time logic) big data processing system and method. Background technique [0002] With the continuous expansion of the scale of China's Internet, especially the rapid development of the mobile Internet in recent years, the informatization of government enterprises and other enterprises have generated massive amounts of data. In 2011, big data was valued by the Chinese government and the IT industry, and it was called the first year of the big data market. More and more companies realize that how to use these massive data to process and transform the seemingly messy data into something valuable to the enterprise is the key to maintaining an advantage in the market competition in the era of big data. [0003] The existing big data processing technology mainly includes the Hadoop processing method. The Hadoop processing m...

AI Technical Summary

Problems solved by technology

[0004] (1) The Hadoop processing method cannot correlate and match events between events, that is to say, the Hadoop processing method cannot process complex events;

[0005] (2) The Hadoop processing method is limited by design and implementation, and can only process historical data, which cannot meet the real-time business processing needs of some industries;

[0007] (4) The Hadoop processing method does not have the visualization technology of real-time big data, and cannot show users intuitive dynamic images;

[0008] (5) The Hadoop processing method cannot integrate the R language, so that the mathematical statistics of the data

Images