Customizable module development system and method based on stream computing engine

Abstract

An embodiment of the invention provides a flow calculation engine-based customizable module development system. The system comprises a component design template, a component template analysis engine, a component pool, a topology plant and a topology submitting and analysis engine, wherein the component design template is used for enabling a user to create a component set according to the component design template; the component template analysis engine is used for analyzing the component set; the component pool is used for storing and recording the component set; the topology plant is used for providing an interface for constructing a topology structure for the user; and the topology submitting and analysis engine is used for submitting the topology structure constructed by the user to a flow calculation engine. Meanwhile, an embodiment of the invention furthermore provides a flow calculation engine-based customizable module development method.

Description

technical field [0001] The invention relates to stream computing technology, in particular to a system and method for developing a customizable module based on a stream computing engine. Background technique [0002] Nowadays, the value of a lot of data will decrease with the passage of time, so after the event occurs, they must be processed as soon as possible. It is best to process the data corresponding to the event as soon as the event occurs. Events are processed once, rather than being cached and processed in batches. [0003] In the existing technology, stream computing has been fully applied in the process of big data processing. The existing stream computing frameworks mainly include storm, speak-streaming, S4, Samza, etc. In the process of developing a stream computing system using an existing stream computing framework, R&D engineers need to understand business requirements and develop a stream computing system based on their own familiarity with a certain stream...

AI Technical Summary

Problems solved by technology

[0004] The development process of the existing stream computing system has the following disadvantages: the development process requires R&D engineers with experience in stream computing development, and the engineer's experience is an important factor in determining the project delivery time, and its uncertainty is strong; because the stream computing system is Developed for a certain business requirement, the coupling of each component is high, so the reusability is not high

Images