Stream data processing method based on event stream processing and plug-in type development framework

A plug-in development and processing method technology, applied in the direction of program control devices, etc., can solve the problem of overall performance degradation of data processing, and achieve the effect of high data processing efficiency and strong scalability

Active Publication Date: 2015-07-15
CHINA INFOMRAITON CONSULTING & DESIGNING INST CO LTD
View PDF3 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Traditional data collection and processing methods for field sensing devices often couple data coll...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Stream data processing method based on event stream processing and plug-in type development framework
  • Stream data processing method based on event stream processing and plug-in type development framework
  • Stream data processing method based on event stream processing and plug-in type development framework

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0107] The following is an example of running on Windows.

[0108] Step 1, start the host program CollectService;

[0109] Step 2, define the interface specification between the plug-in host program and the plug-in; the specific interface specification is as follows:

[0110] (1) The interface between the data acquisition plug-in and the host program:

[0111] Module role

●Provide a unified data acquisition interface

Module Features

abstract class, used to be inherited

class name (object name)

Communicator

main interface

virtual void run_collect(void) = 0;

[0112] (2) The interface between the decoder plug-in and the host program:

[0113] Module role

●Provide a unified decoding interface

Module Features

abstract class, used to be inherited

class name (object name)

Decoder

main interface

virtual intdecode_package(ACE_Message_Block*&mb)=0;

[0114] Step 3, the host prog...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a stream data processing method based on event stream processing and a plug-in type development framework. The stream data processing method comprises the following steps: step 1, establishing a plug-in host program; step 2, defining an interface specification between the plug-in host program and a plug-in; step 3, aiming at data acquisition protocols of different outer field sensing equipment, generating corresponding data acquisition plug-ins; step 4, establishing an event stream processing engine; step 5, defining a time window or a length window for the event stream processing engine; step 6, aiming at the data acquisition protocols of the different outer field sensing equipment, realizing corresponding data processing rules; step 7, defining and registering events; step 8, correlating the registered events with the data processing rules in the step 6 respectively; step 9, setting event processing conditions; step 10, establishing a source data queue and a target queue; step 11, establishing a consumption thread; step 12, leading target data to a destination; and step 13, establishing a daemon process.

Description

technical field [0001] The invention relates to a real-time data collection and processing method for external field sensing and sensing equipment such as electric power, transportation, energy saving and environmental protection, and new energy, in particular to a stream data processing method based on event stream processing and a plug-in development framework. Background technique [0002] At present, when collecting and processing data from field sensing devices, it is usually necessary to connect different field sensing devices at the same time. Since the communication protocols of different sensing devices are different, and some are even very different, the traditional method is generally to carry out special development for the data collection of different field sensing devices. [0003] When there are many sensing devices, the amount of collected data is relatively large, and the real-time performance of data processing is difficult to guarantee. Even if the messag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/44
Inventor 田闯袁伟伟冒兵朱磊李卫张萍
Owner CHINA INFOMRAITON CONSULTING & DESIGNING INST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap