Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A universal streaming data analysis model and a construction method thereof

A technology for analyzing models and streaming data, applied in database models, structured data retrieval, etc., can solve the problems of inflexible response to demand changes and large workload, and achieve the effect of rapid response and saving development work.

Pending Publication Date: 2019-03-29
JIANGSU SKYTECH INFORMATION
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a general streaming data analysis model and its construction method for the streaming data processing or real-time data analysis scene, which separates the creation of the analysis algorithm model from the specific business logic, so as to achieve the flexible establishment of the analysis model The purpose is to solve the problem of inflexibility in responding to changes in requirements due to the heavy workload brought about by instantiating data analysis algorithms at the code level for real-time data at this stage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A universal streaming data analysis model and a construction method thereof
  • A universal streaming data analysis model and a construction method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0055] For the [specific data collection] algorithm, such as figure 1 , figure 2 As shown, the model execution logic is as follows:

[0056] ①After the real-time streaming data is connected, the system filters out unspecified data source data according to the setting of the data source operator, and then performs step ②.

[0057] ②The data flows through the operation operator, and the field comparison judgment is performed: whether the value of the field to be judged in this piece of data is "equal to" the specific value set. Then execute step ③.

[0058] ③According to the execution result of step ②, the data is in the branch operator, and continues to execute downward according to the set execution path. If the data meets the execution conditions of step ②, then execute step ④; otherwise, execute step ⑥.

[0059]④The data flows through the intermediate library collision operator "data into the intermediate library", and the system inserts the piece of data into the speci...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a universal streaming data analysis model and a construction method thereof. The construction method comprises the following steps: 1) establishing a basic component of a business model through an operator abstraction; 2) decoupling with that data source through parameter configuration of the data source, and adjusting the data source used by the model through parameter configuration for different data sources in different scenario; 3) establishing calculation rules of each operator by configuring parameter values of the operators; 4) connecting each operator, taking that calculation result of the first operator as an output, and transmitting the result to the second operator as an input data source for the calculation of the second operator; 5) repeating that steps2) to 4) until the algorithm model construction is completed. The invention realizes the flexible establishment of the service model through the abstraction of the operator, and realizes the flexiblereuse of the same model through the parameter setting.

Description

technical field [0001] The invention relates to stream data processing technology, in particular to a general stream data analysis model and a construction method thereof. Background technique [0002] At this stage, for the processing of streaming data, data analysis algorithms are generally instantiated at the code level. In this way, on the one hand, the analysis algorithms that can be supported are limited, and if it needs to be added or adjusted, it must be implemented through coding, which consumes a lot of work; on the other hand, it is bound to the actual business data, and the implemented algorithm has relatively large limitations. Therefore, the implementation of the analysis model of this type of real-time data is relatively rigid, unable to cope with flexible and changeable business requirements, and the analysis model created in this way cannot be reused in other projects with different businesses. Contents of the invention [0003] The purpose of the present...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/28
Inventor 辛颖梅汪晓刚郑雪原赵熠刁俊芃
Owner JIANGSU SKYTECH INFORMATION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com