A method and system for building an analysis model based on data stream hybrid arrangement
A technology of hybrid orchestration and analysis model, applied in software design and other directions, to save time and cost, release the value of big data, and improve the space for model optimization
Active Publication Date: 2022-04-15
中科天玑数据科技股份有限公司
View PDF12 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0007] The purpose of the present invention is to provide a method and system for constructing an analysis model based on data stream hybrid arrangement that can be better used to solve at least one technical problem in the prior art
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment
[0070] Such as figure 1 As shown, the present invention provides a method for constructing an analysis model based on the hybrid arrangement of data streams, and the method for constructing an analysis model based on the hybrid arrangement of data flows includes the following steps:
[0071] Step S100, based on the data flow of the analysis task, the analysis task is disassembled into A 1 ,A 2 …A n processing subtasks;
[0072] Step S200, for each processing subtask, define each module A n Input input, Output output and processing logic;
[0073] Step S300, encapsulating the analysis task into a directed acyclic data flow graph DataflowGraph of Json structure, which contains component nodes and edges;
[0074] Step S400, converting the data flow graph into a Workflow Graph in Xml format;
[0075] Step S500, parsing the Workflow task flow diagram and performing dispatch scheduling;
[0076] Step S600, returning the execution results of each processing subtask to obtain t...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention provides a method for constructing an analysis model based on the hybrid arrangement of data streams. The method for constructing an analysis model based on the mixed arrangement of data streams includes the following steps: splitting and processing subtasks, receiving the data flow of the analysis task, and converting the analysis task to Split into processing subtasks according to the analysis process; modify the processing subtasks to define: data input, data output, and processing logic for processing subtasks; encapsulate analysis tasks, and encapsulate analysis tasks into data flow diagrams of coding structures; convert language formats, Convert the data flow diagram into a task flow diagram in markup language format; schedule execution, analyze the task flow diagram, and perform dispatch scheduling execution; generate analysis results, return the execution results of scheduling execution, and obtain the analysis results. The invention also provides an analysis model building system based on data stream hybrid arrangement. The invention can solve the problems of single modeling mode, complex modeling process and lack of mixed computing support in the process of data analysis and modeling.
Description
Technical field: [0001] The present invention relates to the technical field of data analysis model construction, in particular to a method and system for constructing an analysis model based on data stream hybrid arrangement. Background technique: [0002] With the rapid development of IT and communication technologies such as the World Wide Web, the Internet, the Internet of Things, cloud computing, and triple play, the rapid growth of data has become a severe challenge and a rare opportunity for many industries. The information society has entered the network Compared with traditional data, big data has the characteristics of huge volume, various modes, extremely fast growth, and sparse value. However, to mine big value from big data often involves preprocessing, analysis and mining. , Knowledge inference, decision-making research and judgment, visual interaction, domain application and other lengthy analysis links, these characteristics make the traditional analysis and ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F8/20
CPCG06F8/20G06F8/24
Inventor 陈欣洁李建广余智华袁宝东冯凯
Owner 中科天玑数据科技股份有限公司