Running method of data analysis workflow, data analysis system and storage medium

A data analysis system and data analysis technology, applied in the field of data processing, can solve the problems of low efficiency of big data analysis system, inability to flexibly configure resource consumption and fine balance of data analysis, etc.

Active Publication Date: 2019-01-11
DATACANVAS LTD
View PDF5 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing big data analysis system can only choose a stand-alone or distributed mode to process data and train models when performing big data analysis...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Running method of data analysis workflow, data analysis system and storage medium
  • Running method of data analysis workflow, data analysis system and storage medium
  • Running method of data analysis workflow, data analysis system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0184] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, the following will clearly and completely describe the technical solutions of the embodiments of the present invention in conjunction with the drawings of the embodiments of the present invention. Apparently, the described embodiments are some, not all, embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the described embodiments of the present invention belong to the protection scope of the present invention.

[0185] The invention proposes an operation method of a data analysis workflow.

[0186] The data analysis workflow in the present invention is used for data analysis processing. The data analysis workflow includes more than one workflow module, and each workflow module has an association relationship. The association relationship includes a serial relationship and a parallel relationship....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a running method of a data analysis workflow. According to the obtained configuration information of the data analysis workflow, the running mode of each workflow module of thedata analysis workflow is determined, and the association relationship among the workflow modules is determined. Finally, the data analysis workflow is run based on the determined association relationship and the running mode. The invention also provides a data analysis system and a storage medium. By determining the operation mode of each workflow module and the correlation relationship between the workflow modules, The data analysis workflow can be run in a single computer and/or distributed mode flexibly, and the fine balance between resource consumption and data analysis can be flexibly configured when the big data analysis system is used to process the big data service, so that the efficiency of the big data analysis system can be improved.

Description

technical field [0001] The present invention relates to the field of data processing, in particular to a method for running a data analysis workflow, a data analysis system and a storage medium. Background technique [0002] As the level of social informatization and intelligence improves, using big data analysis systems to train business models and using trained business models to realize intelligent processing of big data services has gradually become a common method in the big data industry. However, the existing big data analysis system can only choose a stand-alone or distributed mode to process data and train models when performing big data analysis, and cannot flexibly configure the fine balance between resource consumption and data analysis, resulting in the failure of the big data analysis system low efficiency. Contents of the invention [0003] In order to solve the above technical problems, the present invention provides a method for running a data analysis wo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/182G06F16/17G06F16/11
Inventor 刘汶成姜琦李学峰耿迪
Owner DATACANVAS LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap