Unlock instant, AI-driven research and patent intelligence for your innovation.

Data analysis processing method and system

A data analysis and processing technology, applied in the field of big data processing, can solve the problems of low resource utilization efficiency, big data analysis system cannot be compatible with stand-alone operation and distributed operation mode, etc.

Active Publication Date: 2020-05-29
DATACANVAS LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The embodiment of the present invention provides a data analysis and processing method and system to solve the problem that the existing big data analysis system cannot be compatible with stand-alone operation and distributed operation mode, and the resource utilization efficiency is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data analysis processing method and system
  • Data analysis processing method and system
  • Data analysis processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0100] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0101] Please refer to figure 1 , figure 1 It is a flowchart of a data analysis and processing method provided by an embodiment of the present invention. The method can be applied to data analysis and processing systems, such as figure 1 As shown, the method includes the following steps:

[0102] Step 101, acquiring configuration information of data analysis and processing workflow.

[0103] Here, in the data analysis and processing system, in orde...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data analysis processing method and system, and relates to the field of big data processing. The method comprises the steps: obtaining the configuration information of a dataanalysis processing workflow; determining an operation mode of the data analysis processing workflow according to the configuration information; wherein the operation mode comprises a stand-alone modeor a distributed mode; and based on the determined operation mode, operating the data analysis processing workflow. The data analyzing and processing system in the embodiment of the invention can becompatible with a stand-alone operation mode and a distributed operation mode; a single-machine operation mode or a distributed operation mode is flexibly used for operating the data analysis and processing workflow; according to the method, resources in the big data analysis system are effectively allocated, the resource bottleneck of the big data analysis system is overcome, and the resource utilization efficiency of the big data analysis system is improved, so that the big data analysis system is higher in calculation speed and larger in calculation amount.

Description

technical field [0001] The invention relates to the field of big data processing, in particular to a data processing method and system. Background technique [0002] As the level of social informatization and intelligence improves, using big data analysis systems to train business models and using trained business models to realize intelligent processing of big data services has gradually become a common method in the big data industry. Existing big data analysis systems can choose stand-alone or distributed mode to process data and train models when performing big data analysis. However, the existing big data analysis system cannot be compatible with stand-alone operation and distributed operation mode, and the resource utilization efficiency of the big data analysis system is low. Contents of the invention [0003] Embodiments of the present invention provide a data analysis and processing method and system to solve the problem that the existing big data analysis system...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F8/20G06F16/27G06F16/23
CPCG06F8/24G06F16/23G06F16/27
Inventor 路明奎刘汶成
Owner DATACANVAS LTD