Big data support platform with combined processing method

Abstract

The invention provides a big data supporting platform with a co-processing method. The platform includes a server and a user terminal, and a computing package is stored in the server and comprises a data source read-write operator, a data preprocessing operator, a feature project operator, a model operator and a co-processing operator, wherein the co-processing operator comprises a co-processing starting sub-operator and a co-processing ending sub-operator; when a user creates a task flow on the user terminal and needs to use a same flow section to process two different data sets, the co-processing starting sub-operator is used for operations before the flow section is created, and the co-processing ending operator is used for operations after the flow section is created; the flow sectioncomprises one or more of the data source read-write operator, the data preprocessing operator, the feature project operator and the model operator. The big data supporting platform with the co-processing method solves the problems that in the prior art, since two identical flow sections need to be created for processing two different data sets, the same flow section is called twice.

Description

technical field [0001] The invention relates to a data analysis platform, in particular to a big data support platform with a merge processing method. Background technique [0002] The Chinese patent discloses a distributed big data analysis method with an announcement number of CN 105608160 A. The method includes: step 1, creating a new process; step 2, adding an algorithm; step 3, editing the attributes of the algorithm; Run the process on the cluster; step 5, get the analysis result. Although this method feels that it can realize automatic data analysis to a certain extent, the disadvantages of this method are: [0003] Because when the user needs to use the same process segment to process two different data sets when creating a task process on the user terminal, if two identical process segments are created to process two different data sets respectively, the same process segment will be realized. The case of being called twice increases the burden on the server and oc...

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a big data support platform with a combined processing method, which solves the problem in the prior art that the same process segment is called twice due to the need to establish two identical process segments to process two different data sets respectively question

Images