Data processing method and device and electronic equipment

Abstract

The invention provides a data processing method and device and electronic equipment. The method comprises the following steps: in response to a flow chart drawing operation for a drawing interface, generating a target flow chart of a target task according to the flow chart drawing operation; generating a configuration file of the target task based on the target flow chart, wherein the configuration file comprises target task information corresponding to each subtask of the target task; and sending the configuration file to a server of the client to trigger the server to complete the execution process of the target task based on the configuration file. A user can draw a target flow chart of a target task through a flow chart drawing operation on a flow chart drawing interface of a client, and the client can generate a configuration file of the target task based on the target flow chart. The user can generate the configuration file through the client without learning professional development knowledge related to big data, so that time resources of the user can be saved; and professional engineers are not needed for deployment and maintenance, so that human resources of the engineers can be saved.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data processing method, device and electronic equipment. Background technique [0002] Generally speaking, the data processing platform can be established in the following two ways: the first is customized development by engineers, and the data engineer analyzes the original data and the processing results of the original data to customize the development of the data processing platform; the second is the user Directly use the existing data processing framework as the data processing platform. [0003] Among them, the custom-developed method of engineers generally requires multiple groups of engineers to develop different projects of a data processing platform at the same time. There may be a large number of repeated modules in different projects, which wastes the human resources of engineers. When deploying a data processing platform, independent resources are...

AI Technical Summary

Problems solved by technology

[0003] Among them, the method of customized development by engineers usually requires multiple groups of engineers to develop different projects of a data processing platform at the same time. There may be a large number of repeated modules in different projects, which wastes the human resources of engineers.

When deploying a data processing platform, independent resources are usually required, and it cannot be elastically scaled according to the peak and valley of business data volume, which is easy to waste hardware resources

Multiple groups of engineers may use different technologies and development habits when developing different projects, so the developed data processing platform is not easy to manage, maintain, migrate, and reuse modules, consuming more human resources for engineers

[0004] Using the existing data processing framework method requires users to learn the professional development knowledge related to big data. After the development is completed, professional engineers are required to deploy and maintain, which consumes more time resources for users and more human resources for engineers.

Images