Real-time computing task deployment method, device and real-time computing system
By logically parsing and running framework analysis of the relational database tables of the real-time computing system and generating system operation syntax, the problem of difficult deployment of real-time computing tasks in the existing technology is solved, and programming-free deployment is achieved, and costs are reduced.
Patent Information
- Application Number
- CN202011381524.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-12-01
- Publication Date
- 2025-08-19
- Estimated Expiration
- 2040-12-01
AI Technical Summary
The deployment methods of existing real-time computing tasks require writing code programs, resulting in high technical requirements, difficult deployment and high cost.
By obtaining deployment parameters, logically parsing the relational database tables in the real-time computing system, generating running logic files, and parsing content based on the preset running framework to generate system running syntax to achieve programmatic deployment.
Reduces the difficulty of deploying real-time computing tasks, simplifies the deployment process, and reduces the requirements and costs for technicians.
Smart Images

Figure CN112445494B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of Internet development technology, and in particular to a deployment method, device and real-time computing system for real-time computing tasks, and also to an electronic device and storage medium for executing the deployment method of the real-time computing tasks. Background Art
[0002] Real-time computing is typically performed on massive amounts of data, typically requiring seconds. Real-time computing primarily involves real-time data storage and computation, and is applied to business data processing such as real-time statistics, data synchronization, reconciliation, monitoring, and risk control. Currently, a common approach to real-time computing involves analyzing captured data using written code to generate results. However, this approach requires strict encapsulation of the written code logic before deploying the task, placing high demands on technical personnel. This makes deploying real-time computing tasks difficult and costly. Summary of the Invention
[0003] In view of this, the embodiments of the present application provide a deployment method, device and real-time computing system for real-time computing tasks, as well as an electronic device and storage medium for executing the deployment method of real-time computing tasks, which can realize the deployment of real-time computing systems without programming, reduce the difficulty of deploying real-time computing tasks, and are convenient, fast and low-cost.
[0004] A first aspect of an embodiment of the present application provides a method for deploying a real-time computing task, including:
[0005] Get the deployment parameters for deploying real-time computing tasks;
[0006] Performing logical analysis on a relational database table associated with the real-time computing task in the real-time computing system according to the deployment parameters to generate an operation logic file corresponding to the real-time computing task;
[0007] The operation logic file is parsed based on the operation framework preset by the real-time computing system to generate a system operation syntax for the real-time computing system to operate.
[0008] In conjunction with the first aspect, in a first possible implementation of the first aspect, the step of performing logical parsing on a relational database table associated with the real-time computing task in the real-time computing system according to the deployment parameters to generate an execution logic file corresponding to the real-time computing task includes:
[0009] Acquire a relational database table associated with the real-time computing task from a relational database preset in the real-time computing system according to the deployment parameters;
[0010] Performing data adjustment processing on the relational database table according to the deployment parameters to generate a first relational database table;
[0011] The first relational database table is logically parsed by means of language tags and definitions to generate an operation logic file corresponding to the real-time computing task.
[0012] In conjunction with the first aspect, in a second possible implementation of the first aspect, the real-time computing system is configured with at least two execution frameworks. Before the step of parsing the execution logic file based on the execution framework preset by the real-time computing system to generate a system execution syntax for the real-time computing system to execute, the step includes:
[0013] Identify the operating framework selection instruction initiated by the user;
[0014] According to the operation framework selection instruction, a target operation framework corresponding to the selection instruction is selected from at least two operation frameworks configured in the real-time computing system.
[0015] In combination with the second possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the preconfigured running framework of the real-time computing system includes one or more of a flink running framework, a storm running framework, and a spark running framework.
[0016] In conjunction with the first aspect, in a fourth possible implementation manner of the first aspect, before the step of obtaining deployment parameters for deploying the real-time computing task, the step further includes:
[0017] The user is authenticated based on the operation authority conditions preset by the real-time computing system. If the user meets the operation authority conditions, the user is granted the operation authority to deploy the real-time computing task in the real-time computing system.
[0018] A second aspect of an embodiment of the present application provides a real-time computing system, characterized in that the real-time computing system is used to execute any of the methods described above, and the real-time computing system includes an interface layer, a parsing layer, an engine layer, and an operation layer, wherein the interface layer obtains deployment parameters for deploying real-time computing tasks by identifying user interaction operations; the parsing layer performs logical parsing on a relational database table associated with the real-time computing task in the real-time computing system according to the deployment parameters obtained by the interface layer, and generates an operation logic file corresponding to the real-time computing task; the engine layer performs content parsing on the operation logic file generated by the parsing layer based on an operation framework preset by the real-time computing system, and generates a system operation syntax for the operation of the real-time computing system; and the operation layer runs the system operation syntax generated by the engine layer according to the operation framework preset by the real-time computing system.
[0019] A third aspect of an embodiment of the present application provides a real-time computing task deployment device, the real-time computing task deployment device comprising:
[0020] An acquisition module, used to obtain deployment parameters for deploying real-time computing tasks;
[0021] a parsing module, configured to perform logical parsing on a relational database table associated with the real-time computing task in the real-time computing system according to the deployment parameters, and generate an operation logic file corresponding to the real-time computing task;
[0022] The generating module is used to parse the content of the operation logic file based on the operation framework preset by the real-time computing system, and generate a system operation syntax for the operation of the real-time computing system.
[0023] In conjunction with the third aspect, in a first possible implementation of the third aspect, the real-time computing task deployment device further includes:
[0024] A first acquisition submodule, configured to acquire a relational database table associated with the real-time computing task from a relational database preset in the real-time computing system according to the deployment parameters;
[0025] a first adjustment submodule, configured to perform data adjustment processing on the relational database table according to the deployment parameters to generate a first relational database table;
[0026] The first parsing submodule is configured to perform logic parsing on the first relational database table by means of language tags and definitions, and generate a running logic file corresponding to the real-time computing task.
[0027] The fourth aspect of an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the electronic device, wherein when the processor executes the computer program, each step of the method for deploying real-time computing tasks provided in the first aspect is implemented.
[0028] A fifth aspect of an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the steps of the real-time computing task deployment method provided in the first aspect.
[0029] The real-time computing task deployment method, device, and real-time computing system provided by the embodiments of the present application, as well as the electronic device and storage medium for executing the real-time computing task deployment method, have the following beneficial effects:
[0030] This application obtains deployment parameters for deploying real-time computing tasks; performs logical parsing of the relational database table associated with the real-time computing task in the real-time computing system according to the deployment parameters to generate an operation logic file corresponding to the real-time computing task; and performs content parsing of the operation logic file based on the preset operation framework of the real-time computing system to generate a system operation syntax for the operation of the real-time computing system. The above method implements the deployment of real-time computing tasks through a preset relational database table. The method is simple and has low deployment difficulty. Moreover, since the deployment process does not require programming, the technical requirements for deployment personnel are reduced, saving costs. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0032] Figure 1 A flowchart of a method for deploying real-time computing tasks provided in the first embodiment of the present application;
[0033] Figure 2 A flowchart of a method for deploying real-time computing tasks provided in the second embodiment of the present application;
[0034] Figure 3 A flowchart of a method for deploying real-time computing tasks provided in the third embodiment of the present application;
[0035] Figure 4 A schematic structural diagram of a real-time computing system provided in the fourth embodiment of the present application;
[0036] Figure 5 A structural block diagram of a real-time computing task deployment device provided in a fifth embodiment of the present application;
[0037] Figure 6 A structural block diagram of a real-time computing task deployment device provided in a sixth embodiment of the present application;
[0038] Figure 7 This is a structural block diagram of an electronic device provided in the seventh embodiment of the present application. DETAILED DESCRIPTION
[0039] In order to make the purpose, technical solutions and advantages of this application more clearly understood, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.
[0040] See also Figure 1 , Figure 1 This is a flowchart of a method for deploying real-time computing tasks provided in the first embodiment of this application. Detailed description is as follows:
[0041] Step S11: Obtain deployment parameters for deploying real-time computing tasks.
[0042] In this embodiment, deployment parameters are used to deploy real-time computing tasks that need to be executed in the real-time computing system. They are the input parameters required when deploying real-time computing tasks. The input parameters can be obtained by user input through the real-time computing system configuration page. For example, the user can set the module representing the input parameters by dragging and dropping on the page, and enter the corresponding parameter values for the set module, thereby configuring the input parameters required for executing the real-time computing task in the real-time computing system. In this embodiment, based on human-computer interaction with the user on the page, the real-time computing system can identify the operations performed by the user during the human-computer interaction process and then obtain the deployment parameters input by the user based on the identified operations. In this embodiment, the page can be an accessible page compiled and generated by HTML (Hypertext Markup Language) and JavaScript.
[0043] Step S12: performing logic analysis on the relational database table associated with the real-time computing task in the real-time computing system according to the deployment parameters, and generating a running logic file corresponding to the real-time computing task.
[0044] In this embodiment, a relational database is configured within the real-time computing system. This relational database stores various relational database tables required for the real-time computing system to execute tasks, including but not limited to user tables, project tables, user-project association tables, task tables, subtask tables, subtask-task association tables, subtask-subtask association tables, and task-project association tables. In this embodiment, the relational database tables associated with the real-time computing task currently to be deployed in the real-time computing system can be obtained, and then logically parsed based on the obtained deployment parameters to generate a data file in XML format. This data file is the execution logic file corresponding to the real-time computing task. This execution logic file contains the logical relationships between the data in the relational database tables and is used to deploy the real-time computing task. In this embodiment, the relational database can be a MySQL relational database, an Oracle relational database, or the like.
[0045] Step S13: parsing the content of the operation logic file based on the preset operation framework of the real-time computing system to generate a system operation syntax for the real-time computing system to operate.
[0046] In this embodiment, the obtained XML data file is parsed based on the runtime framework configured in the real-time computing system to generate a corresponding system runtime syntax. This system runtime syntax is used by the real-time computing system to operate. This system runtime syntax can be used to initiate real-time computing tasks within the runtime framework configured in the real-time computing system. This enables the programming-free deployment of real-time computing tasks within the real-time computing system.
[0047] As can be seen above, the real-time computing task deployment method provided in this embodiment obtains deployment parameters for deploying the real-time computing task, then logically parses the relational database tables associated with the real-time computing task in the real-time computing system according to the deployment parameters to generate an execution logic file corresponding to the real-time computing task. Furthermore, the execution logic file is parsed based on the preset execution framework of the real-time computing system to generate the system execution syntax for running the real-time computing system. This enables the deployment of the real-time computing system without programming, reducing the difficulty of deploying real-time computing tasks, making it more convenient and efficient, and reducing labor costs.
[0048] In some embodiments of this application, please refer to Figure 2 , Figure 2 This is a flowchart of a method for deploying real-time computing tasks provided in the second embodiment of this application. Detailed description is as follows:
[0049] Step S21: obtaining a relational database table associated with the deployment parameters from a relational database preset in the real-time computing system;
[0050] Step S22: performing data adjustment processing on the relational database table according to the deployment parameters to generate a first relational database table;
[0051] Step S23: performing logical analysis on the first relational database table by means of language tags and definitions, and generating an operation logic file corresponding to the real-time computing task.
[0052] In this embodiment, a relational database table associated with the deployment parameters can be obtained by calling a relational database. For example, if the real-time computing system currently needs to deploy a real-time computing task, then its deployment parameters are the input parameters required to execute the real-time computing task. By traversing and querying the relational database based on these deployment parameters, the relational database tables associated with the deployment parameters can be obtained, such as the user table, project table, user-project association table, task table, subtask table, subtask-task association table, subtask-subtask association table, task-project association table, etc. involved in the real-time computing task. After obtaining the relational database tables associated with the deployment parameters, the data corresponding to the deployment parameters stored in the relational database tables are adjusted by adding, deleting, modifying, and querying in accordance with the deployment parameters and their configured parameter values, thereby generating a first relational database table so that the relational database table associated with the deployment parameters meets the requirements of the real-time computing task. The first relational database table is the relational database table required by the real-time computing system to execute the real-time computing task. Furthermore, based on the deployment parameters, the generated first relational database table is logically parsed. Data in the first relational database table is labeled and defined using a preset language, such as Java, to implement logical parsing of the first relational database table, thereby generating an operational logic file corresponding to the real-time computing task. This operational logic file is implemented as an XML data file. By using an XML data file based on a relational database to represent the operational logic of the real-time computing task to be deployed by the real-time computing system, zero-coding deployment of the real-time computing system is achieved, making it convenient and efficient, while reducing deployment difficulty and labor costs.
[0053] In some embodiments of this application, please refer to Figure 3 , Figure 3 This is a flowchart of a method for deploying real-time computing tasks provided in the third embodiment of this application. Details are as follows:
[0054] Step S31: Identify the operation framework selection instruction initiated by the user;
[0055] Step S32: selecting a target operating framework corresponding to the selection instruction from the operating frameworks pre-configured in the real-time computing system according to the selection instruction.
[0056] In this embodiment, the real-time computing system is compatible with one or more runtime frameworks that can be used when executing real-time computing tasks, including but not limited to the flink runtime framework, the storm runtime framework, and the spark runtime framework. When deploying the real-time computing system, the user can make a selection according to his or her needs. In this embodiment, the user can initiate a runtime framework selection instruction by performing human-computer interaction with the real-time computing system. For example, a runtime framework selection drop-down menu is set in the real-time computing system. The drop-down menu displays menu items corresponding to all runtime frameworks configured for the real-time computing system. One menu item corresponds to one runtime framework. The user initiates a runtime framework selection instruction by clicking any menu item in the drop-down menu. The runtime framework selection instruction contains the runtime framework information corresponding to the menu item clicked by the user. After a user initiates an execution framework selection instruction, the real-time computing system can identify the user-initiated execution framework selection instruction by monitoring the drop-down menu, thereby identifying the user's selection. Thus, according to the execution framework selection instruction, the system can select a corresponding target execution framework from the multiple execution frameworks compatible with the real-time computing system as the execution framework corresponding to the real-time computing task currently deployed by the real-time computing system. Based on the execution framework, the system can perform content parsing on the data file and generate a system execution syntax that can be executed by the target execution framework. This embodiment enables the real-time computing system to support the operation of multiple execution frameworks, enabling customized deployment of real-time computing tasks according to user needs, with excellent flexibility.
[0057] In some embodiments of the present application, a real-time computing system can also configure an operation permission condition for a user to isolate user permissions and ensure information security for real-time computing tasks executed in the real-time computing system. In this embodiment, users can be managed by project. For a project in a real-time computing system, the user is verified to be an administrator for that project. If so, the verification passes, indicating that the user meets the operation permission requirements. The user is then granted operation permission to deploy real-time computing tasks for that project in the real-time computing system. The user can then enter the relevant deployment parameters in the real-time computing system to deploy the real-time computing task. Otherwise, the user cannot enter the relevant deployment parameters in the real-time computing system to deploy the real-time computing task. In this way, user permissions can be isolated by project, preventing illegal operations by users not affiliated with the project and effectively ensuring the information security of the project. For example, in a real-time computing system, for a project, the user who created the project is the default administrator. The user with the default administrator status has the right to add project administrator and ordinary user identities to other users. Among them, users with the default administrator identity can add project administrator identities to developers, allowing developers to perform real-time computing task development work in the real-time computing system, such as creating real-time computing tasks for the project, including configuring the main parameters of the task, defining the task's input, conversion, and output, etc. Users with the default administrator identity can also add project administrator identities to operation and maintenance personnel, allowing operation and maintenance personnel to operate and maintain the real-time computing tasks created by developers, including starting, stopping, monitoring, and following up on exceptions. Users with the default administrator identity can also add ordinary user identities to other relevant personnel. These users can only view real-time computing tasks but cannot operate the real-time computing tasks of the project. This makes it possible to clearly define user operating permissions in the real-time computing system and ensure the information security of the real-time computing system.
[0058] In some embodiments of this application, please refer to Figure 4 , Figure 4 This is a structural diagram of a real-time computing system provided in the fourth embodiment of the present application. Figure 4As shown, the real-time computing system 40 includes an interface layer 41, a parsing layer 42, an engine layer 43, and an execution layer 44. The interface layer 41 obtains deployment parameters for deploying real-time computing tasks by identifying user interactions. The parsing layer 42 performs logical parsing on the relational database tables associated with the real-time computing tasks in the real-time computing system according to the deployment parameters obtained by the interface layer 41, generating an execution logic file corresponding to the real-time computing task. The engine layer 43 parses the execution logic file generated by the parsing layer 42 based on the real-time computing system's preset execution framework, generating a system execution syntax for the real-time computing system. The execution layer 44 executes the system execution syntax generated by the engine layer 43 according to the real-time computing system's preset execution framework. In this embodiment, the interface layer 41 is a page compiled in HTML (Hypertext Markup Language) and JavaScript. This page is accessible by placing it on a high-performance server and configuring a service port. The parsing layer 42 serves as a bridge between the interface layer 41 and the engine layer 43, serving as a link between the upper and lower layers. The parsing layer is also configured with a relational database for managing and storing data in the real-time computing system, such as user tables, project tables, user-project association tables, task tables, subtask tables, subtask-task association tables, subtask-subtask association tables, and task-project association tables. The parsing layer 42 specifically adjusts the data stored in the relevant relational database tables by performing operations such as addition, deletion, modification, and querying within the relational database, ensuring that each relational database table meets the requirements of the real-time computing task. It then performs logical parsing of the adjusted relational database tables using Java language tags and data definitions, generating an XML data file and sending it to the engine layer 43 via an HTTP request. This XML data file serves as the execution logic file corresponding to the real-time computing task. Upon receiving the XML data file from the parsing layer 42, the engine layer 43 parses the XML data file using an execution framework configured based on the real-time computing system, thereby generating a system execution syntax that can be run by the real-time computing system for use by the real-time computing system. In this embodiment, the real-time computing system can be configured with multiple runtime frameworks. Before the engine layer 43 parses the content of an XML data file, it can first identify the runtime framework used by the user for the real-time computing task. The runtime framework then parses the content of the XML data file. After the engine layer 43 generates a system runtime syntax that can be run by the real-time computing system, it initiates the real-time computing task to the runtime layer 44. The runtime layer 44 responds to the real-time computing task initiated by the engine layer 43 and executes the real-time computing system to execute the task.
[0059] See also Figure 5 , Figure 5This is a structural block diagram of a real-time computing task deployment device provided in the fifth embodiment of the present application. The various units included in the device in this embodiment are used to perform the various steps of the above method embodiment. For details, please refer to the relevant description of the above method embodiment. For ease of explanation, only the parts related to this embodiment are shown. Figure 5 As shown, the real-time computing task deployment apparatus includes: an acquisition module 51, a parsing module 52, and a generation module 53. The acquisition module 51 is used to acquire deployment parameters for deploying the real-time computing task; the parsing module 52 is used to perform logical parsing on the relational database table associated with the real-time computing task in the real-time computing system according to the deployment parameters, and generate an operation logic file corresponding to the real-time computing task; and the generation module 53 is used to perform content parsing on the operation logic file based on the preset operation framework of the real-time computing system, and generate a system operation syntax for the operation of the real-time computing system.
[0060] See also Figure 6 , Figure 6 This is a structural block diagram of another real-time computing task deployment device provided in the sixth embodiment of this application. Figure 6 As shown, the deployment device for a real-time computing task further includes: a first acquisition submodule 61, a first adjustment submodule 62, and a first parsing submodule 63. The first acquisition submodule 61 is configured to acquire a relational database table associated with the deployment parameters from a relational database preset in the real-time computing system. The first adjustment submodule 62 is configured to perform data adjustment processing on the relational database table corresponding to the deployment parameters to generate a first relational database table. The first parsing submodule 63 is configured to perform logical parsing of the first relational database table using language tags and definitions to generate a running logic file corresponding to the real-time computing task.
[0061] It should be understood that the above-mentioned deployment device of the real-time computing task corresponds one-to-one with the above-mentioned deployment method of the real-time computing task, and will not be described in detail here.
[0062] See also Figure 7 , Figure 7 This is a structural block diagram of an electronic device provided in the eighth embodiment of the present application. Figure 7As shown, the electronic device 7 of this embodiment includes: a processor 71, a memory 72, and a computer program 73 stored in the memory 72 and executable on the processor 71, such as a program for a method for deploying real-time computing tasks. When the processor 71 executes the computer program 73, the steps of each embodiment of the method for deploying real-time computing tasks described above are implemented. Alternatively, when the processor 71 executes the computer program 73, the functions of each module in the embodiments corresponding to the apparatus for deploying real-time computing tasks described above are implemented. For details, please refer to the relevant description in the embodiments, which will not be repeated here.
[0063] Exemplarily, the computer program 73 may be divided into one or more modules (units), which are stored in the memory 72 and executed by the processor 71 to complete the present application. The one or more modules may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution process of the computer program 73 in the electronic device 7. For example, the computer program 73 may be divided into an acquisition module, a processing module, and an execution module, and the specific functions of each module are as described above.
[0064] The electronic device may include, but is not limited to, a processor 71 and a memory 72. Those skilled in the art will understand that Figure 7 It is only an example of the electronic device 7 and does not constitute a limitation of the electronic device 7. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the electronic device may also include input and output devices, network access devices, buses, etc.
[0065] The processor 71 may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.
[0066] The memory 72 may be an internal storage unit of the electronic device 7, such as a hard disk or memory of the electronic device 7. The memory 72 may also be an external storage device of the electronic device 7, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the electronic device 7. Furthermore, the memory 72 may include both an internal storage unit of the electronic device 7 and an external storage device. The memory 72 is used to store the computer program and other programs and data required by the electronic device. The memory 72 may also be used to temporarily store data that has been output or is about to be output.
[0067] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.
Claims
1. A method for deploying real-time computing tasks, characterized in that: include: Get the deployment parameters for deploying real-time computing tasks; Performing logical analysis on the relational database tables associated with the real-time computing task in the real-time computing system according to the deployment parameters to generate an operation logic file corresponding to the real-time computing task; wherein the relational database stores a variety of relational database tables required for the real-time computing system to execute tasks, the relational database tables including a user table, a project table, a user-project association table, a task table, a subtask table, a subtask-task association table, a subtask-subtask association table, and a task-project association table; parsing the content of the operation logic file based on the operation framework preset by the real-time computing system to generate a system operation syntax for the operation of the real-time computing system, wherein the system operation syntax is a system operation syntax for the operation of the real-time computing system, and a real-time computing task can be initiated in the operation framework configured by the real-time computing system through the system operation syntax; The step of performing logical analysis on a relational database table associated with the real-time computing task in the real-time computing system according to the deployment parameters to generate an operation logic file corresponding to the real-time computing task includes: Acquire a relational database table associated with the real-time computing task from a relational database preset in the real-time computing system according to the deployment parameters; Performing data adjustment processing on the relational database table according to the deployment parameters to generate a first relational database table; The first relational database table is logically parsed by means of language tags and definition data to generate an operation logic file corresponding to the real-time computing task, wherein the operation logic file is an XML data file.
2. The method for deploying real-time computing tasks according to claim 1, characterized in that: The real-time computing system is configured with at least two operating frameworks. Before the step of parsing the operating logic file based on the operating framework preset by the real-time computing system to generate a system operating syntax for the real-time computing system, the method includes: Identify the operating framework selection instruction initiated by the user; According to the operation framework selection instruction, a target operation framework corresponding to the selection instruction is selected from at least two operation frameworks configured in the real-time computing system.
3. The method for deploying real-time computing tasks according to claim 2, wherein: The operating framework configured in the real-time computing system includes one or more of a flink operating framework, a storm operating framework, and a spark operating framework.
4. The method for deploying real-time computing tasks according to claim 1, wherein: Before the step of obtaining the deployment parameters for deploying the real-time computing task, the method further includes: The user is authenticated based on the operation authority conditions preset by the real-time computing system. If the user meets the operation authority conditions, the user is granted the operation authority to deploy the real-time computing task in the real-time computing system.
5. A real-time computing system, characterized in that: The real-time computing system is used to execute the method described in any one of claims 1 to 4 above, and the real-time computing system includes an interface layer, a parsing layer, an engine layer and an operation layer, wherein the interface layer obtains deployment parameters for deploying real-time computing tasks by identifying user interaction operations; the parsing layer performs logical parsing on a relational database table associated with the real-time computing task in the real-time computing system according to the deployment parameters obtained by the interface layer, and generates an operation logic file corresponding to the real-time computing task; the engine layer performs content parsing on the operation logic file generated by the parsing layer based on an operation framework preset by the real-time computing system, and generates a system operation syntax for the operation of the real-time computing system; the operation layer runs the system operation syntax generated by the engine layer according to the operation framework preset by the real-time computing system.
6. A deployment device for real-time computing tasks, characterized in that: include: An acquisition module, used to obtain deployment parameters for deploying real-time computing tasks; a parsing module, configured to perform logical parsing on a relational database table associated with the real-time computing task in the real-time computing system according to the deployment parameters, and generate an operation logic file corresponding to the real-time computing task; wherein the relational database stores a plurality of relational database tables required for the real-time computing system to execute tasks, the relational database tables including a user table, a project table, a user-project association table, a task table, a subtask table, a subtask-task association table, a subtask-subtask association table, and a task-project association table; a generation module configured to parse the content of the operation logic file based on an operation framework preset by the real-time computing system, and generate a system operation syntax for the operation of the real-time computing system, wherein the system operation syntax is a system operation syntax for the operation of the real-time computing system, and a real-time computing task can be initiated in the operation framework configured by the real-time computing system through the system operation syntax; A first acquisition submodule, configured to acquire a relational database table associated with the real-time computing task from a relational database preset in the real-time computing system according to the deployment parameters; a first adjustment submodule, configured to perform data adjustment processing on the relational database table according to the deployment parameters to generate a first relational database table; The first parsing submodule is used to perform logical parsing on the first relational database table by means of language tags and definition data, and generate an operation logic file corresponding to the real-time computing task, wherein the operation logic file is an XML data file.
7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 4 are implemented.
8. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.
Citation Information
Patent Citations
Method and apparatus for automated generation of a data processing topology
WO2016163903A1