Data processing method and device based on relational database and computer equipment

Abstract

The invention relates to a data processing method and device based on a relational database, computer equipment, a computer readable storage medium and a computer program product. The method comprises the steps of obtaining to-be-processed data and starting instruction information, and starting a target processing task according to the starting instruction information; wherein the starting instruction information is generated based on starting condition triggering information of the target processing task and ending instruction information of a previous period; obtaining dependency relationship information between the target processing task and a target association task; and executing the target processing task according to the to-be-processed data, generating end instruction information of a cycle, and generating starting condition triggering information of the target associated task according to the dependency relationship information so as to trigger and start the target associated task and the target processing task of the next cycle. By adopting the method, the data processing flexibility of the relational database can be improved.

Description

Technical Field

[0001] The present application relates to the field of big data technology, and in particular to a data processing method, apparatus, computer equipment, storage medium and computer program product based on a relational database. Background Art

[0002] With the development of data processing technology, more and more data management systems need to maintain large amounts of data during the processing of relational databases. For example, the account management systems of financial institutions such as banks need to process the latest information of all customers every day and generate multi-dimensional decision variables at the customer level, account level, and transaction level. This process requires super data processing capabilities and a large storage space.

[0003] However, in the process of processing such data, the current related technologies often have a strong dependency between the necessary data sources and the non-essential data sources, resulting in many usage scenarios where the corresponding tasks will not be executed until all data sources are in place, which makes the flexibility of task execution low. Summary of the invention

[0004] Based on this, it is necessary to provide a data processing method, device, computer equipment, computer-readable storage medium and computer program product based on a relational database that can improve the flexibility of relational database data processing in order to address the above technical problems.

[0005] In a first aspect, the present application provides a data processing method based on a relational database, comprising:

[0006] Acquire the data to be processed and the start instruction information, and start the target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle;

[0007] Obtaining dependency information between the target processing task and the target associated task;

[0008] The target processing task is executed according to the data to be processed to generate end instruction information of this cycle, and the start condition trigger information of the target associated task is generated according to the dependency information to trigger the start of the target associated task and the target processing task of the next cycle.

[0009] In one embodiment, the data to be processed includes necessary data and non-necessary data; the step of obtaining the data to be processed and the start instruction information, and starting the target processing task according to the start instruction information, includes:

[0010] Acquire the data to be processed;

[0011] In the case where the data to be processed is necessary data and the necessary data is completely acquired, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and starting the target processing task according to the start instruction information;

[0012] In the case where the data to be processed is non-essential data, obtaining a startup configuration table;

[0013] The start instruction information is generated according to the start condition in the start configuration table, the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and the target processing task is started according to the start instruction information.

[0014] In one embodiment, generating the start instruction information according to the start condition in the start configuration table, the start condition trigger information of the target processing task and the end instruction information of the previous cycle includes:

[0015] Determine the start time of the target processing task according to the start configuration table;

[0016] When the start time is reached, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0017] In one embodiment, the non-essential data further includes delayed start data; the generating the start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle includes:

[0018] In the case where the non-essential data is the delayed start data, determining the start time and the preset waiting time of the target processing task according to the start configuration table;

[0019] When the start time arrives and the delayed start data is completely acquired, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle;

[0020] When the start time arrives and the delayed start data acquisition is incomplete, start counting the waiting time;

[0021] When the waiting time is equal to the preset waiting time or the delayed start data is completely acquired, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0022] In one embodiment, the obtaining of the data to be processed and the start instruction information includes:

[0023] In response to the general start instruction of the current workspace, the data to be processed and the start instruction information are obtained.

[0024] In one embodiment, the target processing task and the target associated task belong to the same or different workspaces; the step of executing the target processing task according to the to-be-processed data, generating end instruction information of this cycle, and generating start condition trigger information of the target associated task according to the dependency information, so as to trigger the start of the target associated task and the target processing task of the next cycle, comprises:

[0025] Executing the target processing task according to the data to be processed, and generating end instruction information of this cycle;

[0026] Responding to the general start instruction of the current workspace in the next cycle to trigger the start of the target processing task in the next cycle;

[0027] Generate the start condition trigger information of the target associated task according to the dependency information;

[0028] Responding to a general start instruction of the workspace to which the target-associated task belongs, triggering the start of the target-associated task.

[0029] In a second aspect, the present application also provides a data processing device based on a relational database, comprising:

[0030] An information acquisition module, used to acquire the data to be processed and the start instruction information, and start the target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle;

[0031] A relationship acquisition module, used to acquire dependency information between the target processing task and the target associated task;

[0032] A data processing module is used to execute the target processing task according to the data to be processed, generate the end instruction information of this cycle, and generate the start condition trigger information of the target associated task according to the dependency information, so as to trigger the start of the target associated task and the target processing task of the next cycle.

[0033] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0034] Acquire the data to be processed and the start instruction information, and start the target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle;

[0035] Obtaining dependency information between the target processing task and the target associated task;

[0036] The target processing task is executed according to the data to be processed to generate end instruction information of this cycle, and the start condition trigger information of the target associated task is generated according to the dependency information to trigger the start of the target associated task and the target processing task of the next cycle.

[0037] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0038] Acquire the data to be processed and the start instruction information, and start the target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle;

[0039] Obtaining dependency information between the target processing task and the target associated task;

[0040] The target processing task is executed according to the data to be processed to generate end instruction information of this cycle, and the start condition trigger information of the target associated task is generated according to the dependency information to trigger the start of the target associated task and the target processing task of the next cycle.

[0041] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0042] Acquire the data to be processed and the start instruction information, and start the target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle;

[0043] Obtaining dependency information between the target processing task and the target associated task;

[0044] The target processing task is executed according to the data to be processed to generate end instruction information of this cycle, and the start condition trigger information of the target associated task is generated according to the dependency information to trigger the start of the target associated task and the target processing task of the next cycle.

[0045] The above-mentioned data processing method, device, computer equipment, storage medium and computer program product based on relational database, by obtaining the data to be processed and the start instruction information, start the target processing task according to the start instruction information. Since the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle, the start instruction information depends on the end instruction information of the previous cycle, and depends on the start condition trigger information from the target associated task, so as to set a clear dependency and association relationship between different tasks, so as to ensure data consistency. By obtaining the dependency information between the target processing task and the target associated task, the target processing task is executed according to the data to be processed, the end instruction information of this cycle is generated, and the start condition trigger information of the target associated task is generated according to the dependency information, so as to trigger the start of the target associated task and the target processing task of the next cycle, so that the data to be processed is processed according to the flexible dependency relationship, thereby improving the data processing flexibility of the relational database. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0047] Figure 1 An application environment diagram of a data processing method based on a relational database in one embodiment;

[0048] Figure 2 A schematic diagram of a data processing method based on a relational database in one embodiment;

[0049] Figure 3 is a flow chart of a data processing method based on a relational database in another embodiment;

[0050] Figure 4 is a structural block diagram of a data processing device based on a relational database in one embodiment;

[0051] Figure 5 is an internal structure diagram of a computer device in one embodiment;

[0052] Figure 6 FIG. 4 is a diagram showing the internal structure of a computer device in another embodiment. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0054] The data processing method based on relational database provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Among them, the terminal 102 communicates with the server 104 through the network, and the terminal 102 can be used to obtain the data to be processed and send the data to be processed to the server 104 for processing. The data storage system can store the data that the server 104 needs to process. The data storage system can be integrated on the server 104, or it can be placed on the cloud or other network servers. The data storage system can be used to store the unprocessed data to be processed, as well as the preset data such as the dependency information between the target processing task and the target associated task, and can also be used to record the start instruction information, the end instruction information and the start condition trigger information. Among them, the terminal 102 can be but not limited to various personal computers, laptops, smart phones, tablet computers, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc. The server 104 can be implemented with an independent server or a server cluster consisting of multiple servers.

[0055] In an exemplary embodiment, Figure 2 As shown, a data processing method based on a relational database is provided. A relational database is a database management system based on a relational model. It stores data in the form of tables, and each table consists of rows and columns. Each row represents a data record, and each column represents a field or data attribute. In a relational database, there is usually a certain relationship between data, and these relationships are established through foreign keys. Relational database management systems can use structured query languages ​​to perform data management and operations such as inserting, querying, updating, and deleting. This method is applied to Figure 1 The server 104 in the example is used as an example to illustrate the method, which includes the following steps S202 to S206. Among them:

[0056] Step S202, obtaining the data to be processed and the start instruction information, and starting the target processing task according to the start instruction information.

[0057] The data to be processed include mandatory data and non-mandatory data. Mandatory data refers to data from mandatory data sources, and non-mandatory data refers to data from non-mandatory data sources. Mandatory data sources are data from core systems and data sources that must be available at specified times in a small number of business requirements. If the mandatory data sources are not in place in time, the task cannot be started or cannot be completed smoothly. For example, real-time data, data in key databases, etc. are used to process policy input variables with relatively high requirements for data timeliness and accuracy. Non-mandatory data sources have little impact on task execution. Tasks can be started when these data sources are not in place. In addition to the core system and business-specified mandatory data sources, they are data sources that can use the latest historical data. They can be supplementary or auxiliary data, such as historical data, secondary information, etc., and are used to process policy input variables with relatively low timeliness requirements.

[0058] The start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0059] Exemplarily, the server 104 can obtain the data to be processed and the start instruction information from the terminal 102 or other service ends. The data to be processed includes two categories: necessary data and non-necessary data. The necessary data is the core data that the task execution must rely on. For example, an order processing task may need to rely on real-time inventory data and customer order data, which must be prepared before the task starts. Non-necessary data is auxiliary data. Although it is helpful for task execution, it does not necessarily need to be fully prepared before the task starts, such as historical sales data or market trend data. The server 104 can determine whether the current task can be started based on the end status of the task in the previous cycle. At the end of the processing cycle of the data analysis task of the previous cycle, an end instruction information is generated to indicate the start of the next analysis cycle. The end instruction information will be used as one of the start conditions to ensure that the timing of starting the new task is correct.

[0060] Exemplarily, the server 104 can obtain data to be processed; when the data to be processed is necessary data and the necessary data has been completely acquired, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and the target processing task is started according to the start instruction information; when the data to be processed is not necessary data, the start configuration table is acquired; the start instruction information is generated according to the start conditions in the start configuration table, as well as the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and the target processing task is started according to the start instruction information.

[0061] Furthermore, the server 104 can set a strong dependency on the necessary data. If the data to be processed is the necessary data and the data has been completely acquired, the server 104 can generate a start instruction based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle. For example, if the data cleaning task of the previous cycle has been completed and the end instruction information has been generated, then the server 104 can generate new start instruction information based on the end instruction information and the start condition of the current target task (such as requiring data within a specific date range). The generated start instruction information will instruct the server to start the target processing task, such as data aggregation or data analysis tasks.

[0062] On the other hand, the server 104 can avoid setting strong dependencies on non-essential data. If the data to be processed is non-essential data, the server 104 may not directly rely on the integrity of the data to determine whether the task is started. At this time, the server 104 can obtain a startup configuration table. The startup configuration table is a table that stores task execution configurations and dependencies, which contains information such as the startup conditions, priorities, dependent non-essential data types, and task execution schedules of different tasks. For example, the startup configuration table may include: the startup condition of a task is the end instruction of the data cleaning task and part of the data from data source A, and part of the data from data source B can be gradually acquired during the task execution process.

[0063] Next, the server 104 can generate a new startup instruction by reading the information in the startup configuration table, combining the startup condition trigger information of the target processing task and the end instruction information of the previous cycle. For example, assuming that the data cleaning task has been completed, the startup configuration table indicates that a certain data aggregation task depends on the end instruction of the data cleaning task, and the non-essential data that needs to be obtained (such as historical order information) can be loaded gradually during the execution of the task. Even if these non-essential data are not fully prepared, the server 104 can still generate a startup instruction according to the startup configuration table and start the target processing task.

[0064] Further, assume that server 104 is currently responsible for processing the data of commodity inventory. In this process, there are two target tasks: "inventory data analysis" and "inventory data update". The inventory data analysis task depends on the inventory data and sales data of the day (mandatory data), while the inventory data update task only depends on part of the historical inventory data (non-mandatory data). If the inventory data analysis task has been completed and an end instruction has been generated, the server 104 can start the inventory data update task according to the information in the startup configuration table. At this time, even if part of the historical inventory data is not fully prepared, as long as the configuration table allows the task to be executed when the data is not fully in place, the system will start the task and dynamically obtain the remaining data during the execution process.

[0065] Furthermore, the server 104 can also determine the start time of the target processing task according to the start configuration table; when the start time arrives, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0066] Exemplarily, the startup configuration table not only contains the startup conditions of the task, but also can be used to define the scheduled startup time and execution order of each task. For example, the startup configuration table can specify that an "inventory data update" task should be started at 2 a.m. every day, or it depends on certain data cleaning tasks to be completed at 10 a.m. before it can be started. The server 104 can determine the startup time of the task according to the time point defined in the configuration table.

[0067] For example, the server 104 can obtain the data to be processed and the startup instruction information in response to the general startup instruction of the current workspace. The server 104 can set a general startup instruction for the data processing system, and the startup node of each workspace must rely on this general startup instruction to achieve the overall control effect of the current batch startup and termination.

[0068] Step S204, obtaining dependency information between the target processing task and the target associated task.

[0069] The target processing task and the target associated task may belong to the same workspace or different workspaces. The pending tasks in each workspace can start processing tasks according to the general startup instruction, and the pending tasks in different workspaces can be associated with each other through dependency information, thereby realizing the dependency of tasks across workspaces. The dependency information can be a table structure of a data warehouse, or a form of data or signals generated by a task, etc.

[0070] Exemplarily, the server 104 can obtain the dependency information between the tasks by accessing the corresponding data storage system. The dependency information is used to characterize the execution order between different tasks. For example, the target processing task is "data cleaning", and the target association task is "data analysis". The "data cleaning" task must be completed before the "data analysis" task can be started. Therefore, the server 104 needs to understand the relationship between the two tasks and ensure that the analysis task will not be started until the cleaning task is completed.

[0071] Step S206, executing the target processing task according to the data to be processed, generating end instruction information of this cycle, and generating start condition trigger information of the target associated task according to the dependency information, so as to trigger the start of the target associated task and the target processing task of the next cycle.

[0072] Exemplarily, the server 104 can execute the target processing task based on the data to be processed to generate the end instruction information of this cycle; respond to the general start instruction of the current workspace of the next cycle to trigger the start of the target processing task of the next cycle; generate the start condition trigger information of the target associated task based on the dependency information; respond to the general start instruction of the workspace to which the target associated task belongs to trigger the start of the target associated task.

[0073] Furthermore, first, the server 104 can execute the target processing task according to the data to be processed. For example, if the data to be processed is ready and meets the start conditions of the target task, the server 104 can start the target processing task, such as data cleaning, data analysis or other data processing tasks. After the task is completed, the server 104 can generate the end instruction information of this cycle to indicate that the task of the current cycle has been completed and provide the necessary start conditions for the task of the next cycle.

[0074] Next, in response to the general start instruction of the current workspace in the next cycle, the server 104 can start the target processing task of the next cycle. The server 104 can check the dependency information of all tasks in the current workspace and start the corresponding task according to the dependency information. At the same time, the server 104 can generate the start condition trigger information of the target-related task according to the dependency information. The server 104 can determine when the target-related task should be started according to the dependency information, and generate the corresponding start condition trigger information. Subsequently, in response to the general start instruction of the workspace to which the target-related task belongs, the server 104 can trigger the start of the target-related task.

[0075] In the above-mentioned data processing method based on relational database, by obtaining the data to be processed and the start instruction information, the target processing task is started according to the start instruction information. Since the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle, the start instruction information depends on the end instruction information of the previous cycle and depends on the start condition trigger information from the target associated task, so as to set a clear dependency and association relationship between different tasks, so as to ensure data consistency. By obtaining the dependency information between the target processing task and the target associated task, the target processing task is executed according to the data to be processed, the end instruction information of this cycle is generated, and the start condition trigger information of the target associated task is generated according to the dependency information to trigger the start of the target associated task and the target processing task of the next cycle, so that the data to be processed is processed according to the flexible dependency relationship, thereby improving the data processing flexibility of the relational database.

[0076] In an exemplary embodiment, to implement the above steps, the server 104 can divide the data into four layers: storage layer, basic layer, intermediate layer and output layer, which can not only ensure the traceability of the data, but also effectively realize the reuse of data and ensure the consistency control of the data source during multi-tasking processing.

[0077] Among them, the server 104 can record the date information used by each data source through the startup configuration table in the storage layer, instead of directly storing the actual data. The storage layer saves the data source date required for the fixed batch daily run, thereby ensuring the consistency of the data source date and saving storage space; the server 104 can perform corresponding data processing and processing according to the data source date provided by the storage layer in the basic layer and in combination with the dependency information; the server 104 can also generate core data tables, non-core data tables, and core and non-core related tables in the middle layer according to different business dimensions (such as customers, accounts, bills, etc.), so as to further process and classify the basic data, extract multi-dimensional data views and display them on the terminal 102 to meet different analysis requirements; the server 104 can also classify and merge various tables in the middle layer in the output layer, and finally output a result table that meets business requirements and display it on the terminal 102.

[0078] This hierarchical data architecture ensures that data processing at each stage is transparent and traceable. At the same time, through reasonable division and layered processing, the consistency of data sources and efficient use of storage space are ensured.

[0079] In an exemplary embodiment, Figure 3 As shown, the non-essential data may also include delayed start data; the step of generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle may include steps S302 to S308. Among them:

[0080] Step S302: When the non-essential data is delayed start data, the start time and preset waiting time of the target processing task are determined according to the start configuration table.

[0081] Among them, delayed start data refers to data from specific non-essential data sources, which are used to process policy input variables for special business scenarios specified by the demand proposer. Although these data sources are not essential parts of the core tasks, they have higher timeliness requirements. Therefore, server 104 can set a minimum waiting time, that is, a preset waiting time. After reaching the specified waiting time, it starts to execute related tasks to ensure the timeliness of the data without affecting the execution timing of key tasks.

[0082] For example, in the case where the non-essential data is delayed start data, the server 104 can confirm the start time of the target processing task according to the start configuration table, and obtain the preset waiting time by searching the start configuration table or accessing the data storage system according to the data tag of the delayed start data. For example, assuming that the payment status of a certain order data source needs to be in place within a certain time limit to ensure timely processing, a preset waiting time can be defined in the start configuration table, such as 6 hours, indicating that if the data is not in place within 6 hours, the task will be started after 6 hours regardless of whether the data is completely in place.

[0083] Step S304, when the start time arrives and the delayed start data is completely acquired, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0084] For example, after the start time arrives, the server 104 can check whether the delayed start data has been completely acquired. If the data is complete, the server 104 will generate a start instruction according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle, thereby starting the target processing task.

[0085] Step S306, when the start time arrives and the delayed start data acquisition is incomplete, start timing the waiting time.

[0086] For example, after the start time arrives, the server 104 can check whether the delayed start data has been completely acquired. If the delayed start data has not been completely acquired, the server 104 can call the timing task to start timing, enter the waiting stage, and wait for the data to arrive according to the preset waiting time. In this stage, the task will not start immediately, but will continue to wait for the data source to arrive.

[0087] Step S308, when the waiting time is equal to the preset waiting time or the delayed start data acquisition is complete, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0088] Exemplarily, when the waiting time reaches the preset waiting time, or when the delayed start data is completely acquired during the waiting process, the server 104 can recheck the data integrity and generate the start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle. At this time, regardless of whether the data is completely acquired, as long as the waiting time is full, the server 104 generates a start instruction and starts the relevant task on time, so that the processing of the delayed start data can take into account the timeliness of the data and the flexibility of the task, ensuring that even the delay of the non-core data source will not affect the critical path of the entire batch processing, thereby ensuring the efficiency of data processing and the continuity of business.

[0089] In another exemplary embodiment, the server 104 responds to the general startup instruction of the current workspace, obtains startup instruction information, and starts the target processing task according to the startup instruction information; wherein the startup instruction information is generated based on the startup condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0090] At the same time, the server 104 obtains the data to be processed. If the data to be processed is the necessary data and the necessary data is completely obtained, the server 104 generates the start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and starts the target processing task according to the start instruction information. If the data to be processed is not the necessary data, the server 104 obtains the start configuration table, determines the start time of the target processing task according to the start configuration table, and when the start time arrives, generates the start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and starts the target processing task according to the start instruction information.

[0091] In the case where the non-essential data is delayed start data, the server 104 determines the start time and preset waiting time of the target processing task according to the start configuration table; when the start time is reached and the delayed start data is fully acquired, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle; when the start time is reached and the delayed start data is not fully acquired, the waiting time is started to be counted; when the waiting time is equal to the preset waiting time or the delayed start data is fully acquired, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0092] Next, the server 104 obtains the dependency information between the target processing task and the target associated task, executes the target processing task according to the data to be processed, generates the end instruction information of this cycle, responds to the general start instruction of the current workspace of the next cycle to trigger the start of the target processing task of the next cycle, and the server 104 generates the start condition trigger information of the target associated task according to the dependency information, responds to the general start instruction of the workspace to which the target associated task belongs to trigger the start of the target associated task.

[0093] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0094] Based on the same inventive concept, the embodiment of the present application also provides a data processing device based on a relational database for implementing the data processing method based on a relational database involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the one or more data processing device embodiments based on a relational database provided below can refer to the limitations of the data processing method based on a relational database above, and will not be repeated here.

[0095] In an exemplary embodiment, Figure 4 As shown, a data processing device based on a relational database is provided, comprising: an information acquisition module 402, a relationship acquisition module 404 and a data processing module 406, wherein:

[0096] The information acquisition module 402 is used to acquire the data to be processed and the start instruction information, and start the target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle;

[0097] A relationship acquisition module 404 is used to acquire dependency information between a target processing task and a target associated task;

[0098] The data processing module 406 is used to execute the target processing task according to the data to be processed, generate the end instruction information of this cycle, and generate the start condition trigger information of the target associated task according to the dependency information to trigger the start of the target associated task and the target processing task of the next cycle.

[0099] In one embodiment, the data to be processed includes mandatory data and non-mandatory data; the information acquisition module 402 includes:

[0100] A data acquisition unit, used for acquiring data to be processed;

[0101] A first acquisition unit is used to generate start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle when the data to be processed is the necessary data and the necessary data is completely acquired, and start the target processing task according to the start instruction information;

[0102] The second acquisition unit is used to acquire the startup configuration table when the data to be processed is not necessary data; generate startup instruction information according to the startup conditions in the startup configuration table, the startup condition trigger information of the target processing task and the end instruction information of the previous cycle, and start the target processing task according to the startup instruction information.

[0103] In one of the embodiments, the second acquisition unit is also used to: determine the start time of the target processing task according to the start configuration table; when the start time arrives, generate start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0104] In one embodiment, the non-essential data further includes delayed start data; and the second acquisition unit includes:

[0105] A delayed acquisition unit, used to determine the start time and preset waiting time of the target processing task according to the start configuration table when the non-necessary data is delayed start data;

[0106] A timing unit is used to generate start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle when the start time arrives and the delayed start data is completely acquired; when the start time arrives and the delayed start data is not completely acquired, start timing the waiting time;

[0107] The information processing unit is also used to generate start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle when the waiting time is equal to the preset waiting time or the delayed start data is acquired completely.

[0108] In one embodiment, the information acquisition module 402 is further used to: in response to a general startup instruction of the current workspace, acquire the data to be processed and the startup instruction information.

[0109] In one embodiment, the target processing task and the target associated task belong to the same or different workspaces; the data processing module 406 is specifically used to: execute the target processing task according to the data to be processed, and generate the end instruction information of this cycle; respond to the general start instruction of the current workspace of the next cycle to trigger the start of the target processing task of the next cycle; generate the start condition trigger information of the target associated task according to the dependency information; respond to the general start instruction of the workspace to which the target associated task belongs to trigger the start of the target associated task.

[0110] Each module in the above-mentioned data processing device based on relational database can be implemented in whole or in part by software, hardware and their combination. Each module can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to each module above.

[0111] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 5 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store unprocessed data to be processed, as well as preset data such as dependency information between target processing tasks and target associated tasks, and can also be used to record data such as start instruction information, end instruction information and start condition trigger information. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a data processing method based on a relational database is implemented.

[0112] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 6As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be realized through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a data processing method based on a relational database is realized. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0113] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0114] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the following steps when executing the computer program: obtaining data to be processed and start instruction information, and starting a target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle; obtaining dependency information between the target processing task and the target associated task; executing the target processing task according to the data to be processed, generating the end instruction information of this cycle, and generating the start condition trigger information of the target associated task according to the dependency information, so as to trigger the start of the target associated task and the target processing task of the next cycle.

[0115] In one embodiment, when the processor executes the computer program, the following steps are also implemented: obtaining data to be processed; when the data to be processed is necessary data and the necessary data is completely obtained, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and starting the target processing task according to the start instruction information; when the data to be processed is not necessary data, obtaining a start configuration table; generating start instruction information according to the start conditions in the start configuration table, as well as the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and starting the target processing task according to the start instruction information.

[0116] In one embodiment, when the processor executes the computer program, the following steps are also implemented: determining the start time of the target processing task according to the start configuration table; when the start time arrives, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0117] In one embodiment, the processor also implements the following steps when executing the computer program: when the non-essential data is delayed start data, determining the start time and preset waiting time of the target processing task according to the start configuration table; when the start time is reached and the delayed start data is fully acquired, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle; when the start time is reached and the delayed start data is not fully acquired, starting to count the waiting time; when the waiting time is equal to the preset waiting time or the delayed start data is fully acquired, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0118] In one embodiment, when the processor executes the computer program, the processor further implements the following steps: in response to the general startup instruction of the current workspace, obtaining the data to be processed and the startup instruction information.

[0119] In one embodiment, the processor also implements the following steps when executing the computer program: execute the target processing task according to the data to be processed to generate the end instruction information of this cycle; respond to the general start instruction of the current workspace of the next cycle to trigger the start of the target processing task of the next cycle; generate the start condition trigger information of the target associated task according to the dependency information; respond to the general start instruction of the workspace to which the target associated task belongs to trigger the start of the target associated task.

[0120] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented: obtaining data to be processed and start instruction information, and starting a target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle; obtaining dependency information between the target processing task and the target associated task; executing the target processing task according to the data to be processed, generating the end instruction information of this cycle, and generating the start condition trigger information of the target associated task according to the dependency information, so as to trigger the start of the target associated task and the target processing task of the next cycle.

[0121] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining data to be processed; when the data to be processed is necessary data and the necessary data is completely obtained, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and starting the target processing task according to the start instruction information; when the data to be processed is not necessary data, obtaining a start configuration table; generating start instruction information according to the start conditions in the start configuration table, as well as the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and starting the target processing task according to the start instruction information.

[0122] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining the start time of the target processing task according to the start configuration table; when the start time is reached, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0123] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: when the non-essential data is delayed start data, the start time and preset waiting time of the target processing task are determined according to the start configuration table; when the start time is reached and the delayed start data is fully acquired, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle; when the start time is reached and the delayed start data is not fully acquired, the waiting time is started; when the waiting time is equal to the preset waiting time or the delayed start data is fully acquired, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0124] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: in response to the general startup instruction of the current workspace, the data to be processed and the startup instruction information are acquired.

[0125] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: executing the target processing task according to the data to be processed to generate the end instruction information of this cycle; responding to the general start instruction of the current workspace of the next cycle to trigger the start of the target processing task of the next cycle; generating the start condition trigger information of the target associated task according to the dependency information; responding to the general start instruction of the workspace to which the target associated task belongs to trigger the start of the target associated task.

[0126] In one embodiment, a computer program product is provided, including a computer program, which implements the following steps when executed by a processor: obtaining data to be processed and start instruction information, and starting a target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle; obtaining dependency information between the target processing task and the target associated task; executing the target processing task according to the data to be processed, generating the end instruction information of this cycle, and generating the start condition trigger information of the target associated task according to the dependency information, so as to trigger the start of the target associated task and the target processing task of the next cycle.

[0127] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining data to be processed; when the data to be processed is necessary data and the necessary data is completely obtained, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and starting the target processing task according to the start instruction information; when the data to be processed is not necessary data, obtaining a start configuration table; generating start instruction information according to the start conditions in the start configuration table, as well as the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and starting the target processing task according to the start instruction information.

[0128] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: determining the start time of the target processing task according to the start configuration table; when the start time is reached, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0129] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: when the non-essential data is delayed start data, the start time and preset waiting time of the target processing task are determined according to the start configuration table; when the start time is reached and the delayed start data is fully acquired, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle; when the start time is reached and the delayed start data is not fully acquired, the waiting time is started; when the waiting time is equal to the preset waiting time or the delayed start data is fully acquired, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

[0130] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: in response to the general startup instruction of the current workspace, the data to be processed and the startup instruction information are acquired.

[0131] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: executing the target processing task according to the data to be processed to generate the end instruction information of this cycle; responding to the general start instruction of the current workspace of the next cycle to trigger the start of the target processing task of the next cycle; generating the start condition trigger information of the target associated task according to the dependency information; responding to the general start instruction of the workspace to which the target associated task belongs to trigger the start of the target associated task.

[0132] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0133] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital instruction processor, a programmable logic unit, a data processing logic unit based on quantum computing, etc., but are not limited to this.

[0134] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0135] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A data processing method based on a relational database, characterized in that: The method comprises: Acquire the data to be processed and the start instruction information, and start the target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle; Obtaining dependency information between the target processing task and the target associated task; The target processing task is executed according to the data to be processed to generate end instruction information of this cycle, and the start condition trigger information of the target associated task is generated according to the dependency information to trigger the start of the target associated task and the target processing task of the next cycle.

2. The method according to claim 1, characterized in that The data to be processed includes necessary data and non-necessary data; the step of obtaining the data to be processed and the start instruction information, and starting the target processing task according to the start instruction information, includes: Acquire the data to be processed; In the case where the data to be processed is necessary data and the necessary data is completely acquired, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and starting the target processing task according to the start instruction information; In the case where the data to be processed is non-essential data, obtaining a startup configuration table; The start instruction information is generated according to the start condition in the start configuration table, the start condition trigger information of the target processing task and the end instruction information of the previous cycle, and the target processing task is started according to the start instruction information.

3. The method according to claim 2, characterized in that The generating the start instruction information according to the start condition in the start configuration table, the start condition trigger information of the target processing task and the end instruction information of the previous cycle includes: Determine the start time of the target processing task according to the start configuration table; When the start time is reached, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

4. The method according to claim 2, characterized in that: The non-essential data also includes delayed start data; the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle, including: In the case where the non-essential data is the delayed start data, determining the start time and the preset waiting time of the target processing task according to the start configuration table; When the start time arrives and the delayed start data is completely acquired, generating start instruction information according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle; When the start time arrives and the delayed start data acquisition is incomplete, start counting the waiting time; When the waiting time is equal to the preset waiting time or the delayed start data is completely acquired, the start instruction information is generated according to the start condition trigger information of the target processing task and the end instruction information of the previous cycle.

5. The method according to any one of claims 1 to 4, characterized in that: The obtaining of the data to be processed and the start instruction information includes: In response to the general start instruction of the current workspace, the data to be processed and the start instruction information are obtained.

6. The method according to claim 5, characterized in that The target processing task and the target associated task belong to the same or different workspaces; the target processing task is executed according to the data to be processed, the end instruction information of the current cycle is generated, and the start condition trigger information of the target associated task is generated according to the dependency information to trigger the start of the target associated task and the target processing task of the next cycle, including: Executing the target processing task according to the data to be processed, and generating end instruction information of this cycle; Responding to the general start instruction of the current workspace in the next cycle to trigger the start of the target processing task in the next cycle; Generate the start condition trigger information of the target associated task according to the dependency information; Responding to a general start instruction of the workspace to which the target-associated task belongs, triggering the start of the target-associated task.

7. A data processing device based on a relational database, characterized in that: The device comprises: An information acquisition module, used to acquire the data to be processed and the start instruction information, and start the target processing task according to the start instruction information; wherein the start instruction information is generated based on the start condition trigger information of the target processing task and the end instruction information of the previous cycle; A relationship acquisition module, used to acquire dependency information between the target processing task and the target associated task; A data processing module is used to execute the target processing task according to the data to be processed, generate the end instruction information of this cycle, and generate the start condition trigger information of the target associated task according to the dependency information, so as to trigger the start of the target associated task and the target processing task of the next cycle.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images