Multitask concurrent processing method and device and storage medium
By starting multiple evaluation services on the evaluation platform and updating the relationship table, the problems of low computing efficiency of the evaluation platform and insufficient concurrency of evaluation tasks in the existing technology are solved, and efficient multi-task concurrent processing is achieved.
Patent Information
- Application Number
- CN202311421269.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-27
- Publication Date
- 2025-05-06
AI Technical Summary
When the existing evaluation platforms are multi-task concurrent processing, their computing efficiency is low and they cannot meet the needs of large-scale data volume. An evaluation plan can only correspond to one evaluation service, which limits the concurrency of evaluation tasks.
By starting multiple evaluation services based on the evaluation plan on the evaluation platform and updating the relationship table using the heartbeat service, the concurrent evaluation of multiple evaluation services for multiple evaluation tasks is realized.
It improves the concurrency of evaluation tasks, improves computing efficiency, and can effectively handle large-scale data evaluation services.
Smart Images
Figure CN119938500A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of algorithm evaluation technology, and in particular to a multi-task concurrent processing method, device and storage medium. Background Art
[0002] On the existing evaluation platform, multiple evaluation tasks can only be calculated and completed linearly by one evaluation service. In addition, the execution logic of the current evaluation platform is that if multiple evaluation plans are started on the same host, the evaluation service with a different unique identification code from the one recorded when the first evaluation plan was started will be forced offline, which results in one evaluation plan corresponding to only one evaluation service.
[0003] The above problems will lead to low computational efficiency when using the evaluation platform to evaluate the algorithm, and there is a problem that the data volume requirements of the evaluation business cannot be met when facing a business with a large amount of data. Summary of the invention
[0004] In view of the problems in the prior art that multiple evaluation tasks can only be completed by one evaluation service and one evaluation plan can only correspond to one evaluation service, the present application mainly provides a multi-task concurrent processing method, device and storage medium.
[0005] In order to achieve the above-mentioned purpose, the first technical solution adopted in the present application is a multi-task concurrent processing method, which includes: on the evaluation platform, starting one or more corresponding evaluation services according to the evaluation plan and obtaining the unique identification code corresponding to each evaluation service; according to the correspondence between the evaluation plan and the evaluation service, using the unique identification code of the evaluation service, updating the relationship table in the evaluation platform, wherein if the unique identification code of the evaluation service exists in the relationship table, the current heartbeat time corresponding to the evaluation service is updated; if the unique identification code of the evaluation service does not exist in the relationship table, the unique identification code of the evaluation service is added to the relationship table; multiple evaluation tasks are evaluated according to multiple evaluation services in the evaluation table; wherein the information reflected in the relationship table includes the correspondence between the evaluation plan and the evaluation service and the heartbeat time of the heartbeat service sent by the evaluation service to the evaluation platform.
[0006] Optionally, through the heartbeat service, the evaluation service queries the evaluation platform for the evaluation tasks that need to be performed;
[0007] If there are unexecuted evaluation tasks in the evaluation platform, the evaluation service is used to execute the evaluation tasks; wherein the heartbeat service sends task requests to the evaluation platform according to a predetermined period.
[0008] Optionally, the evaluation service uses the heartbeat service to send the status of the evaluation service and the status of the evaluation task during the evaluation process to the evaluation platform.
[0009] Optionally, when the evaluation task is executed on the evaluated service, the evaluation task is locked on the evaluation platform using an exclusive lock and a transaction mechanism.
[0010] Optionally, during the process of the evaluation service executing the evaluation task, the evaluation service sends the current status of the evaluation service to the evaluation platform through the heartbeat service according to a predetermined period, where the status of the evaluation service includes online, offline, and error.
[0011] Optionally, the evaluation results of the evaluation service on the evaluation task are sent to the evaluation platform through the heartbeat service according to a predetermined period, where the status of the evaluation task includes: waiting, data processing, calculation, storage and success.
[0012] The second technical solution adopted in the present application is a multi-task concurrent processing device, which includes: an information acquisition module, which is used to start one or more corresponding evaluation services on the evaluation platform according to the evaluation plan and obtain the unique identification code corresponding to each evaluation service; a relationship table update module, which is used to update the relationship table in the evaluation platform according to the correspondence between the evaluation plan and the evaluation service, using the unique identification code of the evaluation service, wherein if the unique identification code of the evaluation service exists in the relationship table, the current heartbeat time corresponding to the evaluation service is updated; if the unique identification code of the evaluation service does not exist in the relationship table, the unique identification code of the evaluation service is added to the relationship table; an evaluation module, which is used to evaluate multiple evaluation tasks according to multiple evaluation services in the evaluation table; wherein the information reflected in the relationship table includes the correspondence between the evaluation plan and the evaluation service and the heartbeat time of the heartbeat service sent by the evaluation service to the evaluation platform.
[0013] Optionally, the execution module is used to query the evaluation platform for evaluation tasks that need to be executed through the heartbeat service and the evaluation service; if there are unexecuted evaluation tasks in the evaluation platform, the evaluation service is used to execute the evaluation tasks; wherein the heartbeat service sends task requests to the evaluation platform according to a predetermined period.
[0014] Another third technical solution adopted in the present application is: providing a computer-readable storage medium storing computer instructions, which are operated to execute the multi-task concurrent processing method in solution one or the multi-task concurrent processing device in solution two.
[0015] The beneficial effect that can be achieved by the technical solution of the present application is: by transforming the correspondence between the evaluation plan and the evaluation service, it is possible to achieve the purpose of starting multiple evaluation services with one evaluation plan on the evaluation platform, so that the evaluation service can be deployed on multiple devices, providing the concurrency of evaluation tasks and further improving computing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0017] Figure 1 It is a schematic diagram of a specific implementation of a multi-task concurrent processing method of the present application;
[0018] Figure 2 It is a flow chart of the evaluation service executing the evaluation task in the prior art;
[0019] Figure 3 It is a flowchart of an evaluation service executing an evaluation task in a multi-task concurrent processing method of the present application;
[0020] Figure 4 It is a schematic diagram of a specific implementation of a multi-task concurrent processing device of the present application.
[0021] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0022] The preferred embodiments of the present application are described in detail below in conjunction with the accompanying drawings so that the advantages and features of the present application can be more easily understood by those skilled in the art, thereby making a clearer and more definite definition of the protection scope of the present application.
[0023] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.
[0024] Glossary:
[0025] 1. Evaluation platform: A unified framework that supports customized evaluation of multiple algorithms. On the evaluation platform, users can compare, count, and calculate the actual data values with the predicted values by customizing the algorithm process and algorithm indicators to determine whether the predicted values obtained by the current model meet expectations.
[0026] 2. Evaluation service: The evaluation service refers to the task executor used to perform the evaluation task. To ensure the execution of the task, each evaluation service must specify an evaluation plan. The evaluation service execution task is divided into the Metric server (data processing service) stage and the Aggregator server (aggregation computing service) stage. These two services are deployed in the Kubernetes container (an open source containerized automatic deployment platform) in the form of images.
[0027] 3. Evaluation plan: The evaluation plan refers to the overall strategy used to guide the evaluation service on how to process and calculate data. A user can create multiple different evaluation plans. The premise of starting the evaluation service is to have a corresponding evaluation plan, and the tasks of the metric server stage and the aggregator server stage of the evaluation service need to use the same evaluation plan.
[0028] 4. Evaluation task: Evaluation task refers to the calculation of the real value and the predicted value generated by the user. The evaluation task will be submitted to the evaluation service, and the evaluation service will perform the calculation. The evaluation service to which the evaluation task is submitted is determined by the evaluation scheme specified when submitting the evaluation task.
[0029] About the existing technology:
[0030] In the prior art, when using an evaluation platform to evaluate an evaluation task, the user must first develop an evaluation plan on the evaluation platform, and a user can create multiple evaluation plans. The evaluation service is started according to the evaluation plan. A complete evaluation service consists of two parts, which are the Metric server stage for data processing and the Aggregator server stage for performing aggregation operations based on the data processed by the Metric server stage. These two stages need to be started in the background of the evaluation platform respectively, and the evaluation service needs to be started according to the specified evaluation plan. The started evaluation service is used to execute the evaluation task submitted by the user to the evaluation platform. In the evaluation platform architecture of the prior art, one evaluation plan can only start one evaluation service. This model greatly limits the number of evaluation tasks evaluated by the evaluation platform and reduces the efficiency of the evaluation.
[0031] Therefore, this solution changes the architecture of the evaluation platform so that the evaluation platform can implement a solution to deploy multiple evaluation services on one machine or different machines.
[0032] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The specific embodiments described below can be combined with each other to form new embodiments. The same or similar ideas or processes described in one embodiment may not be repeated in other embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.
[0033] Figure 1 An implementation of a multi-task concurrent processing method of the present application is shown.
[0034] Figure 1 The multi-task concurrent processing method shown includes: step S101, on the evaluation platform, starting one or more corresponding evaluation services according to the evaluation plan and obtaining a unique identification code corresponding to each evaluation service;
[0035] Step S102: according to the correspondence between the evaluation scheme and the evaluation service, the relationship table in the evaluation platform is updated using the unique identification code of the evaluation service, wherein if the unique identification code of the evaluation service exists in the relationship table, the current heartbeat time corresponding to the evaluation service is updated; if the unique identification code of the evaluation service does not exist in the relationship table, the unique identification code of the evaluation service is added to the relationship table;
[0036] Step S103, evaluating multiple evaluation tasks according to multiple evaluation services in the evaluation table; wherein the information reflected in the relationship table includes the corresponding relationship between the evaluation scheme and the evaluation service and the heartbeat time when the evaluation service sends the heartbeat service to the evaluation platform.
[0037] This specific implementation method, by transforming the correspondence between the evaluation plan and the evaluation service, can achieve the purpose of starting multiple evaluation services with one evaluation plan on the evaluation platform, so that the evaluation service can be deployed on multiple devices, increasing the concurrency of evaluation tasks and further improving computing efficiency.
[0038] exist Figure 1 In the illustrated implementation, the multi-task concurrent processing method includes step S101 , on the evaluation platform, starting one or more corresponding evaluation services according to the evaluation plan and obtaining a unique identification code corresponding to each evaluation service.
[0039] Specifically, the user defines one or more evaluation schemes on the evaluation platform, and the evaluation platform starts one or more evaluation services that execute evaluation tasks according to the evaluation schemes. After the evaluation service is started, the evaluation platform obtains the unique identification code of the evaluation service started through the data transmission bus, and saves the obtained unique identification code of the evaluation service in the background. By saving the unique identification code of the started evaluation service on the evaluation platform, it lays the foundation for using one evaluation scheme to start multiple evaluation services to execute evaluation tasks. At the same time, by obtaining the unique identification code of the evaluation service, it can better distinguish and manage multiple evaluation services, so as to better allocate evaluation tasks.
[0040] For example, when the algorithm to be evaluated is to calculate the sum of 3, 2, 4, 6, and 5, the evaluation plan can be to first calculate the sum of the first two numbers, then calculate the sum of the last three numbers, and then add the calculated sums, that is, the evaluation plan can be (3+2)+(4+6+5), which is referred to as Evaluation Plan 1. The evaluation plan can also be to first calculate the sum of the first three numbers, then calculate the sum of the last two numbers, and finally add the calculated sums, that is, the evaluation plan can also be (3+2+4)+(6+5), which is referred to as Evaluation Plan 2. The evaluation plan can also be to first calculate the sum of the first four numbers, and then add the calculated sum to the last number, that is, the evaluation plan can also be (3+2+4+6)+5, which is referred to as Evaluation Plan 3. If the user defines the evaluation scheme 1, evaluation scheme 2 and evaluation scheme 3 as described above on the evaluation platform, when the evaluation platform starts the evaluation service according to the evaluation scheme, three evaluation services need to be started for evaluation scheme 1 and evaluation scheme 2, and two evaluation services need to be started for evaluation scheme 3. After completing the startup of the evaluation service, the evaluation platform obtains the unique identification code of the evaluation service through the data transmission bus and saves the unique identification code to the background.
[0041] exist Figure 1 In the specific implementation shown, the multi-task concurrent processing method also includes step S102, according to the corresponding relationship between the evaluation scheme and the evaluation service, using the unique identification code of the evaluation service, updating the relationship table in the evaluation platform, wherein if the unique identification code of the evaluation service exists in the relationship table, the current heartbeat time corresponding to the evaluation service is updated; if the unique identification code of the evaluation service does not exist in the relationship table, the unique identification code of the evaluation service is added to the relationship table. This step achieves the purpose of starting multiple evaluation services using one evaluation scheme by adding a relationship table to the evaluation platform, which can enhance the efficiency of the evaluation platform in processing tasks, enable the evaluation platform to perform the processing of large-volume evaluation tasks, and improve the efficiency of algorithm evaluation.
[0042] Specifically, the evaluation platform establishes a relationship table about the unique identification code of the evaluation scheme and the evaluation service according to the corresponding relationship between the evaluation scheme and the evaluation service, and saves the relationship table in the background of the evaluation platform. The evaluation platform obtains data such as the evaluation service type, creation time, running host name and update time of the heartbeat service through the heartbeat service. When the evaluation platform obtains the above data, the unique identification code of the data is compared with the unique identification code of the evaluation service already existing in the relationship table. If the unique identification code already exists in the relationship table, the data obtained by the heartbeat service is used to update the relevant data in the relationship table; if it is found through comparison that the unique identification code corresponding to the evaluation service does not exist in the relationship table, the unique identification code corresponding to the evaluation service is added to the relationship table, and the relevant data obtained by the heartbeat service is filled into the corresponding position in the relationship table.
[0043] For example, a relationship table as shown in Figure 1 below is established in the background of the evaluation platform.
[0044]
[0045] Table 1: Relationship table of evaluation scheme 1
[0046] When the evaluation platform obtains data that the heartbeat update time of the evaluation service whose unique identification code is evaluation service 01 is 00:12, the relevant data of the corresponding column of evaluation service 01 in the table is updated to obtain Table 2.
[0047]
[0048] Table 2: Relationship table of evaluation scheme 1
[0049] When the evaluation platform obtains evaluation service related data whose unique identification code is evaluation service 04, a new column of evaluation service 04 is added to the relationship table to record the related data of evaluation service 04, and the relationship table is updated to obtain Table 3.
[0050]
[0051]
[0052] Table 3: Relationship table of evaluation scheme 1
[0053] The above relationship table is only an example of the information contained in the relationship table corresponding to the evaluation scheme, and how to update the relationship table when the information is updated, and does not mean that the relationship table as described above actually exists on the evaluation platform.
[0054] exist Figure 1In the specific implementation shown, the multi-task concurrent processing method also includes step S103, evaluating multiple evaluation tasks according to multiple evaluation services in the evaluation table; wherein the information reflected in the relationship table includes the corresponding relationship between the evaluation scheme and the evaluation service and the heartbeat time of the heartbeat service sent by the evaluation service to the evaluation platform. By using the evaluation service in the relationship table to evaluate the evaluation task, the purpose of starting multiple evaluation services with one evaluation scheme can be achieved on the evaluation platform, so that the evaluation service can be deployed on multiple devices, the concurrency of the evaluation task is increased, and the computing efficiency is further improved.
[0055] Specifically, Figure 2 In the prior art, when multiple evaluation services are started on the same host using the evaluation platform to start the evaluation service, the unique identification code of the evaluation service is sent to the evaluation platform through the heartbeat service, and the evaluation platform determines whether the received unique identification code is the same as the unique identification code of the evaluation service that is running corresponding to the evaluation scheme. If the re-received unique identification code is different from the unique identification code of the evaluation service that is running, the operation of the evaluation service that sent the heartbeat service is terminated; if the re-received unique identification code is the same as the unique identification code of the evaluation service that is running, the heartbeat time of the evaluation service currently executing the task is updated. When the prior art is used to evaluate the evaluation task, there is a problem that when multiple evaluation schemes are started, the evaluation service with a different unique identification code from the evaluation service record corresponding to the first evaluation scheme started will be forced offline, which will cause the evaluation platform to only execute the same evaluation scheme, and cannot execute multiple evaluation schemes at the same time, and the same evaluation scheme can only start one corresponding evaluation service. The existing technology also has the problem that when multiple evaluation schemes are started and multiple evaluation tasks are submitted on the same host, the first task to be executed will be dispersed among the evaluation services of multiple Metric server stages (at this time, the evaluation services corresponding to multiple Metric server stages are the same evaluation service and have the same unique identification code), and will not be submitted to only one evaluation service, because the evaluation service of the Aggregator server stage will perform subsequent calculations in the order in which the tasks of the Metric server stage are completed. This processing will cause the Metric server to be occupied and the Aggregator server to be idle, further causing waste of computing power of the evaluation platform and delay in efficiency.
[0056] like Figure 3When the evaluation service is started by using the evaluation platform, when multiple evaluation services are started on the same host, the unique identification code of the evaluation service is sent to the evaluation platform through the heartbeat service, and the evaluation platform determines whether the received unique identification code is the same as the unique identification code of the evaluation service in the relationship table. If the unique identification code of the evaluation service exists in the relationship table, the current heartbeat time corresponding to the evaluation service is updated; if the unique identification code of the evaluation service does not exist in the relationship table, the unique identification code of the evaluation service is added to the relationship table, and all evaluation services that exist in the relationship table can execute the evaluation task, which solves the problem that one evaluation plan can only correspond to one evaluation service. At the same time, exclusive locks and transaction mechanisms are added to the platform for evaluation tasks to ensure that the same evaluation task will only be executed by one evaluation service, that is, the Metric server is locked at the database level of the evaluation platform so that the same task will only be executed by one Metric server.
[0057] In a specific embodiment of the present application, step S103 includes, through the heartbeat service, the evaluation service queries the evaluation platform for the evaluation tasks that need to be executed; if there are unexecuted evaluation tasks in the evaluation platform, the evaluation service is used to execute the evaluation tasks; wherein the heartbeat service sends task requests to the evaluation platform according to a predetermined period.
[0058] Specifically, the heartbeat service corresponding to the metric server and aggregator server periodically sends heartbeats to the evaluation platform to inquire whether the evaluation platform has any evaluation tasks that need to be executed. When the metric server and aggregator server are in an idle state and there are unexecuted evaluation tasks on the evaluation platform, the platform sends information to the evaluation service through the heartbeat service to inform the heartbeat service of the existence or non-existence of evaluation tasks that need to be executed. When the evaluation service learns that there are evaluation tasks that need to be executed on the evaluation platform, it obtains the task information of the evaluation task through the data bus and executes the evaluation task.
[0059] Furthermore, when the evaluation task is executed in the evaluated service, the evaluation task is locked on the evaluation platform using an exclusive lock and transaction mechanism. By adding an exclusive lock and transaction mechanism to the database, one evaluation task can correspond to one evaluation service, so that multiple evaluation services can evaluate different evaluation tasks.
[0060] Specifically, an exclusive lock mechanism is added to the database of the evaluation platform. After the exclusive lock is added, when the operation of a task is not completed, other evaluation services can read its status but cannot write or update the task. The use of exclusive locks can prevent data errors when high-concurrency tasks are executed.
[0061] For example, when multiple evaluation services in the metric server stage are started on the evaluation platform according to an evaluation plan, and a evaluation task is initiated at the same time. Ideally, this evaluation task will only be obtained by one evaluation service in the metricserver stage through the heartbeat service. When the heartbeat service sent by the evaluation service in other metric server stages checks the task, the evaluation task status of the task will be changed to other states, so that other metric servers do not execute the evaluation task. However, in actual situations, if no exclusive lock and transaction mechanism are added, the multiple metric servers started will obtain the status of the evaluation task through the heartbeat service. At this time, since no exclusive lock is added, the status of the task obtained by all metric servers is the initialization status, then each metric server will execute the task, resulting in a waste of computing power.
[0062] In a specific embodiment of the present application, step S103 includes the evaluation service using the heartbeat service to send the status of the evaluation service and the status of the evaluation task during the evaluation process to the evaluation platform.
[0063] Specifically, during the execution of the evaluation service, the heartbeat service is used to send the status of the evaluation service and the status of the evaluation task during the evaluation process to the evaluation platform, so that the evaluation platform can timely understand the execution status of the task and the status of the evaluation service, so that the evaluation platform can timely process and operate the evaluation task and evaluation service.
[0064] Furthermore, during the process of the evaluation service executing the evaluation task, the evaluation service sends the current status of the evaluation service to the evaluation platform through the heartbeat service according to a predetermined period, wherein the status of the evaluation service includes online, offline, and error.
[0065] Specifically, the evaluation platform will receive heartbeats sent by many evaluation schemes. The heartbeat will contain the time of the current service sending the heartbeat and the unique identification code of the running evaluation service that sent the heartbeat service. Each evaluation service sends a heartbeat to the evaluation platform every 6 seconds. The evaluation platform will compare the heartbeat time and system time of the heartbeat sent by the current evaluation service to determine whether the evaluation service is online. If the time difference between the heartbeat time and the system time is greater than 6 seconds or much greater than 6 seconds, it means that the current evaluation service is not running, and the current evaluation service page will display that the current evaluation service is offline; if the time difference between the heartbeat time and the system time is not greater than 6 seconds, it means that the current evaluation service is running, and the evaluation service page will display that the current evaluation service is online; when the evaluation service does not receive the heartbeat sent by the evaluation service, it means that the current evaluation service has a fault, and the current evaluation service error will be displayed on the evaluation service page.
[0066] Furthermore, the evaluation results of the evaluation task by the evaluation service are sent to the evaluation platform through the heartbeat service according to a predetermined period, wherein the status of the evaluation task includes: waiting, data processing, calculation, storage and success.
[0067] Specifically, the evaluation service in the metric server stage sends a heartbeat to the evaluation platform through the heartbeat service to remind the evaluation platform to query the execution status of the evaluation task. When the evaluation task is not obtained by the corresponding metric server, its corresponding status is always in the initialization state. When the evaluation task is in the initialization state, it means that the task needs to be assigned and processed. When the evaluation platform receives the execution request sent by the evaluation task through the heartbeat service, it assigns the evaluation task to the corresponding metric server for processing.
[0068] For example, the status of the evaluation tasks that can be saved in the evaluation platform is shown in Table 4.
[0069]
[0070]
[0071] Table 4: Evaluation task status table
[0072] In a specific embodiment of the present application, step S103 includes performing data processing on the evaluation task through the data processing service in the evaluation service; performing aggregation operation on the result of the data processing service through the aggregation operation service in the evaluation service to obtain the evaluation result of the evaluation task.
[0073] Specifically, the evaluation service performs evaluation tasks in two stages, namely the metric server (data processing service) stage that processes the data of the evaluation task and the aggregator server (aggregation computing service) that aggregates the results of the data processing service. Only through these two stages of processing can the evaluation task be processed. In the process of executing the evaluation task, after the metric server stage processing is completed, the status of the evaluation task will be sent to the evaluation platform through the heartbeat service. The evaluation platform modifies the status of the evaluation task stored in the background according to the received information. When the status corresponding to the evaluation task is data processing, the aggregator server obtains the evaluation task and performs relevant calculations and processing.
[0074] Figure 4 A specific implementation of a multi-task concurrent processing device of the present application is shown.
[0075] exist Figure 4In the specific implementation shown, the multi-task concurrent processing device mainly includes: an information acquisition module 204, which is used to start one or more corresponding evaluation services according to the evaluation plan on the evaluation platform and obtain a unique identification code corresponding to each evaluation service;
[0076] The relationship table updating module 204 is used to update the relationship table in the evaluation platform according to the corresponding relationship between the evaluation scheme and the evaluation service, using the unique identification code of the evaluation service, wherein if the unique identification code of the evaluation service exists in the relationship table, the current heartbeat time corresponding to the evaluation service is updated; if the unique identification code of the evaluation service does not exist in the relationship table, the unique identification code of the evaluation service is added to the relationship table;
[0077] The evaluation module 204 is used to evaluate multiple evaluation tasks according to multiple evaluation services in the evaluation table; wherein the information reflected in the relationship table includes the correspondence between the evaluation scheme and the evaluation service and the heartbeat time of the evaluation service sending the heartbeat service to the evaluation platform.
[0078] In a specific embodiment of the present application, the evaluation module includes an execution module, which is used to query the evaluation platform for the evaluation task to be executed through the heartbeat service; if there is an unexecuted evaluation task in the evaluation platform, the evaluation service is used to execute the evaluation task; wherein the heartbeat service sends a task request to the evaluation platform according to a predetermined period
[0079] The multi-task concurrent processing device provided in the present application can be used to execute the multi-task concurrent processing method described in any of the above embodiments. Its implementation principle and technical effect are similar and will not be repeated here.
[0080] In another specific embodiment of the present application, a computer-readable storage medium stores computer instructions, and the computer instructions are operated to execute the multi-task concurrent processing method described in the above embodiment.
[0081] In a specific embodiment of the present application, each functional module in a multi-task concurrent processing method of the present application can be directly in hardware, in a software module executed by a processor, or in a combination of the two.
[0082] The software modules may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from and write information to the storage medium.
[0083] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, discrete gates or transistor logic, discrete hardware components, or any combination thereof. A general-purpose processor may be a microprocessor, but in an alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors combined with a DSP core, or any other such configuration. In an alternative, the storage medium may be integrated with the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In an alternative, the processor and the storage medium may reside in a user terminal as discrete components.
[0084] In a specific embodiment of the present application, a computer device includes: at least one processor; and a memory that is communicatively connected to the at least one processor; wherein the memory stores computer instructions that can be executed by the at least one processor, and the at least one processor operates the computer instructions to execute the multi-task concurrent processing method described in the above embodiment.
[0085] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0086] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0087] The above description is only an embodiment of the present application and does not limit the patent scope of the present application. Any equivalent structural transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A multi-task concurrent processing method, characterized in that: include: On the evaluation platform, start one or more evaluation services corresponding to the evaluation plan and obtain a unique identification code corresponding to each evaluation service; According to the correspondence between the evaluation scheme and the evaluation service, the relationship table in the evaluation platform is updated using the unique identification code of the evaluation service, wherein if the unique identification code of the evaluation service exists in the relationship table, the current heartbeat time corresponding to the evaluation service is updated; if the unique identification code of the evaluation service does not exist in the relationship table, the unique identification code of the evaluation service is added to the relationship table; Multiple evaluation tasks are evaluated according to multiple evaluation services corresponding to the evaluation scheme in the relationship table, wherein the information contained in the relationship table includes the correspondence between the evaluation scheme and the unique identification code of the evaluation service and the heartbeat time when the evaluation service sends a heartbeat to the evaluation platform.
2. The multi-task concurrent processing method according to claim 1, characterized in that: The step of evaluating a plurality of evaluation tasks according to the plurality of evaluation services in the evaluation table includes: Through the heartbeat service, the evaluation service queries the evaluation platform for the evaluation tasks that need to be performed; If there is an unexecuted evaluation task in the evaluation platform, the evaluation task is executed by using the evaluation service; The heartbeat service sends a task request to the evaluation platform according to a predetermined period.
3. The multi-task concurrent processing method according to claim 2, characterized in that: If there is an unexecuted evaluation task in the evaluation platform, executing the evaluation task by using the evaluation service includes: When the evaluation task is being executed by the evaluation service, the evaluation task is locked on the evaluation platform using an exclusive lock and a transaction mechanism.
4. The multi-task concurrent processing method according to claim 1, characterized in that: The step of evaluating a plurality of evaluation tasks according to the plurality of evaluation services in the evaluation table includes: The evaluation service uses the heartbeat service to send the status of the evaluation service and the status of the evaluation task during the evaluation process to the evaluation platform.
5. The multi-task concurrent processing method according to claim 4, characterized in that: The evaluation service uses the heartbeat service to send the status of the evaluation service and the status of the evaluation task during the evaluation process to the evaluation platform, including: During the process of the evaluation service executing the evaluation task, the evaluation service sends the current status of the evaluation service to the evaluation platform through the heartbeat service according to a predetermined period, wherein the status of the evaluation service includes online, offline, and error.
6. The multi-task concurrent processing method according to claim 4, characterized in that: The evaluation service uses the heartbeat service to send the status of the evaluation service and the status of the evaluation task during the evaluation process to the evaluation platform, including: The evaluation result of the evaluation task by the evaluation service is sent to the evaluation platform according to a predetermined period through the heartbeat service, wherein the status of the evaluation task includes: waiting, data processing, calculation, storage and success.
7. The multi-task concurrent processing method according to claim 1, characterized in that: The step of evaluating a plurality of evaluation tasks according to the plurality of evaluation services in the evaluation table includes: Performing data processing on the evaluation task through the data processing service in the evaluation service; The aggregation operation service in the evaluation service performs aggregation operation on the result of the data processing service to obtain the evaluation result of the evaluation task.
8. A multi-task concurrent processing device, characterized in that: include: An information acquisition module is used to start one or more corresponding evaluation services according to the evaluation plan on the evaluation platform and obtain a unique identification code corresponding to each evaluation service; A relationship table updating module, used to update the relationship table in the evaluation platform according to the corresponding relationship between the evaluation scheme and the evaluation service, using the unique identification code of the evaluation service, wherein if the unique identification code of the evaluation service exists in the relationship table, the current heartbeat time corresponding to the evaluation service is updated; if the unique identification code of the evaluation service does not exist in the relationship table, the unique identification code of the evaluation service is added to the relationship table; An evaluation module, used for evaluating a plurality of evaluation tasks according to a plurality of the evaluation services in the evaluation table; The information reflected in the relationship table includes the corresponding relationship between the evaluation scheme and the evaluation service and the heartbeat time when the evaluation service sends the heartbeat service to the evaluation platform.
9. The multi-task concurrent processing device according to claim 8, characterized in that: The evaluation module comprises: An execution module, used for querying the evaluation platform for the evaluation task to be executed through the heartbeat service; if there is an unexecuted evaluation task in the evaluation platform, executing the evaluation task by using the evaluation service; The heartbeat service sends a task request to the evaluation platform according to a predetermined period.
10. A computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are operated to execute the multi-task concurrent processing method according to any one of claims 1-7.