A task scheduling method, device, apparatus and storage medium

Abstract

The present application provides a task scheduling method and device, equipment and storage medium. The method is applied to a slave platform, and comprises the following steps: obtaining file transmission information; generating a corresponding event when a preset generation condition is met according to the file transmission information; triggering a scheduling system to send a scheduling instruction to a host platform according to the generated event, so that the host platform completes a batch processing task; and setting an event to trigger the batch processing of the host platform, thereby avoiding frequent scanning of the slave platform system and improving the efficiency of the batch processing of the host platform.

Description

TECHNICAL FIELD

[0001] The present disclosure belongs to the field of computer application, and particularly relates to a task scheduling method and device, equipment and a storage medium. BACKGROUND

[0002] In a financial application system, some downstream open extension platforms (such as component systems) need to return some data files to a host platform at the end of the day, and the host platform needs to trigger some batch processing jobs to run batch processing after the files arrive at the host. At present, a scheduling system (such as the Luban system) is used between the host platform and the extension platform to schedule batch processing jobs. At present, the scheduling system cannot realize the function of file scanning on the host platform, and thus cannot predict the arrival of returned files, and cannot timely trigger the batch processing of the host platform.

[0003] In the prior art, when the downstream extension platform finishes transmitting data files, the data files are simultaneously stored in a directory agreed by the extension platform, and the scheduling system judges whether the data files are transmitted by frequently scanning the directory. Since the data files occupy a large amount of memory resources, frequent scanning of the system directory will cause certain pressure on the hard disk, and reduce the scanning efficiency, thereby affecting the generation of scheduling instructions of the scheduling system, and further reducing the efficiency of batch processing of the host platform. Therefore, how to improve the batch processing efficiency of the host platform for the transmission files of the extension platform becomes a technical problem to be solved at present. SUMMARY

[0004] In view of the above problems of the prior art, the purpose of the present disclosure is to provide a task scheduling method, device, equipment and storage medium, which can improve the efficiency of batch processing of the host platform for files.

[0005] In order to solve the above technical problems, the specific technical solutions of the present disclosure are as follows:

[0006] In one aspect, the present disclosure provides a task scheduling method applied to an extension platform, and the method comprises the following steps:

[0007] obtaining file transmission information;

[0008] generating a corresponding event when a preset generation condition is met according to the file transmission information;

[0009] triggering the scheduling system to issue a scheduling instruction to the host platform according to the generated event, so that the host platform completes a batch processing task.

[0010] Further, the step of obtaining the file transmission information comprises the following steps:

[0011] sending a data file generated by executing a preset business to a file transmission component root node;

[0012] The file transmission component root node transmits the data file to the host platform;

[0013] The data file transmission proportion is acquired to form file transmission information.

[0014] Further, the preset generation condition comprises: preset characteristic data file transmission completion; the preset characteristic comprises at least one of the following characteristics: file type, file size and file quantity.

[0015] Further, after the corresponding event is generated when the preset generation condition is met, the method further comprises:

[0016] When the preset data file transmission is completed, a preset data file transmission completion event is generated, and the event is saved to the event generation list.

[0017] Optionally, the generated event comprises event generation time and event validity period.

[0018] Optionally, according to the generated event, the scheduling system is triggered to issue a scheduling instruction to the host platform, so that the host platform completes the batch processing task, and the method further comprises:

[0019] According to the generated event, a scheduling system control instruction is issued, so that the scheduling system completes the batch processing task according to the control instruction.

[0020] Further, according to the generated event, the scheduling system is triggered to start, and the method further comprises:

[0021] An event monitoring parameter is acquired;

[0022] According to the event monitoring parameter, it is monitored whether there is a generated event in the event generation list;

[0023] When there is a generated event in the event generation list, the scheduling system is triggered to start.

[0024] Further, the event monitoring parameter is acquired.

[0025] A user input and / or a monitoring instruction sent by the scheduling system are received, and the monitoring instruction comprises a monitoring time parameter and a monitoring plan.

[0026] Further, it is monitored whether there is a generated event in the event generation list.

[0027] According to the monitoring time parameter and the monitoring plan, it is monitored whether there is a generated event in the event generation list within a preset time period.

[0028] Optionally, the method further comprises:

[0029] After triggering the scheduling system, the event triggering the scheduling system is deleted from the event generation list.

[0030] Optionally, the method further comprises:

[0031] receiving a query instruction sent by the scheduling system, and sending the event query list to the scheduling system according to the query instruction, so that the scheduling system determines whether an event is generated according to the event query list, and when an event is generated, the scheduling system sends a scheduling instruction to the host platform to complete the batch processing task.

[0032] Further, the method further comprises:

[0033] determining whether the existence time of each event in the event generation list exceeds the event validity period;

[0034] when the existence time of the event exceeds the event validity period, deleting the event.

[0035] In another aspect, the present disclosure also provides a task scheduling method applied to a host platform, the method comprising the following steps:

[0036] receiving a data file transmitted by a slave platform;

[0037] obtaining a scheduling instruction generated by a scheduling system, and performing batch processing on the received data file according to the scheduling instruction, wherein the generation of the scheduling instruction comprises: generating a corresponding event when file transmission information of the slave platform meets a preset generation condition; triggering the scheduling system to send a scheduling instruction to the host platform according to the generated event, so that the host platform completes the batch processing task.

[0038] In another aspect, the present disclosure also provides a task scheduling device applied to a slave platform, the device comprising:

[0039] a transmission information obtaining module configured to obtain file transmission information;

[0040] an event generation module configured to generate a corresponding event according to the file transmission information when a preset generation condition is met;

[0041] a scheduling module configured to trigger the scheduling system to send a scheduling instruction to the host platform according to the generated event, so that the host platform completes the batch processing task.

[0042] In another aspect, the present disclosure provides a task scheduling device applied to a host platform, the device comprising:

[0043] a file receiving module configured to receive a data file transmitted by a slave platform;

[0044] a file batch processing module configured to obtain a scheduling instruction generated by a scheduling system, and perform batch processing on the received data file according to the scheduling instruction, wherein the generation of the scheduling instruction comprises: generating a corresponding event when file transmission information of the slave platform satisfies a preset generation condition; and triggering the scheduling system to send a scheduling instruction to the host platform according to the generated event, so that the host platform completes a batch processing task.

[0045] In another aspect, the present disclosure provides a computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method steps described above when executing the computer program.

[0046] Finally, the present disclosure also provides a computer readable storage medium storing a computer program, wherein the computer program is executable by a processor to implement the method steps described above.

[0047] With the above technical solution, the task scheduling method, device, equipment and storage medium described in the present disclosure obtain file transmission information, generate a corresponding event when the preset generation condition is satisfied according to the file transmission information, and trigger the scheduling system to send a scheduling instruction to the host platform according to the generated event, so that the host platform completes a batch processing task. By setting an event to trigger the batch processing of the host platform, frequent scanning of the slave platform system is avoided, and the efficiency of the batch processing of the host platform is improved.

[0048] In order to make the above and other purposes, features and advantages of the present disclosure more obvious and easy to understand, the following describes a preferred embodiment, and the accompanying drawings are described in detail as follows. BRIEF DESCRIPTION OF DRAWINGS

[0049] In order to more clearly illustrate the technical solutions in the embodiments or prior art described in the present disclosure, the following will briefly introduce the drawings needed to be used in the embodiment or prior art description. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0050] Figure 1 Fig. 1 shows a host platform scheduling control logic diagram in the embodiments of the present disclosure;

[0051] Figure 2A step schematic diagram of the task scheduling method in the embodiments is shown;

[0052] Figure 3 A step schematic diagram of the file transmission information acquisition in the embodiments is shown;

[0053] Figure 4 A schematic diagram of the process of generating the scheduling instruction for the host platform in the embodiments is shown;

[0054] Figure 5 A step schematic diagram of the task scheduling method in the embodiments is shown;

[0055] Figure 6 A structure schematic diagram of the task scheduling device in the embodiments is shown;

[0056] Figure 7 A structure schematic diagram of the task scheduling device in the embodiments is shown;

[0057] Figure 8 A connection schematic diagram of the functional modules in the specific example in the embodiments is shown;

[0058] Figure 9 A structure schematic diagram of the computer device in the embodiments is shown.

[0059] Explanation of the drawing symbols:

[0060] 10, extension platform;

[0061] 20, host platform;

[0062] 30, scheduling system;

[0063] 100, transmission information acquisition module;

[0064] 200, event generation module;

[0065] 300, scheduling module;

[0066] 400, file receiving module;

[0067] 500, file batch processing module;

[0068] 902, computer device;

[0069] 904, processor;

[0070] 906, memory;

[0071] 908, driving mechanism;

[0072] 910, input / output module;

[0073] 912, input device;

[0074] 914. Output devices;

[0075] 916. Presentation equipment;

[0076] 918. Graphical User Interface;

[0077] 920. Network interface;

[0078] 922. Communication link;

[0079] 924. Communication bus. Detailed Implementation

[0080] The technical solutions in the embodiments described below will be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments described herein, and not all of the embodiments. Based on the embodiments described herein, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this document.

[0081] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings herein are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, apparatus, product, or device that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.

[0082] In existing technologies, such as Figure 1 As shown, after the extension platform 10 transmits the data file to the host platform 20, it will perform batch processing of the data file through the instructions of the scheduling system 30. Given the high requirements of the host platform 20 for its stability and security, the scheduling system 30 cannot perform file scanning on the host platform 20. Therefore, it cannot predict the arrival of the returned file and cannot trigger the batch processing of the host platform 20 in a timely manner. Therefore, it is generally adopted that when the extension platform 10 finishes transmitting the data file, it simultaneously saves the data file to the directory agreed upon by the extension platform 10. The scheduling system 30 determines whether the data file has been transmitted completely by frequently scanning this directory. Since the data file will occupy a large amount of memory resources, frequent scanning of the system directory will put a certain pressure on the hard disk, reduce the scanning efficiency, and thus affect the generation of scheduling instructions by the scheduling system 30, thereby affecting the batch processing efficiency of the host platform 20.

[0083] For better understanding of the technical solutions of the present specification, some technical terms are explained first:

[0084] Host platform: can be understood as IBM mainframe, for example, IBM mainframe set in China Construction Bank, and can deploy software system on IBM mainframe;

[0085] Extension platform: can be understood as non-IBM mainframe, for example, some downstream open application platforms of China Construction Bank, such as x86 platform, and can deploy software system on x86 platform, and the extension platform and the host platform can realize data file transmission.

[0086] In order to solve the above problems, the embodiment of the present application provides a task scheduling method, which can improve the efficiency of batch processing of the host platform to the received file. Figure 2 is a step schematic diagram of a task scheduling method provided by the embodiment of the present application, the present specification provides the method operation steps as described in the embodiment or flowchart, but more or less operation steps can be included based on conventional or non-creative labor. The order of steps listed in the embodiment is only one of the many step execution orders, and does not represent the only execution order. In actual system or device product execution, the method order shown in the embodiment or the drawing can be executed or executed in parallel. Specifically, as shown in Figure 2 The method can include:

[0087] S100: obtaining file transmission information;

[0088] S200: according to the file transmission information, when the preset generation condition is met, the corresponding event is generated;

[0089] S300: according to the generated event, triggering the scheduling system to issue scheduling instruction to the host platform, so that the host platform completes the batch processing task.

[0090] It can be understood that in the process of transmitting files from the extension platform to the host platform, when the transmission condition is satisfied, that is, the preset generation condition, the event is generated and published in the form of event, and the scheduling system is triggered to complete the scheduling of the host platform according to the published event, so as to realize the batch processing task of the transmission file. The present application realizes the batch processing problem of the host platform in the form of event driving, avoids the method of scanning the hard disk system in the prior art to determine the condition of returning file transmission completion, thereby solving the triggering problem of batch processing with precondition, and improving the efficiency of host platform batch processing.

[0091] In actual work, such as in the construction system, the downstream open components (extension platform) are all transmitted to the host platform through the file transmission component. The file transmission component is a point-to-point file transmission system. The file transmission component assigns a transmission node number to each application component that needs to deploy file transmission. Meanwhile, the file transmission component itself has a root node interconnected with the host platform. The application component sends the file to the root node through the node deployed by itself, and the root node transmits the file to the host platform through the XCOM tool.

[0092] Therefore, in the above steps, as shown in Figure 3 the file transmission information can include the following steps:

[0093] S101: transmitting a data file generated by executing a preset service to a root node of a file transmission component;

[0094] S102: transmitting the data file to the host platform by the root node of the file transmission component;

[0095] S103: obtaining the data file transmission ratio to form the file transmission information.

[0096] The preset task can be specific service information executed by different preset application components, such as payment service, transfer service, remittance service, etc. The data file can include service type, service data, service object, and other parameters that can realize settlement, reconciliation, and other services on the host platform. The file transmission information can be understood as the file transmission ratio. The data file obtained after executing the specific service is sent to the root node of the file transmission component through the node assigned in advance. Then, the root node of the file transmission component transmits the data file to the preset directory of the host platform through the XCOM tool. In the transmission process, the file transmission component or the extension platform obtains the file transmission ratio in real time, thereby determining the file transmission information.

[0097] When the file transmission ratio is obtained in real time by the file transmission component, the file transmission component sends the obtained ratio information to the extension platform in real time, thereby facilitating the extension platform to obtain the file transmission information in real time.

[0098] The file transmission ratio can be the ratio of a single file transmission, such as the ratio of the size of the successfully transmitted file to the total file size. In some other embodiments, it can also refer to the transmission ratio of multiple files, such as the ratio of the number of successfully transmitted files to the total number of files, or the ratio of the size of the successfully transmitted file to the total file size. The specific setting of the file transmission ratio is not limited in the present specification.

[0099] In the embodiments of the present specification, the preset generation condition comprises: data file transmission of the preset feature is completed; the preset feature comprises at least one of the following features: file type, file size and file quantity.

[0100] It can be understood that the preset generation condition corresponds to the file transmission information, that is, when the proportion of file transmission is 100%, it means that the file transmission is completed, and the corresponding event can be generated. Further, different features of the file can be combined as a generation condition for judgment, such as file type, file size and file quantity, wherein the transmission completion of a plurality of same or similar type of business data files can be combined as a combined generation condition, and when the combined generation condition is reached, that is, the plurality of same or similar type of business data files are transmitted, the host platform batch processing task is scheduled. Since the same or similar type of business data needs to repeat the same batch task, no additional batch task is needed, the efficiency and speed of the host platform batch can be improved; in addition, the file size and the file quantity can be used to control the amount of single batch of the host platform, which reduces the high error probability of large batch amount, improves the stability and reliability of the host platform, and the preset generation condition can have other setting rules, which is not limited in the embodiments of the present specification.

[0101] In the embodiments of the present specification, after the preset generation condition is met, the corresponding event can be generated, and the step of saving the event can be further included, specifically, the step comprises:

[0102] When the preset data file transmission is completed, a preset data file transmission completion event is generated, and the event is saved to an event generation list.

[0103] The event generation list can be saved in the storage space of the extension platform in the form of a file, since the event itself occupies very small memory, the event generation list occupies very small storage resources of the extension platform, thereby ensuring the efficiency of the use of the storage resources of the extension platform.

[0104] The generated event can be stored through the event generation list, so that the scheduling system can be triggered in time according to the event, thereby ensuring the timeliness of the host platform for the corresponding transmission file batch processing.

[0105] In the embodiments of the present application, the generated event includes an event generation time and an event validity period. The event generation time can be the time when the file transfer of the preset feature is completed. The event validity period can be the validity period of the event duration time, such as in days. Within the event validity period, the event can be used to trigger the scheduling system to perform the scheduling task. When the event validity period is exceeded, it indicates that the event has been used up and can be deleted, thereby avoiding occupying the space of the event generation list and further reducing the storage resources occupied by the event generation list.

[0106] In some other embodiments, the generated event can further include an event type. The event type can represent different kinds of events. The event type of the event can be a file transfer completion type, that is, a single event type. Alternatively, the event type can also have other type rules. For example, different event types can be divided according to the priority of different extension platforms. When there are multiple events in the event generation list, the execution order of the events can be determined according to the priority in the event type. Of course, the execution order of the events can also be determined according to the weight relationship between the event generation time and the event type. The division of the event type is not limited in the embodiments of the present application.

[0107] In the embodiments of the present application, the triggering of the scheduling system to send a scheduling instruction to the host platform to make the host platform complete the batch processing task according to the generated event further includes:

[0108] According to the generated event, a scheduling system control instruction is sent to make the scheduling system complete the batch processing task of the host platform according to the control instruction.

[0109] The action triggered by the scheduling system can be initiated by the extension platform. Through the active triggering of the extension platform, the hard disk system of the extension platform can be avoided from being frequently scanned by the scheduling system, and the pressure on the hard disk system during the scanning can be reduced. Moreover, the triggering is based on the event, which can improve the accuracy and timeliness of the active triggering of the extension platform, and further improve the efficiency of the scheduling system.

[0110] Optionally, in the embodiments, when the extension platform determines that the event has been generated, a triggering instruction can be sent to the scheduling system to make the host platform perform the synchronous batch processing task. In this way, the timing of the start of the batch processing task of the host platform can be actively controlled, and the timeliness of the batch processing of the host platform is improved.

[0111] However, in actual work, the extension platform transmits the service data file of a fixed time period (such as the day) to the host platform at a fixed time point (such as the end of the day), so when the host platform simultaneously receives the data files transmitted by multiple extension platforms, the multiple extension platforms trigger the start signal to the scheduling system when the data file transmission is completed, so that the host platform initiates the batch processing task, and a large number of batch processing tasks will reduce the processing efficiency and accuracy of the host platform, and the idle time of the host platform is not considered, which wastes the running resources of the host platform space.

[0112] Therefore, in the preferred embodiment, as shown in Figure 4 According to the generated event, the scheduling system is triggered to start, and the method further comprises the following steps:

[0113] S301: Obtain an event monitoring parameter;

[0114] S302: According to the event monitoring parameter, monitor whether there is a generated event in the event generation list;

[0115] S303: When there is a generated event in the event generation list, trigger the scheduling system to start.

[0116] The event monitoring parameter can be a specific instruction of the monitoring event received by the extension platform, such as querying the event in the event generation list at a fixed time point and time period, so as to better control the timing of triggering the scheduling system to work, and improve the accuracy and reliability of the event-driven scheduling system to work, avoiding triggering the scheduling system to start at the same time as the event is generated, and fully considering the stability of the working performance of the host platform.

[0117] Therefore, in the embodiment of the present specification, obtaining the event monitoring parameter can comprise the following steps:

[0118] Receive user input and / or monitoring instructions sent by the scheduling system, the monitoring instructions comprising monitoring time parameters and monitoring plans.

[0119] In actual work, the user inputs a monitoring instruction into the extension platform to ensure that the generated event can be used to trigger the scheduling system, thereby ensuring that the host platform can batch process the corresponding file received. Alternatively, the user inputs a monitoring instruction into the scheduling system, and the scheduling system sends the monitoring instruction to the extension platform, thereby causing the extension platform to monitor according to the monitoring instruction. The monitoring instruction can include a monitoring time parameter and a monitoring plan. The monitoring time parameter can represent the time to start monitoring or whether an event is generated at the time. The monitoring plan can be a monitoring period and a frequency. The monitoring plan can be used to adjust the monitoring time parameter, thereby achieving automatic adjustment of the event monitoring parameter and automatic execution of the monitoring task, reducing the cost of manually setting the monitoring instruction and improving efficiency.

[0120] In some other embodiments, the monitoring period can not exceed the event validity period, so that the event can be successfully monitored at least once within the event generation to invalidation time period (exceeding the event validity period), thereby ensuring the reliability of the monitoring. In a preferred embodiment, the monitoring period is the event validity period, so that the monitoring period is improved while ensuring that the generated event is monitored, thereby reducing the consumption of extension platform monitoring resources and saving costs.

[0121] In addition, to ensure the accuracy and reliability of the batch processing of the received transmission file by the host platform, the scheduling system can be triggered by the event multiple times within the event validity period, thereby supporting the re-run of the batch processing of the host platform and improving the accuracy.

[0122] In some other embodiments, the monitoring instruction can also include a monitoring event type. When there are multiple event types in the event generation list, the corresponding event can be obtained by matching the monitoring event type, thereby further improving the efficiency of event monitoring. At the same time, the priority of different event types can be determined by monitoring the event type, thereby determining the timing of triggering the scheduling system and improving the efficiency of the batch processing of the host platform.

[0123] On the basis of obtaining the monitoring instruction, the monitoring of the event generation list further includes:

[0124] According to the monitoring time parameter and the monitoring plan, it is monitored whether there is a generated event in the event generation list within a preset time period.

[0125] The preset time period can be a time period determined from the monitoring time parameter, so that events generated within the preset time period can be monitored, thereby avoiding missed monitoring and ensuring the integrity of event monitoring. The preset time period can be set according to actual conditions, which is not limited in the embodiments of the present specification.

[0126] In order to reduce the space occupied by the events that have been monitored and triggered to trigger the function of the event generation list, after the extension platform triggers the dispatching system to issue a dispatching instruction, the following steps can also be included:

[0127] After triggering the dispatching system, the event that triggers the dispatching system in the event generation list is deleted.

[0128] Through the trigger and delete mode, the occupied memory of the event in the time generation list can be reduced in time, and at the same time, the repeated monitoring in the next monitoring period can be avoided, and the monitoring efficiency is improved.

[0129] In some other embodiments, the dispatching system can actively monitor the generation of events, and then issue a dispatching instruction to dispatch the host platform batch processing. Specifically, the following steps can be included:

[0130] Receive the query instruction sent by the dispatching system, and send the event query list to the dispatching system according to the query instruction, so that the dispatching system judges whether there is event generation according to the event query list, and when there is event generation, the dispatching system issues a dispatching instruction to the host platform to make the host platform complete the batch processing task.

[0131] It can be understood that the dispatching system can also accept the query instruction of the user to query whether there is an event in the event generation list, and send the query instruction to the extension platform, and the extension platform sends the stored event generation list to the dispatching system for its query, and when the event exists, it is dispatched, so as to realize the active triggering of the dispatching system. In some other embodiments, the dispatching system can also realize the non-inductive query of the event generation list in the extension platform according to the query instruction of the user, so as to improve the query efficiency and reduce the running consumption of the extension platform. The query instruction can also include query event parameters and query plan, which is similar to the monitoring time parameters and monitoring plan in the above steps. In this specification, it is not described in detail. Through the active query of the dispatching system, a large number of control instructions are avoided to be sent to the dispatching system by the extension platform during the event set generation period (such as the end of the day), so as to affect the normal issuance of the dispatching instruction of the dispatching system, thereby improving the accuracy and efficiency of the batch processing of the host platform.

[0132] On the basis of the above embodiments, in order to avoid that the extension platform does not delete the event that has realized the triggering function in time, therefore, after the event is generated, the dispatching system triggers the dispatching system to issue a dispatching instruction to the host platform to make the host platform complete the batch processing task, the following steps are also included:

[0133] Judge whether the existence time of each event in the event generation list exceeds the event validity period;

[0134] when the event exists for more than the event validity period, deleting the event.

[0135] In actual work, the preset period can be determined according to actual conditions, so as to check the overdue event in time and delete it in time. In order to avoid that there are many overdue events in the event generation list, the preset period can be the event validity period, so that the overdue event can be determined and deleted in time. In some other embodiments, the overdue event can also be determined by polling. The present specification does not limit this.

[0136] Exemplarily, as shown in Figure 8 the function module connection diagram of task scheduling in the embodiment of the present specification, the above method steps can be executed by an event application program and an event query program in the extension platform. Specifically, the function of the event application program is to maintain a published event list, monitor the event list, delete expired events, and timely wake up the application program (such as the event query program) subscribed to the event. At the same time, an interface is provided to the outside, the interface completes the publication of a new event, and after the file transmission component root node completes the return file transmission to the host platform through the XCOM component, the interface is called to register the event to the event application program. The event query program accepts three parameters of monitoring time, monitoring plan and event type. If the monitoring time parameter is empty, the current system date is taken. If the event type is empty, an error is directly returned. The event application program is called through the interface to query whether there is a corresponding file transmission success event. The monitoring time and event type parameters are queried to determine whether there is an event of this type generated on this date. If there is, a success flag is returned to the caller (such as the Luban system) success. The Luban system includes a Luban server and a Luban client. The Luban client is arranged in the extension platform and the host platform. When it is determined that the success flag is returned, the Luban client in the extension platform notifies the Luban server through remote communication that the file has been successfully transmitted. The Luban server then schedules the Luban client in the host platform to perform scheduling work, so as to realize the batch processing of the transmission file in the host platform. If there is no such event, the host platform batch processing program is blocked until the event application program receives the event and wakes up the event query program, and then continuously monitors according to the monitoring plan.

[0137] The above-mentioned task scheduling method generates corresponding events according to the file transmission information when the preset generation condition is met, triggers the scheduling system to issue a scheduling instruction to the host platform according to the generated events, so that the host platform completes the batch processing task, and sets the event to trigger the batch processing of the host platform, thereby avoiding frequent scanning of the extension platform system and improving the efficiency of the batch processing of the host platform.

[0138] On the basis of the above-provided task scheduling method, the embodiment of the present specification further provides a task scheduling device applied to a slave platform, as shown in the following figure: Figure 6 The device comprises:

[0139] A transmission information acquisition module 100 is configured to acquire file transmission information.

[0140] An event generation module 200 is configured to generate a corresponding event according to the file transmission information when a preset generation condition is met.

[0141] A scheduling module 300 is configured to trigger a scheduling system to issue a scheduling instruction to a host platform according to the generated event, so that the host platform completes a batch processing task.

[0142] In another embodiment herein, a task scheduling method applied to a host platform is further provided, as shown in the following figure: Figure 5 The method comprises:

[0143] S400: receiving a data file transmitted by a slave platform;

[0144] S500: acquiring a scheduling instruction generated by a scheduling system, and performing batch processing on the received data file according to the scheduling instruction, wherein the generation of the scheduling instruction comprises: generating a corresponding event when file transmission information of the slave platform meets a preset generation condition; triggering the scheduling system to issue a scheduling instruction to the host platform according to the generated event, so that the host platform completes a batch processing task.

[0145] Correspondingly, the embodiment of the present specification further provides a task scheduling device applied to a host platform, as shown in the following figure: Figure 7 The device comprises:

[0146] A file receiving module 400 is configured to receive a data file transmitted by a slave platform;

[0147] A file batch processing module 500 is configured to acquire a scheduling instruction generated by a scheduling system, and perform batch processing on the received data file according to the scheduling instruction, wherein the generation of the scheduling instruction comprises: generating a corresponding event when file transmission information of the slave platform meets a preset generation condition; triggering the scheduling system to issue a scheduling instruction to the host platform according to the generated event, so that the host platform completes a batch processing task.

[0148] The beneficial effects achieved by the above task scheduling method and device applied to a host platform are consistent with those achieved by the task scheduling method and device applied to a slave platform, and the embodiment of the present specification will not be repeated.

[0149] As shown in the following figure: Figure 9As shown, a computer device 902 provided by embodiments herein can include one or more processors 904, such as one or more central processing units (CPUs), each of which can implement one or more hardware threads. The computer device 902 can also include any memory 906 for storing any kind of information, such as code, settings, data, etc. Without limitation, for example, the memory 906 can include any one or combination of: any type of RAM, any type of ROM, a flash memory device, a hard disk, an optical disk, etc. More generally, any memory can use any technology for storing information. Further, any memory can provide volatile or non-volatile retention of information. Further, any memory can represent a fixed or removable component of the computer device 902. In one case, the computer device 902 can perform any operation of the associated instructions when executed by the processor 904, which are stored in any memory or combination of memories. The computer device 902 also includes one or more drive mechanisms 908, such as a hard disk drive mechanism, an optical disk drive mechanism, etc., for interacting with any memory.

[0150] The computer device 902 can also include an input / output module 910 (I / O) for receiving various inputs (via input devices 912) and for providing various outputs (via output devices 914). One particular output mechanism can include a presentation device 916 and an associated graphical user interface (GUI) 918. In other embodiments, the input / output module 910 (I / O), the input devices 912, and the output devices 914 can also not be included, just as a computer device in a network. The computer device 902 can also include one or more network interfaces 920 for exchanging data with other devices via one or more communication links 922. One or more communication buses 924 couple the above-described components together.

[0151] The communication links 922 can be implemented in any manner, such as through a local area network, a wide area network (e.g., the Internet), a point-to-point connection, etc., or any combination thereof. The communication links 922 can include any combination of hardwired links, wireless links, routers, gateway functionality, name servers, etc., governed by any protocol or combination of protocols.

[0152] Corresponding to the method in Figures 2-5 The embodiments herein also provide a computer readable storage medium, having stored thereon a computer program, which, when executed by a processor, performs the steps of the above-mentioned method.

[0153] The embodiments herein also provide a computer readable instruction, wherein the program in the computer readable instruction, when executed by a processor, causes the processor to perform the steps of the above-mentioned method. Figures 2 to 5The method shown.

[0154] It should be understood that the size of the sequence number of the above-mentioned processes in various embodiments herein does not mean the order of execution, and the execution order of the processes should be determined according to their functions and internal logic, and should not constitute any limitation on the implementation process of the embodiments herein.

[0155] It should also be understood that in the embodiments herein, the term "and / or" is only a description of the association relationship of the associated objects, which means that there can be three relationships. For example, A and / or B can represent three cases of A existing alone, A and B existing together, and B existing alone. In addition, the character " / " in this paper generally represents that the front and rear associated objects are in an "or" relationship.

[0156] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized in electronic hardware, computer software, or a combination of both. In order to clearly illustrate the interchangeability of hardware and software, the components and steps of the examples have been described in general terms in the above description. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this paper.

[0157] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

[0158] In several embodiments provided herein, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only schematic, and the division of the units is only a logical function division, and actual implementation can have another division manner, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed each other can be indirect coupling or communication connection through some interfaces, devices or units, and can also be electrical, mechanical or other forms of connection.

[0159] The units described as separate components can or can not be physically separated, and the components displayed as units can or can not be physical units, that is, they can be located in one place, or they can be distributed on multiple network units. According to actual needs, some or all of the units can be selected to achieve the purpose of the embodiments herein.

[0160] In addition, each functional unit in each embodiment herein can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0161] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions herein, essentially or in the form of a contribution to the prior art, or all or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment herein. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various other media that can store program codes.

[0162] The principles and implementation manners of the embodiments are described herein, and the above descriptions of the embodiments are only used to help understand the methods and core ideas thereof; meanwhile, for those skilled in the art, according to the ideas herein, the specific implementation manners and application ranges can be changed, and the above descriptions should not be understood as limitations on the methods herein.

Claims

1. A task scheduling method applied to a slave platform, characterized in that, The method comprises: obtaining file transmission information; generating a corresponding event when a preset generation condition is met according to the file transmission information; triggering a scheduling system to issue a scheduling instruction to a host platform according to the generated event, so that the host platform completes a batch processing task; the file transmission information comprises: sending a data file generated by executing a preset business to a file transmission component root node through an allocated node in advance, the file transmission component allocating a transmission node number to each application component that needs to deploy file transmission, and the file transmission component having a root node interconnected with the host platform; the file transmission component root node transmits the data file to a preset directory of the host platform; obtaining a data file transmission ratio in the transmission process of the data file from the file transmission component root node to the preset directory of the host platform to form file transmission information; after the corresponding event is generated when the preset generation condition is met, the method further comprises: generating a preset data file transmission completion event when the preset data file transmission is completed, and saving the event to an event generation list; the method further comprises: receiving user input and / or a monitoring instruction sent by the scheduling system, the monitoring instruction comprising a monitoring time parameter, a monitoring plan and a monitoring event type, the monitoring time parameter indicating a time to start monitoring or whether an event is generated at the time, and the monitoring plan being a monitoring period and frequency; monitoring whether there is a generated event in the event generation list within a preset time period according to the monitoring time parameter and the monitoring plan; 2. The method of claim 1, wherein, when there are generated events in the event generation list and there are multiple event types, matching the corresponding event through the monitoring event type, determining the priority of the events corresponding to different event types, determining the time sequence of triggering the scheduling system according to the priority, and triggering the scheduling system to start.

3. The method of claim 1, wherein, The preset generation condition comprises: completion of data file transmission of a preset feature; the preset feature comprises at least one of the following features: file type, file size and file quantity.

4. The method of claim 3, wherein, The generated event comprises an event generation time and an event validity period. The method further comprises:

5. The method of claim 1, wherein, issuing a scheduling system control instruction according to the generated event, so that the scheduling system completes the batch processing task of the host platform according to the control instruction. after the scheduling system is triggered, the event in the event generation list that triggers the scheduling system is deleted.

6. The method of claim 1, wherein, The method further comprises: The method comprises the following steps:

7. The method according to claim 4 or 6, characterized in that, The method comprises the following steps: The method comprises the following steps: The method comprises the following steps:

8. A task scheduling method applied to a host platform, characterized in that, The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps:

9. A task scheduling apparatus applied to a slave platform, characterized in that, The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the following steps: The method comprises the In the transmission process of the data file from the file transmission component root node to the preset directory of the host platform, the data file transmission ratio is obtained to form file transmission information; After the corresponding event is generated when the preset generation condition is met, the device is further configured to: After the preset data file transmission is completed, a preset data file transmission completion event is generated, and the event is saved to an event generation list; According to the generated event, the dispatching system is triggered to start, which further includes: receiving user input and / or a monitoring instruction sent by the dispatching system, the monitoring instruction including a monitoring time parameter, a monitoring plan, and a monitoring event type, the monitoring time parameter indicating a time to start monitoring or whether an event occurs at the time, and the monitoring plan being a monitoring period and frequency; According to the monitoring time parameter and the monitoring plan, it is monitored whether there is a generated event in the event generation list within a preset time period; When there are generated events in the event generation list and there are multiple event types, the corresponding events are obtained by matching the monitoring event type, the priority of events corresponding to different event types is determined, the time sequence of triggering the dispatching system is determined according to the priority, and the dispatching system is triggered to start.

10. A task scheduling apparatus applied to a host platform, characterized in that, The device comprises: a file receiving module configured to receive data files transmitted by the extension platform through the method of claim 1; a file batch processing module configured to obtain a dispatching instruction generated by the dispatching system, and perform batch processing on the received data files according to the dispatching instruction, wherein the generation of the dispatching instruction includes: generating a corresponding event when the file transmission information of the extension platform meets a preset generation condition; and triggering the dispatching system to send a dispatching instruction to the host platform according to the generated event, so that the host platform completes the batch processing task; After the corresponding event is generated when the preset generation condition is met, the device is further configured to: After the preset data file transmission is completed, a preset data file transmission completion event is generated, and the event is saved to an event generation list; According to the generated event, the dispatching system is triggered to start, which further includes: receiving user input and / or a monitoring instruction sent by the dispatching system, the monitoring instruction including a monitoring time parameter, a monitoring plan, and a monitoring event type, the monitoring time parameter indicating a time to start monitoring or whether an event occurs at the time, and the monitoring plan being a monitoring period and frequency; According to the monitoring time parameter and the monitoring plan, it is monitored whether there is a generated event in the event generation list within a preset time period; When there are generated events in the event generation list and there are multiple event types, the corresponding events are obtained by matching the monitoring event type, the priority of events corresponding to different event types is determined, the time sequence of triggering the dispatching system is determined according to the priority, and the dispatching system is triggered to start.

11. A computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the method steps of any one of claims 1 to 8.

12. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the method steps in any one of claims 1 to 8.

Images