Breakpoint reextraction method, device and equipment for application operation and medium

Abstract

The invention discloses a breakpoint reextraction method and device for application jobs, electronic equipment and a storage medium, and relates to the technical field of big data. The method comprises the following steps: receiving breakpoint reextraction parameters of at least one application job; the method comprises the following steps: in a process of scheduling and running entity contents of application jobs through a job scheduling system, determining a first application job with running interruption and an interruption job step of the first application job; generating a new application job for carrying out breakpoint reextraction on the first application job based on the job interruption step, the breakpoint reextraction parameter of the first application job and the entity content of the first application job; and resubmitting the new application job to the job scheduling system for scheduling operation. According to the technical scheme provided by the invention, the breakpoint reextraction of the operation step level can be realized, the manual dependence can be reduced, and the automation degree can be improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of big data, and in particular to a breakpoint resuming method and device for application jobs, an electronic device and a storage medium. BACKGROUND

[0002] In the host job scheduling scenario, batch jobs are often interrupted due to hardware failure, insufficient resources and other problems, and the breakpoint resuming mechanism is the key to ensuring job continuity and reducing repeated computing power consumption. The current mainstream host job breakpoint resuming scheme mainly falls into two categories: one is to use the existing job scheduling software product on the market to realize the automatic resumption of interrupted jobs by pre-configuring parameters; the other is to manually tailor the job content to complete the breakpoint resuming by technical personnel after the job is interrupted.

[0003] However, the existing scheme has obvious limitations: the job scheduling software product can automatically resume, but only supports job-level resumption, and cannot realize more detailed breakpoint resumption at the job step level, resulting in repeated execution of completed job steps, waste of system resources and prolonged processing period; the manual tailoring scheme can realize job step-level resumption, but requires technical personnel to have a good command of both technical implementation and business processes, and the process of manually judging the breakpoint and tailoring the job is time-consuming and laborious, with high labor costs and high error rate. Therefore, there is an urgent need for a technical scheme that can realize breakpoint resumption at the job step level and reduce the dependence on manual work and improve the degree of automation. SUMMARY

[0004] The present application provides a breakpoint resuming method and device for application jobs, an electronic device and a storage medium, which can realize breakpoint resumption at the job step level and reduce the dependence on manual work and improve the degree of automation.

[0005] In a first aspect, the present application provides a breakpoint resuming method for application jobs, which comprises:

[0006] receiving breakpoint resuming parameters of at least one application job;

[0007] determining a first application job interrupted during running and an interrupted job step of the first application job in the process of scheduling and running the entity content of the application job by a job scheduling system;

[0008] generating a new application job for breakpoint resuming of the first application job based on the interrupted job step, the breakpoint resuming parameters of the first application job and the entity content of the first application job;

[0009] re-submitting the new application job to the job scheduling system for scheduling and running.

[0010] Further, after receiving the breakpoint resuming parameters of the at least one application job, the method further comprises: determining a running identification code of each of the application jobs; determining a mapping relationship between an entity content of each of the application jobs and the corresponding running identification code; and recording the mapping relationship and the entity content in a storage unit.

[0011] Further, the determining the first application job with running interruption and the interruption job step of the first application job comprises: searching, in the storage unit, a second application job configured with breakpoint resuming parameters, the breakpoint resuming parameters including a resuming job step to be resumed when a running interruption occurs; obtaining, based on the mapping relationship, a running identification code of the second application job; obtaining, based on the running identification code, running output information of the second application job in a job output storage pool of the job scheduling system; determining whether the resuming job step in the running output information has an interruption; and if the resuming job step has an interruption, determining the second application job as the first application job and the resuming job step as the interruption job step.

[0012] Further, the generating a new application job for breakpoint resuming of the first application job based on the interruption job step, the breakpoint resuming parameters of the first application job and the entity content of the first application job comprises: obtaining the entity content of the first application job from the storage unit; and cutting the entity content based on a job step name of the interruption job step to obtain the new application job, the new application job starting from the interruption job step to an end job step.

[0013] Further, the determining the first application job with running interruption and the interruption job step of the first application job comprises: obtaining, in a job output storage pool of the job scheduling system, running output information of each of the application jobs; and parsing the running output information to obtain the first application job with running interruption and the interruption job step of the first application job.

[0014] Further, before the generating the new application job for breakpoint resuming of the first application job based on the interruption job step, the breakpoint resuming parameters of the first application job and the entity content of the first application job, the method further comprises: obtaining output information of the interruption job step from the running output information; determining whether the interruption job step meets a breakpoint resuming condition based on the output information, the breakpoint resuming parameters including the breakpoint resuming condition; and if the interruption job step meets the breakpoint resuming condition, performing the generating the new application job for breakpoint resuming of the first application job based on the interruption job step, the breakpoint resuming parameters of the first application job and the entity content of the first application job.

[0015] Furthermore, the step of resubmitting the new application job to the job scheduling system for scheduling and execution includes: caching the new application job in a memory queue; reading the new application job from the memory queue and writing it into a temporary dataset for persistent backup;

[0016] In response to the job submission command, the new application job in the temporary dataset is submitted to the job scheduling system for scheduling and execution.

[0017] Secondly, this application provides an application job breakpoint retrieval device, the device comprising:

[0018] The job data receiving module is used to receive breakpoint recapture parameters for at least one application job.

[0019] The interruption information determination module is used to determine the first application job that is interrupted and the interruption step of the first application job during the scheduling and operation of the entity content of the application job through the job scheduling system.

[0020] The application job generation module is used to generate a new application job for re-fractioning the first application job based on the interrupted job step, the breakpoint retrieval parameters of the first application job, and the entity content of the first application job.

[0021] The application job resubmission module is used to resubmit the new application job to the job scheduling system for scheduling and execution.

[0022] Thirdly, this application provides an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to execute the breakpoint re-retrieval method for application jobs as described in any embodiment of this application.

[0023] Fourthly, this application provides a computer-readable storage medium storing computer instructions for causing a processor to execute and implement the breakpoint re-retrieval method for application jobs as described in any embodiment of this application.

[0024] To solve the defects of the prior art in the background art, the embodiments of the present application provide a breakpoint resuming method of application job, and the execution of the method can bring the following beneficial effects: the present application receives the breakpoint resuming parameters of the application job, combines the positioning of the interrupted job (the first application job) and the interrupted job step during the job running process, performs the clipping on the original job entity content based on the job step name, generates a new application job from the interrupted job step to the last job step, completely solves the limitation of the traditional job scheduling software which only supports job level resuming, realizes the accurate resuming at the job step level, avoids the repeated execution of the completed job step, greatly saves the system resources, and shortens the job processing period. Moreover, the present application does not need manual intervention throughout the process, and the parameter configuration, interruption judgment, job clipping and resubmission are all automatically completed by the system, without the need for technical personnel to master complex technical implementation and business processes, completely getting rid of the high dependence of manual clipping scheme on manpower, reducing the labor cost, avoiding the risk of errors caused by manual operation, improving the accuracy and reliability of breakpoint resuming. The present application can realize the breakpoint resuming at the job step level, reduce the dependence on manpower and improve the degree of automation, and provides a more efficient, flexible and low-cost breakpoint resuming solution for mainframe job scheduling.

[0025] It should be noted that the computer instructions described above can be stored in whole or in part on a computer readable storage medium. The computer readable storage medium can be packaged together with the processor of the breakpoint resuming device of the application job, or can be packaged separately from the processor of the breakpoint resuming device of the application job, and the present application does not limit this.

[0026] The description of the second aspect, the third aspect and the fourth aspect in the present application can refer to the detailed description of the first aspect; and the beneficial effects of the description of the second aspect, the third aspect and the fourth aspect can refer to the beneficial effect analysis of the first aspect, which will not be described here.

[0027] It should be understood that the contents described in this part are not intended to identify the key or important features of the embodiments of the present application, nor to limit the scope of the present application. Other features of the present application will become apparent through the following description.

[0028] It can be understood that before using the technical solutions disclosed in the embodiments of the present application, the user should be informed of the type, scope of use and use scenario of the personal information involved in the present application and obtain the authorization of the user in a proper manner according to relevant laws and regulations. BRIEF DESCRIPTION OF DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments description will be briefly introduced. Obviously, the drawings in the following description only constitute some embodiments of the present application, and for those skilled in the art, other drawings can be obtained without creative effort based on these drawings.

[0030] Figure 1 An application instance diagram for the application job breakpoint re-submission in the prior art;

[0031] Figure 2 A flow diagram of an application job breakpoint re-submission method provided by an embodiment of the present application;

[0032] Figure 3 An application instance diagram for the application job breakpoint re-submission provided by an embodiment of the present application;

[0033] Figure 4 A structural diagram of an application job breakpoint re-submission device provided by an embodiment of the present application;

[0034] Figure 5 A block diagram of an electronic device for implementing an application job breakpoint re-submission method provided by an embodiment of the present application. DETAILED DESCRIPTION

[0035] In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments only constitute some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present application.

[0036] The terms "first", "second", "target" and "original" and the like in the specification and claims of the present application and the above drawings are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "include", "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0037] It should be noted that the information collected in the present application is information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of relevant data comply with relevant national and regional laws, regulations and standards, necessary security measures are taken, do not violate public order and good customs, and provide corresponding operation portal for user to choose authorization or refusal.

[0038] Before introducing the present embodiment, the existing breakpoint resubmission method of application job is briefly introduced. As shown in Figure 1 The application example diagram of the breakpoint resubmission of application job in the existing scheme is shown in the figure, which illustrates that when the application job entities 1001-1003 are submitted to the job entry subsystem (JES) 2000 subsystem for running, assuming that the application job 2 2002 is interrupted, then manually judge whether the breakpoint can be resubmitted or not, if yes, then manually cut the application job 2 entity 1002 and submit it to the JES system 2000 for running, becoming the application job 2 2004.

[0039] Figure 2 The flowchart of the breakpoint resubmission method of application job provided by the present embodiment is shown. The present embodiment can be applied to the scene of automatically performing job step breakpoint resubmission of the application job interrupted in running in the batch job scheduling scene. The breakpoint resubmission method of application job provided by the present embodiment can be executed by the breakpoint resubmission device of application job provided by the present embodiment, which can be realized by software and / or hardware and integrated in the electronic device executing the present method.

[0040] Referring to Figure 2 The method of the present embodiment includes but is not limited to the following steps:

[0041] S110, receiving at least one breakpoint resubmission parameter of application job.

[0042] The application job can be a host application program developed by an application developer and running in a job scheduling system (such as a JES system). The scheduling running, input and output information and the like of all application jobs in the host system can be managed through the JES. The application job is composed of a job header and a plurality of job steps (STEP job steps) and is used to complete a specific business function (such as data synchronization, report generation, transaction clearing and the like). The breakpoint resuming parameter can be a configuration information set used to define a breakpoint resuming rule and is a basis for triggering the breakpoint resuming. The breakpoint resuming parameter can at least include a basic identifier parameter (such as an application job name, a job step name of the application job and a job path), a trigger condition parameter (such as a return code triggering resuming) and an execution rule parameter (such as a resuming range and a resuming time limit). The application can modify the trigger condition parameter in the breakpoint resuming parameter, and without re-modifying, compiling or deploying the application program, the purpose of flexibly combining and controlling the resuming condition can be achieved.

[0043] In the embodiment of the application, an entry job and an application job processing program are designed. The entry job supports receiving breakpoint resuming parameters of a plurality of application jobs at the same time (that is, adapting to a batch job scheduling scenario). The entry job can call and execute the application job processing program. The application job processing program has a function of storing entity content and a job unique identifier (Job ID) of the application job, job tailoring and job submission.

[0044] The breakpoint resuming parameter is associated and bound with the application job in a manner of embedding the breakpoint resuming parameter in the application job entity. The entity content and the breakpoint resuming parameter of all application jobs are submitted through the entry job. The entry job calls and executes the application job processing program. The application job processing program receives the entity content and the breakpoint resuming parameter.

[0045] Further, after receiving the breakpoint resuming parameter of the at least one application job, the application job processing program further determines a running identification code of each application job, determines a mapping relationship between the entity content of each application job and the corresponding running identification code and records the mapping relationship and the entity content in a storage unit.

[0046] The running identification code of each application job is determined by submitting the at least one application job to the job scheduling system and generating a corresponding running identification code of each application job through the job scheduling system. For example, the application job processing program submits the application job to the JES system. The JES system generates a corresponding Job ID of each application job. The application job processing program determines the Job ID of each application job.

[0047] S120, in the process of scheduling and running the entity content of the application job by the job scheduling system, determining the first application job interrupted in running and the interrupted job step of the first application job.

[0048] The entity content of the application job can be a complete execution carrier of the application job, containing all information required for job running. The first application job can refer to an application job interrupted in running in a batch job scheduling scenario, which is a target object for breakpoint resumption. The interrupted job step can refer to a specific job step terminated in execution due to program errors, system failures, insufficient resources, etc.

[0049] In an optional embodiment, determining the first application job interrupted in running and the interrupted job step of the first application job comprises: in the storage unit, searching for the second application job configured with the breakpoint resumption parameter, the breakpoint resumption parameter including the resumption job step to be resumed when the running is interrupted; obtaining the running identification code of the second application job based on the mapping relationship; in the job output storage pool of the job scheduling system, obtaining the running output information of the second application job based on the running identification code; determining whether the resumption job step in the running output information is interrupted; if interrupted, determining the second application job as the first application job and the resumption job step as the interrupted job step.

[0050] In this embodiment, the application job processing program stores a plurality of application jobs in the storage unit, including application jobs associated with the breakpoint resumption parameter (i.e., the second application job) and application jobs not associated with the breakpoint resumption parameter. The application job processing program performs the breakpoint resumption processing flow through a timed polling search method, which can specifically include: first, based on the associated identification of the application job (such as job name, job ID), only the second application job is extracted, excluding ordinary application jobs that do not need to be resumed; then, through the mapping relationship between the pre-stored entity content and the running identification code of the application job in the storage unit, the Job ID corresponding to each second application job is obtained; thereafter, the job output storage pool (such as the Simultaneous Peripheral Operations On-Line (SPOOL) output cache pool) of the JES system is accessed to extract the running output information of the second application job, which includes the execution status, return code, error log, execution time, etc. of each job step; finally, the resumption job step (i.e., the job step specified by the user to be monitored and resumed after interruption) preset in the breakpoint resumption parameter is matched, and whether the resumption job step is interrupted is determined by checking the return code, return information or execution status identification of the resumption job step. If the analysis result shows that the resumption job step is indeed interrupted, the second application job is determined as the breakpoint resumption target (i.e., the first application job) to be processed at present, and the interrupted resumption job step is determined as the interrupted job step.

[0051] In another alternative embodiment, determining the first application job interrupted in running and the interrupted job step of the first application job comprises: obtaining running output information of each application job in a job output storage pool of the job scheduling system; and parsing the running output information to obtain the first application job interrupted in running and the interrupted job step of the first application job.

[0052] In the embodiment, the breakpoint resuming processing procedure can further include: after the entity content of the application job is submitted to the JES system, the application job processing program starts a job running state monitoring thread to continuously track the life cycle of the job; the monitoring thread obtains the running state (such as running, completed, interrupted) of each application job and the execution progress (such as completed, running, failed) of each job step in real time. When it is detected that the running state of a certain application job becomes interrupted, the application job processing program immediately extracts the Job ID of the application job, and parses the job step execution record, return code and error information in the log in the job output storage pool (such as the SPOOL output cache pool) of the JES system through the Job ID, and finally locates the interrupted job step that causes the job interruption, such as: a single job step execution failure (such as a return error code) or a job step execution process forced to terminate due to system failure (such as resource interruption, hardware exception).

[0053] When this embodiment is adopted, before step S130 is executed, it further includes: obtaining the output information of the interrupted job step from the running output information; and judging whether the interrupted job step meets the breakpoint resuming condition based on the output information, wherein the breakpoint resuming parameter includes the breakpoint resuming condition (i.e. the trigger condition parameter), that is, after the first application job interrupted in running and the interrupted job step of the first application job are obtained, it is further needed to judge whether the first application job needs to be breakpoint resumed; if yes, then a new application job for breakpoint resuming the first application job is generated based on the interrupted job step, the breakpoint resuming parameter of the first application job and the entity content of the first application job.

[0054] S130, a new application job for breakpoint resuming the first application job is generated based on the interrupted job step, the breakpoint resuming parameter of the first application job and the entity content of the first application job.

[0055] The new application job can be an independent job entity generated by job pruning and used for breakpoint resuming, which can be a job step sequence from the interrupted job step to the end job step.

[0056] Specifically, based on the interrupt job step, the breakpoint resuming parameter of the first application job, and the entity content of the first application job, a new application job for resuming the first application job at the breakpoint is generated, including: obtaining the entity content of the first application job from a storage unit; and cutting the entity content based on the job step name of the interrupt job step to obtain the new application job, the new application job starting from the interrupt job step to the end of the last job step.

[0057] In the embodiment of the present application, the application job processing program obtains the complete entity content of the first application job in the storage unit based on the Job ID of the first application job. The obtained entity content is completely consistent with the version running before the interruption, so that the resuming failure caused by data deviation can be avoided. The application job processing program first analyzes the breakpoint resuming parameter of the first application job to determine the cutting rule (such as the resuming range); and then traverses the job step list in the original entity content to match the position of the interrupt job step through the job step name, and marks as the cutting start point. The job step sequence from the cutting start point (the interrupt job step) to the end of the last job step in the original entity content is reserved, and a new job name or version number is generated after cutting to distinguish the original job, and finally the new application job that can be independently run is obtained.

[0058] S140, re-submit the new application job to the job scheduling system for scheduling and running.

[0059] Specifically, re-submitting the new application job to the job scheduling system for scheduling and running includes: caching the new application job to a memory queue (such as a message queue); reading the new application job from the memory queue and writing it to a temporary data set for persistent backup; and in response to a job submission command, submitting the new application job in the temporary data set to the job scheduling system for scheduling and running.

[0060] In the embodiment of the present application, the application job processing program writes the new application job from the memory queue to a temporary data set, and calls a system command to submit the new application job to the JES system for running. If an interruption occurs when the new application job or another application job is running, the application job processing program will capture it by a timing polling search method, and re-trigger the breakpoint resuming processing flow described above. When all the application jobs are running and the application job processing program no longer captures the interrupt job step that needs to be resumed at the breakpoint, the job running period ends.

[0061] The technical scheme provided by the embodiment comprises the following steps: receiving breakpoint resuming parameters of at least one application job; determining a first application job interrupted during running and an interrupted job step of the first application job in a process of scheduling and running entity content of the application job by a job scheduling system; generating a new application job for resuming the first application job at a breakpoint based on the interrupted job step, the breakpoint resuming parameters of the first application job and the entity content of the first application job; and resubmitting the new application job to the job scheduling system for scheduling and running. The application receives the breakpoint resuming parameters of the application job, combines the positioning of the interrupted job (the first application job) and the interrupted job step in the process of job running, clips the original job entity content based on the job step name, generates the new application job from the interrupted job step to the last job step, completely solves the limitation of the traditional job scheduling software which only supports job-level resuming, realizes the accurate resuming at the job step level, avoids the repeated execution of the completed job step, greatly saves the system resources and shortens the job processing period. Moreover, the application does not need manual intervention in the whole process, and the parameter configuration, interruption judgment, job clipping and resubmission are all automatically completed by the system, without the need for technical personnel to master complex technical implementation and business processes, completely getting rid of the high dependence of manual clipping scheme on manpower, reducing the labor cost, avoiding the risk of errors caused by manual operation, improving the accuracy and reliability of breakpoint resuming. The application can realize the breakpoint resuming at the job step level, reduce the dependence on manpower and improve the degree of automation, and provides a more efficient, flexible and low-cost breakpoint resuming solution for host job scheduling.

[0062] The application further describes the breakpoint resuming method of the application job provided by the embodiment, Figure 3 The application further describes the breakpoint resuming method of the application job provided by the embodiment,

[0063] The application further describes the breakpoint resuming method of the application job provided by the embodiment,

[0064] The application job processing program 201 first solidifies the application job entities 101-103 to the storage unit 300, then submits the application job entities 101-103 to the JES system 400 for running by calling a system command, obtains the Job ID of the application job entities 101-103, maps the Job ID to the application job entities 101-103, and solidifies to the storage unit 300. The application job processing program 201 performs a timing polling search in the storage unit 300 to find the application job with the breakpoint resuming parameter, obtains the corresponding Job ID according to the mapping relationship between the application job and the Job ID, obtains the corresponding running output information from the SPOOL output cache pool of the JES system 400 through the Job ID, and then locates the resuming job step of each application job through the breakpoint resuming parameter of the application job, and judges whether the resuming job step has been interrupted through the job step running result in the running output information.

[0065] Suppose that the application job 2 402 in the JES system 400 has been interrupted. After the application job processing program 201 analyzes the interrupted job step of the application job 2 402, the job clipping module 202 is called to call the copy of the application job 2 entity 102 from the storage unit 300, clip the copy, generate a new job starting from the breakpoint job step to the end of the job step, and push the new job into the memory queue. Then, the application job processing program 201 writes the new job from the memory queue to a temporary data set, and calls a system command to submit the new job to the JES system 400 for running, which corresponds to the application job 2 404 in the figure. If the application job 2 404 is interrupted again, it will be captured by the timing polling search of the application job processing program 201, and the breakpoint resuming processing flow described above will be triggered again. Finally, when all the jobs are completed and the application job processing program 201 no longer captures the job step that needs to be resumed at the breakpoint, the job running period ends.

[0066] Figure 4 A structure diagram of a breakpoint resuming device for an application job provided in an embodiment of the present application is shown in FIG. 4. The device 400 can include: Figure 4

[0067] A job data receiving module 410, configured to receive a breakpoint resuming parameter of at least one application job;

[0068] An interruption information determining module 420, configured to determine a first application job interrupted during running and an interrupted job step of the first application job, in a process of scheduling and running the entity content of the application job by a job scheduling system.

[0069] ​The application job generation module 430 is configured to generate a new application job for breakpoint resuming of the first application job based on the interrupt job step, the breakpoint resuming parameter of the first application job, and the entity content of the first application job.

[0070] The application job resuming module 440 is configured to resubmit the new application job to the job scheduling system for scheduling and running.

[0071] In an embodiment, the breakpoint resuming device of the application job further comprises an information storage module.

[0072] The information storage module is configured to determine a running identification code of each application job after receiving the breakpoint resuming parameter of the at least one application job; determine a mapping relationship between the entity content of each application job and the corresponding running identification code; and record the mapping relationship and the entity content in a storage unit.

[0073] In an embodiment, the interrupt information determination module 420 is specifically configured to: in the storage unit, find a second application job configured with a breakpoint resuming parameter, wherein the breakpoint resuming parameter comprises a resuming job step that needs to be resumed when a running interrupt occurs; based on the mapping relationship, acquire a running identification code of the second application job; in a job output storage pool of the job scheduling system, based on the running identification code, acquire running output information of the second application job; determine whether the resuming job step in the running output information has an interrupt; if the resuming job step has an interrupt, determine the second application job as the first application job, and determine the resuming job step as the interrupt job step.

[0074] In an embodiment, the application job generation module 430 is specifically configured to: acquire the entity content of the first application job from the storage unit; and based on a job step name of the interrupt job step, trim the entity content to obtain the new application job, wherein the new application job starts from the interrupt job step and ends at the last job step.

[0075] In an embodiment, the interrupt information determination module 420 is specifically configured to: in a job output storage pool of the job scheduling system, acquire running output information of each application job; and parse the running output information to obtain a first application job with a running interrupt and an interrupt job step of the first application job.

[0076] In an embodiment, the application job generation module 430 can be specifically configured to: before generating the new application job for breakpoint resuming of the first application job based on the interrupt job step, the breakpoint resuming parameter of the first application job and the entity content of the first application job, acquire the output information of the interrupt job step from the running output information; determine whether the interrupt job step satisfies the breakpoint resuming condition based on the output information, wherein the breakpoint resuming parameter comprises the breakpoint resuming condition; if yes, execute the generation of the new application job for breakpoint resuming of the first application job based on the interrupt job step, the breakpoint resuming parameter of the first application job and the entity content of the first application job.

[0077] In an embodiment, the application job resuming module 440 can be specifically configured to: cache the new application job to a memory queue; read the new application job from the memory queue and write the new application job to a temporary data set for persistent backup; and in response to a job submission command, submit the new application job in the temporary data set to the job scheduling system for scheduling and running.

[0078] The application job breakpoint resuming device provided in the embodiment can be applied to the application job breakpoint resuming method provided in any of the above embodiments, and has corresponding functions and advantages.

[0079] Figure 5 is a block diagram of an electronic device for implementing the application job breakpoint resuming method of the embodiment. The electronic device 10 is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smartphones, wearable devices (such as headsets, glasses, watches, etc.), and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not intended to limit the implementations of the present application described and / or claimed in this document.

[0080] As Figure 5As shown, the electronic device 10 includes at least one processor 11, and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., communicatively connected to the at least one processor 11, where the memory stores a computer program executable by the at least one processor. The processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or loaded from the storage unit 18 into the random access memory (RAM) 13. Various programs and data required for the operation of the electronic device 10 can also be stored in the random access memory (RAM) 13. The processor 11, the read-only memory (ROM) 12, and the random access memory (RAM) 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0081] Various components in the electronic device 10 are connected to the input / output (I / O) interface 15, including an input unit 16, such as a keyboard, a mouse, etc., an output unit 17, such as various types of displays, a speaker, etc., a storage unit 18, such as a magnetic disk, an optical disk, etc., and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks.

[0082] The processor 11 can be various general and / or special purpose processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs various methods and processes described above, such as the breakpoint resuming method of application jobs.

[0083] In some embodiments, the breakpoint resuming method of application jobs can be implemented as a computer program tangibly embodied in a computer readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 10 via the read-only memory (ROM) 12 and / or the communication unit 19. When the computer program is loaded into the random access memory (RAM) 13 and executed by the processor 11, one or more steps of the breakpoint resuming method of application jobs described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to perform the breakpoint resuming method of application jobs by any other appropriate means, such as by means of firmware.

[0084] The various embodiments of the systems and techniques described above can be implemented in digital electronic circuitry, integrated circuitry, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system on a chip systems (SOCs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0085] Computer programs implementing methods of the present application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the computer program, when executed, implements the functions / acts specified in the flowcharts and / or block diagrams. The computer program can be executed entirely on a machine, partially on a machine, partially on a machine as a standalone software package and partially on a remote machine or entirely on a remote machine or server.

[0086] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store computer programs for use by or in connection with an instruction execution system, apparatus, or device. Computer-readable storage media can include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of the machine-readable storage medium will include one or more lines of electrical connections, portable computer disks, hard disk drives, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, fiber optics, portable compact disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0087] To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display (LCD) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0088] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0089] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. A server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and virtual private server.

[0090] It should be noted that the above only describes the preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and those skilled in the art can make various obvious changes, re-adjustments and substitutions without departing from the scope of the present application. For example, those skilled in the art can use the above-mentioned various forms of flow, reorder, add or delete steps; can perform the steps described in the present application in parallel, sequentially or in different order, as long as the desired results of the technical solutions of the present application can be achieved, which is not limited herein.

[0091] The foregoing detailed description has not been limited to specific details regarding the application. It should be apparent that various modifications, combinations, sub-combinations, and alternatives can be made to the disclosed embodiments. Any modifications, changes, and improvements that come within the spirit and scope of the application should be considered as falling within the scope of the application.

Claims

1. A method for retrieving breakpoints in application tasks, characterized in that, The method includes: Receive breakpoint reload parameters for at least one application job; During the scheduling and execution of the entity content of the application job through the job scheduling system, the first application job that is interrupted and the interruption step of the first application job are determined. Based on the interrupted job step, the breakpoint retrieval parameters of the first application job, and the entity content of the first application job, a new application job is generated for retrieving the breakpoint of the first application job. The new application job is resubmitted to the job scheduling system for scheduling and execution.

2. The method for retrieving breakpoints in application jobs according to claim 1, characterized in that, After receiving breakpoint reload parameters for at least one application job, the method further includes: Determine the runtime identifier code for each of the application jobs; Determine the mapping relationship between the entity content of each application job and its corresponding runtime identifier code; The mapping relationship and the entity content are recorded in the storage unit.

3. The method for retrieving breakpoints in application jobs according to claim 2, characterized in that, The step of determining the first application job that is interrupted and the interruption step of the first application job includes: In the storage unit, a second application job configured with breakpoint re-retrieval parameters is located, the breakpoint re-retrieval parameters including a re-retrieval job step that needs to be retrieved when a runtime interruption occurs; The runtime identifier code of the second application job is obtained based on the mapping relationship; In the job output storage pool of the job scheduling system, the running output information of the second application job is obtained based on the running identifier code; Determine whether the re-extraction job step in the runtime output information was interrupted; If an interruption occurs, the second application job is identified as the first application job, and the re-fetch job step is identified as the interrupted job step.

4. The method for retrieving breakpoints in application jobs according to claim 2, characterized in that, The step of generating a new application job for re-framing the first application job based on the interrupted job step, the breakpoint retrieval parameters of the first application job, and the entity content of the first application job includes: The entity content of the first application job is obtained from the storage unit; The entity content is trimmed based on the job step name of the interrupted job step to obtain the new application job, which starts from the interrupted job step and ends at the last job step.

5. The method for retrieving breakpoints in application jobs according to claim 1, characterized in that, The step of determining the first application job that is interrupted and the interruption step of the first application job includes: The running output information of each application job is obtained from the job output storage pool of the job scheduling system. The runtime output information is parsed to obtain the first application job that was interrupted and the interruption step of the first application job.

6. The method for retrieving breakpoints in application jobs according to claim 5, characterized in that, Before generating a new application job for resetting the breakpoint of the first application job based on the interrupted job step, the breakpoint re-retrieval parameters of the first application job, and the entity content of the first application job, the method further includes: Obtain the output information of the interrupted job step from the running output information; Based on the output information, it is determined whether the interrupted work step meets the breakpoint re-release condition, and the breakpoint re-release parameter includes the breakpoint re-release condition. If the conditions are met, a new application job is generated based on the interrupted job step, the breakpoint retrieval parameters of the first application job, and the entity content of the first application job to perform breakpoint retrieval on the first application job.

7. The method for retrieving breakpoints in application jobs according to claim 1, characterized in that, The step of resubmitting the new application job to the job scheduling system for scheduling and execution includes: The new application job is cached in a memory queue; The new application job is read from the memory queue and written to a temporary dataset for persistent backup. In response to the job submission command, the new application job in the temporary dataset is submitted to the job scheduling system for scheduling and execution.

8. A device for retrieving broken points in an application task, characterized in that, The device includes: The job data receiving module is used to receive breakpoint recapture parameters for at least one application job. The interruption information determination module is used to determine the first application job that is interrupted and the interruption step of the first application job during the scheduling and operation of the entity content of the application job through the job scheduling system. The application job generation module is used to generate a new application job for re-fractioning the first application job based on the interrupted job step, the breakpoint retrieval parameters of the first application job, and the entity content of the first application job. The application job resubmission module is used to resubmit the new application job to the job scheduling system for scheduling and execution.

9. An electronic device, characterized in that, The electronic device includes: At least one processor; and a memory communicatively connected to said at least one processor; The memory stores a computer program that is executed by the at least one processor, which enables the at least one processor to perform the breakpoint retrieval method for the application job according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute the breakpoint re-retrieval method for the application job according to any one of claims 1 to 7.

Images