Process execution method and device, electronic equipment and storage medium

Abstract

The invention discloses a process execution method and device, electronic equipment and a storage medium, and relates to the technical field of business process automation. A specific embodiment of the method comprises the following steps: executing a business main process; wherein the business main process is used for performing automatic process processing; executing a screen capture sub-process; wherein the screen capture sub-process is used for capturing a page screenshot of an operation page of the business main process; analyzing and processing the page screenshot to determine whether the business main process is in an interrupted state; in response to the interruption state of the business main process, performing identification processing on the page screenshot to determine an interruption classification corresponding to the business main process; and determining and executing an elimination process corresponding to the interrupt classification so as to enable the business main process to recover a normal execution state. According to the embodiment, long-term stable work of the RPA can be guaranteed, and the execution efficiency of the RPA system is improved.

Description

Technical Field

[0001] This invention relates to the field of business process automation technology, and in particular to a process execution method, apparatus, electronic device, and storage medium. Background Technology

[0002] Robotic Process Automation (RPA) is a technology that uses software robots to simulate human operation of computers. RPA can automate repetitive tasks such as data entry, file management, or system navigation, thereby improving efficiency and reducing human error. However, many RPA systems are susceptible to various factors, causing them to be unable to operate stably for extended periods and resulting in low execution efficiency. Summary of the Invention

[0003] In view of this, embodiments of the present invention provide a process execution method, apparatus, electronic device, and storage medium that can ensure long-term stable operation of RPA and improve the execution efficiency of the RPA system.

[0004] To achieve the above objectives, according to one aspect of the present invention, a process execution method is provided.

[0005] An embodiment of the present invention provides a process execution method comprising: executing a main business process; wherein the main business process is used for automated process processing; Execute the screenshot sub-process; the screenshot sub-process is used to capture screenshots of the operation pages of the main business process; Analyze and process the page screenshots to determine whether the main business process is interrupted; In response to the main business process being interrupted, the page screenshot is identified and processed to determine the interruption category corresponding to the main business process. Identify and execute the elimination process corresponding to the interruption category to restore the main business process to normal execution.

[0006] Optionally, the page screenshot is processed for identification to determine the interruption category corresponding to the main business process, including: Determine if the tooltip component exists in the page screenshot; In response to the presence of a prompt component in the page screenshot, the prompt message is identified from the prompt component in the page screenshot; based on the prompt message, the interruption category corresponding to the main business process is determined.

[0007] Optionally, the page screenshot is processed for identification to determine the interruption category corresponding to the main business process, including: Obtain the execution information corresponding to the main business process; Based on the execution information, at least one alternative interrupt record is matched from the interrupt knowledge base; For each candidate interruption record, determine the base page corresponding to the candidate interruption record; determine the second similarity value between the base page and the page screenshot; The candidate interrupt record with the largest second similarity value is determined as the target interrupt record; The interrupt category corresponding to the target interrupt record is determined as the interrupt category corresponding to the main business process.

[0008] Optionally, the page screenshot is processed for identification to determine the interruption category corresponding to the main business process, including: Obtain the execution information corresponding to the main business process; Input the execution information and page screenshots into the classification and recognition model; Based on the output of the classification and recognition model, determine the interruption category corresponding to the main business process.

[0009] Optionally, the main business process is executed, including: Obtain the process parameters of the main business process; In response to the fact that the process parameters do not meet the execution conditions, the execution status of the main business process is determined to be interrupted. After the preset duration, the process parameters of the main business process are retrieved again; In response to the reacquired process parameters meeting the execution conditions, the execution status of the main business process is switched to normal execution status, and the main business process is controlled to perform automated process processing.

[0010] Optionally, the page screenshots are analyzed to determine whether the main business process is interrupted, including: Get a screenshot of the first page of the operation page at the first time point, and get a screenshot of the second page of the operation page at the second time point; Determine the first similarity value between the screenshot of the first page and the screenshot of the second page; If the first similarity value is greater than the similarity threshold, it is determined that the main business process is in an interrupted state. If the first similarity value is not greater than the similarity threshold, it is determined that the main business process is in normal execution status.

[0011] Optionally, a screenshot subprocess is executed, including: Obtain the execution information of the main business process; In response to the process execution information meeting the trigger conditions, a screenshot sub-process is executed to capture a screenshot of the operation page of the main business process.

[0012] To achieve the above objectives, according to another aspect of the present invention, a process execution apparatus is provided.

[0013] An embodiment of the present invention provides a process execution device comprising: a first execution module, configured to execute a main business process; wherein the main business process is used for automated process processing; The second execution module is used to execute the screenshot sub-process; wherein, the screenshot sub-process is used to capture screenshots of the operation page of the main business process; The status determination module is used to analyze and process page screenshots to determine whether the main business process is interrupted. The classification determination module is used to identify and process page screenshots in response to the main business process being interrupted, so as to determine the interruption category corresponding to the main business process. The interruption elimination module is used to determine and execute the elimination process corresponding to the interruption category, so as to restore the main business process to normal execution.

[0014] To achieve the above objectives, according to another aspect of the present invention, an electronic device is provided.

[0015] An electronic device according to an embodiment of the present invention includes: one or more processors; and a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the process execution method provided in the embodiment of the present invention.

[0016] To achieve the above objectives, according to another aspect of the present invention, a computer-readable medium is provided.

[0017] An embodiment of the present invention provides a computer-readable medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the process execution method provided in the embodiment of the present invention.

[0018] To achieve the above objectives, according to another aspect of the present invention, a computer program product is provided.

[0019] A computer program product according to an embodiment of the present invention includes a computer program, which, when executed by a processor, implements the process execution method provided in the embodiment of the present invention.

[0020] One embodiment of the above invention has the following advantages or beneficial effects: In this embodiment of the invention, during the execution of the main business process, screenshots of the operation page of the main business process are captured by taking screenshots of sub-processes. The screenshots are analyzed to determine whether the main business process is interrupted. If the main business process is interrupted, the interruption category is determined, and the corresponding elimination process is executed to restore the main business process to normal execution. The main business process can be the business processing flow in an RPA system. Therefore, the solution of this embodiment of the invention can ensure the long-term stable operation of RPA and improve the execution efficiency of the RPA system.

[0021] The further effects of the aforementioned unconventional alternative methods will be explained below in conjunction with specific implementation methods. Attached Figure Description

[0022] The accompanying drawings are provided to better understand the invention and are not intended to unduly limit the scope of the invention. Wherein: Figure 1 This is a schematic diagram of a main process of a process execution method according to an embodiment of the present invention; Figure 2 This is a schematic diagram of another main process of the process execution method according to an embodiment of the present invention; Figure 3 This is a schematic diagram of another main process of the process execution method according to an embodiment of the present invention; Figure 4 This is a schematic diagram of the main modules of the process execution device according to an embodiment of the present invention; Figure 5 This is an exemplary system architecture diagram in which embodiments of the present invention can be applied; Figure 6 This is a schematic diagram of the structure of a computer system suitable for implementing embodiments of the present invention. Detailed Implementation

[0023] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of the present invention, including various details to aid understanding. These details should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the invention. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0024] It should be noted that, unless otherwise specified, the embodiments and features described in this invention can be combined with each other. The acquisition, transmission, storage, use, and processing of data in this application comply with relevant national laws and regulations. In the embodiments of this application, certain existing industry solutions such as software, components, and models may be mentioned. These should be considered exemplary, intended only to illustrate the feasibility of implementing the technical solution of this application, and do not imply that the applicant has already used or necessarily used such solutions.

[0025] This invention provides a process execution method, such as... Figure 1 As shown, the method includes the following steps.

[0026] S101: Execute the main business process; whereby the main business process is used for automated process processing.

[0027] The main business process can be configured according to requirements. It is executed by scheduling the corresponding process or by opening the business application. The main business process can be a processing flow within an RPA system. An RPA system is a system that utilizes RPA technology for process processing.

[0028] S102: Execute the screenshot sub-process; where the screenshot sub-process is used to capture screenshots of the operation pages of the main business process.

[0029] The screenshot sub-process can be executed by scheduling the corresponding process or by opening the screenshot application. It can be executed on a scheduled basis, when trigger conditions are met, or upon receiving an execution command for the screenshot sub-process or a troubleshooting command from the main business process.

[0030] In one embodiment of the present invention, executing a screenshot sub-process includes: obtaining process execution information of the main business process; and in response to the process execution information meeting the triggering conditions, executing the screenshot sub-process to capture a screenshot of the operation page of the main business process.

[0031] The process execution information includes: the execution time of the main business process, the return result of the main business process, and the alarm information of the main business process. Triggering conditions can be: the execution time of the main business process exceeds a time threshold, the execution time of the main business process exceeds the time threshold and no return result is received, or the return result of the main business process indicates a runtime error, etc.

[0032] S103: Analyze and process the page screenshots to determine whether the main business process is interrupted.

[0033] There are several ways to determine if a main business process is interrupted. For example, if the execution time of the main business process exceeds a time threshold and no return result is received, it can be determined that the main business process is interrupted. Similarly, if the operation page of the main business process remains unchanged for an extended period, it can be determined that the main business process is interrupted.

[0034] S104: In response to the main business process being interrupted, the page screenshot is identified and processed to determine the interruption category corresponding to the main business process.

[0035] Interruption categories can be set based on the execution status of the main business process. The interruption category must correspond to the reason for the interruption in the main business process.

[0036] S105: Determine and execute the elimination process corresponding to the interruption category to restore the main business process to normal execution status.

[0037] The system has multiple pre-defined interrupt categories and elimination procedures. A mapping relationship is established between interrupt categories and their corresponding elimination procedures. Based on this mapping relationship, the elimination procedure corresponding to each interrupt category is determined.

[0038] The elimination process is used to eliminate the cause of the interruption. The interruption caused the main business process to be interrupted. The elimination process corresponding to the execution interruption category can restore the main business process from the interrupted state to the normal execution state.

[0039] For example, if the interruption is classified as a network problem, the resolution process involves reconnecting to the network or refreshing the network. If the interruption is classified as a memory overflow, the resolution process involves clearing the memory. If the interruption is classified as not logged in, the resolution process involves retrieving the logged-in user information and executing the login process. If the interruption is classified as uncertain, the resolution process involves generating an interruption alert based on the execution information of the main business process and page screenshots, and sending the interruption alert to relevant personnel.

[0040] In this embodiment of the invention, a screenshot of the operation page of the main business process is captured by taking a screenshot of the sub-process. The screenshot is then analyzed to determine if the main business process is interrupted. If it is interrupted, the interruption category is determined, and the corresponding elimination process is executed to restore the main business process to normal execution. The main business process can be a process that utilizes RPA to execute business logic. Therefore, this embodiment of the invention ensures long-term stable operation of RPA and improves the execution efficiency of the RPA system.

[0041] In one embodiment of the present invention, executing a main business process includes: acquiring process parameters of the main business process; determining the execution state of the main business process to be interrupted in response to the process parameters not meeting the execution conditions; acquiring the process parameters of the main business process again after a preset time; and switching the execution state of the main business process to normal execution state in response to the reacquired process parameters meeting the execution conditions, and controlling the main business process to perform automated process processing.

[0042] During the execution of the main business process, the process parameters of the main business process are obtained. The process parameters are the parameters required to execute the main business process. If the process parameters cannot be obtained, or the process parameters do not meet the execution conditions, the main business process cannot be executed normally, and the execution status of the main business process is determined to be interrupted.

[0043] Execute the screenshot sub-process to capture a screenshot of the operation page of the main business process. Perform recognition processing on the screenshot to determine the interruption category corresponding to the main business process. Execute the corresponding elimination process for the interruption category to eliminate the interruption cause that led to the interruption of the main business process.

[0044] Reacquire the process parameters of the main business process. If the reacquired process parameters meet the execution conditions, switch the execution status of the main business process to normal execution status and control the main business process to continue automated process processing.

[0045] In one embodiment of the present invention, analyzing and processing page screenshots to determine whether the main business process is in an interrupted state includes: acquiring a first page screenshot of the operation page at a first time point, and acquiring a second page screenshot of the operation page at a second time point; determining a first similarity value between the first page screenshot and the second page screenshot; determining that the main business process is in an interrupted state in response to the first similarity value being greater than a similarity threshold; and determining that the main business process is in a normal execution state in response to the first similarity value not being greater than the similarity threshold.

[0046] The time interval between the first and second time points can be a preset interval, such as 30 seconds, 1 minute, or 5 minutes. If the operation page remains unchanged or undergoes very minor changes within the preset interval, the main business process is highly likely to be interrupted.

[0047] This invention provides another process execution method, such as... Figure 2 As shown, the method includes the following steps.

[0048] S201: Execute the main business process; whereby the main business process is used for automated process processing.

[0049] S202: Execute the screenshot sub-process; where the screenshot sub-process is used to capture screenshots of the operation pages of the main business process.

[0050] S203: Analyze and process the page screenshots to determine whether the main business process is interrupted.

[0051] S204: In response to the main business process being interrupted, determine whether a prompt component exists in the page screenshot.

[0052] S205: In response to the presence of a tooltip component in the page screenshot, identify the tooltip message from the tooltip component in the page screenshot.

[0053] S206: Based on the prompt, determine the interruption category corresponding to the main business process.

[0054] S207: Determine and execute the elimination process corresponding to the interruption category to restore the main business process to normal execution status.

[0055] In many scenarios, if the main business process is interrupted, a notification component will pop up. Due to various reasons, the system may also display this notification component, which can prevent the main business process from executing normally. Therefore, by analyzing the notification component, we can determine whether the main business process is interrupted and identify the corresponding interruption category.

[0056] Specifically, determine whether a prompt component exists in the page screenshot; in response to the presence of a prompt component in the page screenshot, identify the prompt message from the prompt component in the page screenshot; based on the prompt message, determine whether the main business process is in an interrupted state.

[0057] Pre-determine all prompts involved in the main business process and the corresponding execution status of the main business process for each prompt. Execution statuses include: interrupted, normal execution, and uncertain. If a prompt corresponds to an interrupted state, determine the interruption category for that prompt.

[0058] For example, the main business process is used for automated data entry. The operation page of the main business process contains prompts. If the prompt says: "Please log in first, then enter the data," it indicates that the main business process is interrupted, and the interruption category is: not logged in. If the prompt says: "Please enter the following data," it indicates that the main business process is executing normally.

[0059] In one embodiment of the present invention, the page screenshot is processed for identification to determine the interruption category corresponding to the main business process, including: obtaining execution information corresponding to the main business process; matching at least one candidate interruption record from the interruption knowledge base based on the execution information; determining the base page corresponding to each candidate interruption record; determining a second similarity value between the base page and the page screenshot; determining the candidate interruption record with the largest second similarity value as the target interruption record; and determining the interruption category corresponding to the target interruption record as the interruption category corresponding to the main business process.

[0060] The system has a pre-defined interruption knowledge base. This base includes multiple interruption records. These records store interruption information corresponding to various interruption categories. Each interruption record includes: interruption category, main business process identifier, business system identifier, business category, return result, exception information, and baseline page.

[0061] Execution information comprises various relevant information involved in the execution of the main business process. Execution information may include: main business process identifier, business system identifier, business category, return results, and exception information.

[0062] First, based on the execution information corresponding to the main business process, at least one candidate interrupt record is matched from the interruption knowledge base. For example, if the main business process identifier in the interrupt record matches the main business process identifier in the execution information, then the interrupt record is determined as a candidate interrupt record. Similarly, if the main business process identifier in the interrupt record matches the main business process identifier in the execution information, and the exception information in the interrupt record matches the exception information in the execution information, then the interrupt record is determined as a candidate interrupt record.

[0063] After matching at least one candidate interrupt record from the interruption knowledge base, the second similarity value between the baseline page corresponding to the candidate interrupt record and the page screenshot is calculated. The candidate interrupt record with the highest second similarity value is determined as the target interrupt record. Finally, the interruption category corresponding to the target interrupt record is determined as the interruption category corresponding to the main business process. Using the interruption knowledge base, the interruption category corresponding to the main business process can be determined quickly and accurately.

[0064] In one embodiment of the present invention, the page screenshot is processed for identification to determine the interruption category corresponding to the main business process, including: obtaining the execution information corresponding to the main business process; inputting the execution information and the page screenshot into the classification identification model; and determining the interruption category corresponding to the main business process based on the output of the classification identification model.

[0065] Execution information includes: main business process identifier, business system identifier, business category, return result, exception information, execution time, etc. Training samples are generated based on the known execution information, page screenshot samples, and corresponding screenshots of the operation pages. A classification and recognition model is trained using multiple training samples. The trained classification and recognition model can then efficiently obtain the interruption category corresponding to the main business process.

[0066] Figure 3 This is a schematic diagram of another main process of the process execution method according to an embodiment of the present invention. For example... Figure 3 As shown, the main business process is the process of executing business using RPA. In addition to the main business process, the system also starts a timed screenshot subprocess to eliminate some abnormal interruptions encountered during the execution of the main business process, so as to ensure the uninterrupted execution of the main business process.

[0067] This method consists of two parts: executing the main business process and executing the screenshot sub-process. Among them, Figure 3 The main RPA business execution process in this embodiment is the same as the main business process in this application. Figure 3 The timed screenshot sub-process is the screenshot sub-process in the embodiments of this application.

[0068] For the main business process, initiate the execution of the RPA business process. The main business process executes cyclically. Specific business processes are executed using the main business process. There are two scenarios for the main business process execution: it completes normally and returns; or it encounters an exception during execution, and the main business process returns before execution, remaining in an interrupted state.

[0069] After the previous round of execution of the main business process has ended, the current round of execution begins. If the exception from the previous round persists, the current round will still be unable to execute subsequent processes normally due to the impact of the exception. The solution in this embodiment of the invention asynchronously eliminates the exception from the previous round by taking a screenshot of the sub-process, allowing the current round to resume normal execution.

[0070] For the screenshot sub-process, it is started periodically, such as every 5 minutes. The screenshot sub-process is used to capture screenshots of the operation pages of the main business process. The screenshots are then subjected to OCR (Optical Character Recognition) classification. It is determined whether the main business process is interrupted. If the main business process is not interrupted, the current round of the screenshot sub-process ends. If the main business process is interrupted, the corresponding interruption category is determined. Based on the interruption category, a corresponding elimination process is executed. Once the elimination process is completed, the current round of the screenshot sub-process ends.

[0071] The solution in this embodiment of the invention initiates a screenshot sub-process, sending the page screenshot to an OCR interface for classification and recognition. Based on the interruption classification, an elimination process is invoked to automatically eliminate the corresponding exception, ensuring the uninterrupted and stable operation of the main business process. The screenshot sub-process can assist in eliminating exceptions during the main process's execution, ensuring the long-term stable operation of the main process.

[0072] Taking the RPA-based congratulatory message sending process as an example, this invention illustrates its solution. The system frequently displays a "System XX is not responding" pop-up, interrupting the normal sending of congratulatory messages. If relevant personnel don't receive the messages, they may suspect that no orders have been placed, leading to inquiries with other staff, wasting manpower, reducing company trust and work efficiency, and hindering future business expansion. This invention solves the problem of unsuccessful congratulatory message sending, ensuring the uninterrupted operation of the RPA-based main business process for sending congratulatory messages.

[0073] To address the problems existing in the prior art, embodiments of the present invention provide a process execution device 400, such as... Figure 4 As shown, the device 400 includes: a first execution module 401, used to execute the main business process; wherein the main business process is used for automated process processing; The second execution module 402 is used to execute the screenshot sub-process; wherein, the screenshot sub-process is used to capture screenshots of the operation page of the main business process; The status determination module 403 is used to analyze and process the page screenshot to determine whether the main business process is in an interrupted state. The classification determination module 404 is used to identify and process the page screenshot in response to the main business process being interrupted, so as to determine the interruption category corresponding to the main business process. The interruption elimination module 405 is used to determine and execute the elimination process corresponding to the interruption category so that the main business process can be restored to normal execution.

[0074] It should be understood that the manner in which embodiments of the present invention are implemented is different from the implementation method. Figure 1 The embodiments shown are the same and will not be described again here.

[0075] Optionally, the status determination module 403 is specifically used for: Determine if the tooltip component exists in the page screenshot; In response to the presence of a prompt component in the page screenshot, the prompt message is identified from the prompt component in the page screenshot; based on the prompt message, the interruption category corresponding to the main business process is determined.

[0076] Optionally, the status determination module 403 is specifically used for: Obtain the execution information corresponding to the main business process; Based on the execution information, at least one alternative interrupt record is matched from the interrupt knowledge base; For each candidate interruption record, determine the base page corresponding to the candidate interruption record; determine the second similarity value between the base page and the page screenshot; The candidate interrupt record with the largest second similarity value is determined as the target interrupt record; The interrupt category corresponding to the target interrupt record is determined as the interrupt category corresponding to the main business process.

[0077] Optionally, the status determination module 403 is specifically used for: Obtain the execution information corresponding to the main business process; Input the execution information and page screenshots into the classification and recognition model; Based on the output of the classification and recognition model, determine the interruption category corresponding to the main business process.

[0078] Optionally, the first execution module 401 is specifically used for: Obtain the process parameters of the main business process; In response to the fact that the process parameters do not meet the execution conditions, the execution status of the main business process is determined to be interrupted. After the preset duration, the process parameters of the main business process are retrieved again; In response to the reacquired process parameters meeting the execution conditions, the execution status of the main business process is switched to normal execution status, and the main business process is controlled to perform automated process processing.

[0079] Optionally, the status determination module 403 is specifically used for: Get a screenshot of the first page of the operation page at the first time point, and get a screenshot of the second page of the operation page at the second time point; Determine the first similarity value between the screenshot of the first page and the screenshot of the second page; If the first similarity value is greater than the similarity threshold, it is determined that the main business process is in an interrupted state. If the first similarity value is not greater than the similarity threshold, it is determined that the main business process is in normal execution status.

[0080] Optionally, the second execution module 402 is specifically used for: Obtain the execution information of the main business process; In response to the process execution information meeting the trigger conditions, a screenshot sub-process is executed to capture a screenshot of the operation page of the main business process.

[0081] It should be understood that the manner in which embodiments of the present invention are implemented is different from the implementation method. Figure 1 , 2 The same method is used in the embodiments shown in 1 and 3, and will not be described again here.

[0082] In this embodiment of the invention, during the execution of the main business process, screenshots of the operation page of the main business process are captured by taking screenshots of sub-processes. The screenshots are analyzed to determine whether the main business process is interrupted. If the main business process is interrupted, the interruption category is determined, and the corresponding elimination process is executed to restore the main business process to normal execution. The main business process can be the business processing flow in an RPA system. Therefore, the solution of this embodiment of the invention can ensure the long-term stable operation of RPA and improve the execution efficiency of the RPA system.

[0083] According to embodiments of the present invention, an electronic device and a readable storage medium are also provided.

[0084] An electronic device according to an embodiment of the present invention includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to cause the at least one processor to perform the process execution method provided in the embodiment of the present invention.

[0085] Figure 5 An exemplary system architecture 500 is shown that can be applied to the process execution method or process execution apparatus of the present invention.

[0086] like Figure 5 As shown, system architecture 500 may include terminal devices 501, 502, and 503, a network 504, and a server 505. Network 504 serves as the medium for providing communication links between terminal devices 501, 502, and 503 and server 505. Network 504 may include various connection types, such as wired or wireless communication links, or fiber optic cables, etc.

[0087] Users can use terminal devices 501, 502, and 503 to interact with server 505 via network 504 to receive or send messages, etc. Various client applications can be installed on terminal devices 501, 502, and 503.

[0088] Terminal devices 501, 502, and 503 can be various electronic devices with displays that support web browsing, including but not limited to smartphones, tablets, laptops, and desktop computers.

[0089] Server 505 can be a server that provides various services. The server can analyze and process data such as received product information query requests, and feed back the processing results (such as product information - just an example) to the terminal device.

[0090] It should be noted that the process execution method provided in this embodiment of the invention can be executed by terminal devices 501, 502, and 503, or by server 505. Accordingly, the process execution device can be set in terminal devices 501, 502, and 503, or in server 505.

[0091] It should be understood that Figure 5 The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of terminal devices, networks, and servers can be included.

[0092] The following is for reference. Figure 6 It shows a schematic diagram of the structure of a computer system 600 suitable for implementing embodiments of the present invention. Figure 6 The computer system shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.

[0093] like Figure 6 As shown, the computer system 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 602 or programs loaded from storage section 608 into random access memory (RAM) 603. The RAM 603 also stores various programs and data required for the operation of the system 600. The CPU 601, ROM 602, and RAM 603 are interconnected via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0094] The following components are connected to I / O interface 605: an input section 606 including a keyboard, mouse, etc.; an output section 607 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN card, modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to I / O interface 605 as needed. A removable medium 611, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on drive 610 as needed so that computer programs read from it can be installed into storage section 608 as needed.

[0095] In particular, according to the embodiments disclosed in this invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 609, and / or installed from removable medium 611. When the computer program is executed by central processing unit (CPU) 601, it performs the functions defined above in the system of this invention.

[0096] It should be noted that the computer-readable medium shown in this invention can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this invention, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0097] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0098] The modules described in the embodiments of the present invention can be implemented in software or hardware. The described modules can also be located in a processor, and for example, can be described as: a first execution module, a second execution module, a state determination module, a classification determination module, and an interruption cancellation module. The names of these modules do not necessarily limit the module itself; for example, the first execution module can also be described as a "module that executes the main business process".

[0099] In another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiments; or it may exist independently and not assembled into the device. The computer-readable medium carries one or more programs, which, when executed by the device, cause the device to include: Execute the main business process; the main business process is used for automated process processing. Execute the screenshot sub-process; the screenshot sub-process is used to capture screenshots of the operation pages of the main business process; Analyze and process the page screenshots to determine whether the main business process is interrupted; In response to the main business process being interrupted, the page screenshot is identified and processed to determine the interruption category corresponding to the main business process. Identify and execute the elimination process corresponding to the interruption category to restore the main business process to normal execution.

[0100] According to the technical solution of this embodiment of the invention, during the execution of the main business process, screenshots of the operation page of the main business process are captured by taking screenshots of sub-processes. The screenshots are analyzed to determine whether the main business process is interrupted. If the main business process is interrupted, the interruption category is determined, and the corresponding elimination process is executed to restore the main business process to normal execution. The main business process can be a process that utilizes RPA to perform business processing. Therefore, the solution of this embodiment of the invention can ensure the long-term stable operation of RPA and improve the execution efficiency of the RPA system.

[0101] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can occur depending on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A process execution method, characterized in that, include: Execute the main business process; wherein, the main business process is used for automated process processing; Execute the screenshot sub-process; wherein, the screenshot sub-process is used to capture a screenshot of the operation page of the main business process; The screenshots of the page are analyzed and processed to determine whether the main business process is interrupted. In response to the main business process being interrupted, the page screenshot is identified to determine the interruption category corresponding to the main business process. Identify and execute the elimination process corresponding to the interruption category to restore the main business process to normal execution.

2. The method according to claim 1, characterized in that, The process of identifying and processing the page screenshot to determine the interruption category corresponding to the main business process includes: Determine whether a prompt component exists in the screenshot of the page; In response to the presence of a prompt component in the page screenshot, a prompt message is identified from the prompt component in the page screenshot; based on the prompt message, the interruption category corresponding to the main business process is determined.

3. The method according to claim 1, characterized in that, The process of identifying and processing the page screenshot to determine the interruption category corresponding to the main business process includes: Obtain the execution information corresponding to the main business process; Based on the execution information, at least one alternative interrupt record is matched from the interrupt knowledge base; For each of the candidate interruption records, determine the base page corresponding to the candidate interruption record; determine the second similarity value between the base page and the page screenshot; The candidate interrupt record with the largest second similarity value is determined as the target interrupt record; The interrupt category corresponding to the target interrupt record is determined as the interrupt category corresponding to the main business process.

4. The method according to claim 1, characterized in that, The process of identifying and processing the page screenshot to determine the interruption category corresponding to the main business process includes: Obtain the execution information corresponding to the main business process; The execution information and the page screenshot are input into the classification and recognition model; Based on the output of the classification and recognition model, the interruption category corresponding to the main business process is determined.

5. The method according to claim 1, characterized in that, The main execution process includes: Obtain the process parameters of the main business process; In response to the fact that the process parameters do not meet the execution conditions, the execution status of the main business process is determined to be interrupted. After a preset duration, the process parameters of the main business process are retrieved again; In response to the reacquired process parameters meeting the execution conditions, the execution state of the main business process is switched to normal execution state, and the main business process is controlled to perform automated process processing.

6. The method according to claim 1, characterized in that, The step of analyzing and processing the page screenshot to determine whether the main business process is interrupted includes: Obtain a screenshot of the first page of the operation page at a first time point, and obtain a screenshot of the second page of the operation page at a second time point; Determine the first similarity value between the first page screenshot and the second page screenshot; In response to the first similarity value being greater than the similarity threshold, it is determined that the main business process is in an interrupted state; In response to the first similarity value not being greater than the similarity threshold, it is determined that the main business process is in normal execution status.

7. The method according to claim 1, characterized in that, The screenshot execution sub-process includes: Obtain the process execution information of the main business process; In response to the process execution information meeting the triggering conditions, the screenshot sub-process is executed to capture a screenshot of the operation page of the main business process.

8. A process execution device, characterized in that, include: The first execution module is used to execute the main business process; wherein, the main business process is used for automated process processing. The second execution module is used to execute the screenshot sub-process; wherein, the screenshot sub-process is used to capture a screenshot of the operation page of the main business process; The status determination module is used to analyze and process the page screenshot to determine whether the main business process is in an interrupted state. The classification determination module is used to identify the page screenshot in response to the main business process being interrupted, so as to determine the interruption category corresponding to the main business process. The interruption elimination module is used to determine and execute the elimination process corresponding to the interruption category, so as to restore the main business process to normal execution.

9. An electronic device, characterized in that, include: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1-7.

10. A computer-readable medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-7.

Images