A playback system and method of an RPA process execution process

Abstract

The application discloses an RPA process execution process playback system and method in the field of RPA processes, which comprises the following steps: acquiring RPA process execution logs, screen recordings and event logs; reading the start and end times in the RPA process execution logs; synchronously playing the screen recordings, RPA process diagram animations and highlighted event logs based on the start and end times; in response to a jump occurring during the playing process, acquiring a target time after the jump, and jumping the highlighted contents of the screen recordings, RPA process diagram animations and event logs to the target time; receiving a keyword, and based on the keyword, searching for a corresponding time point in the logs, which include the RPA process execution logs and the event logs, and controlling the playing progress to jump to the corresponding time point.The application synchronizes the logs, screen recordings and RPA processes recorded in the RPA process execution process, which facilitates intuitive observation of the detailed conditions of the RPA process execution process and facilitates analysis of the RPA process and positioning of running errors.

Description

TECHNICAL FIELD

[0001] The present application relates to a playback system and method for RPA process execution process, belonging to the field of RPA process. BACKGROUND

[0002] RPA is a process automation technology. After a technician writes an RPA process, a robot can automatically execute the process repeatedly, replacing manual execution of these operations. Because RPA is efficient and accurate, using RPA processes can achieve the purpose of saving manpower, improving employee work efficiency and satisfaction, so it has been widely used. In order to ensure that the RPA process execution process is consistent with the expectations of the developer and user, the developer and user need to check the specific execution process of the RPA. The general method is to record the complete screen content when the RPA process is executed, and then view it in the form of video playback. This method is simple and intuitive, but it is not very convenient. For example, when there are many operation steps in the RPA process, it is impossible to know which step is currently being executed by looking at the screen alone. If the process is wrong, some error information will appear in the process log. It is not easy to understand what happened on the corresponding screen from these error information alone, what the specific error is, and which step caused the error. SUMMARY

[0003] The purpose of the present application is to overcome the shortcomings of the prior art, provide a playback system and method for RPA process execution process, synchronize the logs, screen recordings and RPA process execution process recorded during the RPA process execution process, and facilitate the analysis of the RPA process and the positioning of the running error.

[0004] To achieve the above purpose, the present application adopts the following technical scheme:

[0005] In a first aspect, the present application provides a playback method for RPA process execution process, comprising:

[0006] obtaining RPA process execution logs, screen recordings and event logs;

[0007] reading the start and end times in the RPA process execution logs;

[0008] synchronously playing the screen recordings, RPA process diagram animations and highlighted event logs based on the start and end times; in response to a jump occurring during the playing process, obtaining a target time after the jump, and jumping the screen recordings, RPA process diagram animations and event log highlighted content to the target time;

[0009] receiving a keyword, and based on the keyword searching the corresponding time point of the logs, controlling the playing progress to jump to the corresponding time point, the logs including RPA process execution logs and event logs.

[0010] Further, the RPA process execution log is a log generated during execution of the written RPA process, each record in the RPA process execution log contains a timestamp, a process node ID and the location of the corresponding node in the process diagram picture, the process diagram picture is derived from the written RPA process, and the RPA process diagram animation is a demonstration animation that highlights the currently executed node on the process diagram picture.

[0011] Further, the screen recording is the video recording data on the screen of the execution device of the written RPA process during execution.

[0012] Further, the event log is a record of all events occurring during execution of the written RPA process, and each record of an event contains a timestamp.

[0013] Further, the type of jump includes jump through a control play bar or jump according to log search.

[0014] In a second aspect, the present application provides a playback system for an RPA process execution process, comprising:

[0015] A receiving module for obtaining an RPA process execution log, a screen recording and an event log;

[0016] A reading module for reading the start and end times in the RPA process execution log;

[0017] A synchronous playing module for synchronously playing the screen recording, the RPA process diagram animation and the highlighted event log based on the start and end times; in response to a jump during playing, obtaining a target time after the jump, and jumping the highlighted content of the screen recording, the RPA process diagram animation and the event log to the target time;

[0018] A searching module for receiving a keyword, and based on the keyword searching a corresponding time point in the log, controlling the playing progress to jump to the corresponding time point, the log including the RPA process execution log and the event log.

[0019] In a third aspect, the present application provides a playback device for an RPA process execution process, comprising a processor and a storage medium;

[0020] The storage medium is used for storing instructions;

[0021] The processor is used for operating according to the instructions to perform the steps of the method according to any one of the above aspects.

[0022] In a fourth aspect, the present application provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the steps of any of the above methods.

[0023] Compared with the prior art, the present application has the following beneficial effects:

[0024] The present application can synchronize the logs, screen recordings and RPA processes recorded during the execution of the RPA process, not only can view the content on the screen at each step of the RPA process execution, the corresponding log is what, and then intuitively watch the detailed situation of the RPA process execution process, simplify the analysis problem, positioning error and other tasks, but also can quickly locate the corresponding operation steps in the RPA process through the log search, view what the screen content is at that time, and then quickly locate the execution process of the RPA process according to the log, time, whether it is to understand the current RPA process execution process, or to analyze the problem, positioning error, it is more convenient. BRIEF DESCRIPTION OF DRAWINGS

[0025] Figure 1 is the system framework diagram provided by the embodiment one of the present application;

[0026] Figure 2 is the player interface schematic diagram provided by the embodiment one of the present application. DETAILED DESCRIPTION

[0027] The present application will be further described below in conjunction with the drawings. The following embodiments are only used to more clearly illustrate the technical solutions of the present application, and cannot be used to limit the protection scope of the present application.

[0028] Embodiment one:

[0029] A playback method of RPA process execution process, please refer to Figure 1 , the specific process is as follows:

[0030] 1, get a written RPA process, install RPA execution program, screen recorder and log recorder;

[0031] 2, call RPA execution program, run RPA process, start screen recorder and log recorder at the same time;

[0032] 3, when RPA execution program runs, automatically record the start and end time of each step; screen recorder automatically records the screen content; log recorder records all events, each event contains a timestamp;

[0033] 4, RPA process is executed, screen recorder and log recorder end.

[0034] Process of using data:

[0035] 1, read the RPA process execution log, screen recording, event log, read the process start execution time and end execution time; screen recording is a normal video stream, each video stream consists of <timestamp, frame> elements, timestamp is the timestamp, frame is the video frame; the RPA process execution log is <timestamp, project, step, rect>, project is the information corresponding to the RPA process, step is the information of a node in the process, rect is the box where the corresponding node in the RPA flowchart is located; the event log is <timestamp, line>, line is a text line, indicating the specific content of the event, generally a line of text;

[0036] 2, load the player, the start time is the process start time, and the end time is set as the process end time;

[0037] 3, play the video according to the time schedule, and promote the highlight display of the RPA flowchart animation and the event log to keep consistent. Specifically: according to the current time, in seconds, locate the corresponding record in the process execution log and the event log; if the current time is between the timestamps of two consecutive events, then the latter event is the current event; when updating the flowchart animation, first redraw the original flowchart picture, and then draw a highlight box according to the rect in the corresponding record in the process execution log; when updating the event log, highlight the text line of the corresponding record, and restore the default color of other text lines;

[0038] 4, if there is a jump, then determine the RPA process execution progress according to the time to update the animation display. The screen recording is directly jumped. The event log is also used to determine which lines to highlight according to the timestamp. The jump method can be to jump by using the play bar, or to jump according to the log search.

[0039] Figure 2 is a schematic diagram of a playback system interface, the left column is general information of the current RPA process, including operator, operation start, end time, step number and other information; the main window includes three parts, the middle is the event log corresponding to the current operation, the upper right is the player of the screen recording, and the lower right is the RPA flowchart animation. The bottom is the play controller, which can control the play progress of the highlight display of the event log, screen recording and RPA flowchart animation at the same time.

[0040] Embodiment two:

[0041] A playback system of an RPA process execution process can realize the playback method of the RPA process execution process in embodiment one, comprising:

[0042] The receiving module is configured to acquire the RPA process execution log, the screen recording and the event log;

[0043] The reading module is configured to read the start time and the end time in the RPA process execution log;

[0044] The synchronous playing module is configured to synchronously play the screen recording, the RPA process diagram animation and the highlighted event log based on the start time and the end time, and in response to a jump occurring in the playing process, acquire a target time after the jump, and jump the screen recording, the RPA process diagram animation and the highlighted event log to the target time.

[0045] The searching module is configured to receive a keyword, and after searching a corresponding time point of a log based on the keyword, control the playing progress to jump to the corresponding time point, wherein the log includes the RPA process execution log and the event log.

[0046] Embodiment three

[0047] The embodiment of the application further provides a playback device of an RPA process execution process, which can realize the playback method of the RPA process execution process.

[0048] The storage medium is configured to store instructions.

[0049] The processor is configured to operate according to the instructions to perform the steps of the following method:

[0050] The processor is configured to operate according to the instructions to perform the steps of the following method:

[0051] The reading module is configured to read the start time and the end time in the RPA process execution log;

[0052] The synchronous playing module is configured to synchronously play the screen recording, the RPA process diagram animation and the highlighted event log based on the start time and the end time, and in response to a jump occurring in the playing process, acquire a target time after the jump, and jump the screen recording, the RPA process diagram animation and the highlighted event log to the target time.

[0053] The searching module is configured to receive a keyword, and after searching a corresponding time point of a log based on the keyword, control the playing progress to jump to the corresponding time point, wherein the log includes the RPA process execution log and the event log.

[0054] Embodiment four

[0055] The embodiment of the application further provides a computer readable storage medium, which can realize the playback method of the RPA process execution process, and has a computer program stored thereon, wherein the program is executed by a processor to realize the steps of the following method:

[0056] Obtaining RPA process execution logs, screen recordings and event logs;

[0057] Reading start and end times in the RPA process execution logs;

[0058] Synchronously playing the screen recordings, RPA process chart animations and highlighted event logs based on the start and end times; in response to a jump occurring during the playing process, obtaining a target time after the jump, and jumping the screen recordings, RPA process chart animations and highlighted event logs to the target time;

[0059] Receiving a keyword, and after searching for a corresponding time point in the logs based on the keyword, controlling the playing progress to jump to the corresponding time point, the logs including the RPA process execution logs and the event logs.

[0060] Those skilled in the art will understand that the embodiments of the present application can be provided as methods, systems or computer program products. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage devices, etc.) containing computer-usable program code.

[0061] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of the flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing devices to produce a machine, so that the instructions executed by the computer or other programmable data processing devices produce a device implemented in the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1 an apparatus that implements the functions specified in the flow(s) or block(s).

[0062] These computer program instructions can also be stored in a computer-readable memory that can direct the computer or other programmable data processing devices to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including instruction apparatus, which implements the flowcharts and / or block diagrams. Figure 1 one or more flows and / or blocks Figure 1 an apparatus that implements the functions specified in the flow(s) or block(s).

[0063] These computer program instructions can also be loaded into a computer or other programmable data processing devices, so that a series of operational steps are performed on the computer or other programmable data processing devices to generate a computer-implemented process, so that the instructions executed on the computer or other programmable devices provide a process for implementing the flowchart Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks to perform the functions specified in the flowchart

[0064] The above description is only the preferred embodiment of the present application, it should be pointed out that for those skilled in the art, without departing from the technical principles of the present application, a number of improvements and modifications can also be made, these improvements and modifications should also be considered as the protection scope of the present application.

Claims

1. A playback method of an RPA process execution procedure, characterized by, The method comprises the following steps: acquiring RPA process execution logs, screen recordings and event logs; reading the start and end times in the RPA process execution logs; synchronously playing the screen recordings, RPA process diagram animations and highlighted event logs based on the start and end times; in response to a jump occurring during the playing process, acquiring a target time after the jump, and jumping the highlighted contents of the screen recordings, RPA process diagram animations and event logs to the target time; receiving a keyword, and based on the keyword, searching for a corresponding time point in the logs, and controlling the playing progress to jump to the corresponding time point, wherein the logs comprise RPA process execution logs and event logs; the RPA process execution logs are logs generated by an already written RPA process during execution, each record in the RPA process execution logs contains a timestamp, a process node ID and a position of a node in a corresponding process diagram picture, the process diagram picture is derived from the already written RPA process, and the RPA process diagram animation is a demonstration animation in which a current execution node is represented by a highlight box on the process diagram picture; the event logs are records of all events occurring during execution of the already written RPA process, and each record of an event contains a timestamp; the jump types include a jump by controlling a playing bar or a jump according to a log search; the synchronous playing of the screen recordings, RPA process diagram animations and highlighted event logs based on the start and end times comprises the following steps: according to a current time, locating corresponding records in the process execution logs and event logs in units of seconds; if the current time is between the timestamps of two consecutive events, the latter event is the current event; when updating the process diagram animation, an original process diagram picture is redrawn, and a highlight box is drawn according to rect in the corresponding record in the process execution logs; when updating the event logs, a text line of the corresponding record is highlighted, and other text lines are restored to the default color; rect is a box in which a corresponding node in the RPA process diagram is located.

2. The playback method of the RPA process execution procedure according to claim 1, characterized in that, the screen recordings are video recording data of a screen of an execution device of the already written RPA process during execution.

3. A playback system of an RPA process execution procedure, characterized by, The method comprises the following steps: a receiving module for acquiring RPA process execution logs, screen recordings and event logs; a reading module for reading the start and end times in the RPA process execution logs; a synchronous playing module for synchronously playing the screen recordings, RPA process diagram animations and highlighted event logs based on the start and end times; in response to a jump occurring during the playing process, acquiring a target time after the jump, and jumping the highlighted contents of the screen recordings, RPA process diagram animations and event logs to the target time; a searching module for receiving a keyword, and based on the keyword, searching for a corresponding time point in the logs, and controlling the playing progress to jump to the corresponding time point, wherein the logs comprise RPA process execution logs and event logs; The RPA process execution log is a log generated by the written RPA process during execution, each record in the RPA process execution log contains a timestamp, a process node ID and the location of the corresponding node in the process diagram picture, the process diagram picture is derived from the written RPA process, and the RPA process diagram animation is a demonstration animation that highlights the current execution node on the process diagram picture; The event log is a record of all events occurring during the execution of the written RPA process, and each event record contains a timestamp; the type of jump includes jump through the control play bar or jump according to log search; The synchronous playback of the screen recording, the RPA process diagram animation and the highlighted event log based on the start and end time comprises: according to the current time, locating the corresponding record in the process execution log and the event log in seconds; if the current time is between the timestamps of two consecutive events, the latter event is the current event; when updating the process diagram animation, first redraw the original process diagram picture, and then draw a highlight box according to the rect in the corresponding record in the process execution log; when updating the event log, the text line of the corresponding record is highlighted, and other text lines are restored to the default color; Wherein, rect is the box where the corresponding node in the RPA process diagram is located.

4. A playback apparatus of an RPA process execution procedure, characterized by, It comprises a processor and a storage medium; The storage medium is used to store instructions; The processor is used to operate according to the instructions to perform the steps of the method according to claim 1 or 2.

5. A computer-readable storage medium having stored thereon a computer program, characterized in that, The program is executed by the processor to realize the steps of the method of claim 1 or 2. The program is executed by the processor to realize the steps of the method of claim 1 or 2.

Images