Automatic business process-oriented recording method and system and electronic equipment

Abstract

The invention provides an automatic business process-oriented recording method and system and electronic equipment, and belongs to the technical field of business video data analysis. The process of executing the automatic business process record by the terminal equipment comprises the following steps of: reading business operation data stored in a preset time period, and performing operation analysis on the business operation data by adopting a video analysis model to obtain a first version business process record; wherein the service operation data is used for indicating operation generated by a user in a service execution process; responding to a change operation instruction of the user, and generating a new round of business operation data; the change operation instruction indicates a change operation of a user on a business process record; and according to the new round of operation data, generating and covering the business process record, and obtaining a final business process record. According to the method, the required key information is automatically extracted by analyzing the screen recording content, and the business flow chart and the operation manual which are easy to understand and subsequently maintain are generated.

Description

Technical Field

[0001] The present invention relates to the technical field of business video data analysis, and in particular to a method, system and electronic equipment for automated business process recording. Background Art

[0002] With the great promotion of computer technology, intelligent office technology has also been greatly developed. Based on the public's daily demand for efficient office work, video recording and document recording have become one of the necessary ways to operate historical data. In order to better clarify the historical operation data, the existing technology often uses the form of operation interface screen recording or manual operation document writing to record. Figure 1 As shown in the figure, the process of generating a text-based process record document is as follows: first, conduct a demand analysis based on the business type; second, manually sort out the process based on historical experience and draw the corresponding image document; third, write the corresponding text document according to the corresponding operation process; third, review and modify the generated image document and text document; finally, obtain the image document and text document corresponding to the final business process and output them.

[0003] It is not difficult to see that the recording method used in the prior art has the following defects:

[0004] Defect 1: Manually drawing flowcharts and writing operation documents is time-consuming and labor-intensive;

[0005] Defect 2: Since manual writing is subject to subjective factors and lack of concentration, manual writing still has a high error rate;

[0006] Defect 3: The existing screen recording technology only records the current operation interface, and does not have the ability to convert the screen recording content into an easy-to-understand structured document;

[0007] Defect 4: Lack of timeliness. Since the entire process relies on manual implementation, when the business process changes, it needs to be manually re-sorted, drawn and written, resulting in insufficient real-time update of the overall process. Summary of the invention

[0008] Purpose of the invention: To propose a method, system and electronic device for automated business process recording to solve the above-mentioned problems existing in the prior art. By analyzing the recorded content, the required key information is automatically extracted to generate a business process diagram and operation manual that are easy to understand and subsequently maintain.

[0009] Technical solution: In the first aspect, a method for recording an automated business process is proposed. The process of performing automated business process recording by a terminal device includes the following steps:

[0010] Read the business operation data stored in a preset time period, and use the video analysis model to perform operation analysis on the business operation data to obtain a preliminary version of the business process record; wherein the business operation data is used to indicate the operations generated by the user during the business execution process, including but not limited to videos, screenshots, interaction instructions, interaction timestamps, interface locations, and types;

[0011] Responding to a user's change operation instruction, generating a new round of business operation data; the change operation instruction instructs the user to change the business process record;

[0012] According to the new round of operation data, the business process record is generated and overwritten to obtain the final business process record.

[0013] Among them, the process of generating business operation data includes the following steps: receiving the start recording instruction selected by the user, triggering the screen recording operation; recording the current business screen, and synchronously judging the interactive operation; receiving the end recording instruction selected by the user, triggering the end of the screen recording operation; stopping the recording of the current business screen, and terminating the interactive operation judgment; storing the business operation data generated between the start recording instruction and the end recording instruction to the specified file storage location.

[0014] The process of obtaining business process records includes the following steps: according to the occurrence of interactive operations, read the key frame information and interface change information in the video, and divide the video into multiple operation segments; read the specific operation behavior in the operation segment, and synchronously read the timestamp and interface position corresponding to the annotation; identify and eliminate irrelevant operation information; according to the operation segment information finally obtained, construct different nodes in the process record, and according to the logical relationship between the operation segments, connect different nodes to obtain the initial version of the business process record; according to the information-related records, embed the screenshot into the initial version of the business process record to obtain a business record flowchart.

[0015] In a second aspect, an embodiment of the present invention proposes a system for automated business process recording, which is used to implement an automated business process recording method. The system includes: a data reading module, a data analysis module, an instruction response module and a record update module.

[0016] Among them, the data reading module is used to read the business operation data stored within a preset time period; the data analysis module is used to use a video analysis model to perform operation analysis on the business operation data to obtain a preliminary version of the business process record; the instruction response module is used to respond to the operation instructions selected by the user; the record update module is used to generate and overwrite the business process record according to a new round of operation data to obtain the final business process record.

[0017] In a third aspect, an embodiment of the present invention provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the automated business process recording method provided in the above embodiment.

[0018] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps for executing the method for recording automated business processes provided in the above embodiment are implemented.

[0019] In a fifth aspect, an embodiment of the present invention provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the method for automated business process recording are implemented.

[0020] Beneficial effects: The present invention proposes a method, system and electronic device for automated business process recording, which automatically extracts the required key information through analysis of the screen recording content, and generates business process diagrams and operation manuals that are easy to understand and subsequently maintain. Compared with the manual operation method in the prior art, the present application greatly reduces the time and cost of manually drawing flowcharts and writing documents. At the same time, through intelligent recognition and extraction technology, it reduces human errors and ensures the accuracy of document content. In addition, the automated data processing method of the present application structures the overall analysis process and realizes objective structured process recording, which is convenient for subsequent updates and modifications, and is also adaptable to different businesses, with greater universality. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0022] Figure 1 The data processing flow chart of the prior art.

[0023] Figure 2 It is a data processing flow chart of the present invention.

[0024] Figure 3 The present invention is a flowchart of obtaining business operation data according to an embodiment of the present invention.

[0025] Figure 4 A flowchart of generating a business operation record according to an embodiment of the present invention.

[0026] Figure 5Schematic diagram of the architecture of a business process recording system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0027] In the following description, a large number of specific details are provided to provide a more thorough understanding of the present invention. However, it is apparent to those skilled in the art that the present invention can be implemented without one or more of these details. In other examples, in order to avoid confusion with the present invention, some technical features well known in the art are not described.

[0028] In order to overcome the shortcomings of traditional business process recording, such as lack of real-time performance and long time consumption, which is due to over-reliance on manual work, this application proposes a method and system for automated business process recording, which automatically extracts the required key information through analysis of the screen recording content, and generates business process diagrams and operation manuals that are easy to understand and maintain. Figure 2 The following steps are shown:

[0029] S1. Read the business operation data stored in a preset time period, and use a video analysis model to perform operation analysis on the operation data to obtain business process records.

[0030] The business operation data is used to indicate the operations generated by the user during the business execution process.

[0031] Optionally, the preset time period is set according to the user's selection, and the relevant data within the time range is automatically captured through the preset time range mode.

[0032] Optionally, the preset time period is formed according to a start instruction and an end instruction. When the start instruction is triggered, it serves as the initial position of the preset time period, and when the end instruction is triggered, it serves as the end position of the preset time period.

[0033] In one implementation, before reading the business operation data, Figure 3 The figure also includes the process of generating business operation data: after the system is started, according to the "start recording" function selected by the user, the corresponding start recording instruction is received, and the screen recording operation is triggered to record all activities on the current screen; then, according to the "end recording" function selected by the user, the corresponding end recording instruction is received, the screen recording end operation is triggered, the system stops the screen recording operation, and the business operation data generated between the start recording instruction and the end recording instruction are stored in the specified file storage location.

[0034] The process of recording the screen also includes real-time judgment of user interaction operations and taking screenshots based on the judgment results. Optionally, the changes on the screen are captured in real time, and when user interaction is detected, the screenshot mechanism is triggered, the screenshot operation is executed, and the captured current screen state is used as the interactive screenshot.

[0035] Exemplarily, during the recording process, all changes on the screen are captured in real time. When user interactions include mouse clicks, keyboard input, dragging, etc., the screenshot mechanism is triggered to capture the current screen state, record key information such as the interaction timestamp, location, click type, input type, etc., and save it to a designated file storage location. At the same time, the business operation data is associated with information using graphical association.

[0036] In one implementation, the process of analyzing the acquired business process records includes the following steps: first, according to the occurrence of interactive operations, the key frame information and interface change information in the video are read, and the video is divided into multiple operation segments; second, the specific operation behavior in the operation segment is read, and the timestamp and interface position corresponding to the annotation are synchronously read; third, irrelevant operation information is identified and eliminated; from this, according to the operation segment information finally obtained, different nodes in the process record are constructed, and according to the logical relationship between the operation segments, different nodes are connected to obtain a preliminary version of the business process record; finally, according to the information-related records, the screenshots are embedded in the preliminary version of the business process record to obtain a business record flowchart.

[0037] S2. Respond to the user's change operation instruction and generate a new round of business operation data; the change operation instruction indicates the user's change operation on the business process record.

[0038] In one implementation, the user previews the generated business process records and business operation data through a visual interface, and adjusts the business operation data when the user finds data that he wants to change based on the preview results. Optionally, the operations for adjusting the business data include but are not limited to: adding, deleting, moving nodes, moving connection lines, reselecting, and replacing screenshots.

[0039] In another implementation, the user previews the generated business process records and business operation data through a visual interface. Based on the preview results, the user can directly modify the initially obtained business process records, thereby reducing the redundant process of generating records based on business operation data and shortening time consumption.

[0040] S3. Generate and overwrite the business process record according to the new round of operation data to obtain the final business process record.

[0041] Optionally, in this embodiment, the automatic generation process of the flowchart of the business process record is presented in the form of a hierarchical graph. The hierarchical graph is defined as G = (V, E, n), where V represents the node set corresponding to the operation behavior; E is the edge connecting the nodes, indicating the logical relationship between the operation behaviors; and n represents the hierarchical height in the time dimension.

[0042] In order to improve the generation process of the flowchart, the operation mode of the loop condition judgment is adopted to judge and call the operation behavior. For example, an if loop embedded judgment statement is built to judge in turn whether the current interactive behavior is dragging, clicking, adding, deleting, etc. When the judgment result is "yes", jump out of the current judgment loop and draw a process node diagram representing the current interactive behavior.

[0043] Optionally, when selecting the filling content of the interactive behavior in the flowchart, the constructed knowledge graph is used to retrieve and associate related behaviors.

[0044] In a further embodiment, based on the overall automated business processing flow, the terminal can view and share business operation data at different stages by responding to instructions input by the user for the data generated in the process.

[0045] It is understandable that by responding to the instructions input by the user, the business operation data of different stages can be shared and viewed on demand. Exemplarily, when the user selects the function button to view the document, the system presents the business process diagram, screenshots, and the generated detailed business process records to the user's visual interface. Among them, the business process record includes a description of the business process diagram, operating instructions for each step, and corresponding screenshots. When the user selects the function button to share, the system will share the business process diagram, screenshots, and the generated detailed business process records with one click according to the shared content selected by the user. When the user selects the function button to export, the system will export the business process diagram, screenshots, and the generated detailed business process records according to the export content selected by the user. Optionally, the content format of the export includes but is not limited to: PDF, Word, HTML.

[0046] In a certain embodiment, a subject for executing a method for recording an automated business process may be a terminal (terminal device), which may be a certain terminal device such as a mobile phone, a tablet computer, or a computer device such as a laptop or a desktop computer. Figure 4 As shown, the following steps are included:

[0047] Step 1: During the operation, trigger the screen recording operation according to the user's function selection;

[0048] Step 2: After the screen recording operation is triggered, the background operation interaction data is synchronously recorded, and a screenshot of the current interface is taken when the interaction operation occurs;

[0049] Step 3: Trigger the screen recording end operation according to the user's function selection;

[0050] Step 4: read all operation data obtained during the recording process; the corresponding operation data includes: screen, screenshot, interaction command, interaction timestamp, location, type (such as click, input) and other key information;

[0051] Step 5: Comprehensively analyze all operation data to obtain a business process diagram;

[0052] Step 6: The user improves the obtained business process diagram;

[0053] Step 7. After completing the flowchart confirmation, view and export the document.

[0054] In one embodiment, a system for automated business process recording is provided to implement an automated business process recording method, such as Figure 5 The system shown includes: a data reading module, a data analysis module, a command response module, and a record update module.

[0055] Among them, the data reading module is used to read the business operation data stored within a preset time period; the data analysis module is used to use a video analysis model to perform operation analysis on the business operation data to obtain the initial version of the business process record; the instruction response module is used to respond to the operation instructions selected by the user; the record update module is used to generate and overwrite the business process record according to a new round of operation data to obtain the final business process record.

[0056] Optionally, the business operation data is used to indicate the operations generated by the user during the business execution process, including but not limited to videos, screenshots, interaction instructions, interaction timestamps, interface locations, and types. Operation instructions include: start recording instructions, end recording instructions, share instructions, and change operation instructions.

[0057] During the process of executing automated business process records, the data reading module reads the business operation data stored within a preset time period; the data is then transmitted to the data analysis module, which uses a video analysis model to perform operational analysis on the business operation data to obtain a preliminary version of the business process record.

[0058] In one implementation, for the obtained business process records, users can issue sharing instructions and change operation instructions according to actual needs. In response to the sharing instructions input by the user, the business operation data of different stages are shared on demand; when responding to the user's change operation instructions, including: adding, deleting, moving nodes, moving connection lines, reselecting screenshots, replacing screenshots, after responding to the user's change operation instructions, a new round of business operation data is generated, and the business process record is re-overwritten to obtain the final business process record; at the same time, the final business process record is exported in at least one document format according to user needs. Optionally, the export format of the final business process record includes but is not limited to: PDF, Word, HTML.

[0059] In one embodiment, a device for an automated business process recording method is provided, the device comprising: a processor and a memory storing computer program instructions; wherein the processor reads and executes the computer program instructions to implement an automated business process recording method.

[0060] Specifically, the electronic device includes computers in various forms, including but not limited to laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. In addition, the electronic device can also be presented in various forms of mobile devices, such as cellular phones, smart phones, wearable devices and other computer devices.

[0061] Optionally, the electronic report automatic generation device also includes components for realizing different functions, and the components are connected to the I / O interface through a bus. Among them, the functional components include but are not limited to: input units, output units, storage units and communication units, input units such as mice and keyboards; output units such as different types of displays and speakers; storage units such as disks and optical disks; communication units such as network cards, modems, and wireless communication transceivers.

[0062] The communication unit is used to realize data transmission between the electronic device and other target objects, and optionally, to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0063] In one embodiment, a computer program is also provided. When the computer program is executed by a processor, each process of the above-mentioned embodiment of the method for automated business process recording is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0064] In one embodiment, a computer-readable storage medium is also provided, on which a computer program is stored, and when the computer program is executed by a processor, each process of the above-mentioned method embodiment for automatically identifying indicators and dimensions and generating charts can be implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0065] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0066] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0067] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0068] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1The steps for the functions specified in one or more boxes.

[0069] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0070] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0071] Computer readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, modules of programs or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0072] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity or device including the element.

[0073] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0074] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A method for recording automated business processes, characterized in that: The process of performing automated business process recording on a terminal device includes the following steps: Read the business operation data stored in a preset time period, and use the video analysis model to perform operation analysis on the business operation data to obtain a preliminary version of the business process record; wherein the business operation data is used to indicate the operations generated by the user during the business execution process, including but not limited to videos, screenshots, interaction instructions, interaction timestamps, interface locations, and types; Responding to a user's change operation instruction, generating a new round of business operation data; the change operation instruction indicates the user's change operation on the business process record; According to the new round of operation data, the business process record is generated and overwritten to obtain the final business process record.

2. The automated business process recording method according to claim 1, characterized in that: The process of generating the business operation data comprises the following steps: Receive the start recording command selected by the user and trigger the screen recording operation; Record the current business screen and simultaneously determine the interactive operations; Receive the end recording instruction selected by the user, triggering the screen recording end operation; Stop recording the current business screen and terminate the interactive operation judgment; The business operation data generated between the start recording instruction and the end recording instruction is stored in the specified file storage location.

3. The automated business process recording method according to claim 1, characterized in that: By judging the interactive operation status with the user in real time, the screenshot mechanism is triggered to take a screenshot of the current business execution interface; The information corresponding to the screenshot includes but is not limited to: timestamp, location, clicks, and inputs of the interaction, which is stored in a designated file storage location, and the business operation data is associated with information in a graphical association manner.

4. The automated business process recording method according to claim 3, characterized in that: The process of performing operation analysis on the business operation data using the video analysis model and obtaining the business process record includes the following steps: According to the occurrence of interactive operations, read the key frame information and interface change information in the video, and divide the video into multiple operation segments; Read the specific operation behavior in the operation fragment, and synchronously read the timestamp and interface position corresponding to the annotation; Identify and eliminate irrelevant operational information; According to the operation fragment information finally obtained, different nodes in the process record are constructed, and according to the logical relationship between the operation fragments, different nodes are connected to obtain the initial version of the business process record; According to the records associated with the information, the screenshots are embedded into the preliminary business process records to obtain a business record flow chart.

5. The automated business process recording method according to claim 1, characterized in that: Instructions in response to user input also include: sharing instructions; In response to sharing instructions input by users, business operation data at different stages are shared on demand.

6. The automated business process recording method according to claim 1, characterized in that: The instructions in response to the user input also include: changing the operation instructions; The responded user change operation instructions include: adding, deleting, moving nodes, moving connection lines, reselecting screenshots, and replacing screenshots; after responding to the user change operation instructions, a new round of business operation data is generated, and the business process record is re-overwritten to obtain the final business process record; at the same time, the final business process record is exported in at least one document format according to user needs.

7. A system for automated business process recording, used to implement the automated business process recording method according to any one of claims 1 to 6, characterized in that: Includes the following modules: A data reading module, configured to read business operation data stored within a preset time period; A data analysis module is configured to use a video analysis model to perform operation analysis on the business operation data to obtain a preliminary version of the business process record; The instruction response module is configured to respond to the operation instruction selected by the user; the operation instruction includes: start recording instruction, end recording instruction, share instruction, and change operation instruction; The record updating module is configured to generate and overwrite the business process record according to a new round of operation data to obtain a final business process record.

8. An electronic device, characterized in that: The invention comprises a processor, a memory and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, the steps of the automated business process recording method as claimed in any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the automated business process recording method according to any one of claims 1 to 6 are implemented.

10. A computer program product, characterized in that The invention comprises a computer program, which, when executed by a processor, implements the steps of the automated business process recording method according to any one of claims 1 to 6.

Images