Business analysis system, business analysis device, business analysis method, and program
The business analysis system addresses the challenge of large log files by capturing smaller operation images and using server-stored master images to generate composite diagrams, enhancing data collection efficiency and RPA task identification.
Patent Information
- Application Number
- PCT/JP2023/018161
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-15
- Publication Date
- 2024-11-21
AI Technical Summary
Existing business analysis methods relying on manual identification of tasks suitable for RPA face challenges in efficiently collecting data without increasing log file size, as capturing more peripheral information leads to larger log files and resource pressure.
A business analysis system that captures smaller images of user operations and associates them with attached information, using a server to store larger master images, allowing for reduced log file sizes by generating composite images for operation flow diagrams.
Enables effective data collection for business analysis without increasing log file sizes, reducing resource pressure and improving the efficiency of identifying tasks for RPA implementation.
Smart Images

Figure JP2023018161_21112024_PF_FP_ABST
Abstract
Description
Work analysis system, work analysis device, work analysis method, and program
[0001] One aspect of the present invention relates to a task analysis device, a task analysis method, and a program.
[0002] In business activities, it is particularly important to carry out daily business operations efficiently and smoothly. Because the business environment changes due to both external and internal factors, it is necessary to continuously improve business operations. To improve business operations, it is effective to carry out the following steps in order: "Understanding the actual situation," "Discovering and analyzing areas for improvement," "Planning improvements," and "Implementing the improvement plans."
[0003] Robotic Process Automation (RPA) is a software tool that performs computer operations on behalf of humans and is becoming increasingly popular as a powerful tool for improving business efficiency. However, to effectively implement RPA, it is necessary to identify tasks suitable for RPA and comprehensively analyze the entire business process. Traditionally, this type of analysis has been performed manually, which tends to depend on the analyst's know-how and skills, resulting in ineffective use of RPA. Therefore, a method is known for extracting routine operations by recording user terminal operations as an operation log and using software to mechanically repeat and statistically analyze the tasks based on the operation log (see, for example, Patent Document 1).
[0004] International Publication No. 2020 / 235085
[0005] Patent Literature 1 proposes capturing operation logs as images and creating an operation flow diagram to visualize user operation procedures. Many operating systems (OS) have the ability to capture monitor displays, which has the advantage of being system-independent and reducing costs. By utilizing this method, repetitive tasks that are candidates for RPA can be easily identified without relying on know-how or skills.
[0006] However, if you focus too much on the operation area when capturing an image of the operation screen, peripheral information will be lost. On the other hand, if you increase the image size to capture more peripheral information, the log file size will become too large. In this way, the more useful data you try to capture, the larger the log file will become, putting a strain on resources. A solution to these issues was eagerly awaited.
[0007] The present invention has been made in light of the above circumstances, and aims to provide a technique that can collect data related to business analysis without increasing the size of the log file.
[0008] A task analysis system according to one aspect of the present invention includes an analyzed terminal having an application installed, an analyzing terminal capable of communicating with the analyzed terminal, and a server capable of communicating with the analyzed terminal and the analyzing terminal. The server includes an image management unit. The analyzed terminal includes a log acquisition unit. The analyzing terminal includes a visualization unit. The image management unit manages a first image, generated by pre-capturing an operation screen of the application, in association with attached information related to the operation on the operation screen. When operating the application, the log acquisition unit captures a second image from the operation screen that is smaller in size than the first image and includes the user's operation position on the operation screen, and generates a log file by associating the attached information related to the operation with the second image. The visualization unit acquires the second image related to the analysis target from the log file, acquires a first image corresponding to the attached information of the second image from the server, and creates an operation flow diagram related to the operation of the application by combining the second image with the acquired first image.
[0009] According to one aspect of the present invention, data related to business analysis can be collected without increasing the size of the log file.
[0010] FIG. 1 is a diagram showing an example of an operation flow diagram using a captured image of an operation screen. FIG. 2 is a functional block diagram showing an example of a business analysis system according to an embodiment. FIG. 3 is a diagram showing an example of a master image. FIG. 4 is a diagram showing an example of a captured image. FIG. 5 is a diagram showing an example of a composite image generated by the visualization unit 21a. FIG. 6 is a diagram showing an example of a composite image generated by the visualization unit 21a. FIG. 7 is a flowchart showing an example of a processing procedure in the business analysis system according to an embodiment.
[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. First, an operation flow diagram using a captured image of an operation screen of a business application will be described. In the embodiment, a transit guide application is assumed as the business application, but the present invention is not limited to this.
[0012] FIG. 1 shows an example of an operational flow diagram using captured images of an operation screen. An operational flow diagram is a diagram that visualizes the state transitions of an operation screen that change in response to user operations, and is the basis for business analysis. In FIG. 1, node (1) is a captured image that shows an action (application, window, operation) within a process. In other words, a node is a captured image of an actual operation screen. Therefore, in order to visualize a business process that involves many operations, it is necessary to record many captured images, which results in an increase in the amount of data. Below, we disclose a technology that makes it possible to reduce the amount of data. Note that operations on the same operation location or the same sequence index are displayed as a single node.
[0013] Edges (2) are arrow icons connecting nodes, and the direction of the arrows indicates the order of operations. As there are multiple nodes (1), multiple edges (2) are drawn between them. Typically, nodes (1) include operation points (3) that accept manual input operations by the user. The operation points (3) are, for example, input fields for text information, clickable icons containing hyperlinks, or pull-down menus containing multiple options. Technically, the operation points (3) are logs whose type attribute is indicated by operation.
[0014] Furthermore, the operation flow diagram may display additional information related to the operations on the operation screen in text format. The additional information may include, for example, items such as window title, URL / file path, operation location, operation type, number of orders, and input value type.
[0015] 2 is a functional block diagram showing an example of a business analysis system according to an embodiment. The system shown in FIG. 2 includes an analyzed terminal 1 on which a business application is installed and which is the subject of business analysis, and an analyzing terminal 2 capable of communicating with the analyzed terminal 1. The two are connected via, for example, a hub, and are communicatively connected via an office network or the like. The hub is further connected to a router and a firewall (not shown), which allows the analyzed terminal 1 and the analyzing terminal 2 to communicate with a server 3 on a network 100.
[0016] The server 3 is a computer (information processing device) including a storage unit 31 such as a semiconductor memory and a processor 32 such as a CPU (Central Processing Unit). The processor 32 includes a master image management unit 32b as a processing function according to the embodiment. The master image management unit 32b manages master images generated by capturing in advance the operation screen of a business application on the analysis target terminal 1, in association with attached information ( FIG. 1 ) related to operations on the operation screen. Multiple master images are acquired according to the chronological order of operations by the user, and the image data of each master image is stored in the storage unit 31 (master image 31a). FIG. 3 is a diagram showing an example of a master image.
[0017] The analyzed terminal 1 is a computer (information processing device) including a storage unit 12, a processor 11, and a display 13. The processor 11 includes a log acquisition unit 11a as a processing function according to the embodiment. The log acquisition unit 11a acquires a capture image when a business application is operated on the analyzed terminal 1.
[0018] 4 is a diagram showing an example of a capture image. The capture image is a small area (image fragment) smaller in size than the master image and including the user's operation position (e.g., click position) on the operation screen of the display device 13. Capture image (A) shows an image fragment when, for example, the user enters "Tokyo" in the "Departure Point" dialog box. Capture image (B) shows an image fragment when, for example, the IC card use radio button is clicked on the "Fare" line. Both capture images are cut out as a rectangular area including the coordinates of the position operated by the user (operation position coordinates).
[0019] The log acquisition unit 11a generates a log file by associating the captured image with attached information related to the operation when the captured image was generated. The log file is stored in the storage unit 12 (log file 12a). That is, in the log file, the captured image is managed by being linked to the attached information by the user. The attached information may be the user's operation history (operation log), the application name (executable file name) of the target system, the window title, or a uniform resource locator (URL). All of this information is saved together. In other words, the information required to link the captured image with the master image 31a stored on the server 3 can be used as attached information.
[0020] The analyzing terminal 2 is a computer (information processing device) including a processor 21 and a storage unit 22. The processor 21 includes a visualization unit 21a as a processing function according to the embodiment. The visualization unit 21a acquires, from the log file 12a, a capture image related to an analysis target for task analysis of the analyzed terminal 1. The visualization unit 21a also acquires, from the server 3, a master image corresponding to the attached information of the acquired capture image. The visualization unit 21a then generates a composite image by combining the acquired master first image with the capture image. Based on this composite image, the visualization unit 21a creates an operation flow diagram such as that shown in FIG. 1. The function of the visualization unit 21a is realized based on a program 22a stored in the storage unit 22. In other words, the program 22a causes the computer to function as the analyzing terminal 2 including the visualization unit 21a.
[0021] 5 and 6 are diagrams showing examples of composite images generated by the visualization unit 21a. The composite image shown in Fig. 5 is generated by combining the master image shown in Fig. 3 with the captured image (A). The composite image shown in Fig. 6 is generated by combining the master image shown in Fig. 3 with the captured image (B). Here, the position coordinates at which the captured image is to be combined in the master image can be uniquely determined by a known method such as template matching.
[0022] 7 is a flowchart showing an example of a processing procedure in the task analysis system of the embodiment. In FIG. 7, the analyzing terminal 2 transmits a data acquisition request to the analyzed terminal 1 and reads a log file related to the task to be analyzed (step S11). Next, the analyzing terminal 2 acquires attached information of the capture image included in the acquired log file (step S12).
[0023] Next, the analysis terminal 2 sends a search request to the server 3 using the acquired attached information as a search key, and acquires master images having attached information that matches the search key (step S13). If the attached information does not match exactly, master images with a high matching rate for attached information are downloaded to the analysis terminal 2.
[0024] Next, the analysis terminal 2 identifies the display position of the captured image by template matching between the captured image and the downloaded master image (step S14).The analysis terminal 2 then combines the captured image with the master image to generate a composite image and create an operation flow diagram.
[0025] As described above, according to the embodiment, a master image of a system application to be operated by a user is acquired in advance and stored in the external server 3. Then, when the user operates the terminal, a piece of the image including an area changed by the operation is acquired as a capture image. Then, by combining the capture image with the master image, it becomes possible to reproduce an operation flow diagram including all necessary information.
[0026] Here, since the master image, which has a large amount of image data, is stored on the server 3, only the captured image needs to be stored locally on the analyzed terminal 1. The amount of data for the captured image can be significantly smaller than the amount of data for the master image. As a result, according to the embodiment, it is possible to collect data related to business analysis without increasing the size of the log file. As a result, it is possible to significantly reduce the capacity of the log file on the analyzed terminal compared to existing technologies.
[0027] It should be noted that the present invention is not limited to the above-described embodiment. For example, in the embodiment, the master image is stored in the server 3, but it is of course possible to store the master image in a cloud service. Furthermore, the exchange of various data between the analyzed terminal 1 and the analyzing terminal 2 is not limited to communication via a network. For example, it is also possible to store the log file 12a in a storage device (such as a USB memory) and exchange data directly.
[0028] That is, this invention is not limited to the above-described embodiments, and the components can be modified and embodied in practice without departing from the spirit of the invention. Furthermore, various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiments. For example, some components may be omitted from all the components shown in the embodiments. Furthermore, components from different embodiments may be appropriately combined.
[0029] 1...Analyzed terminal 2...Analyzing terminal 3...Server 11...Processor 11a...Log acquisition unit 12...Memory unit 12a...Log file 13...Display 21...Processor 21a...Visualization unit 22...Memory unit 22a...Program 31...Memory unit 31a...Master image 32...Processor 32b...Master image management unit 100...Network.
Claims
1. A business analysis system comprising: an analyzed terminal having an application installed; an analyzing terminal capable of communicating with the analyzed terminal; and a server capable of communicating with the analyzed terminal and the analyzing terminal, wherein the server comprises an image management unit, the analyzed terminal comprises a log acquisition unit, and the analyzing terminal comprises a visualization unit, wherein the image management unit manages a first image generated by previously capturing an operation screen of the application in association with additional information related to the operation on the operation screen, wherein the log acquisition unit captures a second image from the operation screen when the application is operated, the second image being smaller than the first image and including a user's operation position on the operation screen, and generates a log file by associating the additional information related to the operation with the second image, wherein the visualization unit acquires a second image related to an analysis target from the log file, acquires a first image corresponding to the additional information of the second image from the server, and creates an operation flow diagram related to the operation of the application by combining the second image with the acquired first image.
2. The business analysis system of claim 1, wherein the ancillary information associated with the first image is at least one of a window title on the operation screen, a URL (Uniform Resource Locator) / file path, an operation location, an operation type, a number of orders, or a type of input value.
3. A business analysis system as described in claim 1, wherein the ancillary information associated with the second image is at least one of a user's operation history (operation log) on the operation screen, the name of the application, a window title, or a URL (Uniform Resource Locator).
4. A task analysis device comprising: a terminal to be analyzed having an application installed; a means for communicating with a server which manages a first image generated by capturing an operation screen of the application in advance in association with additional information related to the operation on the operation screen; and a visualization unit, wherein the visualization unit: captures a second image smaller in size than the first image from the operation screen when the application is operated, includes a user's operation position on the operation screen, associates the additional information related to the operation with the second image, and acquires the second image related to the analysis subject from a log file generated on the terminal to be analyzed; acquires a first image corresponding to the additional information of the second image from the server; and creates an operation flow diagram related to the operation of the application by combining the second image with the acquired first image.
5. A task analysis method for a task analysis system comprising an analyzed terminal having an application installed, an analyzing terminal capable of communicating with the analyzed terminal, and a server capable of communicating with the analyzed terminal and the analyzing terminal, wherein the server manages a first image generated by previously capturing an operation screen of the application in association with additional information related to the operation on the operation screen, the analyzed terminal captures a second image from the operation screen when operating the application, the second image being smaller in size than the first image and including the user's operation position on the operation screen, the analyzed terminal generates a log file by associating the additional information related to the operation with the second image, the analyzing terminal acquires a second image related to an object of analysis from the log file, the analyzing terminal acquires a first image corresponding to the additional information of the second image from the server, and the analyzing terminal synthesizes the second image with the acquired first image to create an operation flow diagram related to the operation of the application.
6. A program including instructions for causing an information processing device to function as the business analysis device according to claim 4.
Citation Information
Patent Citations
Software robot definition information generation system, software robot definition information generation method, and program
JP2019169044A
Data processing device, data processing method, and data processing program
WO2022054262A1
Processing device, processing method, and processing program
WO2023281718A1
