Information processing program, information processing system, and information processing method
The described system addresses the limitations of cloud-based RPA by encrypting user and group keys for secure automation within corporate networks, offering a flexible and secure processing automation solution.
Patent Information
- Application Number
- JP2020147462
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-09-02
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2040-09-02
AI Technical Summary
Existing cloud-based robotic process automation (RPA) technologies are not optimal for systems restricted to access within a corporate network and lack secure automation mechanisms.
An information processing system that encrypts user and group keys to automate processing, using a client-server architecture with cloud server support, enabling secure execution of automated tasks based on scenario creation and decryption of encrypted information.
Provides a general-purpose, secure processing automation mechanism that can execute tasks within corporate networks, ensuring data security and flexibility in task execution.
Smart Images

Figure 0007577254000001 
Figure 0007577254000002 
Figure 0007577254000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing program, an information processing system, and an information processing method for automating processing. [Background technology]
[0002] In recent years, a technology has been used that records a user's operation procedure on a computer as a scenario and automatically executes the operation procedure to automate processing on the computer. This technology is called Robotic Process Automation (RPA). For example, a technology has been disclosed that generates an image of a character string to be searched for, extracts the image from the display screen by image recognition processing, and identifies the position to be automated (Patent Document 1).
[0003] Also, a technology related to RPA using a cloud has been disclosed, in which a request is made to form a tunnel with an external server using computer authentication information, and when the tunnel formation request is authenticated, the external server transmits operations designated in advance by a human to a first internal server in order (Patent Document 2). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2018-116394 A [Patent Document 2] JP 2020-92400 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, automating processes via the cloud is not necessarily optimal for users, and there is a demand for a more versatile mechanism for automating processes, such as automating systems with access restricted to within a corporate network, etc. In particular, there is a demand for a mechanism that can execute automated processes securely. [Means for solving the problem]
[0006] One aspect of the present invention is an information processing system that automatically executes processing in accordance with a scenario created to automate a target processing, comprising: a first information generation means for encrypting a user key generated from user information obtained from a user to generate first information; a second information generation means for encrypting a group key generated from group information related to a group to which one or more users belong, using the user key to generate second information; a third information generation means for encrypting job information required to execute the scenario, using the group key to generate third information; and an execution means for decrypting the first information, the second information, and the third information in that order when automatically executing processing in accordance with the scenario, and using the job information obtained by decryption to automatically execute processing in accordance with the scenario.
[0007] Here, it is preferable that the system includes a client and a server, the processing in the first information generating means is executed by the client and the first information is registered to the server via an information and communication network, the processing in the second information generating means is executed by the client and the second information is registered to the server via an information and communication network, the processing in the third information generating means is executed by the client and the third information is registered to the server via an information and communication network, and the processing in the execution means is executed in the client or the server.
[0008] In addition, the server is preferably a cloud server.
[0009] It is also preferable that the first information generation means encrypts the user key using a public key at the client to generate the first information, and the execution means decrypts the first information using a private key corresponding to the public key at the server.
[0010] It is also preferable that the execution means decrypts the first information by using the user key generated by the client using the user information.
[0011] Furthermore, when registering another user to the group, it is preferable that the first information generation means encrypts a user key generated from user information obtained from the other user to generate the first information for the other user, and the second information generation means encrypts the group key using the user key for the other user to generate the second information.
[0012] It is also preferable that a schedule for automating the processing is set in advance, and the processing automation in the execution means is executed according to the schedule.
[0013] Another aspect of the present invention is an information processing program that automatically executes processing in accordance with a scenario created to automate a target processing, comprising: a first information generation means that encrypts a user key generated from user information obtained from a user to generate first information; a second information generation means that uses the user key to encrypt a group key generated from group information related to a group to which one or more users belong to to generate second information; a third information generation means that uses the group key to encrypt job information required to execute the scenario to generate third information; and an execution means that, when automatically executing processing in accordance with the scenario, decrypts the first information, the second information, and the third information in that order, and uses the job information obtained by decryption to automatically execute processing in accordance with the scenario.
[0014] Another aspect of the present invention is an information processing method for automatically executing processing in accordance with a scenario created to automate a target processing, comprising: a first information generation step of encrypting a user key generated from user information obtained from a user to generate first information; a second information generation step of encrypting a group key generated from group information related to a group to which one or more users belong, using the user key to generate second information; a third information generation step of encrypting job information required to execute the scenario, using the group key to generate third information; and an execution step of decrypting the first information, the second information, and the third information in sequence when automatically executing processing in accordance with the scenario, and using the job information obtained by decryption to automatically execute processing in accordance with the scenario. Effect of the Invention
[0015] According to the present invention, it is possible to provide a more versatile mechanism for automating processing. Also, it is possible to provide a mechanism for automatically executing processing in a secure state. Other objects of the embodiments of the present invention will become apparent by referring to the entire specification. [Brief description of the drawings]
[0016] [Figure 1] 1 is a schematic diagram of an overall configuration of an information processing system according to an embodiment of the present invention. [Diagram 2] 2 is a diagram illustrating a configuration of an API server according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a diagram illustrating a configuration of a cloud server according to an embodiment of the present invention. [Figure 4] FIG. 2 is a diagram showing a configuration of a client according to an embodiment of the present invention. [Diagram 5] 3 is a flowchart showing a scenario creation method in an embodiment of the present invention. [Figure 6] FIG. 4 is a diagram showing a display example of a first display unit in the embodiment of the present invention. [Figure 7]10A to 10C are diagrams illustrating a process for displaying a moving image according to an embodiment of the present invention. [Figure 8] FIG. 4 is a diagram illustrating an example of an option database according to the embodiment of the present invention. [Figure 9] 5A to 5C are diagrams illustrating an example of a display on a second display unit in the embodiment of the present invention. [Figure 10] 11A and 11B are diagrams illustrating an example of a display of a menu image according to the embodiment of the present invention. [Figure 11] FIG. 11 is a diagram illustrating a process for selecting a processing option according to an embodiment of the present invention. [Figure 12] FIG. 11 is a diagram illustrating a process of adding a scenario according to an embodiment of the present invention. [Figure 13] FIG. 4 is a diagram showing an example of a condition database according to the embodiment of the present invention. [Figure 14] 13 is a flowchart showing a scenario execution method according to a modified example of the present invention. [Figure 15] 10 is a flowchart showing a registration process for automating the process according to an embodiment of the present invention. [Figure 16] 10 is a flowchart showing a new user registration process for automating the process according to an embodiment of the present invention. [Figure 17] 10 is a flowchart showing processing executed by a cloud server according to an embodiment of the present invention. [Figure 18] 10 is a flowchart showing an execution process in a client according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] [System Configuration] As shown in Fig. 1, an information processing system 100 according to an embodiment of the present invention includes an API server 102, a cloud server 104, a client 106, and an information and communication network 108. The API server 102, the cloud server 104, and the client 106 are connected via the information and communication network 108 (e.g., the Internet). The client 106 can access a web page provided by the API server 102. The client 106 can also access the cloud server 104 via the API server 102, and can automatically execute processing in a secure state.
[0018] The API server 102 generally includes a web server and a database, and is configured across multiple layers in the OSI reference model. Although only one API server 102 is shown in Fig. 1, multiple API servers 102 may be connected to the information and communications network 108, and web pages may be provided from each of the multiple API servers 102.
[0019] As shown in FIG. 2, the API server 102 includes a processing unit 10, a storage unit 12, an input unit 14, an output unit 16, and a communication unit 18. The processing unit 10 includes a means for performing arithmetic processing, such as a CPU. The processing unit 10 executes a web page providing program (e.g., a server program) stored in the storage unit 12, thereby realizing a function for providing a web page to the client 106 in the information processing system 100 in this embodiment. The storage unit 12 includes a storage means such as a semiconductor memory or a memory card. The storage unit 12 is connected to the processing unit 10 so as to be accessible, and stores the web page providing program and information required for the processing. The input unit 14 includes a means for inputting information. The input unit 14 includes, for example, a keyboard, a touch panel, buttons, etc., for receiving input from an administrator. The output unit 16 includes a means for outputting a processing result in the API server 102, such as a user interface screen (UI) for receiving input information from the administrator. The output unit 16 includes, for example, a display for presenting an image to the administrator. The communication unit 18 includes an interface for communicating information with the client 106 via the information communication network 108. The communication by the communication unit 18 may be wired or wireless.
[0020] As shown in FIG. 3, the cloud server 104 includes a processing unit 20, a storage unit 22, an input unit 24, an output unit 26, and a communication unit 28. The processing unit 20 includes a means for performing arithmetic processing, such as a CPU. The processing unit 20 executes an automation processing program stored in the storage unit 22 to realize automation of processing for a web page using security information. Specifically, the cloud server 104 functions as a so-called service worker, a job worker, a key management server (KMS), or the like. The storage unit 22 includes a storage means, such as a semiconductor memory or a memory card. The storage unit 22 is connected to the processing unit 20 in an accessible manner, and stores the automation processing program and information required for the processing. The input unit 24 includes a means for inputting information. The input unit 24 includes, for example, a keyboard, a touch panel, a button, or the like for receiving input from an administrator. The output unit 26 includes a means for outputting a processing result in the cloud server 104, such as a user interface screen (UI) for receiving input information from the administrator. The output unit 26 includes, for example, a display for presenting an image to the administrator. The communication unit 28 includes an interface for communicating information with the client 106 via the information communication network 108. The communication by the communication unit 28 may be wired or wireless.
[0021] In this embodiment, cloud server 104 is connected to client 106 via information and communication network 108, but it may be a local server connected to client 106 via a LAN or the like. That is, cloud server 104 may be any server capable of communicating with client 106 and storing security information required for automating processing on behalf of client 106.
[0022] As shown in FIG. 4, the client 106 includes a processing unit 30, a storage unit 32, an input unit 34, an output unit 36, and a communication unit 38. The processing unit 30 includes a means for performing arithmetic processing, such as a CPU. The processing unit 30 executes a client program (or a client application) stored in the storage unit 32, thereby realizing automation of processing for a web page in the information processing system 100 in this embodiment. The storage unit 32 includes a storage means, such as a semiconductor memory or a memory card. The storage unit 32 is connected to the processing unit 30 so as to be accessible, and stores the client program and information required for the processing. The input unit 34 includes a means for inputting information. The input unit 34 includes, for example, a keyboard, a touch panel, a button, etc., for receiving input from a user. The output unit 36 includes a means for outputting information required for processing in the client 106, such as a user interface screen (UI) for receiving input information from a user. The output unit 36 includes, for example, a display for presenting an image to a user. The communication unit 38 includes an interface for communicating information with the API server 102 via the information and communication network 108. The communication by the communication unit 38 may be wired or wireless.
[0023] In the following, a scenario creation process, a scenario execution process, and an automation process will be described as being executed by one client 106, but some of these processes may be executed by other clients 106.
[0024] Furthermore, the API server 102, cloud server 104, and client 106 may be generally used computers, i.e., PCs (personal computers), or mobile terminals such as smartphones. A part or all of the processing of the API server 102 may be realized in the client 106, or a part or all of the processing of the client 106 may be realized in the API server 102. A part or all of the processing of the API server 102 may be realized in the cloud server 104, or a part or all of the processing of the cloud server 104 may be realized in the API server 102.
[0025] [Scenario creation process] In the information processing system 100, to automate processing for a web page, it is necessary to store the processing as a scenario including programs, codes, data, etc., which are in a format that can be automatically executed by a computer, and to execute the automated processing according to this scenario. Hereinafter, RPA data (Robotic Process Automation Data) including programs, codes, data, etc., which are in a format that can be automatically executed by a computer, is called a scenario. For example, processing for a web browser can be stored as a scenario that can be executed by an application such as Selenium.
[0026] Hereinafter, a process of storing a scenario to automate the processing of a web page by the information processing system 100 in this embodiment will be described with reference to the flowchart in Fig. 5. The processing of a web page means operations that can be performed on the web page, such as operations on elements that constitute the web page (e.g., cursor movement, clicking, etc.), input of information such as text, etc., and the processes associated therewith.
[0027] In step S10, a startup process of an application for storing a scenario is performed. Through the process in this step, the information processing system 100 functions as a startup processing means. The client 106 executes a client program stored in the storage unit 32 to start up the application for storing a scenario.
[0028] In step S12, a process is performed to display a first display unit including an editing section for editing the content to be automated. Through the process in this step, the information processing system 100 functions as a first display unit display means. With the start of the application in step S10, the first display unit including an editing section for editing the content to be automated is displayed on the output unit 36 of the client 106.
[0029] 6 shows an example of the display of the first display section 200. The first display section 200 includes an option display area 202, a process content editing area 204, and a process content input area 206.
[0030] The option display area 202 is an area showing options of the process to be automated. The user can add a new process to be automated by using the input unit 34 to select one of the options displayed in the option display area 202 (for example, by clicking the option using the mouse, etc.). The options of the process include processes associated with operations on the web browser and web pages. Examples of processes on the web browser and web pages include an operation and the process of opening a web page specified by a URL input by the user, a process of updating a web page in an active window, an operation and the process of moving a cursor to an area specified by the user on a web page, an operation and the process of clicking an area on a web page where the cursor is located, and the like. However, the processes on the web browser and web pages are not limited to these, and other processes may be options.
[0031] The processing options may also be processing for a native application used locally. In this specification, the term "native application" refers to an application that performs arithmetic processing in a processing means inside the terminal. Specifically, there are word processing applications, spreadsheet applications, etc.
[0032] The process content editing area 204 is an area for displaying and editing the contents of the process to be automated. That is, the process content editing area 204 is an area for displaying the process stored as a scenario. The process content editing area 204 is preferably for displaying the process stored as a scenario in a flowchart format for each step. The contents of the process to be automated are stored as a scenario in which each operation or each process is arranged as a step in the order in which it is to be automatically performed. For example, a process corresponding to an option selected in the option display area 202 is displayed in the process content editing area 204 and added to the scenario as a process to be automated. Also, as described later, an operation performed by the user on the second display unit displaying a web page or a process performed on the second display unit is displayed in the process content editing area 204 and added to the scenario as a process to be automated. Also, the user can edit the contents of the process displayed in the process content editing area 204 by using the input unit 34. Examples of editing the contents of the process include changing the order of the processes, changing the data used in the processes, and changing the parameters required for the processes. However, editing the contents of the process is not limited to these editing, and may be any editing of a scenario for the process to be automated.
[0033] The processing content input area 206 is an area for inputting information necessary for automation, such as data and parameters, when editing the contents of the processing to be automated. The processing content input area 206 displays an input interface image for inputting information necessary for the processing to be edited in the processing content editing area 204. The user uses the input unit 34 to input the necessary information into the processing content input area 206 and then confirms the information, thereby setting the processing to be stored as a scenario.
[0034] In this embodiment, the option display area 202, the processing content editing area 204, and the processing content input area 206 are displayed simultaneously on one screen, but they may be displayed spatially or temporally separately. For example, the option display area 202, the processing content editing area 204, and the processing content input area 206 may be displayed as separate windows. Also, for example, each of the option display area 202, the processing content editing area 204, and the processing content input area 206 may be displayed as a window that pops up only when necessary.
[0035] For example, when registering a process to open a web page in a scenario, as illustrated in FIG. 6, by selecting (clicking) "Open a web page" in the option display area 202 (hatched in the figure to indicate that it has been selected), it is displayed in the process content editing area 204 as a new process to be stored in the scenario. At the same time, an input interface image for inputting information related to the process is displayed in the process content input area 206 as the process (step) currently being edited in the process content editing area 204. Here, a name to be given to the process "Open a web page", a URL for identifying the target web page, and an image for inputting options for the process to open the web page are displayed. When the execute button is clicked with the name "Open page A" and the URL "https: / www.xxx", the process (step) "Open a web page" to be edited in the process content editing area 204 is given the name "Open page A", and the process of opening the web page https: / www.xxx is stored as a scenario.
[0036] By repeating such operations, a scenario in which the processes to be automated are arranged in chronological order as steps is stored in storage unit 32. In the present embodiment, a process of opening a web page and storing the processes on that web page as a scenario will be described below.
[0037] When options for the process to be automated are displayed in option display area 202, an explanation of the meaning of the option may be provided. For example, as shown in Fig. 7, when an option is an operation to open a web page, moving the cursor over the option may pop up video area 202a that displays a video explaining the meaning of the option "Go to the site specified by the URL". For the processes of other options, explanations may be displayed in the form of video in video area 202a in a similar manner.
[0038] By explaining the processing that is executed when an option is added to a scenario in this manner, the user can easily understand which option should be added to the scenario in order to execute the required processing.
[0039] Furthermore, for options selected in the option display area 202 and added to a scenario, options that are likely to be used next may be preferentially displayed in the option display area 202. In this case, as shown in Fig. 8, options are associated with each option in order of likelihood of being selected next and stored in an option database, and the option database is referenced to display the option associated with the option added to the scenario in the option display area 202 as the option most likely to be selected next. At this time, it is preferable to display the options in the option display area 202 in order of likelihood of being selected next. Also, options may be determined in order of likelihood of being selected next by machine learning or the like.
[0040] Since there may be several hundred options for automated processing, ease of use for the user can be improved by preferentially displaying options that are likely to be used.
[0041] In step S14, a process of acquiring source code for displaying a webpage to be automated is performed. The process in this step causes information processing system 100 to function as a code acquisition means. When a URL of a webpage to be automated is specified in step S12, processing unit 30 accesses API server 102 via information communication network 108 to acquire source code of the webpage identified by the specified URL.
[0042] In step S16, a process is performed to embed a code for displaying options of selectable processes in the web page to be automated. The process in this step causes the information processing system 100 to function as a code embedding means. The processing unit 30 analyzes the source code of the web page acquired in step S14, and embeds a code for displaying, in a menu format, processes to be performed on tabs that can be processed in the web page in the source code.
[0043] In step S18, a process is performed to display a second display unit that displays a web page to be automated. Through the process in this step, the information processing system 100 functions as a second display unit display means. The processing unit 30 displays a web page corresponding to the source code in which the code for menu display is embedded in step S16 on the web browser as the second display unit. The web browser for displaying the web page may be an existing browser or may be a dedicated browser in the information processing system 100.
[0044] 9 shows an example of the display of the second display unit 300. When the processing unit 30 receives source code specified by a URL (in this example, https: / www.xxx) from the API server 102, the processing unit 30 embeds a code for displaying a menu in the source code and displays it as the second display unit 300.
[0045] For example, in the second display unit 300 shown in Fig. 9, by moving cursor 302 to an image area where processing is possible ("icon X" in the figure) and right-clicking, a menu image 304 is displayed that displays possible processing options for the object called icon X based on the embedded code, as shown in Fig. 10. The user can use the input unit 34 to select a desired processing option from the options displayed as menu image 304.
[0046] Here, the object refers to an object whose position on the screen needs to be specified in the process to be automated. The object can be, for example, an icon, a button, or text on a web page.
[0047] It is preferable to simultaneously display the first display section 200 and the second display section 300. In this case, the window displaying the first display section 200 and the window displaying the second display section 300 may be displayed side by side, or may be displayed partially or entirely overlapping each other. In other words, it is sufficient that the first display section 200 and the second display section 300 are displayed in such a manner that they can be immediately operated by switching the windows. Note that the first display section 200 and the second display section 300 may be displayed separately in space or time.
[0048] In step S20, a process for storing the process for the web page is performed. Through the process in this step, the information processing system 100 functions as a scenario storage means. When one of the options in the menu image 304 is selected, the process represented by that option is stored as a scenario.
[0049] Specifically, when the user selects one of the options from the menu image 304 displayed on the second display unit 300 using the input unit 34, a process to be stored as a scenario is added and displayed in the process content editing area 204 of the first display unit 200. For example, as shown in FIG. 11, the user moves the cursor 302 to an option "click" in the menu image 304 and clicks the mouse. As a result, as shown in FIG. 12, a new object selection "click icon X" and a process for the object are added as a scenario to the process content editing area 204 of the first display unit 200, and information indicating the content of the process is displayed in the process content input area 206. Therefore, the user can store the process for the web page displayed on the second display unit 300 as a scenario by editing and confirming the content displayed on the first display unit 200.
[0050] In this embodiment, the menu image 304 is displayed to allow the user to select a process, but it is also possible to directly operate an object on the web page displayed on the second display unit 300, thereby acquiring the object and the contents of the operation performed on that object and recording them as a scenario.
[0051] In step S22, a process of setting a condition for identifying an object in processing according to a scenario is performed. Through the process in this step, the information processing system 100 functions as a condition setting unit.
[0052] In this embodiment, a plurality of conditions for identifying an object can be set for one object. That is, a user can set a plurality of conditions for selecting a target object when executing an automated process according to a scenario. The conditions for selecting an object preferably include at least one of a CSS selector for an object on a web page, the coordinates on the screen of the object (area on the screen), and an image when the object is displayed.
[0053] For example, as shown in Fig. 12, a condition setting screen including a condition selection area 206a and a condition content setting area 206b is displayed in the processing content input area 206. In the example of Fig. 12, in the condition content setting area 206b, four CSS selectors (CSS selectors 1 to 4), one image recognition, and one image coordinate are listed as options for conditions for selecting an object.
[0054] A CSS selector is a condition for selecting an object on a webpage expressed in HTML, and can be, for example, pattern 1 "id attribute>tag name>relative structure", pattern 2 "tag name>relative structure", pattern 3 "id attribute>class attribute>tag name>relative structure", pattern 4 "tag name>name attribute>relative structure", etc. For example, by selecting an object to be processed on a webpage displayed on the second display unit 300 and specifying processing for that object, a CSS selector showing processing content for that element with that object as an element is automatically added to the conditions.
[0055] Image recognition is a condition for recognizing and selecting an object selected on a web page that is the target of operation as an image. Image data of the object used for image recognition can be obtained by a user selecting an image of the object on the web page and storing it as image data. Image data of the object included in an HTML element of the object on the web page may be stored as image data of the object used for image recognition. Image data may also be automatically generated based on text and its display parameters (font elements, etc.) and stored as image data of the object used for image recognition.
[0056] The image coordinates (area) are conditions for selecting an object selected on a web page to be operated based on the coordinates (area) on the screen. The coordinate data of the object may be stored as coordinate data by a user selecting an image area of the object on the web page. Alternatively, coordinate data for displaying image data of the object included in an HTML element of the object on the web page may be stored.
[0057] In addition, the user can select the conditions to be used for selecting objects in the condition selection area 206a. In this embodiment, as shown in Fig. 12, a toggle button is displayed for each condition, and the user can select a state in which the condition is used (ON) by moving the toggle button to the right, and a state in which the condition is not used (OFF) by moving the toggle button to the left. Fig. 12 shows an example in which the conditions of CSS selector 1, CSS selector 3, image recognition, and image coordinates are used (ON), and the conditions of CSS selector 2 and CSS selector 4 are not used (OFF).
[0058] It is preferable to set the initial state of each condition to a state in which the condition is used (ON). In this case, for conditions that the user does not think need to be used, the condition may be set to a state in which the condition is not used (OFF) in the condition selection area 206a.
[0059] In addition, in the present embodiment, the selection of conditions is performed using toggle buttons, but other selection methods may be applied. For example, instead of toggle buttons, check boxes, on / off buttons, etc. may be used to select conditions.
[0060] The conditions for identifying an object are stored as a condition database for each object that is the target of an automated process in the storage unit 32. For example, in the case of the example shown in Fig. 12, a condition database as shown in Fig. 13 is stored.
[0061] By repeating the above steps S18 and S22, the processes to be automated can be stored in sequence as scenarios.
[0062] [Scenario execution process] It is possible to automate processes including operations on websites, etc., according to the scenario recorded in the above-mentioned scenario creation process. Hereinafter, a process of automatically executing processes according to a scenario by the information processing system 100 in this embodiment will be described with reference to the flowchart in Fig. 14.
[0063] The scenario execution process is performed according to the scenario at the date and time set as a user instruction or schedule. At that time, job information such as ID, password, OS authentication information, etc. may be requested to automate the process. The scenario execution process that ensures security by using this job information will be described later.
[0064] In step S30, a startup process of an application for executing the scenario is performed. Through the process in this step, the information processing system 100 functions as a startup processing means. The client 106 executes a client program stored in the storage unit 32 to start an application for automatically executing processing according to the scenario.
[0065] At this time, before executing the scenario, job information such as an ID, password, authentication information for the OS, etc. may be requested. By requesting such job information, the security of automating processing according to the scenario can be improved.
[0066] In step S32, a process for displaying a webpage that is a target of the automated process is performed. The process in this step causes the information processing system 100 to function as a webpage display means. The processing unit 10 reads out the URL of the webpage that is the target of the step, "open a webpage," stored as a scenario, and accesses the API server 102 via the information and communication network 108 to obtain the source code of the webpage identified by the specified URL. Then, as shown in FIG. 9, the webpage is displayed.
[0067] In step S34, the web page is processed. The information processing system 100 functions as a scenario execution means by the processing in this step. The processing unit 10 automatically identifies an object to be processed and processes the object according to the scenario.
[0068] The object identification process is performed based on the conditions set to the state (ON) used in step S22. When the processing unit 10 reads the next processing content from the scenario, it starts the process of identifying the object to be processed. For each object, an object that satisfies at least one of the conditions set to the state (ON) used in step S22 is selected on the web page displayed in step S32.
[0069] If the condition is a CSS selector, the HTML element of the webpage defined as the processing target in the CSS selector is searched from the webpage that is the target of the automation process. If the HTML element is included in the webpage, the HTML element is identified as the object to be processed. If the condition is image recognition, image data stored for image recognition is read out, and an image area corresponding to the image data is searched from the webpage that is the target of the automation process. If the image area is included in the webpage, coordinates on the screen corresponding to the image area are obtained, and an HTML element of the webpage corresponding to the coordinates is identified as the object to be processed. If the condition is image coordinates (area), an HTML element of the webpage located at the image coordinates (area) set as the condition in the webpage that is the target of the automation process is searched. If an HTML element of the webpage that can be processed exists in the image coordinates (area), the HTML element of the webpage corresponding to the image coordinates (area) is identified as the object to be processed.
[0070] When multiple conditions are set for an object, the object identification process is performed in order until any one of the multiple conditions is satisfied. When any one of the conditions is satisfied and an object to be processed is identified, the object identification process is terminated.
[0071] Here, if all the conditions set to the state (ON) used for identifying the object are not satisfied, a process may be performed to display information indicating that the object targeted for the automated process could not be identified to inform the user. Also, the satisfied conditions among the conditions for identifying the object may be displayed to inform the user.
[0072] When the object to be processed is specified, the processing unit 10 executes the process recorded in the scenario for the object. If the scenario includes further processes to be automated, step S34 may be repeated.
[0073] For example, when the process of "clicking icon X" is registered in the scenario, a process of identifying the object "icon X" to be processed is performed first. For example, by referring to a condition database stored in the storage unit 32 as shown in FIG. 13, it is checked whether an object that satisfies any of the conditions that are set to ON exists in the web page. Specifically, it is confirmed in order whether condition 1 (CSS selector 1), condition 3 (CSS selector 3), condition 5 (image recognition), and condition 6 (image coordinates) that are set to ON as conditions for identifying "icon X" are satisfied, and when an object that satisfies any of the conditions exists, the object is identified as "icon X". In other words, when an object that satisfies at least one of the conditions that are set to ON is found, the object is identified as "icon X". Then, a process of clicking on the "icon X" is automatically performed. If there is no object that satisfies the conditions on the website, information indicating that the object to be the target of the automated process could not be identified is displayed to inform the user.
[0074] The automated processing based on the scenario may be performed by the cloud server 104 via the information and communication network 108, or may be performed by the client 106 instead of the cloud server 104. When the processing is performed by the cloud server 104, processing can be realized that is not dependent on the presence or absence of a power source for the client 106. When the processing is performed by the client 106, processing of web pages such as an in-house site that cannot be accessed from outside via the information and communication network 108 can also be automated. It is preferable that the information processing system 100 be able to switch between the processing by the cloud server 104 and the processing by the client 106.
[0075] In addition, in the present embodiment, the target is a process in a web browser, but the target is not limited to this. The target of the process may be other processes such as a native application used locally.
[0076] [Automated processing] Hereinafter, a method for securely automating processing using security information by the information processing system 100 according to this embodiment will be described.
[0077] In this embodiment, a method is described in which security information including passwords and the like of users who use the information processing system 100 is registered, and processing automation is performed based on instructions from users who belong to a group that can execute scenarios for automating processing.
[0078] <Registration process> First, a process for securely registering information required for automating a process will be described with reference to the flowchart of FIG.
[0079] In step S40, a process of generating a public key and a private key is performed. Through the process in this step, the information processing system 100 functions as an initialization unit.
[0080] The processing unit 20 of the cloud server 104 generates a public key pk and a private key sk corresponding thereto. The processing unit 20 stores the generated private key sk in the storage unit 22 and transfers the public key pk to the client 106. The public key pk may be transferred to the client 106 by embedding it in a client program (or a client application) executed by the client 106, for example.
[0081] In step S42, a process of accepting user secret information (Master Secret) is performed. Through the process in this step, the information processing system 100 functions as a user secret information acquisition unit.
[0082] The processing unit 30 of the client 106 acquires user secret information from a user who is to automate a process. The user secret information is preferably information known only to a specific user, such as a password or a personal identification number. Specifically, the processing unit 30 accepts input of the user secret information from the user using the input unit 34. For example, user secret information [A, ms] is received from user A.
[0083] In step S44, a process of generating a user key (Master Key) from the user secret information is performed. Through the process in this step, the information processing system 100 functions as a user key generating means.
[0084] The processing unit 30 of the client 106 generates a user key from the user secret information acquired in step S42. For example, an existing key generation method such as PBKDF2 can be applied to generate the user key. For example, a user key [A,mk] for user A is generated from the user secret information [A,ms] acquired from user A.
[0085] In step S46, a process of encrypting the user key is performed. Through the process in this step, the information processing system 100 functions as a user key encryption unit.
[0086] The processing unit 30 of the client 106 encrypts the user key generated in step S44 using the public key pk to generate the first information. For example, an existing encryption algorithm such as DES, RC4, or AES can be applied to encrypt the user key. For example, the processing unit 30 encrypts the user key [A,mk] generated from the user secret information [A,ms] obtained from the user A to generate the first information Enc pk ([A,mk]), where Enc key (XXX) means information obtained by encrypting information XXX using key Key.
[0087] In step S48, the first information obtained by encrypting the user key is transmitted to the cloud server 104 and stored therein. Through the processing in this step, the information processing system 100 functions as a first information storage means. In this embodiment, the user key generation means and the first information storage means function as a first information generation means.
[0088] The processing unit 30 of the client 106 transmits the first information encrypted in step S46 to the cloud server 104 via the communication unit 38. The processing unit 20 of the cloud server 104 receives the first information transmitted from the client 106 via the communication unit 28. The processing unit 20 stores the received first information in the storage unit 22. For example, the first information Enc pk ([A, mk]) is stored in the memory unit 22.
[0089] The processes in steps S42 to S48 are performed for each user who executes the automation of the process. For example, if user B, in addition to user A, belongs to a group of users who execute the automation of the process, a user key [B, mk] is generated from user secret information [B, ms] obtained from user B, and the user key [B, mk] is encrypted to obtain first information Enc pk ([B, mk]). Then, the first information Enc pk ([B, mk]) is transmitted from the client 106 to the cloud server 104 and stored therein.
[0090] In step S50, a process of generating a group key is performed. Through the process in this step, information processing system 100 functions as a group key generating means.
[0091] The processing unit 30 of the client 106 acquires group information known only to the group to which the user permitted to execute the process belongs, and generates a group key from the group information. For example, an existing key generation method such as PBKDF2 can be applied to generate the group key. For example, a group key [G, gk] is generated for the group G to which user A belongs.
[0092] It is assumed that at least one user belongs to each group. That is, the number of users belonging to a group may be multiple or may be one.
[0093] In step S52, a process of encrypting the group key is performed. Through the process in this step, the information processing system 100 functions as a group key encryption means.
[0094] The processing unit 30 of the client 106 encrypts the group key generated in step S50 using the user key generated in step S44 to generate second information. For example, an existing encryption algorithm such as DES, RC4, or AES can be applied to encrypt the group key. For example, the processing unit 30 encrypts the group key [G, gk] for group G using a user key [A, mk] for user A belonging to group G to generate second information Enc [A,mk] Generate ([G,gk]).
[0095] In step S54, the second information obtained by encrypting the group key is transmitted to and stored in cloud server 104. Through the processing in this step, information processing system 100 functions as second information storage means. In this embodiment, the group key generation means and the second information storage means function as second information generation means.
[0096] The processing unit 30 of the client 106 transmits the second information encrypted in step S52 to the cloud server 104 via the communication unit 38. The processing unit 20 of the cloud server 104 receives the second information transmitted from the client 106 via the communication unit 28. The processing unit 20 stores the received second information in the storage unit 22. For example, the second information Enc [A,mk] ([G, gk]) is stored in the memory unit 22.
[0097] In step S56, a process of encrypting the job information is performed. Through the process in this step, the information processing system 100 functions as a job information encryption unit.
[0098] The job information is information required to execute a scenario for automating processing. The job information is information required when executing a scenario, such as an ID, a password, and information required for authentication in the OS (such as a token). The processing unit 30 of the client 106 encrypts the job information using the group key generated in step S50 to generate the third information. For example, an existing encryption algorithm such as DES, RC4, or AES can be applied to encrypt the job information. For example, the third information Enc is generated by encrypting the job information [X, xc] using a group key [G, gk] for the group G. [G,gk] Generate ([X,xc]).
[0099] Here, if the group key [G, gk] does not exist in the client 106, the processing unit 30 accesses the cloud server 104 via the communication unit 38 and the communication unit 28 to obtain the second information. Then, the processing unit 30 may receive user secret information input from the user, generate a user key based on the user secret information, and use the user key to decrypt the second information to obtain the group key. For example, when a user A belonging to group G performs processing, the processing unit 30 receives the second information Enc from the cloud server 104. [A,mk] Then, the second information Enc([G, gk]) is obtained by receiving user secret information [A, ms] from user A and generating a user key [A, mk]. [A,mk] ([G, gk]) may be decrypted to obtain the group key [G, gk] for the group G.
[0100] In step S58, the encrypted third information is transmitted to and stored in the cloud server 104. Through the processing in this step, the information processing system 100 functions as a third information storage unit. In the present embodiment, the job information encryption unit and the third information storage unit function as a third information generation unit.
[0101] The processing unit 30 of the client 106 transmits the third information encrypted in step S56 to the cloud server 104 via the communication unit 38. The processing unit 20 of the cloud server 104 receives the third information transmitted from the client 106 via the communication unit 28. The processing unit 20 stores the received third information in the storage unit 22. For example, the third information Enc [G,gk] ([X, xc]) is stored in the memory unit 22.
[0102] At this time, the first information, the second information, and the third information are all encrypted in the communication between cloud server 104 and client 106, and security in the communication of these pieces of information is ensured.
[0103] <New user addition process> A new user can also be added to an already existing group. The process of adding a new user to an already existing group will be described with reference to the flowchart of FIG.
[0104] In step S60, a process of encrypting a request to add a new user is performed. Through the process in this step, the information processing system 100 functions as a new user addition request encryption unit.
[0105] When the processing unit 30 of the client 106 receives a request to add a new user from the input unit 34 or the like, the processing unit 30 performs a process of encrypting the request to add a new user and generating fourth information. That is, when a request to add a new user to an existing group from an existing user who belongs to the group is received, the processing unit 30 encrypts the request (request information) to add the new user using the user key of the existing user. For example, when a user A who belongs to group G makes a request to add a new user B, the processing unit 30 encrypts request information Xb requesting that user B be added to group G using the user key [A,mk] for user A to generate fourth information Enc [A,mk] Generate (Xb).
[0106] In the present embodiment, the fourth information is generated by encryption, but other techniques such as digital signature may be applied.
[0107] In step S62, a process is performed in which the encrypted fourth information is transmitted to and stored in the cloud server 104. Through the process in this step, the information processing system 100 functions as a fourth information storage unit.
[0108] The processing unit 30 of the client 106 transmits the fourth information encrypted in step S60 to the cloud server 104 via the communication unit 38. The processing unit 20 of the cloud server 104 receives the fourth information transmitted from the client 106 via the communication unit 28. The processing unit 20 stores the received fourth information in the storage unit 22. For example, the fourth information Enc [A,mk] (Xb) is stored in the memory unit 22.
[0109] At this time, the fourth information is encrypted in communication between cloud server 104 and client 106, and security of the information is ensured.
[0110] In step S64, the fourth information is decrypted to confirm the request from the user. Through the process in this step, the information processing system 100 functions as a request confirmation means.
[0111] First, the processing unit 20 of the cloud server 104 obtains a user key of an existing user that is already stored in the storage unit 22. Then, the processing unit 20 uses the user key to decrypt the fourth information to confirm the request to add a new user. For example, the processing unit 20 uses a private key sk held in the cloud server 104 to decrypt the first information Enc already stored in the storage unit 22. pk ([A, mk]) to obtain the user key [A, mk] of user A. Then, the fourth information Enc received in step S62 is decrypted using the user key [A, mk]. [A,mk] (Xb) is decrypted to extract the request information Xb.
[0112] In step S66, a process for obtaining a group key is performed. Through the process in this step, the information processing system 100 functions as a group key obtaining unit.
[0113] The processing unit 20 of the cloud server 104 reads out the second information obtained by encrypting the group key already stored in the storage unit 22, and decrypts the second information using the user key of an existing user who belongs to the group to obtain the group key. For example, the second information Enc [A,mk] ([G, gk]) and uses the user key [A, mk] of user A who belongs to group G to obtain the second information Enc [A,mk] Decrypt ([G, gk]) to obtain the group key [G, gk] for group G.
[0114] In step S68, the group key is encrypted with the user key of the newly added user and stored. Through the processing in this step, the information processing system 100 functions as a group key encryption means.
[0115] The processing unit 20 of the cloud server 104 encrypts the group key acquired in step S66 using the user key of the newly added user to generate second information and store it in the storage unit 22. Through the processing in this step, the information processing system 100 functions as a group key encryption means.
[0116] The processing unit 20 of the cloud server 104 encrypts the group key acquired in step S66 using the user key of the newly added user to generate second information. For example, an existing encryption algorithm such as DES, RC4, or AES can be applied to encrypt the group key. For example, when a user B is newly added to a group G, the processing unit 20 encrypts the group key [G, gk] for the group G using the user key [B, mk] for the user B to generate the second information Enc [B,mk] ([G, gk]) is generated and stored in the storage unit 22.
[0117] It is assumed that the user key of the newly added user is stored in advance in storage unit 22 of cloud server 104, similar to steps S42 to S48 above.
[0118] By the above process, the second information can be stored, which is the group key for the group to which the new user has been added, encrypted using the user key for the new user. Therefore, when the new user executes automation of a process according to a scenario belonging to the group, the group key can be obtained using the user key of the new user, and the new user can execute automation of a process using the group key.
[0119] <Automating processing on cloud servers> Next, a process of automating processing using information registered in cloud server 104 will be described with reference to the flowchart in Fig. 17. Execution of the automation of processing in cloud server 104 starts the following processing when, for example, a user belonging to a group having authority instructs cloud server 104 to automate processing, or when the start date and time of the automation of processing preset by a user belonging to a group having authority is reached.
[0120] In step S70, a process for acquiring information required for execution is performed. Through the process in this step, the information processing system 100 functions as an execution initialization unit.
[0121] The processing unit 20 of the cloud server 104 reads and acquires from the storage unit 22 the private key, first information obtained by encrypting the user key of the user who instructed the execution of the automation of the process, second information obtained by encrypting the group key of the group to which the user belongs, and third information obtained by encrypting job information for executing a scenario for the group. For example, when automation of the process is executed by user A according to a scenario for group G, the first information Enc pk([A, mk]), the second information Enc [A,mk] ([G, gk]), the third information Enc [G,gk] ([X, xc]) is read and acquired from the storage unit 22.
[0122] In step S72, a process of acquiring a user key is performed. Through the process in this step, the information processing system 100 functions as a user key decryption means.
[0123] The processing unit 20 of the cloud server 104 decrypts the first information using the private key sk acquired in step S70 to obtain a user key. For example, the first information Enc pk Decrypt ([A,mk]) to obtain the user key [A,mk].
[0124] In step S74, a process of acquiring the group key is performed. Through the process in this step, the information processing system 100 functions as a group key decryption means.
[0125] The processing unit 20 of the cloud server 104 decrypts the second information acquired in step S70 using the user key acquired in step S72 to obtain a group key. For example, the processing unit 20 decrypts the second information Enc [A,mk] Decrypt ([G, gk]) to obtain the group key [G, gk].
[0126] In step S76, a process of acquiring job information is performed. Through the process in this step, the information processing system 100 functions as a job information decoding unit.
[0127] The processing unit 20 of the cloud server 104 decrypts the third information acquired in step S70 using the group key acquired in step S74 to obtain the job information. For example, the third information Enc [G,gk] Decrypt ([X, xc]) to obtain job information [X, xc] for automatically executing processing according to the scenario of group G.
[0128] In step S78, a process for automating the process according to the scenario is performed. Through the process in this step, the information processing system 100 functions as a process execution unit.
[0129] The processing unit 20 of the cloud server 104 starts automating the process according to the target scenario using the job information acquired in step S76. For example, for a scenario for a group G to which a user A belongs, the processing unit 20 automatically performs the process according to the scenario using the job information [X, xc] required to execute the scenario.
[0130] <Automating processes on the client> Next, a process for automating processing using information registered in client 106 will be described with reference to the flowchart in Fig. 18. Execution of the automation of processing in client 106 starts the following process, for example, when a user belonging to an authorized group issues an instruction to client 106 to automate processing, when the start date and time of the automation of processing preset by a user belonging to an authorized group is reached, etc.
[0131] In step S80, a process for acquiring information required for execution is performed. Through the process in this step, the information processing system 100 functions as an execution initialization unit.
[0132] The processing unit 30 of the client 106 accesses the cloud server 104 and requests second information obtained by encrypting a group key of a group to which the user belongs, which is stored in advance in the storage unit 22 of the cloud server 104, and third information obtained by encrypting job information for executing a scenario for the group. The cloud server 104 reads the second information and the third information from the storage unit 22 via the communication units 28 and 38 and transmits them to the client 106. For example, when user A executes automation of processing according to a scenario for group G, the second information Enc [A,mk] ([G, gk]), the third information Enc [G,gk] ([X, xc]) is sent from the cloud server 104 to the client 106.
[0133] At this time, the second information and the third information are both encrypted, and security is ensured in the communication between cloud server 104 and client 106.
[0134] In step S82, a process of generating a user key is performed. Through the process in this step, the information processing system 100 functions as a user key generating means.
[0135] The processing unit 30 of the client 106 accepts input of user secret information from the user. Then, a process of generating a user key from the user secret information is performed. For example, an existing key generation method such as PBKDF2 can be applied to generate the user key. For example, a user key [A, mk] for user A is generated from user secret information [A, ms] acquired from user A.
[0136] In step S84, a process of acquiring the group key is performed. Through the process in this step, the information processing system 100 functions as a group key decryption means.
[0137] The processing unit 30 of the client 106 decrypts the second information acquired in step S80 using the user key acquired in step S82 to obtain a group key. For example, the second information Enc [A,mk] Decrypt ([G, gk]) to obtain the group key [G, gk].
[0138] In step S86, a process of acquiring job information is performed. Through the process in this step, the information processing system 100 functions as a job information decoding unit.
[0139] The processing unit 30 of the client 106 decrypts the third information acquired in step S80 using the group key acquired in step S84 to obtain the job information. For example, the third information Enc [G,gk] Decrypt ([X, xc]) to obtain job information [X, xc] for automatically executing processing according to the scenario of group G.
[0140] In step S88, a process for automating the process according to the scenario is performed. Through the process in this step, the information processing system 100 functions as a process execution unit.
[0141] The processing unit 30 of the client 106 starts automating the process according to the target scenario using the job information acquired in step S86. For example, for a scenario for group G to which user A belongs, the processing unit 30 automatically performs the process according to the scenario using the job information [X, xc] required to execute the scenario.
[0142] As described above, the information processing system 100 can provide a general-purpose process automation mechanism and a mechanism that can automatically execute processes in a secure state. [Explanation of symbols]
[0143] 10 processing unit, 12 memory unit, 14 input unit, 16 output unit, 18 communication unit, 20 processing unit, 22 memory unit, 24 input unit, 26 output unit, 28 communication unit, 30 processing unit, 32 memory unit, 34 input unit, 36 output unit, 38 communication unit, 100 information processing system, 102 API server, 104 cloud server, 106 client, 108 information communication network, 200 first display unit, 202 option display area, 202a video area, 204 processing content editing area, 206 processing content input area, 206a condition selection area, 206b condition content setting area, 300 second display unit, 302 cursor, 304 menu image.
Claims
1. An information processing system that automatically executes a process according to a scenario created for automating a target process, a first information generating means for generating first information by encrypting a user key generated from user information acquired from a user; a second information generating means for generating second information by encrypting a group key generated from group information related to a group to which one or more users belong, using the user key; a third information generating means for generating third information by encrypting job information required for executing the scenario using the group key; an execution means for automatically executing a process according to the scenario by sequentially decrypting the first information, the second information, and the third information, and automatically executing a process according to the scenario using the job information obtained by the decryption, when the process is automatically executed according to the scenario; An information processing system comprising:
2. 2. The information processing system according to claim 1, Includes a client and a server, the process in the first information generating means is executed by the client, and the first information is registered in the server via an information communication network; the process in the second information generating means is executed by the client, and the second information is registered in the server via an information communication network; the process in the third information generating means is executed by the client, and the third information is registered in the server via an information communication network; An information processing system, wherein the processing in said execution means is executed in said client or said server.
3. 3. The information processing system according to claim 2, The information processing system, wherein the server is a cloud server.
4. 4. The information processing system according to claim 2, The first information generating means generates the first information by encrypting the user key using a public key in the client; The information processing system according to claim 1, wherein the execution means decrypts the first information by using a private key corresponding to the public key in the server.
5. 4. The information processing system according to claim 2, The information processing system according to claim 1, wherein the execution means decrypts the first information by using the user key generated by the client using the user information.
6. The information processing system according to any one of claims 1 to 5, When registering another user to the group, the first information generating means generates the first information for the different user by encrypting a user key generated from user information acquired from the different user; The information processing system according to claim 1, wherein the second information generating means generates the second information by encrypting the group key using the user key for the other user.
7. The information processing system according to any one of claims 1 to 6, 1. An information processing system comprising: a process automation schedule that is set in advance; and an execution means that executes the process automation in accordance with the schedule.
8. An information processing program that automatically executes processing according to a scenario created to automate a target process, Computer, a first information generating means for generating first information by encrypting a user key generated from user information acquired from a user; a second information generating means for generating second information by encrypting a group key generated from group information related to a group to which one or more users belong, using the user key; a third information generating means for generating third information by encrypting job information required for executing the scenario using the group key; an execution means for automatically executing a process according to the scenario by sequentially decrypting the first information, the second information, and the third information, and automatically executing a process according to the scenario using the job information obtained by the decryption, when the process is automatically executed according to the scenario; and causing the information processing program to function as described above.
9. An information processing method for automatically executing a process according to a scenario created for automating a target process, comprising: a first information generating step of generating first information by encrypting a user key generated from user information acquired from a user; a second information generating step of generating second information by encrypting, using the user key, a group key generated from group information related to a group to which one or more users belong; a third information generating step of encrypting job information required for executing the scenario using the group key to generate third information; an execution step of, when automatically executing a process according to the scenario, sequentially decrypting the first information, the second information, and the third information, and automatically executing a process according to the scenario using the job information obtained by the decryption; An information processing method comprising:
Citation Information
Patent Citations
Database access system
JP2004234344A
Data processor
JP2006345261A
Encryption key management program and data management system
JP2014127721A
Operation automation device
JP2018116394A
Apparatus, method and program for automating business process accompanied with operation for in-office server on internal network
JP2020092400A
