Image processing device, information processing terminal, control method, and program

Abstract

To prevent authentication information automatically inputted in an authentication screen displayed in an image processing device from leaking to a third party by executing an RPA when remotely operating the image processing device from an information processing terminal.SOLUTION: An image processing device 2 includes a display part 5a for displaying an operation screen, a remote operation reception part 26 for transmitting the operation screen displayed in the display part 5a to an information processing terminal 3 and receiving a remote operation to the operation screen by the information processing terminal 3, and an RPA execution part 28 for automatically executing an RPA 17 with a plurality of operation procedures registered in advance on the basis of the remote operation. The RPA execution part 28 makes information automatically inputted in the authentication screen invisible by processing the authentication screen when the authentication screen is displayed in the display part 5a during execution of the RPA 17.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an image processing apparatus, an information processing terminal, a control method, and a program.

Background Art

[0002] Conventionally, in order to prevent authentication information such as a password from leaking to a third party when a user inputs the authentication information on an operation panel, a technique is known in which the arrangement of numeric keys displayed on an operation screen is randomly changed (for example, Patent Documents 1 and 2). In this conventional technique, since the arrangement of numeric keys is randomly changed each time, even if a third party observes the movement of the user's hand while the user is inputting authentication information, it is impossible to recognize what information has been input.

[0003] In recent years, image processing apparatuses such as MFPs (Multifunction Peripherals) have a remote panel function. The remote panel function is a function that, when detecting access from an external information processing terminal, provides the same screen as the operation screen displayed on the operation panel to the information processing terminal and accepts remote operations by the information processing terminal.

[0004] By installing the remote panel function in an image processing apparatus, there is an advantage that an administrator or a service technician can change the settings of the image processing apparatus by remote operation using an information processing terminal without going to the installation location of the image processing apparatus. Also, with the recent spread of remote work, there is an advantage that a user can use the image processing apparatus by remote operation while staying at home.

[0005] Furthermore, in recent years, there has been growing interest in improving work efficiency by utilizing Robotic Process Automation (hereinafter referred to as "RPA"). RPA is software that pre-registers multiple operation procedures and automatically executes these pre-registered procedures based on execution instructions from the user. When administrators, service personnel, or users remotely operate an image processing device, running RPA makes it possible to automate operations on the image processing device, thereby improving work efficiency. [Prior art documents] [Patent Documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2000-99801 [Patent Document 2] Japanese Patent Publication No. 2005-258838 [Overview of the project] [Problems that the invention aims to solve]

[0007] When administrators, service technicians, or users access an image processing device using an information processing terminal and run RPA to automatically perform operations on the image processing device, an authentication screen may appear on the control panel of the image processing device. RPA can automatically input pre-registered authentication information into this authentication screen. The image processing device then updates the authentication screen sequentially based on the authentication information automatically input by the RPA.

[0008] However, when the image processing device is being remotely controlled, there is a possibility that a third party may be near the device. If that third party is viewing the authentication screen, there is a problem in that the authentication information automatically entered by the RPA could be leaked to the third party.

[0009] The present invention was made to solve the above-mentioned problems, and aims to provide an image processing device, an information processing terminal, a control method, and a program that can prevent authentication information from being leaked to a third party even if an authentication screen is displayed during the execution of RPA. [Means for solving the problem]

[0010] To achieve the above objective, the invention according to claim 1 is an image processing apparatus comprising: a display unit that displays an operation screen; a remote operation reception unit that transmits the operation screen displayed on the display unit to an information processing terminal and receives remote operations on the operation screen from the information processing terminal; and an RPA execution unit that automatically executes RPA with a plurality of pre-registered operation procedures based on the remote operations. An RPA registration unit that creates and registers the RPA based on remote operation from the information processing terminal, Equipped with the RPA Registration Department The RPA Registration When the authentication screen is displayed on the display unit, the authentication screen is processed. , via remote operation from the aforementioned information processing terminal the aforementioned authentication screen Enter This configuration is characterized by making the information being conveyed invisible. The invention according to claim 2 is an image processing apparatus comprising: a display unit that displays an operation screen; a remote operation reception unit that transmits the operation screen displayed on the display unit to an information processing terminal and receives remote operations on the operation screen from the information processing terminal; an RPA execution unit that automatically executes an RPA with a plurality of pre-registered operation procedures based on the remote operations; and an RPA registration unit that creates and registers the RPA based on remote operations from the information processing terminal, wherein the RPA execution unit processes the authentication screen to make the information automatically entered into the authentication screen invisible when an authentication screen is displayed on the display unit during the execution of the RPA, and the RPA registration unit processes the authentication screen to make the information entered into the authentication screen invisible when an authentication screen is displayed on the display unit during the registration of the RPA.

[0011] Claim 3 The invention relating to this claim is 2 In the image processing apparatus, the RPA execution unit is configured to disable the authentication screen when it is displayed on the display unit during the execution of the RPA.

[0012] Claim 4 The invention relating to this claim is 2 In the image processing device, the RPA execution unit is configured to hide the display of operation actions for operation buttons included in the authentication screen.

[0013] Claim 5 The invention relating to this claim is 2The image processing apparatus further comprises a display control unit that controls an operation screen to be displayed on the display unit, wherein when the display control unit displays the authentication screen, it randomly arranges a plurality of operation buttons included in the authentication screen, the RPA holds button information relating to the operation buttons to be automatically operated on the authentication screen, and the RPA execution unit, based on the button information, selects an operation button to be automatically operated from among the plurality of operation buttons randomly arranged on the authentication screen and automatically inputs the authentication information.

[0015] The invention according to claim 6 is, 2 In the image processing apparatus, the RPA registration unit is configured to send a command to the information processing terminal to hide the operation trajectory of the pointing device displayed on the information processing terminal when the authentication screen is displayed on the display unit during the creation of the RPA.

[0017] Claim 7 The invention relates to an information processing terminal that can communicate with an image processing device that displays an operation screen, acquires and displays the operation screen, accepts operations on the operation screen and transmits operation information to the image processing device, thereby remotely controlling the image processing device, comprising: a storage unit that stores RPA in which a plurality of operation procedures for the image processing device are pre-registered; and an RPA execution unit that executes the operation procedures automatically by executing the RPA. The RPA registration unit creates and registers the aforementioned RPA, Equipped with the RPA Registration Department The RPA Registration When an authentication screen is displayed in the image processing device, the image processing device processes the authentication screen, and the authentication screen Enter This configuration instructs that the information being communicated be made invisible. The invention according to claim 8 is configured such that, in the information processing terminal of claim 7, the RPA execution unit, when an authentication screen is displayed on the image processing device during the execution of the RPA, instructs the image processing device to process the authentication screen and make the information automatically entered on the authentication screen invisible.

[0018] The invention according to claim 9 is configured such that, in the information processing terminal of claim 8, the RPA execution unit instructs the image processing device to hide the authentication screen when the authentication screen is displayed during the execution of the RPA.

[0019] In the invention according to claim 10, in the information processing terminal of claim 8, the RPA execution unit is configured to instruct to make the display of operation actions on the operation buttons included in the authentication screen non-displayed.

[0020] The invention according to claim 11 is a control method for an image processing system in which an image processing apparatus that displays an operation screen and an information processing terminal can communicate with each other, the information processing terminal acquires and displays the operation screen, receives an operation on the operation screen, and transmits operation information to the image processing apparatus to remotely control the image processing apparatus from the information processing terminal, the method including a storage step of storing an RPA in which a plurality of operation procedures for the image processing apparatus are registered in advance, and an RPA execution step of automatically executing the operation procedures by executing the RPA, The RPA registration step involves creating and registering the aforementioned RPA, and having the RPA Registration step being, during the Registration RPA, when an authentication screen is displayed on the image processing apparatus, processing the authentication screen to make the information to be Enter presented on the authentication screen in a state where it is impossible to visually recognize it, which is a characteristic configuration.

[0021] The invention according to claim 12 is a program executed in an image processing apparatus including a display unit that displays an operation screen, the program causing the image processing apparatus to transmit the operation screen displayed on the display unit to an information processing terminal, and receiving a remote operation on the operation screen by the information processing terminal, and an RPA execution step of automatically executing an RPA in which a plurality of operation procedures are registered in advance based on the remote operation, An RPA registration step in which the RPA is created and registered based on remote operation from the information processing terminal, being Let it be executed such that the Registration RPA step is, during the Registration RPA, when an authentication screen is displayed on the display unit, processing the authentication screen , via remote operation from the aforementioned information processing terminal to make the information to be Enter presented on the authentication screen in a state where it is impossible to visually recognize it, which is a characteristic configuration.

[0022] The invention according to claim 13 is a program executed in an information processing terminal that is able to communicate with an image processing device that displays an operation screen, acquires and displays the operation screen, accepts operations on the operation screen and transmits operation information to the image processing device to remotely control the image processing device, the program comprising: a storage step of storing an RPA in the information processing terminal in which a plurality of operation procedures for the image processing device are pre-registered; and an RPA execution step of executing the RPA to automatically execute the operation procedures. The RPA registration step involves creating and registering the aforementioned RPA, of Let it be executed , the RPA Registration The step is the RPA Registration When an authentication screen is displayed in the image processing device, the image processing device processes the authentication screen, and the authentication screen Enter This configuration instructs that the information being controlled be made invisible. [Effects of the Invention]

[0023] According to the present invention, even if an authentication screen is displayed on the image processing device while RPA is being executed remotely from an information processing terminal, it becomes possible to effectively prevent the authentication information automatically entered on the authentication screen from being leaked to a third party. [Brief explanation of the drawing]

[0024] [Figure 1] This figure shows an example configuration of an image processing system. [Figure 2] This is a block diagram showing an example of the functional configuration of the image processing system in the first embodiment. [Figure 3] This diagram shows the operation screen displayed on the image processing device and the display screen displayed on the display unit of the information processing terminal. [Figure 4] This diagram shows the workflow when creating an RPA (Robotic Process Automation) system. [Figure 5] This diagram illustrates the authentication screens displayed on both the image processing device and the information processing terminal. [Figure 6] This flowchart shows an example of the processing procedure for an image processing device when creating an RPA (Robotic Process Automation) system. [Figure 7] This diagram shows the workflow during RPA execution. [Figure 8] This figure shows an example of how to modify an authentication screen. [Figure 9] This flowchart shows an example of the processing procedure of an image processing device during RPA execution. [Figure 10] This is a block diagram showing an example of the functional configuration of an image processing system in the second embodiment. [Figure 11] This diagram shows the workflow when creating an RPA (Robotic Process Automation) system. [Figure 12] This diagram shows the workflow during RPA execution. [Figure 13] This flowchart shows an example of the processing procedure of an information processing terminal when RPA is executed. [Figure 14] This figure shows an example of hiding the operation action display when authentication information is entered. [Modes for carrying out the invention]

[0025] Preferred embodiments of the present invention will be described in detail below with reference to the drawings. In the embodiments described below, elements common to all are denoted by the same reference numerals, and redundant explanations of these elements will be omitted.

[0026] (First Embodiment) A first embodiment of the present invention will now be described. Figure 1 is a diagram showing an example configuration of an image processing system 1 in the first embodiment of the present invention. This image processing system 1 is configured such that an image processing device 2, which is composed of an MFP or the like, and an information processing terminal 3, which is composed of a personal computer (PC), tablet terminal, smartphone, etc., can communicate with each other via a network 4. The network 4 is a complex network that includes LANs and the internet.

[0027] The image processing device 2 has multiple functions, including copying, scanning, printing, and faxing, and executes jobs specified by the user. This image processing device 2 is equipped with an operation panel 5 that can be operated by the user. Various operation screens are displayed on the operation panel 5 and accept user input. For example, when a user uses the image processing device 2, they configure the job by performing various setting operations on the operation screen displayed on the operation panel 5. After configuring the job, the user can instruct the image processing device 2 to execute the job by operating on the operation panel 5, and execute jobs such as copying jobs.

[0028] Image processing device 2 may have usage permissions set for each user for multiple functions. In this case, if usage permissions are set for the function selected by the user, image processing device 2 will display an authentication screen on the operation panel 5 and perform user authentication. If the user identified through user authentication is a user for whom usage permissions have been set, image processing device 2 will make the function selected by the user available.

[0029] The control panel 5 is also used by administrators and service technicians when configuring or changing settings for the image processing device 2. For example, when the image processing device 2 displays a settings screen that can only be configured by specific users such as administrators and service technicians, it displays an authentication screen on the control panel 5 and performs user authentication. If the user identified through this user authentication is determined to be a specific user such as an administrator or service technician, the image processing device 2 displays a settings screen that can only be configured by that specific user on the control panel 5.

[0030] The image processing device 2 has a remote panel function. The remote panel function, upon detecting access from an external information processing terminal 3, provides the information processing terminal 3 with the same screen displayed on the operation panel 5, allowing for remote operation by the information processing terminal 3. This remote panel function enables administrators and service personnel to change settings on the image processing device 2 remotely using the information processing terminal 3 without having to go to the installation location. Furthermore, users can remotely operate the image processing device 2 from their homes using the information processing terminal 3, enabling them to use the image processing device 2 for teleworking and other remote work situations.

[0031] Furthermore, the image processing device 2 of this embodiment has a function to create an RPA (Robotic Process Automation) with multiple pre-registered operation procedures, and then execute that RPA to automatically execute the pre-registered operation procedures. Therefore, even when a user operates the image processing device 2 remotely, the user's operational burden can be reduced by having the image processing device 2 execute the RPA.

[0032] Figure 2 is a block diagram showing an example of the functional configuration of the image processing system 1. The image processing device 2 includes an operation panel 5, a control unit 10, a storage unit 11, a communication interface 12, a scanner unit 13, a printer unit 14, and a fax unit 15.

[0033] The control panel 5 comprises a display unit 5a and an operation unit 5b. The display unit 5a is composed of a color liquid crystal display or the like and displays various operation screens. The operation unit 5b consists of touch panel keys arranged on the screen of the display unit 5a and push button keys arranged around the screen of the display unit 5a, and accepts user operations. The storage unit 11 is a non-volatile storage device composed of a hard disk drive (HDD) or the like. The storage unit 11 stores the program 16, RPA 17, setting information 19, etc. The control unit 10 comprehensively controls the operation of the image processing device 2. The control unit 10 has a hardware processor such as a CPU (not shown). This hardware processor reads and executes the program 16 stored in the storage unit 11.

[0034] The communication interface 12 allows the image processing device 2 to communicate with the information processing terminal 3 via the network 4, and is composed of, for example, a NIC (Network Interface Card). The scanner unit 13 optically reads the image of a document set by the user and generates image data. The printer unit 14 prints the image onto a sheet such as printing paper based on the image data to be printed and outputs it. The fax unit 15 sends and receives fax data via a public telephone network (not shown in the diagram).

[0035] The hardware processor of the control unit 10 executes program 16, thereby causing the control unit 10 to function as a display control unit 20, an operation reception unit 21, an operation control unit 22, a remote operation reception unit 26, an RPA registration unit 27, and an RPA execution unit 28.

[0036] The display control unit 20 displays an operation screen (including an authentication screen) that the user can operate on the display unit 5a of the operation panel 5. The operation reception unit 21 receives user operations on the operation unit 5b. The operation control unit 22 controls the operation of the image processing device 2 based on user operations, including those of administrators and service personnel.

[0037] When the operation reception unit 21 receives a user operation, it outputs operation information indicating the operation performed by the user to the display control unit 20. As a result, the display control unit 20 updates the operation screen displayed on the display unit 5a to reflect the user's operation.

[0038] Furthermore, the operation reception unit 21 outputs operation information indicating the user's operation to the operation control unit 22. The operation control unit 22 controls the operation of the image processing device 2. The operation control unit 22 includes a user authentication unit 23, a setting management unit 24, and a job control unit 25.

[0039] The user authentication unit 23 is a processing unit that performs user authentication. For example, if the user has permission to use a function selected by the user, the user authentication unit 23 functions in the operation control unit 22. The user authentication unit 23 also functions when a settings screen that can only be configured by specific users, such as administrators or service personnel, is displayed on the display unit 5a. The user authentication unit 23 displays the authentication screen on the display unit 5a via the display control unit 20. The user authentication unit 23 then obtains the authentication information entered on the authentication screen and performs user authentication based on that authentication information.

[0040] The settings management unit 24 manages the settings that are set for the image processing device 2. For example, when settings are made for the image processing device 2 by an administrator or service technician, the settings management unit 24 records those settings as setting information 19 and stores it in the storage unit 11. Then, when the image processing device 2 is operating, the settings management unit 24 reads the setting information 19 from the storage unit 11 and reflects the settings recorded in the setting information 19 to each part.

[0041] Furthermore, when a user configures a job, the configuration management unit 24 reflects that configuration to each unit, enabling the execution of the job specified by the user.

[0042] The job control unit 25 controls the execution of jobs in the image processing device 2. For example, the job control unit 25 drives the scanner unit 13, the printer unit 14, and the fax unit 15 to execute jobs specified by the user.

[0043] The remote control reception unit 26 functions as a web server and, upon detecting access from the information processing terminal 3 via the communication interface 12, communicates with the information processing terminal 3 and accepts remote operations from the information processing terminal 3. The remote control reception unit 26 obtains the operation screen displayed on the display unit 5a from the display control unit 20. The remote control reception unit 26 then converts the operation screen into web page format screen information such as HTML (HyperText Markup Language) and provides the converted screen information to the information processing terminal 3. This allows the information processing terminal 3 to display the same operation screen as the one displayed on the display unit 5a of the operation panel 5. The remote control reception unit 26 obtains operation information for the operation screen from the information processing terminal 3 via the communication interface 12. Upon obtaining the operation information, the remote control reception unit 26 outputs that operation information to the display control unit 20. This allows the display control unit 20 to update the operation screen displayed on the display unit 5a via remote operation from the information processing terminal 3. The remote control reception unit 26 also outputs the operation information obtained from the information processing terminal 3 to the operation control unit 22. As a result, the motion control unit 22 can control the operation of the image processing device 2 by remote operation from the information processing terminal 3.

[0044] The RPA registration unit 27 is a processing unit that creates an RPA by registering multiple operation procedures performed remotely from the information processing terminal 3. When the remote operation reception unit 26 receives an RPA creation instruction from the information processing terminal 3, it activates the RPA registration unit 27. Once the RPA registration unit 27 is activated, an RPA is created based on the operation information subsequently received by the remote operation reception unit 26. That is, the RPA registration unit 27 stores the operation information each time it is acquired from the information processing terminal 3 by the remote operation reception unit 26. The RPA registration unit 27 repeats this operation until it is instructed to terminate RPA creation. When the information processing terminal 3 instructs it to terminate RPA creation, the RPA registration unit 27 generates operation procedure information 18 based on the operation information it has accumulated and stores up to that point, and generates an RPA 17 that records the operation procedure information 18. The RPA registration unit 27 then saves the generated RPA 17 to the storage unit 11. For example, the operation procedure information 18 is written as a script that runs during the execution of the RPA 17.

[0045] The RPA execution unit 28 functions when an RPA execution instruction is received by the remote operation reception unit 26. The RPA execution unit 28 is a processing unit that reads and executes the RPA 17 stored in the storage unit 11 and automatically executes multiple operation procedures based on the operation procedure information 18 recorded in the RPA 17. By automatically executing multiple operation procedures that are pre-registered in the RPA 17, the RPA execution unit 28 can reduce the user's operational burden.

[0046] Next, the information processing terminal 3 comprises a control unit 30, a display unit 31, an operation unit 32, and a communication interface 33. The display unit 31 is a display device composed of a color liquid crystal display or the like. The operation unit 32 consists of a keyboard, mouse, or the like, and accepts user input. The operation unit 32 may also be equipped with touch panel keys located on the screen of the display unit 31. The communication interface 33 allows the information processing terminal 3 to communicate with the image processing device 2 via the network 4, and is composed of, for example, a network interface card (NIC).

[0047] The control unit 30 includes a hardware processor such as a CPU (not shown in the diagram) and a storage unit. The storage unit pre-stores a program to be executed by the hardware processor. The hardware processor reads and executes this program, thereby causing the control unit 30 to function as a browser 34.

[0048] The browser 34 retrieves a web page provided by the web server and displays it on the display unit 31. It also receives user input on the web page via the operation unit 32, generates operation information indicating the user's input, and outputs it to the web server. By accessing the image processing device 2, the browser 34 displays the same operation screen on the display unit 31 as the operation screen displayed on the display unit 5a of the operation panel 5. The browser 34 receives user input on that operation screen, generates operation information indicating the user's input, and sends it to the image processing device 2. This allows the information processing terminal 3 to remotely control the image processing device 2.

[0049] Figure 3 shows the operation screen displayed on the image processing device 2 and the display screen displayed on the display unit 31 of the information processing terminal 3. Figure 3(a) shows an example of the operation screen G10 displayed on the display unit 5a of the image processing device 2. The operation screen G10 shown in Figure 3(a) is an example of the top screen of multiple operation screens displayed on the operation panel 5, and is a screen that prompts the user to select the function to be used. This operation screen G10 displays multiple operation buttons that the user can operate. For example, if a user wants to perform a copy job using the image processing device 2, they should operate the "Copy" operation button displayed on the operation screen G10. Also, if an administrator or service technician wants to perform setting operations on the image processing device 2, they should operate the "Settings Menu" operation button displayed on the operation screen G10.

[0050] Figure 3(b) shows an example of an operation screen G20 displayed on the display unit 31 of the information processing terminal 3. The operation screen G20 shown in Figure 3(b) is a screen displayed by the browser 34. This operation screen G20 includes a display area R1 that displays operation buttons B1 and B2 related to RPA, and a display area R2 that displays the same operation screen G10 as the operation screen G10 displayed on the operation panel 5 of the image processing device 2. The screen including display areas R1 and R2 is generated, for example, by the remote operation reception unit 26 of the image processing device 2. Therefore, the browser 34 can display the operation screen G20 shown in Figure 3(b) on the display unit 31 by displaying the web page received from the image processing device 2 directly on the display unit 31.

[0051] Display area R1 includes operation button B1 for instructing RPA creation and operation button B2 for instructing RPA execution. When instructing the image processing device 2 to create an RPA, the user operates operation button B1 and then operates on the operation screen G10 displayed in display area R2. As a result, the user's operations on operation screen G10 are sequentially recorded in the image processing device 2, and the multiple operations performed by the user are created as a registered RPA. When the operation screen G10 displayed in the image processing device 2 switches to another screen due to the user's operation, the operation screen G10 displayed in display area R2 also switches to another screen. Therefore, by operating on the screen in display area R2, the user can remotely perform operations similar to those performed on the operation panel 5 of the image processing device 2. In addition, when operation button B1 is operated and RPA creation begins, operation button B1 in display area R1 switches to a button for instructing the end of RPA creation. Therefore, when the user wants to end RPA creation, they just need to operate operation button B1 again.

[0052] Furthermore, to instruct the image processing device 2 to execute RPA, the user only needs to operate operation button B2. When operation button B2 is operated, the execution of RPA already stored in the image processing device 2 begins. As a result, multiple operation procedures pre-registered by the user are automatically executed in the image processing device 2. Therefore, the user can have the image processing device 2 execute the desired process without having to perform any operations on the operation screen G10 in the display area R2.

[0053] Figure 4 shows the operation flow when creating an RPA. When a user instructs the information processing terminal 3 to create an RPA, the information processing terminal 3 sends the RPA creation instruction to the image processing device 2. When the image processing device 2 receives the RPA creation instruction from the information processing terminal 3, it activates the RPA registration unit 27 and starts the operation for RPA creation.

[0054] After the user instructs the information processing terminal 3 to create an RPA, the user sequentially performs operations on the operation screen G10 displayed in the display area R2. When the information processing terminal 3 detects an operation by the user, it generates operation information indicating that operation and transmits the operation information to the image processing device 2. For example, the operation information includes the display size and resolution of the display unit 31, the display size and position of the display area R2, coordinate information indicating the position operated by the user, and button information that can identify the operation button operated by the user. Therefore, by analyzing the operation information obtained from the information processing terminal 3, the image processing device 2 can understand which operation buttons were operated by the user operating the information processing terminal 3, and can reflect the user's remote operation in the image processing device 2. In addition, each time the RPA registration unit 27 obtains operation information from the information processing terminal 3, it temporarily stores that operation information. For example, the RPA registration unit 27 temporarily stores the operation information in the storage unit 11 according to the user's operation sequence.

[0055] After performing a series of operations on the image processing device 2, the user instructs the image processing device 2 to finish creating the RPA. This sends an RPA creation completion instruction from the information processing terminal 3 to the image processing device 2. When the RPA registration unit 27 receives the RPA creation completion instruction from the information processing terminal 3, it reads the operation information that it had temporarily stored in the storage unit 11 up to that point, generates operation procedure information 18 that shows multiple operation steps, creates an RPA 17 that includes the operation procedure information 18, and saves it in the storage unit 11. With this, an RPA 17 with multiple operation steps pre-registered is saved in the image processing device 2.

[0056] Incidentally, while the RPA registration unit 27 is creating the RPA 17 based on the user's remote operation, an authentication screen may be displayed on the display unit 5a of the operation panel 5. Figure 5 is an example of the authentication screen G11 displayed on the image processing device 2 and the information processing terminal 3, respectively. Figure 5(a) shows an example of the authentication screen G11 displayed on the display unit 5a of the image processing device 2. The authentication screen G11 shown in Figure 5(a) displays, for example, an authentication information display field that displays authentication information entered by the user, and soft keys such as a keyboard or numeric keypad for the user to enter the authentication information. When the authentication screen G11 is displayed on the display unit 5a of the operation panel 5 during RPA creation, the operation screen G20 shown in Figure 5(b) is displayed on the display unit 31 of the information processing terminal 3. That is, the same authentication screen G11 displayed on the operation panel 5 of the image processing device 2 is displayed in the display area R2 of the operation screen G20. Therefore, the user can enter authentication information such as a password by performing button operations on the soft keys of the authentication screen G11 displayed on the information processing terminal 3. The authentication information entered by the user is recorded character by character as operation information by the RPA registration unit 27. Therefore, when the RPA 17 is created in the image processing device 2, the operation procedure information of the RPA 17 will include the operation procedure for entering the authentication information to authenticate the user.

[0057] Figure 6 is a flowchart showing an example of the processing procedure of the image processing device 2 when creating an RPA. This process is mainly performed by the RPA registration unit 27. When the image processing device 2 detects an RPA creation instruction, it determines whether or not it has obtained operation information from the information processing terminal 3 (step S10). If it has obtained operation information (YES in step S10), it stores that operation information (step S11). If it has not obtained operation information, the process in step S11 is skipped.

[0058] Next, the image processing device 2 determines whether or not the information processing terminal 3 has instructed it to end RPA creation (step S12). If the instruction to end RPA creation has not been given (NO in step S12), the processing by the image processing device 2 returns to step S10, and the process described above is repeated. Through this repetition, operation information acquired sequentially from the information processing terminal 3 is accumulated. On the other hand, if RPA creation is instructed (YES in step S12), the image processing device 2 reads the operation information accumulated up to that point (step S13) and generates operation procedure information 18 (step S14). The image processing device 2 then generates an RPA 17 including the operation procedure information 18 and saves it to the storage unit 11 (step S15). This completes the RPA creation process.

[0059] Next, Figure 7 shows the operation flow during RPA execution. When a user instructs the information processing terminal 3 to execute RPA, the information processing terminal 3 sends an RPA execution instruction to the image processing device 2. When the image processing device 2 receives the RPA execution instruction from the information processing terminal 3, it activates the RPA execution unit 28 and starts the execution of RPA 17.

[0060] When the RPA execution unit 28 starts the execution of RPA 17, it reads the operation procedure information 18 recorded in RPA 17. Based on the operation procedure information 18, the RPA execution unit 28 sequentially performs automated operations on the operation screen G10 displayed on the operation panel 5. Once the automated execution of all operations recorded in the operation procedure information 18 is complete, the RPA execution is terminated.

[0061] As described above, when the RPA execution unit 28 is executing RPA 17, an authentication screen may be displayed on the display unit 5a of the operation panel 5. The RPA execution unit 28 can automatically input authentication information to that authentication screen. However, when the image processing device 2 is executing RPA 17 via remote control from the information processing terminal 3, if a third party is near the image processing device 2, that third party may see the automatically inputted authentication information, potentially leading to the leakage of authentication information. To prevent this, the RPA execution unit 28 monitors the operation screen displayed on the display unit 5a of the operation panel 5 while RPA 17 is being executed. In the process of performing automated operations based on the operation procedure information 18, if the RPA execution unit 28 detects that the operation screen displayed on the display unit 5a has switched to an authentication screen, it processes the authentication screen via the display control unit 20, making the information automatically input to the authentication screen invisible.

[0062] Figure 8 shows an example of how the authentication screen G11 displayed on the display unit 5a can be modified. For example, the RPA execution unit 28 modifies the authentication screen G11 so that the authentication information display field and soft keys included in the authentication screen G11 are hidden. As a result, as shown in Figure 8(a), the authentication screen G11 displayed on the display unit 5a of the operation panel 5 has the display area R4 that displays the authentication information display field and soft keys hidden, making it impossible to see the authentication information automatically entered by the RPA execution unit 28.

[0063] When the authentication screen G11 shown in Figure 8(a) is displayed on the image processing device 2, the operation screen G20 displayed on the information processing terminal 3 becomes the screen shown in Figure 8(b). That is, the portion of the authentication screen G11 displayed in the display area R2 on the information processing terminal 3 corresponding to the display area R4 is hidden, just like on the image processing device 2. As a result, the user using the information processing terminal 3 can confirm that the image content for inputting authentication information on the authentication screen G11 displayed on the image processing device 2 is hidden.

[0064] As shown in Figure 8, the RPA execution unit 28 hides the display area R4 of the authentication screen G11 and then starts automatically inputting authentication information to the authentication screen G11. That is, the RPA execution unit 28 outputs the authentication information to the display control unit 20 and the operation control unit 22, respectively. As a result, the user authentication unit 23 can obtain the authentication information from the RPA execution unit 28 and perform user authentication based on that authentication information, even when no soft keys or other elements are displayed on the display unit 5a.

[0065] The processing of the authentication screen G11 by the RPA execution unit 28 is not limited to the method of hiding the display area R4 where the authentication information display field and soft keys are displayed, as described above. For example, the RPA execution unit 28 may hide the entire authentication screen G11, or it may black out the display screen of the display unit 5a to make the authentication screen G11 invisible. In addition to hiding it, the RPA execution unit 28 may also overlay another image on the authentication screen G11 so that the other image hides the authentication screen G11 and the authentication information automatically entered into the authentication screen G11 is not visible.

[0066] Figure 9 is a flowchart showing an example of the processing procedure of the image processing device 2 during RPA execution. This processing is mainly performed by the RPA execution unit 28. When the image processing device 2 detects an RPA execution instruction, it reads the RPA 17 stored in the storage unit 11 (step S20). At this time, there may be multiple RPA 17s stored in the storage unit 11. In that case, the RPA execution unit 28 displays a list screen of multiple RPA 17s on the information processing terminal 3 via the remote operation reception unit 26 and accepts the user of the information processing terminal 3 to select an RPA 17. The RPA execution unit 28 then reads the RPA 17 selected by the user from the storage unit 11. Once the RPA 17 to be executed is read from the storage unit 11, the RPA execution unit 28 starts executing the read RPA 17 (step S21).

[0067] When the execution of RPA17 begins, the RPA execution unit 28 reads the operation procedure information 18 (step S22). Next, the RPA execution unit 28 performs a determination process on the operation screen G10 displayed on the display unit 5a (step S23) to determine whether the operation screen G10 is the authentication screen G11 or not (step S24). If the operation screen G10 is not the authentication screen G11 (NO in step S24), the processing by the RPA execution unit 28 proceeds to step S26. On the other hand, if the operation screen G10 is the authentication screen G11 (YES in step S24), the RPA execution unit 28 processes the authentication screen G11 to make the authentication information that will be automatically entered into the authentication screen G11 invisible (step S25). In other words, the RPA execution unit 28 processes the authentication screen G11 to make the authentication information invisible before starting the automatic input of authentication information to the authentication screen G11.

[0068] Next, the RPA execution unit 28 performs an automated operation based on the operation procedure information read in step S22 (step S26). At this time, if authentication information is input by the RPA execution unit 28, the authentication screen G11 has already been processed, so even if a third party is near the image processing device 2, it is possible to prevent the authentication information from being leaked to the third party.

[0069] Next, the RPA execution unit 28 determines whether there is a subsequent operation (step S27). If there is a subsequent operation (YES in step S27), it repeatedly executes the processes from step S23 onwards. At this time, if the operation screen G10 has transitioned from the authentication screen G11 to another screen, the display unit 5a will correctly display a screen different from the authentication screen G11. By repeatedly performing the processes from steps S23 to S27, the RPA execution unit 28 can automatically execute the series of operations registered in RPA 17 in the specified order. Conversely, if there is no subsequent operation (NO in step S27), the RPA execution unit 28 terminates the execution of RPA 17 (step S28). This completes the RPA execution process.

[0070] As described above, the image processing device 2 of this embodiment includes a display unit 5a that displays the operation screen G10, a remote operation reception unit 26 that transmits the operation screen G10 displayed on the display unit 5a to an information processing terminal 3 and accepts remote operations on the operation screen G10 from the information processing terminal 3, and an RPA execution unit 28 that automatically executes an RPA 17 with multiple pre-registered operation procedures based on the remote operations from the information processing terminal 3. Furthermore, when the authentication screen G11 is displayed on the display unit 5a during the execution of the RPA 17, the RPA execution unit 28 is configured to process the authentication screen G11 so that the information automatically entered into the authentication screen G11 is not visible. By having such a configuration, the image processing device 2 can prevent the information automatically entered into the authentication screen G11 from being leaked to a third party, even when the authentication screen G11 is displayed during the execution of the RPA 17.

[0071] Furthermore, the display control unit 20 may randomly change the arrangement of the soft keys each time it displays the authentication screen G11 on the display unit 5a of the operation panel 5 in order to improve security. As described above, the operation information recorded in the operation procedure information 18 includes button information that can identify the operation buttons operated by the user. Therefore, even if the arrangement of the buttons on the authentication screen G11 differs each time due to the display control unit 20, the RPA execution unit 28 can select the operation button to be automatically operated from among the multiple operation buttons included in the soft keys based on the button information, and can automatically input the authentication information.

[0072] Furthermore, the above describes an example in which the authentication screen G11 is modified during the execution of RPA17 to make the information automatically entered into the authentication screen G11 invisible. However, it is preferable to prevent third parties from seeing the authentication information as much as possible, even during the creation of RPA17. For example, when the image processing device 2 is remotely controlled by the information processing terminal 3, the movement trajectory of the pointing device of the information processing terminal 3 may also be displayed on the display unit 5a of the image processing device 2. If the movement trajectory of the pointing device is displayed on the display unit 5a, there is a possibility that the authentication information entered into the authentication screen G11 may be seen by a third party. To prevent this, it is preferable that the RPA registration unit 27 sends a command to the information processing terminal 3 to hide the movement trajectory of the pointing device displayed on the information processing terminal 3 when the authentication screen G11 is displayed on the display unit 5a during the creation of RPA17. As a result, the movement trajectory of the pointing device caused by mouse operations, etc., will not be displayed on the information processing terminal 3. As a result, the movement trajectory of the pointing device is no longer displayed on the display unit 5a of the image processing device 2, thus preventing the authentication information entered on the authentication screen G11 from being leaked to a third party.

[0073] (Second Embodiment) Next, a second embodiment of the present invention will be described. In the first embodiment described above, an example was given in which the RPA is stored and executed in the image processing device 2. In this embodiment, an example will be given in which the RPA is stored and executed in the information processing terminal 3.

[0074] Figure 10 is a block diagram showing an example of the functional configuration of the image processing system 1 in this embodiment. The difference between the configuration shown in Figure 10 and the configuration shown in Figure 2 is that the RPA registration unit and the RPA execution unit are provided on the information processing terminal 3 and not on the image processing device 2.

[0075] The information processing terminal 3 has a storage unit 35, which consists of a hard disk drive (HDD) or a solid-state drive (SSD). This storage unit 35 stores a program 36 that is executed by the hardware processor (not shown) of the control unit 30. The storage unit 35 also stores an RPA (Robotic Process Automation) 35. The hardware processor of the control unit 30 reads and executes the program 36 from the storage unit 35, thereby causing the control unit 30 to function as a browser 34, an RPA registration unit 41, and an RPA execution unit 42.

[0076] The browser 34, similar to the first embodiment, accesses the image processing device 2 to obtain a web page provided by the remote operation reception unit 26 and displays the web page on the display unit 31. This web page includes the operation screen G10 displayed on the display unit 5a of the operation panel 5.

[0077] The RPA registration unit 41 has the same functions as the RPA registration unit 27 described in the first embodiment. That is, the RPA registration unit 41 stores the user's operations on the operation screen G10 while the browser 34 is accessing the image processing device 2, and generates operation procedure information 18. The RPA registration unit 41 then generates an RPA 37 including the operation procedure information 38 and stores the RPA 37 in the storage unit 35. The operation procedure information 38 is written as a script that runs, for example, while the RPA 37 is being executed, similar to the operation procedure information 18 in the first embodiment.

[0078] The RPA execution unit 42 has the same functions as the RPA execution unit 28 described in the first embodiment. That is, while the browser 34 is accessing the image processing device 2, the RPA execution unit 42 reads the RPA 37 from the storage unit 35 and performs an automated operation on the operation screen G10 displayed by the browser 34 based on the operation procedure information 38 recorded in the RPA 37.

[0079] Figure 11 shows the operation flow when creating an RPA. When the user instructs the information processing terminal 3 to create an RPA, the RPA registration unit 41 on the information processing terminal 3 functions and starts the operation for RPA creation.

[0080] After the user instructs the information processing terminal 3 to create an RPA, the user sequentially performs operations on the operation screen G10 displayed in the display area R2 of the operation screen G20. When the information processing terminal 3 detects an operation by the user, it generates operation information indicating that operation and transmits the operation information to the image processing device 2. At this time, the RPA registration unit 41 acquires the operation information and temporarily stores it. For example, the RPA registration unit 41 temporarily stores the operation information in the storage unit 35 according to the user's operation sequence.

[0081] After performing a series of operations on the image processing device 2, the user instructs the RPA creation to end. When the RPA registration unit 41 detects the user's instruction to end RPA creation, it reads the operation information that had been temporarily stored in the storage unit 11 up to that point, generates operation procedure information 38 indicating multiple operation steps, creates an RPA 37 including the operation procedure information 38, and saves it in the storage unit 35. With this, an RPA 37 with multiple operation steps pre-registered is saved in the information processing terminal 3.

[0082] Figure 12 shows the operation flow during RPA execution. When the user instructs the information processing terminal 3 to execute RPA, the RPA execution unit 42 on the information processing terminal 3 functions and starts the execution of RPA 37.

[0083] When the RPA execution unit 42 starts the execution of RPA 37, it reads the operation procedure information 38 recorded in RPA 37. Based on the operation procedure information 38, the RPA execution unit 42 sequentially performs automated operations on the operation screen G10 displayed in the display area R2 of the operation screen G20. When the automated execution of all operations recorded in the operation procedure information 38 is completed, the RPA execution is terminated.

[0084] When the RPA execution unit 42 is executing RPA 37, an authentication screen may be displayed on the display unit 5a of the image processing device 2. The RPA execution unit 42 can automatically input authentication information to that authentication screen. However, when the information processing terminal 3 is remotely controlling the image processing device 2 by executing RPA 37, if a third party is near the image processing device 2, that third party may see the automatically inputted authentication information, potentially leading to the leakage of authentication information. To prevent this, the RPA execution unit 42 monitors the operation screen displayed on the display unit 5a of the operation panel 5 while RPA 37 is being executed. The display unit 31 of the information processing terminal 3 displays the same operation screen as the operation panel 5 of the image processing device 2. Therefore, the RPA execution unit 42 can monitor the operation screen displayed on the display unit 5a of the operation panel 5 by monitoring the operation screen G10 displayed on the display unit 31 via the browser 34. In the process of performing automated operations based on the operation procedure information 38, when the RPA execution unit 42 detects that the operation screen G10 displayed on the display unit 31 has switched to the authentication screen G11, it sends a screen processing instruction to the image processing device 2. At this time, the RPA execution unit 42 may instruct the system to hide the authentication screen G11. When the image processing device 2 receives this screen processing instruction, it processes the authentication screen G11 via the display control unit 20, making the information automatically entered into the authentication screen G11 invisible.

[0085] Figure 13 is a flowchart showing an example of the processing procedure of the information processing terminal 3 during RPA execution. This process is mainly performed by the RPA execution unit 42. When the information processing terminal 3 detects an RPA execution instruction from the user, it reads the RPA 37 stored in the storage unit 35 (step S30). At this time, the storage unit 35 may have multiple RPA 37s stored. In that case, the RPA execution unit 42 displays a list screen of multiple RPA 37s via the browser 34 and accepts the user's selection operation for an RPA 37. The RPA execution unit 42 then reads the RPA 37 selected by the user from the storage unit 35. Once the RPA 17 to be executed is read from the storage unit 35, the RPA execution unit 42 starts executing the read RPA 37 (step S31).

[0086] When the execution of RPA37 begins, the RPA execution unit 42 reads the operation procedure information 38 (step S32). Next, the RPA execution unit 42 performs a determination process on the operation screen G10 displayed in the display area R2 (step S33) and determines whether the operation screen G10 is the authentication screen G11 or not (step S34). If the operation screen G10 is not the authentication screen G11 (NO in step S34), the processing by the RPA execution unit 42 proceeds to step S36. On the other hand, if the operation screen G10 is the authentication screen G11 (YES in step S34), the RPA execution unit 42 sends a screen processing instruction to the image processing device 2 (step S35). In other words, the RPA execution unit 42 sends the screen processing instruction before starting the automatic input of authentication information to the authentication screen G11. As a result, the authentication screen G11 displayed on the display unit 5a is processed in the image processing device 2, and the authentication information that is automatically input into the authentication screen G11 becomes invisible.

[0087] Next, the RPA execution unit 42 performs an automated operation based on the operation procedure information 38 read in step S32 (step S36). At this time, if authentication information is input by the RPA execution unit 42, the authentication screen G11 has already been processed, so even if a third party is near the image processing device 2, it is possible to prevent the authentication information from being leaked to the third party.

[0088] Next, the RPA execution unit 42 determines whether there is a subsequent operation (step S37). If there is a subsequent operation (YES in step S37), it repeatedly executes the processes from step S33 onwards. At this time, if the operation screen G10 has transitioned from the authentication screen G11 to another screen, the display unit 5a will correctly display a screen different from the authentication screen G11. By repeatedly performing the processes from steps S33 to S37, the RPA execution unit 42 can automatically execute a series of operations registered in RPA 37 in the specified order. Conversely, if there is no subsequent operation (NO in step S37), the RPA execution unit 42 terminates the execution of RPA 37 (step S38). This completes the RPA execution process.

[0089] As described above, the information processing terminal 3 of this embodiment includes a storage unit 35 that stores RPA 37, which has a plurality of operation procedures for the image processing device 2 pre-registered, and an RPA execution unit 42 that automatically executes the plurality of operation procedures by executing RPA 35. The RPA execution unit 42 is configured such that when the authentication screen G11 is displayed on the image processing device 2 while RPA 37 is being executed, it sends a screen processing instruction to the image processing device 2 to process the authentication screen G11, thereby making the information automatically entered into the authentication screen G11 in a state where it cannot be seen by a third party. With this configuration, the information processing terminal 3 can prevent the information automatically entered into the authentication screen G11 from being leaked to a third party, even when the authentication screen G11 is displayed on the image processing device 2 while RPA 37 is being executed.

[0090] In particular, in this embodiment, operation procedure information 38, which records multiple operation procedures for the image processing device 2, is stored in the information processing terminal 3. Therefore, for example, when an administrator or service technician performs the same configuration work on multiple image processing devices 2, they can perform the configuration work remotely without having to move to the installation location of each image processing device 2, thereby improving work efficiency.

[0091] In this embodiment, the configuration and operation other than those described above are the same as those described in the first embodiment.

[0092] (modified version) Preferred embodiments of the present invention have been described above. However, the present invention is not limited to those described in the above embodiments, and various modifications are applicable.

[0093] For example, in each of the above embodiments, the case in which RPA17 and 37 are executed on either the image processing device 2 or the information processing terminal 3 is illustrated. However, it is not limited to this, and a configuration in which RPA17 and 37 are executed on both the image processing device 2 and the information processing terminal 3 may be adopted. For example, RPA37 executed on the information processing terminal 3 may include an operation procedure that causes the image processing device 2 to execute RPA17. In this case, when RPA37 is executed on the information processing terminal 3, RPA17 can be automatically executed on the image processing device 2. Therefore, for example, if an operation procedure for automatically inputting authentication information to the authentication screen G11 is saved in RPA17 of the image processing device 2, there is no need to save the authentication information on the information processing terminal 3. Thus, there is an advantage in that a highly secure image processing system 1 can be constructed.

[0094] Furthermore, the processing method for the authentication screen G11 may be different from the processing method described in the above embodiment. For example, in the normal state, when a button operation is performed on the soft keys of the authentication screen G11, the display control unit 20 changes the display of the button by displaying an operation action such as an animation for the operated button, as shown in Figure 14(a). However, if such an operation action display is performed during RPA execution, there is a possibility that the button operated by a third party may be identified. Therefore, the processing of the authentication screen G11 during RPA execution may be such that the operation action display is hidden. As a result, even if an operation button is automatically operated during RPA execution, the display of the operated button does not change as shown in Figure 14(b), thus preventing the button operated by a third party from being identified.

[0095] Furthermore, in the above embodiment, when the authentication screen G11 is displayed on the image processing device 2 while the RPA 17,37 is being executed, the authentication screen G11 is processed so that the information automatically entered into the authentication screen G11 is not visible to a third party. However, this is not the only possible configuration. For example, the RPA registration units 27,41 may be configured such that when the authentication screen G11 is displayed on the image processing device 2 while the RPA 17,37 is being created, the authentication screen G11 is processed so that the information entered into the authentication screen G11 is not visible to a third party. In this case, the user can input authentication information using the keyboard of the information processing terminal 3, so even if soft keys are not displayed on the authentication screen G11, the user can manually input the authentication information.

[0096] Furthermore, the programs 16 and 36 described in each of the above embodiments are not limited to those pre-stored in the image processing device 2 or the information processing terminal 3. That is, the programs 16 and 36 executed in the image processing device 2 or the information processing terminal 3 may be the subject of trading on their own. In this case, the programs 16 and 36 may be provided in a manner that allows them to be downloaded via a network such as the Internet, or they may be provided recorded on a computer-readable recording medium such as a CD-ROM. [Explanation of symbols]

[0097] 1. Image Processing System 2 Image Processing Device 3. Information Processing Terminal 5. Control Panel 5a Display section 16,36 Programs 17.37 RPA (Robotic Process Automation) 20 Display Control Unit 26 Remote Control Reception Department 27,41 RPA Registration Department 28,42 RPA Execution Unit

Claims

1. A display unit that shows the operation screen, A remote operation reception unit that transmits the operation screen displayed on the display unit to an information processing terminal and accepts remote operations on the operation screen from the information processing terminal, Based on the aforementioned remote control, an RPA execution unit automatically executes RPA with multiple pre-registered operation procedures, An RPA registration unit that creates and registers the RPA based on remote operation from the information processing terminal, Equipped with, The image processing apparatus is characterized in that, when the RPA registration unit displays the authentication screen on the display unit during the registration of the RPA, it processes the authentication screen to make the information entered into the authentication screen via remote control from the information processing terminal invisible.

2. A display unit that shows the operation screen, A remote operation reception unit that transmits the operation screen displayed on the display unit to an information processing terminal and accepts remote operations on the operation screen from the information processing terminal, Based on the aforementioned remote control, an RPA execution unit automatically executes RPA with multiple pre-registered operation procedures, An RPA registration unit that creates and registers the RPA based on remote operation from the information processing terminal, Equipped with, When the RPA execution unit displays an authentication screen on the display unit during the execution of the RPA, it processes the authentication screen to make the information automatically entered into the authentication screen invisible, The image processing apparatus is characterized in that, when the RPA registration unit displays the authentication screen on the display unit during the registration of the RPA, it processes the authentication screen to make the information entered into the authentication screen via remote control from the information processing terminal invisible.

3. The image processing apparatus according to claim 2, characterized in that the RPA execution unit switches the authentication screen to hidden when the authentication screen is displayed on the display unit during the execution of the RPA.

4. The image processing apparatus according to claim 2, characterized in that the RPA execution unit hides the display of operation actions for operation buttons included in the authentication screen.

5. A display control unit that controls the operation screen displayed on the display unit. Furthermore, When the display control unit displays the authentication screen, it randomly arranges the multiple operation buttons included in the authentication screen. The RPA maintains button information relating to the operation buttons that should be automatically operated on the authentication screen. The image processing apparatus according to claim 2, characterized in that the RPA execution unit selects an operation button to be automatically operated from among the multiple operation buttons randomly arranged on the authentication screen based on the button information, and automatically inputs authentication information.

6. The image processing apparatus according to claim 2, characterized in that the RPA registration unit sends a command to the information processing terminal to hide the operation trajectory of the pointing device displayed on the information processing terminal when the authentication screen is displayed on the display unit during the creation of the RPA.

7. An information processing terminal that can communicate with an image processing device that displays an operation screen, acquires and displays the operation screen, accepts operations on the operation screen and transmits operation information to the image processing device, thereby remotely controlling the image processing device, A storage unit that stores RPA in which multiple operation procedures for the image processing device are pre-registered, The RPA execution unit automatically executes the aforementioned operation procedure by executing the RPA, The RPA registration unit creates and registers the aforementioned RPA, Equipped with, The RPA registration unit is an information processing terminal that, when an authentication screen is displayed on the image processing device during the registration of the RPA, instructs the image processing device to process the authentication screen and make the information entered on the authentication screen invisible.

8. The information processing terminal according to claim 7, wherein the RPA execution unit, when an authentication screen is displayed on the image processing device during the execution of the RPA, instructs the image processing device to process the authentication screen and make the information automatically entered on the authentication screen invisible.

9. The information processing terminal according to claim 8, wherein the RPA execution unit instructs the image processing device to hide the authentication screen when the authentication screen is displayed during the execution of the RPA.

10. The information processing terminal according to claim 8, wherein the RPA execution unit instructs the system to hide the display of operation actions for the operation buttons included in the authentication screen.

11. A control method for an image processing system in which an image processing device that displays an operation screen and an information processing terminal are able to communicate with each other, and the information processing terminal acquires and displays the operation screen, accepts operations on the operation screen and transmits operation information to the image processing device, thereby remotely controlling the image processing device from the information processing terminal, A storage step for storing RPA in which multiple operation procedures for the image processing device are pre-registered, The RPA execution step involves automatically executing the aforementioned operation procedure by executing the RPA, The RPA registration step involves creating and registering the aforementioned RPA, It has, The RPA registration step is a control method characterized in that, when an authentication screen is displayed in the image processing device during the registration of the RPA, the authentication screen is processed to make the information entered into the authentication screen invisible.

12. A program executed in an image processing device equipped with a display unit that displays an operation screen, wherein the image processing device is configured to perform the following: A remote operation reception step includes transmitting the operation screen displayed on the display unit to an information processing terminal and receiving remote operations on the operation screen from the information processing terminal, Based on the aforementioned remote control, an RPA execution step is performed to automatically execute multiple pre-registered operation procedures. An RPA registration step in which the RPA is created and registered based on remote operation from the information processing terminal, Make it run, The RPA registration step is a program characterized in that, when an authentication screen is displayed on the display unit during the registration of the RPA, the authentication screen is modified to make the information entered into the authentication screen via remote operation from the information processing terminal invisible.

13. A program executed on an information processing terminal that can communicate with an image processing device that displays an operation screen, acquires and displays the operation screen, accepts operations on the operation screen and transmits operation information to the image processing device to remotely control the image processing device, wherein the information processing terminal... A storage step for storing RPA in which multiple operation procedures for the image processing device are pre-registered, The RPA execution step involves automatically executing the aforementioned operation procedure by executing the RPA, The RPA registration step involves creating and registering the aforementioned RPA, Make it run, The RPA registration step is a program that, when an authentication screen is displayed on the image processing device during the registration of the RPA, instructs the image processing device to process the authentication screen and make the information entered on the authentication screen invisible.

Images