Information processing system and program

Abstract

To suppress interference between a direct operation and a remote operation on an information processing device while achieving more efficient use of the information processing device than a system that unconditionally restricts remote operation.SOLUTION: In a control unit 11 of an image processing device 10, when a request for job execution is made to the image processing device 10 by remote operation from a remote terminal of a first user, a determination unit 103 determines whether a direct operation is being performed on the image processing device 10 by a second user, and when a direct operation is being performed, a display control unit 104 causes the device to display information for responding to an inquiry about whether the job is to be executed, and when execution of the job is permitted, a job control unit 106 causes the job to be executed.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing system and a program. [Background technology]

[0002] There is known a technology that enables remote operation of the operation screen of the information processing device from a remote terminal by connecting the remote terminal to the information processing device such as a multifunction device that enables printing and reading of documents (for example, Patent Document 1). Such a technology enables remote operation from the remote terminal and direct operation of the operation screen of the information processing device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6071273 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when a direct operation is being performed on the operation screen or the like of the information processing device, the remote operation may be restricted in order to prevent interference between the direct operation and the remote operation. In this case, even if the contents of the direct operation and the remote operation are in a relationship in which they do not interfere with each other, the remote operation may be unconditionally restricted, and the information processing device may not be used efficiently.

[0005] An object of the present invention is to suppress interference between direct operation and remote operation on an information processing device, while achieving more efficient use of the information processing device than a system that unconditionally restricts remote operation. [Means for solving the problem]

[0006] The invention described in claim 1 is an information processing system comprising one or more processors, wherein when a request for execution of a job is made to an information processing device by remote operation from a remote terminal of a first user, the one or more processors inquire of the second user as to whether or not the job should be executed, if a direct operation of the information processing device is performed by a second user, and when the response to the inquiry is that execution of the job is permitted, the one or more processors execute the job. The invention described in claim 2 is the information processing system described in claim 1, characterized in that the one or more processors cause the information processing device to display, as the inquiry, information indicating that the execution request has been made and information for responding to the inquiry. The invention described in claim 3 is the information processing system described in claim 2, characterized in that the one or more processors do not cause the remote terminal to display information for responding to the inquiry. The invention described in claim 4 is the information processing system described in claim 3, characterized in that the one or more processors display information on the remote terminal indicating whether the job can be executed depending on the content of the response to the inquiry. The invention described in claim 5 is the information processing system described in claim 4, characterized in that, when the one or more processors are able to execute the job, information for instructing the execution of the job is displayed only on the information processing device. The invention described in claim 6 is the information processing system described in claim 2, characterized in that the one or more processors decide to reject the job if the response is not made within a predetermined time after information for making the response is displayed on the information processing device. The invention described in claim 7 is the information processing system described in claim 1, characterized in that the one or more processors determine whether the direct operation is being performed based on at least one of sensing information from a sensor that detects the use of the information processing device and authentication information for using the information processing device. The invention described in claim 8 is the information processing system described in claim 7, characterized in that the one or more processors determine whether the direct operation is being performed based on information indicating whether the sensor has detected at least one of a user performing the direct operation on the information processing device and an object being input / output to the information processing device as the sensing information. The invention described in claim 9 is the information processing system described in claim 7, characterized in that the one or more processors determine whether the direct operation is being performed based on information indicating the presence or absence of a user who has been authenticated to use the information processing device as the authentication information. The invention described in claim 10 is an information processing system comprising one or more processors, wherein when a first user remotely operates an information processing device to execute a job, and a second user directly operates the information processing device, when a predetermined condition is satisfied, the one or more processors cause the information processing device to display information for instructing the execution of the job, and cause the information processing device to execute the job in accordance with the instruction to execute the job from the first user. The invention described in claim 11 is the information processing system described in claim 10, characterized in that the one or more processors, as the predetermined condition, cause the information processing device to display information for instructing the execution of the job after receiving the execution request if the direct operation is no longer performed after the execution request is made and before the information processing device receives the execution request. The invention described in claim 12 is the information processing system described in claim 10, characterized in that the one or more processors cause the information processing device to display information for instructing the execution of the job when the predetermined condition is that permission has been obtained for the execution request by remote operation of the first user. The invention described in claim 13 is a program that enables a computer to realize a function of inquiring of a second user as to whether or not to allow the execution of a job when a first user remotely operates an information processing device and a second user is directly operating the information processing device, and a function of executing the job when the response to the inquiry indicates that the execution of the job is permitted. The invention described in claim 14 is a program that enables a computer to realize the following functions: when a first user remotely operates an information processing device to execute a job, and a second user is directly operating the information processing device, when predetermined conditions are satisfied, the information processing device displays information for instructing the execution of the job, and the job is executed in response to an instruction to execute the job from the first user. Effect of the Invention

[0007] According to the present invention of claim 1, when a job execution request is made to the information processing device by remote operation from a remote terminal of a first user, if a direct operation is being performed on the information processing device by a second user, an inquiry is made to the second user as to whether or not to allow the execution of the job. If the answer to the inquiry is that the execution of the job is permitted, the job is executed, and if the execution of the job is not permitted, the job is not executed. This allows the second user to permit remote operations that do not interfere with the direct operation on the information processing device and to exclude remote operations that interfere with the direct operation on the information processing device. As a result, it is possible to efficiently use the information processing device while suppressing interference between the direct operation and remote operation on the information processing device. In other words, since multiple users can simultaneously operate one information processing device in parallel, it is possible to efficiently use limited resources. According to the present invention of claim 2, as an inquiry about permission or denial of job execution, information indicating that an execution request has been made and information for responding to the inquiry are displayed on the information processing device. This allows the second user to respond to the inquiry while understanding that a job execution request has been made by remote operation of another user (first user). According to the present invention of claim 3, information for replying to an inquiry about permission or denial of job execution is not displayed on the remote terminal. This allows the reply to be made only by directly operating the information processing device. As a result, a reply not intended by the second user is suppressed. According to the present invention of claim 4, information indicating whether the job requested from the remote terminal can be executed depending on the content of the response from the second user is displayed on the remote terminal, so that the first user can understand at a glance whether the job can be executed by remote operation. According to the present invention of claim 5, information for instructing the execution of a job requested from a remote terminal is displayed only on the information processing device. This makes it impossible to instruct the execution of a job from a remote terminal, so that it is possible to prevent information output from the information processing device from being leaked to a third party other than the second user. According to the present invention of claim 6, if there is no reply within a predetermined time after the information for replying to the inquiry about permission or denial of the job execution is displayed, the job is rejected. This makes it possible to reduce the time cost that may occur due to no reply to the inquiry. According to the present invention of claim 7, whether or not a direct operation is being performed on the information processing device is determined based on at least one of sensing information from a sensor that detects the use of the information processing device and authentication information for using the information processing device. This makes it possible to select or combine methods for determination. According to the present invention of claim 8, whether or not a direct operation is being performed is determined based on information indicating whether or not the sensor has detected at least one of a user performing a direct operation on the information processing device and an object input / output to / from the information processing device as sensing information of the sensor for using the information processing device. This makes it possible to select or use in combination a sensing target. According to the present invention of claim 9, it is determined whether or not a direct operation is being performed on the information processing device based on information indicating the presence or absence of a user who has been authenticated to use the information processing device as authentication information for using the information processing device. This makes it possible to make a determination based on the presence or absence of a user who has logged in to the information processing device, for example. According to the present invention of claim 10, when a job execution request is made to the information processing device by a remote operation of a first user, if a direct operation is being performed on the information processing device by a second user, when a predetermined condition is satisfied, information for instructing the execution of the job is displayed on the information processing device. Then, the job is executed according to the instruction by the first user. Thereby, a decision on whether or not to permit the job execution request by the remote operation is automatically made. As a result, it is possible to efficiently use the information processing device while suppressing interference between the direct operation and the remote operation on the information processing device. In other words, since multiple users can simultaneously operate one information processing device in parallel, it is possible to efficiently use limited resources. According to the present invention of claim 11, when a direct operation to the information processing device is not performed before the information processing device receives a job execution request after a job execution request is made by a remote operation, information for instructing the execution of the job is displayed on the information processing device after the job execution request is received. This prevents a situation in which a job cannot be executed because there is no one to respond to an inquiry. According to the present invention of claim 12, whether or not to display information for instructing execution of a job on the information processing device is determined based on past results regarding execution requests made by remote operations of the first user. This realizes automatic determination based on past results, thereby enabling efficient operation. According to the present invention of claim 13, when a job execution request is made to the information processing device by remote operation from a remote terminal of a first user, if a direct operation is being performed on the information processing device by a second user, an inquiry is made to the second user as to whether or not to allow the execution of the job. If the answer to the inquiry is that the execution of the job is permitted, the job is executed, and if the execution of the job is not permitted, the job is not executed. This allows the second user to permit remote operations that do not interfere with the direct operation on the information processing device and to exclude remote operations that interfere with the direct operation on the information processing device. As a result, it is possible to efficiently use the information processing device while suppressing interference between the direct operation and remote operation on the information processing device. In other words, since multiple users can simultaneously operate one information processing device in parallel, it is possible to efficiently use limited resources. According to the present invention of claim 14, when a job execution request is made to an information processing device by a remote operation of a first user, if a second user is performing a direct operation on the information processing device, when a predetermined condition is satisfied, information for instructing execution of the job is displayed on the information processing device. Then, the job is executed according to the instruction by the first user. Thereby, a decision on whether or not to permit the job execution request by the remote operation is automatically made. As a result, it is possible to efficiently use the information processing device while suppressing interference between the direct operation and the remote operation on the information processing device. In other words, since multiple users can simultaneously operate one information processing device in parallel, it is possible to efficiently use limited resources. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an example of an overall configuration of an information processing system to which a first embodiment is applied. [Diagram 2] FIG. 2 illustrates an example of a hardware configuration of an image processing apparatus. [Diagram 3] FIG. 2 illustrates an example of a functional configuration of a control unit of the image processing apparatus. [Figure 4] FIG. 2 illustrates an example of a functional configuration of a control unit of a user terminal. [Diagram 5] 4 is a flowchart showing a flow of processing by the image processing device. [Figure 6] FIG. 4 is a diagram showing the flow of states of the image processing device and the user terminal. [Figure 7] 11 is a flowchart showing a process flow of an image processing device according to a second embodiment. [Figure 8] FIG. 4 is a diagram showing the flow of states of the image processing device and the user terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. [First embodiment] <Configuration of information processing system> FIG. 1 is a diagram showing an example of an overall configuration of an information processing system 1 to which the first embodiment is applied. The information processing system 1 is configured by connecting an image processing device 10 and a user terminal 30 via a network 90. ​​The network 90 is, for example, a LAN (Local Area Network) or the Internet.

[0010] (Image Processing Device) The image processing device 10 is an information processing device that performs various processes in response to input operations by a user who uses the information processing system 1. For example, the image processing device 10 performs a process of forming an image on a medium such as paper, a process of outputting the recording medium on which the image has been formed, a process of reading the image formed on paper, etc. Examples of the image processing device 10 include a so-called electrophotographic multifunction machine that forms a toner image on the printing surface of paper, a so-called inkjet printer that ejects ink onto the printing surface of paper, etc.

[0011] The image processing device 10 displays a user interface, accepts an input operation on the user interface, and acquires the input information. The input operation on the user interface is divided into direct operation and remote operation. A direct operation is a direct input operation on the user interface displayed on the image processing device 10 by a user facing the image processing device 10. A remote operation is an indirect input operation on the user interface of the image processing device 10 that is shared and displayed on the user terminal 30 by a user operating a user terminal 30 remotely connected to the image processing device 10. Hereinafter, a user who remotely operates the image processing device 10 is referred to as a "first user", and a user who directly operates the image processing device 10 is referred to as a "second user".

[0012] Furthermore, the image processing device 10 acquires various types of information transmitted from the user terminal 30 and performs various processes. Furthermore, the image processing device 10 transmits various types of information to the user terminal 30. For example, the image processing device 10 accepts a job execution request from a first user via remote operation and acquires the input information. A "job" is a unit indicating a predetermined process (e.g., printing, reading, etc.) executed by the image processing device 10.

[0013] When the image processing device 10 receives a job execution request from a first user and determines that a second user is performing a direct operation on the image processing device 10, the image processing device 10 inquires of the second user whether or not to allow the execution of the job requested by the first user. For example, a method of inquiring of the second user whether or not to allow the execution of the job requested by the first user may be a method of displaying a button on a user interface of the image processing device 10 for allowing the second user to select whether or not to allow the execution of the job requested by the first user. The method by which the image processing device 10 determines whether or not the second user is performing a direct operation on the image processing device 10 will be described later.

[0014] When the second user responds to the inquiry from the image processing device 10 by permitting the execution of the job requested by the first user, the image processing device 10 executes the job requested by the first user. For example, as a method of inquiring of the second user about permission for the execution of the job requested by the first user, a button for allowing the second user to select permission for the execution of the job requested by the first user is displayed on the user interface of the image processing device 10. In this case, when the button for permitting the execution of the job requested by the first user is pressed, the image processing device 10 executes the job requested by the first user. The configuration and processing of the image processing device 10 will be described in detail later.

[0015] (User terminal) The user terminal 30 is an information processing device such as a smartphone, a tablet terminal, or a personal computer operated by a user who uses the information processing system 1. Application software that enables remote operation of the image processing device 10 is installed in the user terminal 30.

[0016] The user terminal 30 acquires various types of information transmitted from the image processing device 10 and performs various processes. Furthermore, the user terminal 30 transmits various types of information to the image processing device 10. For example, the user terminal 30 displays a user interface of the remotely connected image processing device 10 in a shared manner. Furthermore, the user terminal 30 accepts an input operation on the shared and displayed user interface and acquires the input information.

[0017] For example, when an input operation for causing the image processing device 10 to execute a job is performed as an input operation on the shared and displayed user interface, the user terminal 30 accepts the input operation as a "job execution request" and acquires the input information. Then, the user terminal 30 transmits the acquired input information to the image processing device 10. The configuration and processing of the user terminal 30 will be described in detail later.

[0018] The configuration of the information processing system 1 described above is an example, and the information processing system 1 as a whole may have the function of realizing the above-mentioned processing. Therefore, some or all of the functions of the above-mentioned processing may be shared or cooperated within the information processing system 1. That is, some or all of the functions of the user terminal 30 may be functions of the image processing device 10, and some or all of the functions of the image processing device 10 may be functions of the user terminal 30. Furthermore, some or all of the functions of the user terminal 30 and the image processing device 10 constituting the information processing system 1 may be transferred to another server (not shown) or the like. This promotes processing in the information processing system 1 as a whole, and also makes it possible for the processes to be complemented.

[0019] <Hardware configuration of image processing device> FIG. 2 is a diagram illustrating an example of a hardware configuration of the image processing device 10. As shown in FIG. The image processing device 10 has a control unit 11, a memory 12, a storage unit 13, a communication unit 14, an operation unit 15, a display unit 16, a reading unit 17, an image forming unit 18, and a sensor unit 19. These units are connected to each other via a data bus, an address bus, a PCI (Peripheral Component Interconnect) bus, etc.

[0020] The control unit 11 is a processor that controls the functions of the image processing device 10 through the execution of various software such as an OS (operating system) and application software. The control unit 11 is composed of, for example, a CPU (Central Processing Unit). The memory 12 is a storage area that stores various software and data used for executing the software, and is used as a working area for calculations. The memory 12 is composed of, for example, a RAM (Random Access Memory).

[0021] The storage unit 13 is a storage area for storing input data for various software programs and output data from various software programs. The storage unit 13 is composed of, for example, a hard disk drive (HDD), a solid state drive (SSD), a semiconductor memory, etc., used for storing programs and various setting data. The storage unit 13 is provided with, for example, a user DB 131 in which information about users (hereinafter referred to as "user information") is stored, as a database for storing various information.

[0022] The communication unit 14 transmits and receives data between the user terminal 30 and the outside via the network 90. ​​The operation unit 15 is composed of, for example, a software keyboard, mechanical buttons, switches, etc., and accepts input operations. The operation unit 15 also includes a touch sensor that configures a touch panel integrally with the display unit 16. The display unit 16 is composed of, for example, a liquid crystal display or an organic EL (Electro Luminescence) display used to display information, and displays images, text data, etc.

[0023] The reading unit 17 reads an image recorded on a medium such as paper (for example, a paper document) as a recording medium. The reading unit 17 is composed of, for example, a CCD type scanner that reduces the reflected light of light irradiated from a light source onto an original document using a lens and receives the light with a CCD (Charge Coupled Devices), or a CIS type scanner that receives the reflected light of light irradiated from an LED light source onto an original document in sequence using a CIS (Contact Image Sensor).

[0024] The image forming unit 18 forms an image to be printed on the printing surface of a sheet of paper as a recording medium, for example, by an electrophotographic method or an inkjet method. These units are connected to each other by a data bus, an address bus, a PCI bus, etc. The sensor unit 19 is composed of various sensors such as an ambient light sensor, a proximity sensor, a light sensor such as LiDAR (Light Detection And Ranging), and an acceleration sensor, and detects the use of the image processing device 10 by the second user.

[0025] <Hardware configuration of user terminal> The hardware configuration of the user terminal 30 is similar to the hardware configuration of the image processing device 10 shown in Fig. 2 except for the reading unit 17, the image forming unit 18, and the sensor unit 19. That is, the user terminal 30 is equipped with a control unit, a memory, a storage unit, a communication unit, an operation unit, and a display unit that have the same functions as the control unit 11, the memory 12, the storage unit 13, the communication unit 14, the operation unit 15, and the display unit 16 shown in Fig. 2, respectively, and illustration and description thereof will be omitted.

[0026] <Functional configuration of the control unit of the image processing device> FIG. 3 is a diagram showing an example of a functional configuration of the control unit 11 of the image processing device 10. As shown in FIG. In the control unit 11 of the image processing device 10, an information management unit 101, an acquisition unit 102, a determination unit 103, a display control unit 104, a transmission control unit 105, and a job control unit 106 function.

[0027] The information management unit 101 stores and manages various types of information in a database in the storage unit 13 (see FIG. 2). For example, the information management unit 101 stores and manages user information in a user DB 131. The user information managed by the information management unit 101 includes identification information capable of uniquely identifying a user (e.g., a user ID, biometric information, etc.), a user name, authentication information for using the image processing device 10, and a record of whether or not a job execution request made by remote operation has been accepted.

[0028] The acquisition unit 102 acquires various kinds of information. For example, the acquisition unit 102 acquires input information that is accepted by the operation unit 15 (see FIG. 2) as a direct operation on a user interface displayed on the display unit 16. In this case, the input information acquired by the acquisition unit 102 may include, for example, input information input as a response to an inquiry from a first user as to whether or not to permit execution of a job requested for execution. The acquisition unit 102 also acquires various kinds of information transmitted from the user terminal 30. For example, the information transmitted from the user terminal 30 may include a request to execute a job.

[0029] The determination unit 103 determines whether or not the second user is directly operating the image processing device 10. For example, the determination unit 103 determines whether or not the second user is directly operating the image processing device 10 based on sensing information obtained from the sensor unit 19 (see FIG. 2). Examples of the sensing information obtained from the sensor unit 19 include information indicating whether or not the second user performing a direct operation on the image processing device 10 has been detected, and information indicating whether or not an object input / output to the image processing device 10 has been detected. Examples of the object input / output to the image processing device 10 include a manuscript, a printed sheet of paper, and the like.

[0030] Furthermore, for example, the determination unit 103 determines whether or not a direct operation is being performed on the image processing device 10 by the second user based on authentication information for using the image processing device 10. Examples of the authentication information for using the image processing device 10 include information indicating the presence or absence of a user who has been authenticated to use the image processing device 10. Examples of the information indicating the presence or absence of a user who has been authenticated to use the image processing device 10 include information indicating whether or not a user is logged in to the image processing device 10.

[0031] The display control unit 104 performs control for displaying various information on the display unit 16 (see FIG. 2). For example, the display control unit 104 performs control for displaying a user interface on the display unit 16. The user interface displayed on the display unit 16 includes, for example, information indicating that a job execution request has been made by the first user, information for responding to an inquiry from the first user regarding whether or not to permit execution of the job requested to be executed, and the like.

[0032] Furthermore, the display control unit 104 performs control to display various kinds of information on the display unit of the user terminal 30. For example, the display control unit 104 performs control to display the user interface displayed on the display unit 16 in a shared manner on the display unit of the user terminal 30. Furthermore, the display control unit 104 performs control to prevent predetermined information from among various kinds of information included in the user interface displayed on the display unit 16 from being shared and displayed on the display unit of the user terminal 30. In this case, examples of the "predetermined information" include information for responding to an inquiry about permission or denial of execution of a job requested by a first user.

[0033] The display control unit 104 also controls the display of information indicating whether or not the job requested by the first user can be executed on the display unit of the user terminal 30. In this case, the display control unit 104 determines the content to be displayed according to the content of the reply from the second user to the inquiry from the first user regarding whether or not the job requested by the first user can be executed.

[0034] Specifically, when the content of the answer from the second user allows the execution of the job requested by the first user, the display control unit 104 performs control to display on the display unit of the user terminal 30 a message indicating that the job can be executed. In this case, the display control unit 104 may perform control so that information for instructing the execution of the job requested by the first user is displayed only on the display unit 16 of the image processing device 10. The information for instructing the execution of the job requested by the first user is, for example, a button for instructing the execution of the job (hereinafter referred to as an "execute button").

[0035] On the other hand, if the content of the response from the second user does not permit the execution of the job requested by the first user, the display control unit 104 performs control to cause the display unit of the user terminal 30 to display a message indicating that the job requested by the first user cannot be executed.

[0036] The transmission control unit 105 performs control for transmitting various types of information via the communication unit 14 (see FIG. 2). For example, the transmission control unit 105 performs control for transmitting various types of information toward the user terminal 30. Examples of information transmitted toward the user terminal 30 include control information for displaying various types of information on the display unit of the user terminal 30.

[0037] Examples of such control information transmitted to the user terminal 30 include control information for causing the user interface displayed on the display unit 16 of the image processing device 10 to be shared and displayed on the display unit of the user terminal 30, control information for preventing predetermined information among the various information contained in the user interface from being shared and displayed on the display unit of the user terminal 30, and control information for displaying information indicating whether the job requested to be executed by the first user can be executed.

[0038] The job control unit 106 performs control to cause the image processing device 10 to execute a job and control to cause the image processing device 10 not to execute a job. For example, when the content of the reply from the second user to an inquiry allows the execution of a job requested by the first user, the job control unit 106 performs control to cause the job to be executed. Also, for example, when the content of the reply from the second user to an inquiry allows the execution of a job requested by the first user, the job control unit 106 performs control to cause the job to be executed.

[0039] In addition, if no response is made within a predetermined time after information for responding to an inquiry regarding whether or not to permit the execution of a job requested by the first user is displayed on the display unit 16, the job control unit 106 determines to reject the job requested by the first user and performs control to prevent the job requested by the first user from being executed.

[0040] (Functional configuration of the control unit of the user terminal) FIG. 4 is a diagram illustrating an example of a functional configuration of the control unit of the user terminal 30. As shown in FIG. In the control section of the user terminal 30, an acquisition section 301, a transmission control section 302, and a display control section 303 function.

[0041] The acquisition unit 301 acquires various kinds of information. For example, the acquisition unit 301 acquires input information that is accepted by an operation unit of the own device. Also, for example, the acquisition unit 301 acquires various kinds of information transmitted from the image processing device 10. For example, the information transmitted from the image processing device 10 includes control information for displaying various kinds of information on the display unit of the user terminal 30.

[0042] The transmission control unit 302 performs control to transmit various types of information via the communication unit. For example, the transmission control unit 302 performs control to transmit various types of information toward the image processing device 10. For example, information to be transmitted toward the image processing device 10 includes input information acquired by the acquisition unit 301. For example, input information acquired by the acquisition unit 301 includes a job execution request.

[0043] The display control unit 303 performs control to display various kinds of information on the display unit. For example, the display control unit 303 performs control to display a user interface displayed on the display unit 16 (see FIG. 2) of the image processing device 10 in a shared manner on the display unit of the user terminal 30. The display control unit 303 also performs control to display information indicating whether a job requested by the first user can be executed on the display unit. Specifically, the display control unit 303 displays such information on the display unit based on the control information acquired by the acquisition unit 301.

[0044] <Processing flow> (Processing flow of image processing device) FIG. 5 is a flowchart showing the flow of processing in the image processing device 10. The image processing device 10 stores and manages user information in a database (step 501). Specifically, the image processing device 10 stores and manages user information in the user DB 131 of the storage unit 13 (see FIG. 2).

[0045] Next, when there is a job execution request from the first user (YES in step 502), the image processing device 10 accepts the job execution request (step 503). Then, when it is determined that the second user is performing a direct operation (YES in step 504), the image processing device 10 displays a selection button on the user interface for allowing the second user to select whether or not to allow the job requested by the first user to be executed (step 505).

[0046] On the other hand, if the second user has not directly operated the image processing device 10 (NO in step 504), the image processing device 10 displays on the user terminal 30 a message indicating that the requested job will be executed (step 507), executes the job (step 508), and ends the process (END). If there is no job execution request from the first user (NO in step 502), the image processing device 10 repeats the determination process in step 502 until there is a job execution request from the first user.

[0047] Thereafter, when a button that permits execution of the job is pressed among the selection buttons displayed on the user interface in step 505 (YES in step 506), the image processing device 10 displays on the user terminal 30 a message indicating that the requested job can be executed (step 507), executes the job (step 508), and ends the process (END). On the other hand, when a button that does not permit execution of the job is pressed among the selection buttons displayed on the user interface in step 505 (NO in step 506), the image processing device 10 displays on the user terminal 30 a message indicating that the requested job cannot be executed (step 509), and ends the process (END).

[0048] <Example> Fig. 6 is a diagram showing the flow of states of the image processing device 10 and the user terminal 30. Note that time flows from left to right in Fig. 6. 6, when the second user 22 approaches the image processing device 10, a menu screen is displayed on the display unit 16 of the image processing device 10. Here, when the second user 22 performs a setting on the menu screen to execute “scan transmission” which causes a document reading process and a transmission process of the read data to be performed, a scan transmission screen is displayed on the display unit 16.

[0049] At this time, it is assumed that the first user 21 is about to perform an operation to instruct the user terminal 30 remotely connected to the image processing device 10 to execute a "print" job for printing a document. In this case, the user terminal 30 displays a screen that allows the user to specify a document file to be printed, together with a message "Printing is possible", as shown in Fig. 6, for example.

[0050] Here, when the first user 21 performs an operation on the user terminal 30 to instruct the image processing device 10 to execute a "print" job, a button 161 is displayed in a part of the scan transmission screen displayed on the display unit 16 of the image processing device 10 as information indicating that a job execution request has been made by the first user 21. The second user 22 becomes aware that a job execution request has been made by the first user 21 when the button 161 is displayed in a part of the scan transmission screen.

[0051] When the second user 22 who has learned that the first user 21 has requested execution of a job presses a button 161, a pop-up screen 162 is displayed including a selection button 163 for selecting whether or not to permit execution of the job requested by the first user 21. Here, the second user 22 selects whether or not to permit execution of the job requested by the first user 21, taking into consideration the work he or she is currently doing (work to have the image processing device 10 execute "scan and send").

[0052] Here, for example, assume that the image processing device 10 is capable of executing the "scan and send" process and the "print" process in parallel. In this case, when the second user 22 presses the button 164 labeled "Allow" among the selection buttons 163 displayed on the pop-up screen 162, the "print" job requested by the first user is executed. At the same time, a message is displayed on the display unit of the user terminal 30 indicating that the "print" job requested by the first user will be executed. Furthermore, when the "print" process is completed, a message is displayed on the display unit of the user terminal 30 to that effect.

[0053] Furthermore, when the second user 22 presses the button 165 labeled “Reject” among the selection buttons 163 displayed on the pop-up screen 162, a message is displayed on the display unit of the user terminal 30 indicating that the “Print” job cannot be executed because the second user is directly operating the image processing device 10.

[0054] [Second embodiment] (Hardware configuration of image processing device) The hardware configuration of the image processing device 10 and the functional configuration of the control unit 11 according to the second embodiment are basically the same as the hardware configuration and the functional configuration of the control unit 11 shown in Fig. 2 and Fig. 3. However, in the first embodiment, when the image processing device 10 receives a job execution request from a first user and determines that a second user is directly operating the image processing device 10, the image processing device 10 inquires of the second user whether or not to allow the execution of the job requested by the first user. In contrast, in the second embodiment, the image processing device 10 does not inquire of the second user who is directly operating the image processing device 10.

[0055] That is, in the image processing device 10 according to the second embodiment, when a first user remotely operates the image processing device 10 and a second user directly operates the image processing device 10, the image processing device 10 displays an execution button on the user interface of the image processing device 10 if a predetermined condition is satisfied. Here, when the first user remotely operating the image processing device 10 presses the execution button displayed on the image processing device 10 as a direct operation on the image processing device 10, the job requested by the first user is executed.

[0056] At this time, the user interface of the image processing device 10 is shared and displayed on the user terminal 30 of the first user, but the execution button is controlled not to be shared and displayed. This is based on the requirement of information security that does not allow execution of a job by remote operation when the user is not in front of the image processing device 10.

[0057] Conditions for displaying an execution button on the user interface of the image processing device 10 include, for example, a condition that after a first user makes an execution request, no direct operation is performed by a second user before the image processing device 10 receives the execution request, and a condition that permission has been granted for a job execution request.

[0058] Among these, when a condition is satisfied that after a job execution request is made by a first user, direct operation by a second user is no longer performed before the image processing device 10 receives the job execution request, the image processing device 10 displays the execute button after receiving the job execution request from the first user. Also, when a condition is satisfied that permission for the job execution request has been obtained, the image processing device 10 immediately displays the execute button.

[0059] 7 is a flowchart showing the flow of processing of the image processing device 10 according to the second embodiment. Note that, among the processing of the image processing device 10 according to the second embodiment, the processing flow from steps 701 to 703 is similar to the processing from steps 501 to 503 in the above-mentioned first embodiment, and therefore the description thereof will be omitted.

[0060] When the image processing device 10 determines that the second user is performing a direct operation (YES in step 704), the process proceeds to the determination process of step 705. On the other hand, when the image processing device 10 determines that the second user is not performing a direct operation on the image processing device 10 (NO in step 704), the image processing device 10 displays on the user terminal 30 a message indicating that the job requested by the first user will be executed (step 709), executes the job (step 710), and ends the process (END).

[0061] When the first user who has made the job execution request is a user who has a track record of obtaining permission to execute a job in the past (YES in step 705), the image processing device 10 displays an execution button on the user interface (step 706). On the other hand, when the first user who has made the job execution request is a user who has not a track record of obtaining permission to execute a job in the past (NO in step 705), the process returns to the determination process of step 704.

[0062] When the execute button displayed on the user interface is pressed (YES in step 707), the image processing device 10 displays on the user terminal 30 a message indicating that the job requested by the first user will be executed (step 709), executes the job (step 710), and ends the process (END). On the other hand, when the execute button has not been pressed (NO in step 707), the process proceeds to the decision process of step 708.

[0063] If a predetermined time has elapsed without the execution button being pressed (YES in step 708), the image processing device 10 displays on the user terminal 30 a message indicating that the job requested by the first user cannot be executed (step 711), and ends the process (END). On the other hand, if the predetermined time has not elapsed (NO in step 708), the process returns to the determination process in step 707.

[0064] Fig. 8 is a diagram showing the flow of states of the image processing device 10 and the user terminal 30. Note that time flows from left to right in Fig. 8. When the second user 22 approaches the image processing device 10 and performs settings for executing "scan transmission" which reads an original document and transmits the read data, a scan transmission screen is displayed on the display unit 16. At this time, it is assumed that the first user 21 is about to perform an operation to instruct the user terminal 30 remotely connected to the image processing device 10 to execute a "print" job which prints a document. In this case, the user terminal 30 displays a screen that allows the user to specify a document file to be printed, together with a message "Printing is possible", as shown in FIG. 8, for example.

[0065] Here, it is assumed that the first user 21 performs an operation on the user terminal 30 to instruct the image processing device 10 to execute a "print" job. In this case, in the above-described first embodiment, as shown in Fig. 6, a button 161 is displayed as information indicating that the first user 21 has requested execution of a job in part of the scan transmission screen displayed on the display unit 16 of the image processing device 10. However, if the second user 22 who was in front of the image processing device 10 has already left when the first user 21 requested execution of the job, the following process is performed.

[0066] That is, the image processing device 10 does not display the button 161 in Fig. 6 on the display unit 16. That is, the image processing device 10 does not display information indicating that a job execution request has been made by the first user 21 on the display unit 16, as shown in Fig. 8. In this case, the image processing device 10 acquires job parameters from the user terminal 30 remotely connected to the image processing device 10. The job parameters are information required for the image processing device 10 to execute a "print" job.

[0067] At least a part of the job parameter information and information for instructing execution of the "print" process are displayed on the display unit 16 of the image processing device 10 that has acquired the job parameters. Here, the information for instructing execution of the "print" process is, for example, a display of a button 166 labeled "Print" as shown in FIG. 8. The first user 21 approaches the image processing device 10 and instructs execution of the "print" process by pressing the button 166 displayed on the display unit 16 of the image processing device 10. Then, the image processing device 10 starts the "print" process.

[0068] <Other embodiments> Although the present embodiment has been described above, the present invention is not limited to the above-mentioned embodiment. Moreover, the effects of the present invention are not limited to those described in the above-mentioned embodiment. For example, the configuration of the information processing system 1 shown in FIG. 1 and the hardware configuration of the image processing device 10 shown in FIG. 2 are merely examples for achieving the object of the present invention, and are not particularly limited. Moreover, the functional configuration of the image processing device 10 shown in FIG. 3 and the functional configuration of the user terminal 30 shown in FIG. 4 are also merely examples, and are not particularly limited. It is sufficient that the information processing system 1 of FIG. 1 has a function capable of executing the above-mentioned processing as a whole, and the functional configuration used to realize this function is not limited to the examples of FIG. 3 and FIG. 4.

[0069] In addition, the order of the steps of the processing of the image processing device 10 shown in each of Fig. 5 and Fig. 7 is merely an example and is not particularly limited. The processing is not limited to the processing performed in chronological order according to the order of the steps shown in the figures, and may be performed in parallel or individually without necessarily being performed in chronological order. In addition, the specific examples shown in each of Fig. 6 and Fig. 8 are merely examples and are not particularly limited.

[0070] 6, when the first user 21 performs an operation on the user terminal 30 to instruct the image processing device 10 to execute a "print" job, a button 161 is displayed in a portion of the scan and transmission screen displayed on the display unit 16 of the image processing device 10 as information indicating that a job execution request has been made by the first user 21. As a result, the second user 22 knows that a job execution request has been made by the first user 21 from the button 161 being displayed in a portion of the scan and transmission screen.

[0071] However, the information displayed on the display unit 16 of the image processing device 10 is not limited to information indicating that a job execution request has been made by the first user 21. Other information supporting each of the business processes of the first user 21 and the second user 22 who share one image processing device 10 may be displayed. For example, information indicating whether a job that the second user is causing the image processing device 10 to execute and a job requested to be executed by the first user can be executed in parallel may be displayed. Specifically, for example, when the job that the second user 22 is causing the image processing device 10 to execute is "scan and send", a message such as "print, XX, △△, ... processes can be executed in parallel" may be displayed on the display unit 16 of the image processing device 10.

[0072] In the second embodiment described above, as shown in Fig. 7, when a predetermined time has elapsed without the execution button being pressed, a message is displayed on the user terminal 30 indicating that the job requested by the first user cannot be executed, and the process is terminated, but this is not limiting. For example, the configuration may be such that when a predetermined time has elapsed without the execution button being pressed, the job requested by the first user is automatically permitted to be executed.

[0073] (Additional Note) (((1))) one or more processors; The one or more processors: When a request for execution of a job is made to the information processing device by remote operation from a remote terminal of a first user, if a direct operation is being performed on the information processing device by a second user, an inquiry is made to the second user as to whether or not the execution of the job is permitted; If the execution of the job is permitted as a response to the inquiry, the job is executed. Information processing system. (((2))) the one or more processors cause the information processing device to display, as the inquiry, information indicating that the execution request has been made and information for responding to the inquiry. An information processing system according to (((1))). (((3))) The one or more processors are characterized in that they do not cause the remote terminal to display information for responding to the inquiry. The information processing system according to (((2))). (((4))) the one or more processors cause the remote terminal to display information indicating whether the job can be executed, depending on the content of the response to the inquiry. The information processing system according to (((3))). (((5))) the one or more processors, when the job can be executed, display information for instructing the execution of the job only on the information processing device; The information processing system according to (((4))). (((6))) the one or more processors determine to reject the job if the reply is not made within a predetermined time after the information for making the reply is displayed on the information processing device. 13. An information processing system according to any one of ((2))) to (((5))). (((7))) The one or more processors determine whether the direct operation is being performed based on at least one of sensing information of a sensor that detects use of the information processing device and authentication information for using the information processing device. 13. An information processing system according to any one of ((1)) to ((6))). (((8))) The one or more processors determine whether the direct operation is being performed based on information indicating whether the sensor has detected at least one of a user performing the direct operation on the information processing device and an object input / output to / from the information processing device, as the sensing information. An information processing system according to (((7))). (((9))) The one or more processors determine whether the direct operation is being performed based on information indicating the presence or absence of a user who has been authenticated to use the information processing device as the authentication information. An information processing system according to (((7))). (((10))) one or more processors; The one or more processors: when a first user remotely operates an information processing device to request execution of a job, and a second user directly operates the information processing device, when a predetermined condition is satisfied, displaying information for instructing execution of the job on the information processing device; The job is executed in response to an instruction to execute the job from the first user. Information processing system. (((11))) The one or more processors are characterized in that, as the predetermined condition, if the direct operation is not performed after the execution request is made and before the information processing device receives the execution request, the one or more processors cause the information processing device to display information for instructing the execution of the job after the execution request is received. The information processing system according to (((10))). (((12))) the one or more processors are characterized in that, when there is a record of obtaining permission for the execution request by the remote operation of the first user as the predetermined condition, the one or more processors cause the information processing device to display information for instructing the execution of the job. The information processing system according to (((10))). (((13))) On the computer, a function of inquiring of the second user as to whether or not to permit execution of the job when a first user remotely operates the information processing device and a second user directly operates the information processing device; a function of executing the job when the execution of the job is permitted as a response to the inquiry; and A program to achieve this. (((14))) On the computer, a function of displaying information for instructing execution of a job on an information processing device when a second user is directly operating the information processing device when a first user remotely operates the information processing device and a predetermined condition is satisfied; a function of executing the job in response to an instruction to execute the job from the first user; A program to achieve this.

[0074] According to the present invention (((1))), when a job execution request is made to an information processing device by remote operation from a remote terminal of a first user, if a direct operation is being performed on the information processing device by a second user, an inquiry is made to the second user as to whether or not to permit execution of the job. If the answer to the inquiry is that the job execution is permitted, the job is executed, and if the job execution is not permitted, the job is not executed. This allows the second user to permit remote operations that do not interfere with the direct operation on the information processing device and to exclude remote operations that interfere with the direct operation on the information processing device. As a result, it is possible to efficiently use the information processing device while suppressing interference between the direct operation and remote operation on the information processing device. In other words, since multiple users can simultaneously operate one information processing device in parallel, it is possible to efficiently utilize limited resources. According to the present invention (((2))), as an inquiry as to whether or not to permit execution of a job, information indicating that an execution request has been made and information for responding to the inquiry are displayed on the information processing device. This allows the second user to respond to the inquiry while understanding that a job execution request has been made by remote operation of another user (first user). According to the present invention (((3))), information for replying to an inquiry about permission or denial of job execution is not displayed on the remote terminal. This allows the reply to be made only by directly operating the information processing device. As a result, a reply not intended by the second user is suppressed. According to the present invention (((4))), information indicating whether the job requested from the remote terminal can be executed or not is displayed on the remote terminal depending on the content of the reply from the second user, so that the first user can know at a glance whether the job can be executed by remote operation or not. According to the present invention (((5))), information for instructing the execution of a job requested from a remote terminal is displayed only on the information processing device. This makes it impossible to instruct the execution of a job from a remote terminal, so that it is possible to prevent information output from the information processing device from being leaked to a third party other than the second user. According to the present invention (((6))), if no reply is made within a predetermined time after the display of information for replying to an inquiry about permission or denial of job execution, the job is rejected. This makes it possible to reduce the time cost that may be incurred by not replying to the inquiry. According to the present invention (((7))), whether or not a direct operation is being performed on the information processing device is determined based on at least one of sensing information from a sensor that detects the use of the information processing device and authentication information for using the information processing device. This makes it possible to select or combine methods for determination. According to the present invention (((8))), whether or not a direct operation is being performed is determined based on information indicating whether or not the sensor has detected at least one of a user performing a direct operation on the information processing device and an object input / output to / from the information processing device, as sensing information of the sensor for using the information processing device. This makes it possible to select or use in combination a sensing target. According to the present invention (((9))), whether or not a direct operation is being performed on the information processing device is determined based on information indicating the presence or absence of a user who has been authenticated to use the information processing device as authentication information for using the information processing device. This makes it possible to make a determination based on the presence or absence of a user who is logged in to the information processing device, for example. According to the present invention (((10))), when a job execution request is made to an information processing device by a remote operation of a first user, if a second user is performing a direct operation on the information processing device, information for instructing the execution of the job is displayed on the information processing device when a predetermined condition is satisfied. Then, the job is executed according to the instruction by the first user. Thereby, a decision on whether to permit or deny the job execution request by the remote operation is automatically made. As a result, it is possible to efficiently use the information processing device while suppressing interference between the direct operation and the remote operation on the information processing device. In other words, since multiple users can simultaneously operate one information processing device in parallel, it is possible to efficiently use limited resources. According to the present invention (((11))), if a direct operation on the information processing device is no longer performed before the information processing device receives a job execution request after a job execution request is made by remote operation, information for instructing the execution of the job is displayed on the information processing device after the job execution request is received. This prevents a situation from occurring in which a job cannot be executed because there is no one to respond to an inquiry. According to the present invention (((12))), whether or not to display information for instructing execution of a job on an information processing device is determined based on past results of execution requests made by a first user through remote operations. This allows automatic determination based on past results, thereby enabling efficient operation. According to the present invention (((13))), when a job execution request is made to an information processing device by remote operation from a remote terminal of a first user, if a direct operation is being performed on the information processing device by a second user, an inquiry is made to the second user as to whether or not to permit execution of the job. If the answer to the inquiry is that the job execution is permitted, the job is executed, and if the job execution is not permitted, the job is not executed. This allows the second user to permit remote operations that do not interfere with the direct operation on the information processing device and to exclude remote operations that interfere with the direct operation on the information processing device. As a result, it is possible to efficiently use the information processing device while suppressing interference between the direct operation and remote operation on the information processing device. In other words, since multiple users can simultaneously operate one information processing device in parallel, it is possible to efficiently utilize limited resources. According to the present invention (((14))), when a job execution request is made to an information processing device by a remote operation of a first user, if a second user is performing a direct operation on the information processing device, information for instructing the execution of the job is displayed on the information processing device when a predetermined condition is satisfied. Then, the job is executed according to the instruction by the first user. Thereby, a decision on whether to permit or deny the job execution request by the remote operation is automatically made. As a result, it is possible to efficiently use the information processing device while suppressing interference between the direct operation and the remote operation on the information processing device. In other words, since multiple users can simultaneously operate one information processing device in parallel, it is possible to efficiently use limited resources. [Explanation of symbols]

[0075] 1...information processing system, 10...image processing device, 11...control unit, 30...user terminal, 90...network, 101...information management unit, 102...acquisition unit, 103...determination unit, 104...display control unit, 105...transmission control unit, 106...job control unit, 301...acquisition unit, 302...transmission control unit, 303...display control unit

Claims

1. One or more processors; The one or more processors: When a request for execution of a job is made to the information processing device by remote operation from a remote terminal of a first user, if a direct operation is being performed on the information processing device by a second user, an inquiry is made to the second user as to whether or not the execution of the job is permitted; If the execution of the job is permitted as a response to the inquiry, the job is executed. Information processing system.

2. the one or more processors cause the information processing device to display, as the inquiry, information indicating that the execution request has been made and information for responding to the inquiry. The information processing system according to claim 1 .

3. the one or more processors do not cause the remote terminal to display information for responding to the inquiry. The information processing system according to claim 2 .

4. the one or more processors cause the remote terminal to display information indicating whether the job can be executed or not, depending on the content of the response to the inquiry. The information processing system according to claim 3 .

5. the one or more processors, when capable of executing the job, cause information for instructing execution of the job to be displayed only on the information processing device; 5. The information processing system according to claim 4.

6. the one or more processors determine to reject the job if the reply is not made within a predetermined time after the information for making the reply is displayed on the information processing device. The information processing system according to claim 2 .

7. The one or more processors determine whether the direct operation is being performed based on at least one of sensing information of a sensor that detects use of the information processing device and authentication information for using the information processing device. The information processing system according to claim 1 .

8. The one or more processors determine whether the direct operation is being performed based on information indicating whether the sensor has detected at least one of a user performing the direct operation on the information processing device and an object input / output to the information processing device, as the sensing information. The information processing system according to claim 7.

9. The one or more processors determine whether the direct operation is being performed based on information indicating the presence or absence of a user who has been authenticated to use the information processing device, as the authentication information. The information processing system according to claim 7.

10. One or more processors; The one or more processors: when a first user remotely operates the information processing device to request execution of a job, and a second user directly operates the information processing device, when a predetermined condition is satisfied, displaying information for instructing execution of the job on the information processing device; The job is executed in response to an instruction for execution of the job from the first user. Information processing system.

11. the one or more processors are characterized in that, as the predetermined condition, if the direct operation is no longer performed before the information processing device receives the execution request after the execution request is made, the one or more processors cause the information processing device to display information for instructing the execution of the job after the execution request is received. The information processing system according to claim 10.

12. the one or more processors are configured to cause the information processing device to display information for instructing the execution of the job when there is a record of permission being obtained for the execution request by the remote operation of the first user as the predetermined condition. The information processing system according to claim 10.

13. On the computer, a function of inquiring of the second user as to whether or not to permit execution of the job when a first user remotely operates the information processing device and a second user directly operates the information processing device; a function of executing the job when the execution of the job is permitted as a response to the inquiry; and A program to achieve this.

14. On the computer, a function of displaying information for instructing execution of a job on an information processing device when a second user is directly operating the information processing device when a first user remotely operates the information processing device and a predetermined condition is satisfied; a function of executing the job in response to an instruction to execute the job from the first user; A program to achieve this.

Images