Information processing system and program

Abstract

To suppress a leakage of information of an original set to an image processing device, via a remote terminal.SOLUTION: In a control unit 11 in an image processing device 10, when an event determination unit 103 determines the generation of an event to start a direct operation on the image processing device 10, a generation unit 104 generates identification information, a display control unit 106 performs control to display the identification information, and an operation control unit 108 restricts remote operation on the image processing device 10 from a terminal other than a terminal whose identification information has been read.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing system and a program. [Background technology]

[0002] There is known a technology that enables remote operation of an image processing device, such as a multifunction peripheral that enables printing and reading of documents, by connecting a remote terminal to the image processing device (for example, Patent Document 1). Such a technology enables operations for causing the image processing device to read a document set therein and operations for acquiring information on the read document to be performed from the remote terminal. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-207875 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, if remote operation of a remote terminal to read an original is unconditionally permitted, the information of the original set in the image processing device can be obtained by the remote terminal regardless of who is performing the remote operation. In this case, there is a risk that the information of the original set in the image processing device may be leaked via the remote terminal.

[0005] An object of the present invention is to prevent information on a document set in an image processing apparatus from being leaked via a remote terminal. [Means for solving the problem]

[0006] The invention described in claim 1 is an information processing system comprising one or more processors, which, when an event occurs that initiates direct operation of an image processing device, causes predetermined identification information to be displayed on the image processing device, and restricts remote operation of the image processing device from terminals other than the terminal that read the identification information. The invention described in claim 2 is the information processing system described in claim 1, characterized in that the one or more processors display information on the image processing device that corresponds information about the image processing device with information for authentication as the identification information, and restrict remote operation of the image processing device from terminals other than the terminal authenticated based on the information for authentication among the terminals that read the identification information. The invention described in claim 3 is the information processing system described in claim 2, characterized in that the one or more processors cause the image processing device to display one-time identification information, the information for authentication being updated each time it is displayed on the image processing device. The invention described in claim 4 is the information processing system described in claim 2, characterized in that the one or more processors restrict remote operation of the image processing device from terminals other than terminals that have read the identification information and have been authenticated based on the unused authentication information. The invention described in claim 5 is the information processing system described in claim 4, characterized in that after the identification information is displayed on the image processing device, when a predetermined condition is satisfied, the one or more processors switch to displaying the identification information with updated information for authentication on the image processing device. The invention described in claim 6 is the information processing system described in claim 5, characterized in that the condition is that a job instructed from the terminal that read the identification information has been executed. The invention described in claim 7 is the information processing system described in claim 5, characterized in that the condition is that an authentication request is made from another terminal that read the identification information. The invention described in claim 8 is the information processing system described in claim 1, characterized in that the one or more processors restrict remote operation of the image processing device from the terminal that read the identification information if the direct operation is completed or the direct operation is not started after the identification information is displayed on the image processing device. The invention described in claim 9 is the information processing system described in claim 8, characterized in that the one or more processors determine that the direct operation has been completed or that the direct operation has not been started when a person moves away from the image processing device. The invention described in claim 10 is the information processing system described in claim 8, characterized in that the one or more processors determine that the direct operation has been completed or that the direct operation has not been started when the original document is removed from the image processing device. The invention described in claim 11 is the information processing system described in claim 1, characterized in that the one or more processors determine that the direct operation is started when an object approaches the image processing device. The invention described in claim 12 is the information processing system described in claim 11, characterized in that the one or more processors determine that the direct operation has begun when a human approaches the image processing device. The invention described in claim 13 is the information processing system described in claim 11, characterized in that the one or more processors determine that the direct operation is started when a document is set in the image processing device. The invention described in claim 14 is the information processing system described in claim 1, characterized in that, if the image processing device is unable to execute a job instructed by the terminal that read the identification information, the one or more processors display this fact on the terminal. The invention described in claim 15 is the information processing system described in claim 14, characterized in that the one or more processors display on the terminal at least one of information for enabling the image processing device to execute the job and information regarding jobs other than the job that can be executed by the image processing device. The invention described in claim 16 is a program that enables a computer to realize the following functions: when an event occurs that initiates direct operation of an image processing device, the computer displays predetermined identification information on the image processing device; and the computer restricts remote operation of the image processing device from terminals other than the terminal that read the identification information. Effect of the Invention

[0007] According to the present invention of claim 1, when an event occurs that starts a direct operation on the image processing device, predetermined identification information is displayed on the image processing device. Then, remote operation of the image processing device from a terminal other than the terminal that read the identification information is restricted. This makes it possible to prevent information on a document set on the image processing device from being leaked via a terminal remotely connected to the image processing device. According to the present invention of claim 2, identification information in which information related to the image processing device and information for authentication are associated with each other is displayed on the image processing device. Then, authentication based on the information for authentication is performed on a terminal attempting to connect to the image processing device by reading the identification information displayed on the image processing device. This makes it possible to authenticate the use of the image processing device by having a terminal read the identification information displayed on the image processing device. According to the present invention of claim 3, one-time identification information is displayed on the image processing device. This enables so-called one-time authentication for use of the image processing device by having a terminal read the identification information displayed on the image processing device. According to the present invention of claim 4, among the terminals that have read the identification information, remote operation from terminals other than the terminal authenticated based on unused authentication information is restricted, thereby making it possible to prevent duplicate use of identification information that has been used once. According to the present invention of claim 5, after the identification information is displayed on the image processing device, when a predetermined condition is satisfied, the identification information with updated authentication information is switched and displayed on the image processing device, thereby enabling remote operation of the image processing device from the terminal that reads the switched and displayed identification information. According to the present invention of claim 6, after the identification information is displayed on the image processing device, when a job instructed from the terminal that read the identification information is executed, the identification information with updated authentication information is switched and displayed on the image processing device, thereby enabling remote operation of the image processing device from the terminal that read the switched and displayed identification information. According to the present invention of claim 7, after the identification information is displayed on the image processing device, when another terminal that read the identification information requests authentication, the identification information with updated information for authentication is switched and displayed on the image processing device, thereby enabling remote operation of the image processing device from the terminal that read the switched and displayed identification information. According to the present invention of claim 8, when a direct operation on the image processing device is completed or when a direct operation on the image processing device is not started after the identification information is displayed on the image processing device, remote operation of the image processing device from the terminal that read the identification information is restricted. This makes it possible to prevent the image processing device from being monopolized by remote operation from the terminal that read the identification information. According to the present invention of claim 9, when a person moves away from the image processing device after the identification information is displayed on the image processing device, it is determined that the direct operation on the image processing device is completed or that the direct operation on the image processing device has not been started. This enables the determination by a human presence sensor or the like that is provided in the image processing device in advance. According to the present invention of claim 10, when the document set in the image processing device is removed after the identification information is displayed on the image processing device, it is determined that the direct operation on the image processing device is completed or that the direct operation on the image processing device has not been started. This makes it possible to make the determination using a proximity sensor or the like that is provided in the image processing device. According to the present invention of claim 11, when an object approaches the image processing device, it is determined that a direct operation on the image processing device is started. This makes it possible to make the determination by various sensors that the image processing device is equipped with in advance. According to the present invention of claim 12, when a person approaches the image processing device, it is determined that a direct operation on the image processing device is started. This makes it possible to make the determination using a human presence sensor or the like that is provided in the image processing device in advance. According to the present invention of claim 13, when a document is set on the image processing device, it is determined that a direct operation on the image processing device is started. This makes it possible to make the determination using a proximity sensor or the like that is provided in the image processing device in advance. According to the present invention of claim 14, when the image processing device cannot execute the job instructed from the terminal that read the identification information, the fact is displayed on the terminal. This allows the user who instructed the job from the terminal to know that the job he or she instructed cannot be executed for some reason, and allows the user to consider how to deal with the situation. According to the present invention of claim 15, when the image processing device cannot execute a job instructed by the terminal that read the identification information, at least one of information for enabling the job to be executed and information on other executable jobs is displayed on the terminal, thereby enabling the user who instructed the job to know how to deal with the job that cannot be executed. According to the present invention of claim 16, when an event occurs that starts a direct operation on the image processing device, predetermined identification information is displayed on the image processing device. Then, remote operation of the image processing device from a terminal other than the terminal that read the identification information is restricted. This makes it possible to prevent information on a document set in the image processing device from being leaked via a terminal remotely connected to the image processing device. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of an overall configuration of an information processing system to which an embodiment of the present invention is applied. [Diagram 2]FIG. 2 illustrates an example of a hardware configuration of an image processing apparatus. [Diagram 3] FIG. 2 illustrates an example of a functional configuration of a control unit of the image processing apparatus. [Figure 4] FIG. 2 illustrates an example of a functional configuration of a control unit of a user terminal. [Diagram 5] 4 is a flowchart showing a flow of processing by the image processing device. [Figure 6] 13 is a flowchart showing a process flow of a user terminal. [Figure 7] 10A and 10B are diagrams showing specific examples of user interfaces displayed on the image processing device and the user terminal, respectively. [Figure 8] 1A is a diagram showing a specific example of a remote operation screen displayed on a user terminal when an image processing device cannot execute a job instructed by a user, and FIG. 1B is a diagram showing a specific example of a case where identification information displayed by an image processing device is switched. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. <Configuration of information processing system> FIG. 1 is a diagram showing an example of the overall configuration of an information processing system 1 to which the present embodiment is applied. The information processing system 1 is configured by connecting an image processing device 10 and user terminals 30-1 to 30-n (n is an integer value equal to or greater than 1) via a network 90. ​​The network 90 is, for example, a local area network (LAN) or the Internet. Hereinafter, when there is no need to explain each of the user terminals 30-1 to 30-n individually, they will be collectively referred to as "user terminal 30."

[0010] (Image Processing Device) The image processing device 10 is an information processing device that performs various processes in response to input operations by a user who uses the information processing system 1. For example, the image processing device 10 performs a print process in which an image is formed on a medium such as paper and outputted, a copy process in which an image of an original is copied onto a medium such as paper and outputted, a read process in which an image formed on paper or the like is read, and a fax process in which an original is transmitted by facsimile. Examples of the image processing device 10 include a so-called electrophotographic multifunction machine that forms a toner image on the printing surface of paper, and a so-called inkjet printer that ejects ink onto the printing surface of paper.

[0011] The image processing device 10 displays a user interface, accepts an input operation on the user interface, and acquires the input information. The input operation on the user interface is divided into direct operation and remote operation. A direct operation is a direct input operation on the user interface displayed on the image processing device 10 by a user facing the image processing device 10. A remote operation is an indirect input operation on the user interface of the image processing device 10 shared and displayed on the user terminal 30 by a user operating a user terminal 30 remotely connected to the image processing device 10.

[0012] Furthermore, the image processing device 10 acquires various information transmitted from the user terminal 30 and performs various processes. For example, the image processing device 10 receives an instruction to execute a job from a user and executes the job. A "job" is a unit indicating a predetermined process executed by the image processing device 10 (for example, a print process for forming an image on a medium such as paper and outputting it, a copy process for copying an image of an original onto a medium such as paper and outputting it, a read process for reading an image formed on paper or the like, a fax process for transmitting an original by facsimile, etc.). Furthermore, the image processing device 10 transmits various information to the user terminal 30.

[0013] For example, the image processing device 10 displays identification information on its own device when an event occurs that initiates a direct operation on the device. An "event that initiates a direct operation on the device" is an object (e.g., a person) approaching, a document being placed, etc. When the displayed identification information is read by the user terminal 30, the image processing device 10 restricts remote operation of the device from terminals other than the user terminal 30. Specifically, the image processing device 10 performs authentication based on read information transmitted from the user terminal 30 that read the displayed identification information, and restricts remote operation of the device from terminals other than the user terminal 30 that read the identification information.

[0014] "Identification information" refers to information such as a QR code (registered trademark) associated with information for uniquely identifying the image processing device 10 (hereinafter referred to as "device information") and information for authentication related to the use of the image processing device 10 (hereinafter referred to as "authentication information").

[0015] The image processing device 10 that has displayed the identification information restricts remote operation of the device from terminals other than the user terminal 30 that has read the identification information and that has been authenticated based on the authentication information associated with the identification information. When displaying identification information on the device, the image processing device 10 displays one-time identification information, the associated authentication information of which is updated each time it is displayed. The authentication information associated with the identification information displayed one-time on the image processing device 10 is unused. For this reason, it is not possible to perform remote operation using identification information associated with authentication information that has already been used.

[0016] After displaying the identification information, the image processing device 10 switches to display the identification information with the updated associated authentication information when a predetermined condition is satisfied. Here, the "predetermined condition" refers to, for example, that a job instructed by the user terminal 30 that read the identification information displayed on the image processing device 10 has been executed, or that an authentication request has been made by the user terminal 30 that read the identification information displayed on the image processing device 10, etc.

[0017] After displaying the identification information, the image processing device 10 starts a direct operation on the device itself, and when the direct operation is completed, restricts remote operation on the device itself from the user terminal 30 that read the identification information. Furthermore, if a direct operation on the device itself is not started after displaying the identification information, the image processing device 10 restricts remote operation on the image processing device 10 from the user terminal 30 that read the identification information.

[0018] In this case, when the image processing device 10 detects that a person has left the device or that a direct operation on the device has been completed, the image processing device 10 may determine that a direct operation on the device has been completed or that a direct operation on the device has not been started. Also, when the image processing device 10 detects that a document has been removed from the device, the image processing device 10 may determine that a direct operation on the device has been completed or that a direct operation on the device has not been started.

[0019] When the image processing device 10 is unable to execute a job instructed by the user terminal 30, it causes the user terminal 30 to display information indicating that (hereinafter referred to as "unexecutable information"). Furthermore, when the image processing device 10 is unable to execute a job instructed by the user terminal 30, it causes the user terminal 30 to display information for enabling the instructed job to be executed (hereinafter referred to as "handling information").

[0020] Furthermore, when the image processing device 10 is unable to execute a job instructed by the user terminal 30, it displays information on jobs other than the instructed job that the image processing device 10 can execute (hereinafter referred to as "alternative job information") on the user terminal 30. The configuration and processing of the image processing device 10 will be described in detail later.

[0021] (User terminal) The user terminal 30 is an information processing device such as a smartphone, a tablet terminal, or a personal computer operated by a user who uses the information processing system 1. Application software that enables remote operation of the image processing device 10 is installed in the user terminal 30.

[0022] The user terminal 30 acquires various types of information transmitted from the image processing device 10 and performs various processes. Furthermore, the user terminal 30 transmits various types of information to the image processing device 10. For example, the user terminal 30 displays a user interface of the remotely connected image processing device 10 in a shared manner. Furthermore, the user terminal 30 accepts an input operation on the shared and displayed user interface and acquires the input information.

[0023] For example, when an input operation for causing the image processing device 10 to execute a job is performed as an input operation on the shared and displayed user interface, the user terminal 30 transmits the input information to the image processing device 10. In addition, the user terminal 30 reads the identification information displayed on the image processing device 10, and transmits the read information to the image processing device 10 as a request for authentication to use the image processing device 10.

[0024] Furthermore, the user terminal 30 acquires control information transmitted from the image processing device 10 and performs various processes based on the control information. For example, after transmitting input information for executing a job to the image processing device 10, when control information for displaying execution impossible information is transmitted, the user terminal 30 displays the execution impossible information based on the control information.

[0025] Furthermore, when control information for displaying information enabling the image processing device 10 to execute a job is transmitted to the user terminal 30, the user terminal 30 displays the information enabling the image processing device 10 to execute a job based on the control information. Furthermore, when control information for displaying alternative job information is transmitted to the user terminal 30, the user terminal 30 displays the alternative job information based on the control information. The configuration and processing of the user terminal 30 will be described in detail later.

[0026] The configuration of the information processing system 1 described above is an example, and the information processing system 1 as a whole may have the function of realizing the above-mentioned processing. Therefore, some or all of the functions of the above-mentioned processing may be shared or cooperated within the information processing system 1. That is, some or all of the functions of the user terminal 30 may be functions of the image processing device 10, and some or all of the functions of the image processing device 10 may be functions of the user terminal 30. Furthermore, some or all of the functions of the user terminal 30 and the image processing device 10 constituting the information processing system 1 may be transferred to another server (not shown) or the like. This promotes processing in the information processing system 1 as a whole, and also makes it possible for the processes to be complemented.

[0027] <Hardware configuration of image processing device> FIG. 2 is a diagram illustrating an example of a hardware configuration of the image processing device 10. As shown in FIG. The image processing device 10 has a control unit 11, a memory 12, a storage unit 13, a communication unit 14, an operation unit 15, a display unit 16, a reading unit 17, an image forming unit 18, and a sensor unit 19. These units are connected to each other via a data bus, an address bus, a PCI (Peripheral Component Interconnect) bus, etc.

[0028] The control unit 11 is a processor that controls the functions of the image processing device 10 through the execution of various software such as an OS (operating system) and application software. The control unit 11 is composed of, for example, a CPU (Central Processing Unit). The memory 12 is a storage area that stores various software and data used for executing the software, and is used as a working area for calculations. The memory 12 is composed of, for example, a RAM (Random Access Memory).

[0029] The storage unit 13 is a storage area for storing input data for various software programs and output data from various software programs. The storage unit 13 is composed of, for example, a hard disk drive (HDD), a solid state drive (SSD), a semiconductor memory, etc., used for storing programs and various setting data. The storage unit 13 is provided with, for example, a device DB 131 in which device information is stored, an authentication DB 132 in which authentication information is stored, etc., as databases for storing various information.

[0030] The communication unit 14 transmits and receives data between the user terminal 30 and the outside via the network 90. ​​The operation unit 15 is composed of, for example, a software keyboard, mechanical buttons, switches, etc., and accepts input operations. The operation unit 15 also includes a touch sensor that configures a touch panel integrally with the display unit 16. The display unit 16 is composed of, for example, a liquid crystal display or an organic EL (Electro Luminescence) display used to display information, and displays images, text data, etc.

[0031] The reading unit 17 reads an image recorded on a medium such as paper (e.g., a paper document) as a recording medium. The reading unit 17 is composed of, for example, a CCD type scanner that reduces the reflected light of light irradiated from a light source onto an original document using a lens and receives the light with a CCD (Charge Coupled Devices), or a CIS type scanner that receives the reflected light of light irradiated in sequence from an LED light source onto an original document using a CIS (Contact Image Sensor). The reading unit 17 also reads information of an image displayed on the display unit 16 via a camera (e.g., a QR code (registered trademark)).

[0032] The image forming unit 18 forms an image to be printed on a printing surface of a sheet of paper as a recording medium by, for example, an electrophotographic method or an inkjet method, etc. The sensor unit 19 is composed of various sensors such as a human presence sensor, an ambient light sensor, a proximity sensor, an optical sensor such as LiDAR (Light Detection And Ranging), and an acceleration sensor, and detects a direct operation of the image processing device 10 by a user.

[0033] <Hardware configuration of user terminal> The hardware configuration of the user terminal 30 is similar to the hardware configuration of the image processing device 10 shown in Fig. 2 except for the image forming unit 18 and the sensor unit 19. That is, the user terminal 30 is equipped with a control unit, a memory, a storage unit, a communication unit, an operation unit, a display unit, and a reading unit that have the same functions as the control unit 11, the memory 12, the storage unit 13, the communication unit 14, the operation unit 15, the display unit 16, and the reading unit 17, respectively, of Fig. 2, and illustration and description thereof are omitted.

[0034] <Functional configuration of the control unit of the image processing device> FIG. 3 is a diagram showing an example of a functional configuration of the control unit 11 of the image processing device 10. As shown in FIG. In the control unit 11 of the image processing device 10, an information management unit 101, an acquisition unit 102, an event determination unit 103, a generation unit 104, a job determination unit 105, a display control unit 106, a transmission control unit 107, and an operation restriction unit 108 function.

[0035] The information management unit 101 stores and manages various types of information in a database of the storage unit 13 (see FIG. 2). For example, the information management unit 101 stores and manages device information in a device DB 131. The device information includes, for example, information capable of uniquely identifying the image processing device 10. Examples of information capable of uniquely identifying the image processing device 10 include a uniform resource locator (URL), an email address, and a service set identifier (SSID) for accessing the image processing device 10. The information management unit 101 also stores and manages authentication information in an authentication DB 132. Examples of the authentication information include an authentication ID and a password that are generated in one time.

[0036] The acquisition unit 102 acquires various kinds of information. For example, the acquisition unit 102 acquires various kinds of information transmitted from the user terminal 30. Examples of the information transmitted from the user terminal 30 include read information of identification information displayed on the image processing device 10, input information input to execute a job, and the like.

[0037] The event determination unit 103 determines whether an event has occurred that starts a direct operation on the image processing device 10. Whether an event has occurred that starts a direct operation is determined based on, for example, whether an event such as the approach of an object (e.g., a human being) or the setting of a document has occurred. Specifically, the event determination unit 103 detects the approach of an object, the setting of a document, etc., based on the result of sensing by the sensor unit 19 (see FIG. 2), and determines whether an event has occurred that starts a direct operation on the image processing device 10.

[0038] The generating unit 104 generates identification information to be displayed on the image processing device 10. Specifically, the generating unit 104 generates a QR code (registered trademark) as identification information in which device information and authentication information are associated with each other. When generating the identification information, the generating unit 104 generates one-time identification information in which the associated authentication information is updated every time the identification information is displayed on the image processing device 10.

[0039] The job determination unit 105 determines whether or not a job has been executed instructed by the user terminal 30 that has read the identification information displayed on the image processing device 10. Specifically, the job determination unit 105 determines whether or not the instructed job has been executed based on the history of jobs executed by the image processing device 10.

[0040] The display control unit 106 performs control to cause the display unit 16 (see FIG. 2) to display various types of information. For example, the display control unit 106 performs control to cause the display unit 16 to display a user interface. The display control unit 106 also performs control to cause the display unit 16 to display identification information.

[0041] The display control unit 106 also performs control to display various types of information on the display unit of the user terminal 30. For example, the display control unit 106 performs control to share and display the user interface displayed on the display unit 16 on the display unit of the user terminal 30. The display control unit 106 also performs control to display unexecutable information on the display unit of the user terminal 30. The display control unit 106 also performs control to display handling information on the display unit of the user terminal 30. The display control unit 106 also performs control to display alternative job information on the display unit of the user terminal 30.

[0042] The transmission control unit 107 performs control for transmitting various types of information via the communication unit 14 (see FIG. 2). For example, the transmission control unit 107 performs control for transmitting various types of information toward the user terminal 30. Examples of the information transmitted toward the user terminal 30 include control information for causing the user terminal 30 to execute various processes.

[0043] Examples of control information for causing the user terminal 30 to execute various processes include control information for shared display of the user interface displayed on the display unit 16 of the image processing device 10 on the display unit of the user terminal 30, control information for displaying unexecutable information, control information for displaying handling information, and control information for displaying alternative job information.

[0044] The operation restriction unit 108 restricts remote operations on the image processing device 10. For example, the operation restriction unit 108 restricts remote operations on the image processing device 10 from terminals other than the user terminal 30 that has read the displayed identification information. Furthermore, the operation restriction unit 108 restricts remote operations on the image processing device 10 from terminals other than the user terminal 30 that has read the identification information displayed on the image processing device 10 and that has been authenticated based on the authentication information associated with the identification information.

[0045] Furthermore, after displaying the identification information, the operation restriction unit 108 starts a direct operation on the image processing device 10, and when the direct operation is completed, restricts remote operation on the image processing device 10 from the user terminal 30 that read the identification information. Furthermore, if a direct operation on the image processing device 10 is not started after displaying the identification information, the operation restriction unit 108 restricts remote operation on the image processing device 10 from the user terminal 30 that read the identification information.

[0046] <Functional configuration of the control unit of the user terminal> FIG. 4 is a diagram illustrating an example of a functional configuration of the control unit of the user terminal 30. As shown in FIG. In the control section of the user terminal 30, an acquisition section 301, a transmission control section 302, and a display control section 303 function.

[0047] The acquisition unit 301 acquires various kinds of information. For example, the acquisition unit 301 acquires input information that is accepted by an operation unit of the user terminal 30. The acquisition unit 301 also acquires identification information that is read by a reading unit of the user terminal 30. The acquisition unit 301 also acquires various kinds of information transmitted from the image processing device 10. Examples of the information transmitted from the image processing device 10 include control information for causing the user terminal 30 to execute various processes.

[0048] The transmission control unit 302 performs control to transmit various kinds of information via the communication unit. For example, the transmission control unit 302 performs control to transmit various kinds of information toward the image processing device 10. Examples of information to be transmitted toward the image processing device 10 include input information acquired by the acquisition unit 301. Examples of input information acquired by the acquisition unit 301 and transmitted toward the image processing device 10 include read information obtained by reading identification information displayed on the image processing device 10, input information input to execute a job, and the like.

[0049] The display control unit 303 performs control to display various types of information on the display unit. For example, the display control unit 303 performs control to display a user interface displayed on the display unit 16 (see FIG. 2) of the image processing device 10 on the display unit of the user terminal 30 in a shared manner. The display control unit 303 also performs control to display unexecutable information on the display unit. The display control unit 303 also performs control to display handling information. The display control unit 303 also performs control to display substitute job information. Specifically, the display control unit 303 causes the display unit to display these pieces of information based on the control information acquired by the acquisition unit 301.

[0050] <Processing flow of image processing device> FIG. 5 is a flowchart showing the flow of processing in the image processing device 10. The image processing device 10 stores and manages device information and authentication information in a database (step 501). Specifically, the image processing device 10 stores and manages device information in a device DB 131 of the storage unit 13 (see FIG. 2) and stores and manages authentication information in an authentication DB 132.

[0051] When an event occurs that starts a direct operation on the image processing device 10 (YES in step 502), the image processing device 10 displays the identification information on the display unit 16 (see FIG. 2) of the image processing device 10 (step 503), and proceeds to the determination process of step 504. On the other hand, when an event that starts a direct operation on the image processing device 10 has not occurred (NO in step 502), the image processing device 10 repeats the determination process of step 502.

[0052] When the image processing device 10 receives read information from the user terminal 30 that read the identification information as a request for authentication from the user terminal 30 that read the identification information (YES in step 504), the image processing device 10 acquires the transmitted read information (step 505). Then, the image processing device 10 performs authentication based on the acquired read information (step 506). Specifically, the image processing device 10 authenticates the user terminal 30 based on the device information and authentication information associated with the identification information specified from the acquired read information, and transmits information indicating this to the user terminal 30. On the other hand, if the read information has not been transmitted (NO in step 504), the image processing device 10 repeats the determination process in step 504 until the read information is transmitted.

[0053] When an instruction to execute a job is sent from the user terminal 30 (YES in step 507), the image processing device 10 accepts the instruction (step 508) and proceeds to the determination process of step 509. On the other hand, if an instruction to execute a job has not been sent (NO in step 507), the image processing device 10 repeats the determination process of step 507 until an instruction to execute a job is sent.

[0054] If the job instruction received in step 508 is a job instruction from the user terminal 30 authenticated in step 506 (YES in step 509), the image processing device 10 executes the job received in step 508 (step 510) and proceeds to the decision process of step 513. On the other hand, if the job instruction received in step 508 is not a job instruction from the user terminal 30 authenticated in step 506 (NO in step 509), the image processing device 10 does not execute the requested job (step 511), but transmits execution impossible information to the user terminal 30 (step 512), and ends the process (END).

[0055] When the user who has been directly operating the image processing device 10 leaves (YES in step 513), the image processing device 10 cancels the display of the identification information (step 514) and ends the process (END). On the other hand, when the user who has been directly operating the image processing device 10 has not left (NO in step 513), the image processing device 10 returns to the determination process in step 507.

[0056] <Processing flow on user terminal> FIG. 6 is a flowchart showing the flow of processing performed by the user terminal 30. The user terminal 30 accepts an input operation for setting a job to be executed by the image processing device 10 (step 601). When a user approaches the image processing device 10 and identification information is displayed on the image processing device 10 (YES in step 602), the user terminal 30 reads the identification information displayed on the image processing device 10 based on the user's operation (step 603), transmits the read information to the image processing device 10 as an authentication request (step 604), and proceeds to the determination process of step 605. On the other hand, if the identification information is not displayed on the image processing device 10 (NO in step 602), the user terminal 30 repeats the determination process of step 602 until the identification information is displayed on the image processing device 10.

[0057] When the user terminal 30 receives information indicating that the user has been authenticated from the image processing device 10 (YES in step 605), the user terminal 30 acquires the information (step 606) and transmits an instruction to execute a job to the image processing device 10 (step 607). Then, the process proceeds to the decision process of step 608. On the other hand, when information indicating that the user has not been authenticated is received (NO in step 605), the process of the user terminal 30 returns to the decision process of step 602.

[0058] When the user terminal 30 receives control information for displaying the execution impossible information from the image processing device 10 (YES in step 608), the user terminal 30 displays the execution impossible information (step 609) and proceeds to the decision process of step 611. On the other hand, when the control information for displaying that the job is being executed is received (NO in step 608), the user terminal 30 displays that the job is being executed (step 610) and ends the process (END).

[0059] When the user terminal 30 receives control information for displaying the handling information from the image processing device 10 (YES in step 611), the user terminal 30 displays the handling information (step 612). On the other hand, when the control information for displaying the handling information has not been received (NO in step 611), the process of the user terminal 30 proceeds to the determination process of step 613.

[0060] When control information for displaying the alternative job information is transmitted from the image processing device 10 to the user terminal 30 (YES in step 613), the user terminal 30 displays the alternative job information (step 614) and ends the process (END). On the other hand, when control information for displaying the alternative job information is not transmitted (NO in step 613), the process of the user terminal 30 returns to the decision process of step 608.

[0061] <Example> FIG. 7 is a diagram showing a specific example of a user interface displayed on each of the image processing device 10 and the user terminal 30. As shown in FIG. 7 shows a specific example of a user interface (hereinafter referred to as a "direct operation screen") displayed on the image processing device 10. The lower part of Fig. 7 shows a specific example of a user interface (hereinafter referred to as a "remote operation screen") displayed on the user terminal 30.

[0062] The user 21 operates the user terminal 30-1 to set a job to be executed by the image processing device 10 and to issue an instruction to execute the job. For example, when the job that the user 21 wants the image processing device 10 to execute is a job of reading processing, setting information as shown in FIG. 7 is displayed on the remote operation screen. That is, the notation "Scan setting" indicating that this is a screen for setting reading processing, and notations "Email transmission", "Color", and "PDF" indicating the contents of the job setting of the reading processing are displayed. The user 21 checks the contents of the job setting of the reading processing and presses the button 201 marked "Execute". This causes an instruction to be transmitted to the image processing device 10 to execute the job.

[0063] When the user 21 approaches the image processing device 10, the image processing device 10 detects the approach of the user 21 and displays identification information. At this time, if there are multiple image processing devices 10 in the vicinity, the user 21 may select an available image processing device 10 and approach it. In the example of the direct operation screen shown in FIG. 7, a screen (left diagram) that is displayed before the approach of the user 21 is detected and a screen (right diagram) that is displayed after the approach of the user 21 is detected are shown. In the screen (right diagram) that is displayed after the approach of the user 21 is detected, a QR code (registered trademark) is displayed as the identification information 200 together with the notation "remote" indicating that this is identification information for performing remote operation.

[0064] The user 21 operates the user terminal 30-1 to read the identification information displayed on the direct operation screen. Specifically, the user 21 performs an operation to activate the camera of the user terminal 30-1 and an operation to display the identification information 200 on the remote operation screen. At this time, a message such as "Please read the QR code with the camera" shown in Fig. 7 may be displayed on the remote operation screen.

[0065] The user terminal 30-1 reads the identification information 200 displayed on the remote operation screen, and transmits the read information to the image processing device 10. Then, authentication is performed in the image processing device 10, and a job for the reading process is executed. At this time, messages such as "Scanning," "Sending mail," and "Please pick up the document" are displayed on the remote operation screen, for example, as shown in FIG.

[0066] A validity period may be set for the identification information 200 displayed on the image processing device 10. In this case, even if the user terminal 30-1 reads the identification information 200, if the read information is transmitted after a predetermined time has elapsed since the identification information 200 was displayed, authentication based on the read information of the identification information 200 is not performed. Furthermore, remote operation from the user terminal 30-2 of the user 22 who has not read the identification information 200 displayed on the image processing device 10 is restricted. Furthermore, even if the user 22 reads the identification information 200 by operating the user terminal 30-2, if the reading is performed after the reading by the user terminal 30-1, remote operation from the user terminal 30-2 is restricted.

[0067] The identification information 200 displayed on the image processing device 10 becomes invalid when the user 21 leaves in front of the image processing device 10. Therefore, even if the identification information 200 is captured and stored in the user terminal 30, the identification information 200 is invalidated when the user 21 leaves in front of the image processing device 10, and authentication is not performed using the stored identification information 200. The period during which the identification information 200 generated and displayed by the image processing device 10 is valid is, for example, a period during which the approach of the user 21 is detected or a period during which a document is set.

[0068] FIG. 8A is a diagram showing a specific example of a remote operation screen displayed on the user terminal 30 when the image processing apparatus 10 cannot execute a job instructed by the user. The user 21 operates the user terminal 30-1 to set a job to be executed by the image processing device 10 and to issue an instruction to execute the job. For example, as in the example of FIG. 7 described above, assume that the job that the user 21 wants the image processing device 10 to execute is a reading process job. In this case, if the image processing device 10 can execute the instructed reading process job without any problems, the remote operation screen illustrated in FIG. 7 described above is displayed. On the other hand, if the image processing device 10 cannot execute the job, for example, because it does not have the ability to execute the instructed reading process job, a remote operation screen such as that shown in FIG. 8(A) is displayed.

[0069] That is, as shown in Fig. 8(A), for example, a notation "Document (Cannot be executed)" is displayed, indicating that the job cannot be executed because the document format is not supported. In this case, even if the user 21 presses the button 201 labeled "Execute", an error is displayed because the image processing device 10 cannot execute the job. The user 21 can execute the reading process job by changing the settings of the reading process job. Although not shown, handling information and alternative job information may be displayed on the remote operation screen together with the information indicating that the job cannot be executed.

[0070] FIG. 8B is a diagram showing a specific example in which the identification information 200 displayed by the image processing device 10 is switched. As shown in Fig. 7 above, when the user 21 approaches the image processing device 10, the image processing device 10 detects the approach of the user 21 and displays the identification information 200. At this time, if the user 21 who was in front of the image processing device 10 is replaced by the user 22 and the sensor unit 19 (see Fig. 2) of the image processing device 10 cannot detect this, the displayed identification information 200 is not updated. In this case, even if the replaced user 22 reads the identification information 200 with the user terminal 30-2, remote connection is restricted as described above. For this reason, in this embodiment, the following process is performed.

[0071] That is, after displaying the identification information 200, when the image processing device 10 executes a job instructed by the user terminal 30 (e.g., the user terminal 30-1 in FIG. 7 described above) that read the identification information 200, the image processing device 10 switches to display the identification information 200 with updated associated authentication information as shown in the upper part of FIG. 8(B). Also, when read information is transmitted to the image processing device 10 as an authentication request from the user terminal 30 (e.g., the user terminal 30-1 in FIG. 7 described above) that read the identification information, the image processing device 10 switches to display the identification information 200 with updated associated authentication information as shown in the lower part of FIG. 8(B). In this case, for example, a message such as "Authentication of the previous user has been cancelled. Please read the QR code again" is displayed on the remote operation screen of the user terminal 30-2 of the replaced user 22.

[0072] <Other embodiments> Although the present embodiment has been described above, the present invention is not limited to the above-mentioned embodiment. Moreover, the effects of the present invention are not limited to those described in the above-mentioned embodiment. For example, the configuration of the information processing system 1 shown in FIG. 1 and the hardware configuration of the image processing device 10 shown in FIG. 2 are merely examples for achieving the object of the present invention, and are not particularly limited. Moreover, the functional configuration of the image processing device 10 shown in FIG. 3 and the functional configuration of the user terminal 30 shown in FIG. 4 are also merely examples, and are not particularly limited. It is sufficient that the information processing system 1 of FIG. 1 has a function capable of executing the above-mentioned processing as a whole, and the functional configuration used to realize this function is not limited to the examples of FIG. 3 and FIG. 4.

[0073] In addition, the order of each step of the process of the image processing device 10 shown in Fig. 5 and the process of the user terminal 30 shown in Fig. 6 is merely an example and is not particularly limited. The process is not limited to the process performed in chronological order according to the order of the steps shown in the figure, and may be performed in parallel or individually without necessarily being performed in chronological order. In addition, the specific examples shown in Figs. 7 and 8 are also merely examples and are not particularly limited.

[0074] For example, in the above embodiment, the reading process is exemplified as the process that the user causes the image processing device 10 to execute, but is not limited to this. For example, the process may be a print process for forming an image on a medium such as paper and outputting it, a copy process for copying an image of an original onto a medium such as paper and outputting it, a read process for reading an image formed on paper or the like, a fax process for transmitting an original by facsimile, etc.

[0075] (Additional Note) (((1))) one or more processors; The one or more processors: When an event occurs that starts a direct operation on the image processing device, predetermined identification information is displayed on the image processing device; a terminal that has read the identification information and that restricts remote operations of the image processing device from a terminal other than the terminal that has read the identification information; Information processing system. (((2))) The one or more processors: displaying, on the image processing device, information relating to the image processing device and information for authentication as the identification information; a terminal that has read the identification information and that is not authenticated based on the authentication information, is restricted from remote operation of the image processing device from a terminal other than the terminal that has read the identification information and that is authenticated based on the authentication information; An information processing system according to (((1))). (((3))) the one or more processors cause the image processing device to display the one-time identification information, the information for authentication being updated each time the identification information is displayed on the image processing device, The information processing system according to (((2))). (((4))) the one or more processors restrict remote operations of the image processing device from terminals other than a terminal authenticated based on the unused authentication information among the terminals that have read the identification information. The information processing system according to (((2))). (((5))) the one or more processors, when a predetermined condition is satisfied after the identification information is displayed on the image processing device, switch to display the identification information with the information for authentication updated on the image processing device. The information processing system according to (((4))). (((6))) The condition is that a job instructed from a terminal that has read the identification information has been executed. The information processing system according to (((5))). (((7))) The condition is that an authentication request is made from another terminal that has read the identification information. The information processing system according to (((5))). (((8))) the one or more processors, when the direct operation is completed or the direct operation is not started after the identification information is displayed on the image processing device, restrict a remote operation of the image processing device from a terminal that has read the identification information. 13. An information processing system according to any one of ((1)) to ((7))). (((9))) the one or more processors determine that the direct manipulation is completed or that the direct manipulation has not been started when a person moves away from the image processing device. An information processing system according to (((8))). (((10))) the one or more processors determine that the direct operation is completed or that the direct operation has not been started when the document is removed from the image processing device. An information processing system according to (((8))). (((11))) The one or more processors determine that the direct manipulation is started when an object approaches the image processing device. 13. An information processing system according to any one of ((1)) to ((10)). (((12))) The one or more processors determine that the direct operation is started when a person approaches the image processing device. The information processing system according to (((11))). (((13))) The one or more processors determine that the direct operation is started when a document is set in the image processing device. The information processing system according to (((11))). (((14))) When the image processing device cannot execute a job instructed by a terminal that has read the identification information, the one or more processors display a message to that effect on the terminal. 13. An information processing system according to any one of claims 1 to 13. (((15))) the one or more processors display at least one of information for enabling the image processing device to execute the job and information on a job other than the job that can be executed by the image processing device on the terminal. The information processing system according to (((14))). (((16))) On the computer, a function of displaying predetermined identification information on the image processing device when an event occurs that starts a direct operation on the image processing device; a function of restricting remote operations of the image processing device from terminals other than the terminal that has read the identification information; A program to achieve this.

[0076] According to the present invention (((1))), when an event occurs that starts a direct operation on the image processing device, predetermined identification information is displayed on the image processing device. Then, remote operation of the image processing device from a terminal other than the terminal that read the identification information is restricted. This makes it possible to prevent information on a document set in the image processing device from being leaked via a terminal remotely connected to the image processing device. According to the present invention (((2))), identification information in which information about the image processing device and information for authentication are associated with each other is displayed on the image processing device. Then, authentication based on the information for authentication is performed on a terminal attempting to connect to the image processing device by reading the identification information displayed on the image processing device. This makes it possible to authenticate the use of the image processing device by having a terminal read the identification information displayed on the image processing device. According to the present invention (((3))), one-time identification information is displayed on the image processing device. This enables so-called one-time authentication for use of the image processing device by having a terminal read the identification information displayed on the image processing device. According to the present invention (((4))), among the terminals that have read the identification information, remote operation from terminals other than the terminal authenticated based on the unused authentication information is restricted. This makes it possible to prevent duplicate use of identification information that has been used once. According to the present invention (((5))), after the identification information is displayed on the image processing device, when a predetermined condition is satisfied, the identification information with updated authentication information is displayed on the image processing device. This makes it possible to remotely operate the image processing device from the terminal that reads the switched and displayed identification information. According to the present invention (((6))), after the identification information is displayed on the image processing device, when a job instructed from the terminal that read the identification information is executed, the identification information with updated authentication information is switched and displayed on the image processing device, thereby enabling remote operation of the image processing device from the terminal that read the switched and displayed identification information. According to the present invention (((7))), after the identification information is displayed on the image processing device, when another terminal that read the identification information requests authentication, the identification information with updated information for authentication is displayed on the image processing device, thereby enabling remote operation of the image processing device from the terminal that read the switched and displayed identification information. According to the present invention (((8))), when a direct operation on the image processing device is completed or when a direct operation on the image processing device is not started after the identification information is displayed on the image processing device, remote operation of the image processing device from the terminal that read the identification information is restricted. This makes it possible to prevent the image processing device from being used exclusively by a remote operation from the terminal that read the identification information. According to the present invention (((9))), when a person moves away from the image processing device after the identification information is displayed on the image processing device, it is determined that the direct operation on the image processing device is completed or that the direct operation on the image processing device has not been started. This makes it possible to make the determination using a human presence sensor or the like that is already installed in the image processing device. According to the present invention (((10))), when the document set in the image processing device is removed after the identification information is displayed on the image processing device, it is determined that the direct operation on the image processing device is completed or that the direct operation on the image processing device has not been started. This makes it possible to make the determination using a proximity sensor or the like that is provided in the image processing device. According to the present invention (((11))), when an object approaches an image processing device, it is determined that a direct operation on the image processing device is to be started. This makes it possible to make such determination using various sensors that are provided in the image processing device in advance. According to the present invention (((12))), when a person approaches the image processing device, it is determined that a direct operation on the image processing device is to be started. This makes it possible to make such a determination using a human presence sensor or the like that is provided in the image processing device in advance. According to the present invention (((13))), when a document is set on the image processing device, it is determined that a direct operation on the image processing device is started. This makes it possible to make the determination using a proximity sensor or the like that is provided in the image processing device in advance. According to the present invention (((14))), if the image processing device cannot execute the job instructed from the terminal that read the identification information, a message to that effect is displayed on the terminal. This allows the user who instructed the job from the terminal to know that the job he or she instructed cannot be executed for some reason, and allows the user to consider how to respond. According to the present invention (((15))), when an image processing device cannot execute a job specified by a terminal that has read the identification information, at least one of information for enabling the job to be executed and information about other executable jobs is displayed on the terminal, thereby enabling the user who specified the job to know how to deal with the job that cannot be executed. According to the present invention (((16))), when an event occurs that initiates a direct operation on the image processing device, predetermined identification information is displayed on the image processing device. Then, remote operation of the image processing device from a terminal other than the terminal that read the identification information is restricted. This makes it possible to prevent information about a document set on the image processing device from being leaked via a terminal remotely connected to the image processing device. [Explanation of symbols]

[0077] 1...information processing system, 10...image processing device, 11...control unit, 30...user terminal, 90...network, 101...information management unit, 102...acquisition unit, 103...event determination unit, 104...generation unit, 105...job determination unit, 106...display control unit, 107...transmission control unit, 108...operation restriction unit, 301...acquisition unit, 302...transmission control unit, 303...display control unit

Claims

1. One or more processors; The one or more processors: When an event occurs that starts a direct operation on the image processing device, predetermined identification information is displayed on the image processing device; a terminal that has read the identification information and that restricts remote operations of the image processing device from a terminal other than the terminal that has read the identification information; Information processing system.

2. The one or more processors: displaying, on the image processing device, information relating to the image processing device and information for authentication as the identification information; a terminal that has read the identification information and that is not authenticated based on the authentication information, is restricted from remote operation of the image processing device from a terminal other than the terminal that has read the identification information and that is authenticated based on the authentication information; The information processing system according to claim 1 .

3. the one or more processors cause the image processing device to display one-time identification information, the information for authentication being updated each time the identification information is displayed on the image processing device, The information processing system according to claim 2 .

4. the one or more processors restrict remote operations of the image processing device from terminals other than a terminal authenticated based on the unused authentication information among the terminals that have read the identification information. The information processing system according to claim 2 .

5. and when a predetermined condition is satisfied after the identification information is displayed on the image processing device, the one or more processors switch to display the identification information with the information for authentication updated on the image processing device.

5. The information processing system according to claim 4.

6. The condition is that a job instructed from a terminal that has read the identification information has been executed.

6. The information processing system according to claim 5.

7. The condition is that an authentication request is made from another terminal that has read the identification information.

6. The information processing system according to claim 5.

8. the one or more processors are configured to restrict remote operation of the image processing device from a terminal that has read the identification information when the direct operation is completed or the direct operation is not started after the identification information is displayed on the image processing device, The information processing system according to claim 1 .

9. the one or more processors determine that the direct manipulation is completed or that the direct manipulation has not been started when a person moves away from the image processing device. The information processing system according to claim 8.

10. the one or more processors determine that the direct manipulation is completed or that the direct manipulation has not been started when the document is removed from the image processing device. The information processing system according to claim 8.

11. The one or more processors determine that the direct manipulation is started when an object approaches the image processing device. The information processing system according to claim 1 .

12. The one or more processors determine that the direct operation is started when a person approaches the image processing device. The information processing system according to claim 11.

13. The one or more processors determine that the direct operation is started when a document is set in the image processing device. The information processing system according to claim 11.

14. When the image processing device is unable to execute a job instructed by a terminal that has read the identification information, the one or more processors display a message to that effect on the terminal. The information processing system according to claim 1 .

15. the one or more processors display at least one of information for enabling the image processing device to execute the job and information on a job other than the job that can be executed by the image processing device on the terminal.

15. The information processing system according to claim 14.

16. On the computer, a function of displaying predetermined identification information on the image processing device when an event occurs that starts a direct operation on the image processing device; a function of restricting remote operations of the image processing device from terminals other than the terminal that has read the identification information; A program to achieve this.

Images