Information processing system and program

Abstract

To provide an information processing system and a program that allow a user to obtain connection information for connecting to image information on the display screen of an information processing device with a simpler operation than when the user obtains the information by visual inspection or search.SOLUTION: An information processing system includes a processor that generates a display screen for an information processing device 100 and makes the connection information for connecting to the image information of the generated display screen available for reception by an external terminal device 200 that is placed within a readable distance of the information processing device 100.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system and a program. [Background technology]

[0002] Patent Document 1 discloses an image processing device that generates a web page showing the job processing status in the image processing device, and the web page can be viewed on a terminal device connected via a network.

[0003] Furthermore, Patent Document 2 below discloses an information transmission device that allows a screen common to the screen displayed on the display unit to be viewed on an external device. This information device generates a web page including image data showing the screen common to the screen displayed on the display unit of the information transmission device, and transmits the generated web page to the information processing device.

[0004] Patent Document 3 discloses an image forming device that uses short-range wireless communication technology to launch a desired application by simply touching a mobile terminal to the image forming device, allowing the user to issue printing instructions and check the status on the mobile terminal. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-040880 [Patent Document 2] Japanese Patent Application Laid-Open No. 2012-014280 [Patent Document 3] Japanese Patent Application Laid-Open No. 2015-230539 Summary of the Invention [Problem to be solved by the invention]

[0006] Conventionally, image processing devices equipped with web server functionality have been known. These image processing devices generate web pages showing the job processing status of the image processing device, and the web pages can be viewed on a terminal device connected via a network. However, users have had to visually check or search for connection information, such as a URL, indicating the location of the web page. For example, when the URL is displayed on the display unit of the image processing device, the user has to manually input the visually confirmed URL into the terminal device. Alternatively, for example, the user has had to access the image processing device or a server from the terminal device via a network and search for the URL of the web page corresponding to the image processing device.

[0007] Therefore, the object of the present disclosure is to provide an information processing system and a program that enable a user to obtain connection information for connecting to image information on the display screen of an information processing device with simpler operations than when the user obtains the information visually or by searching. [Means for solving the problem]

[0008] The information processing system of the first aspect of the present disclosure includes: a processor; The processor: generating a display screen of the information processing device; The connection information for connecting to the generated image information on the display screen is made available for reception by an external terminal device that is brought close enough to the information processing device to read the connection information.

[0009] An information processing system according to a second aspect of the present disclosure is the information processing system according to the first aspect, wherein the processor makes the connection information receivable by the external terminal device via close proximity wireless communication or short-range wireless communication.

[0010] An information processing system of a third aspect of the present disclosure is an information processing system according to the second aspect, in which the processor writes the connection information to a contactless IC chip for close proximity wireless communication, thereby making the connection information receivable by the external terminal device via close proximity wireless communication.

[0011] An information processing system of a fourth aspect of the present disclosure is an information processing system according to the third aspect, in which the processor issues the connection information for each image processing and rewrites the connection information written in the contactless IC chip with the newly issued connection information.

[0012] An information processing system according to a fifth aspect of the present disclosure is the information processing system according to the third aspect, wherein the processor transmits the connection information to an external terminal device that has been wirelessly connected in advance via the short-range wireless communication.

[0013] An information processing system of a sixth aspect of the present disclosure is the information processing system of the first aspect, further comprising a display device, and the processor displays the connection information as code information on the display device, thereby enabling the external terminal device to take an image.

[0014] An information processing system of a seventh aspect of the present disclosure is the information processing system of the first aspect, further comprising a display device, and when the processor detects a connection from the external terminal device to image information of the display screen identified by the connection information, the processor transmits the image information of the display screen displayed on the display device to the external terminal device, and makes the image of the display screen invisible except to the external terminal device.

[0015] An information processing system according to an eighth aspect of the present disclosure is the information processing system according to the seventh aspect, wherein the processor erases an image on the display screen being displayed on the display device.

[0016] An information processing system according to a ninth aspect of the present disclosure is the information processing system according to the seventh aspect, wherein the processor changes the image on the display screen currently being displayed on the display device to an initial image and displays the image.

[0017] An information processing system of a tenth aspect of the present disclosure is an information processing system according to any one of the seventh to ninth aspects, wherein the processor resumes displaying the image on the display screen on the display device when the processor receives a request from the external terminal device to display the image on the display screen again on the display device.

[0018] An information processing system of an eleventh aspect of the present disclosure is an information processing system according to the tenth aspect, further comprising an input device, wherein when the processor receives a request from the external terminal device to re-display the image of the display screen on the display device and the input device is being operated, the processor does not resume displaying the image of the display screen on the display device, but notifies the external terminal device that the input device is being operated.

[0019] An information processing system of a twelfth aspect of the present disclosure is an information processing system according to the seventh aspect, wherein the processor is capable of accepting operations from a pre-authenticated user, and when a connection from the external terminal device to image information of the display screen identified by the connection information is detected, the information processing system enters an authenticated state in which operations can be performed on the display screen from the external terminal device, and an authenticated state in which operations cannot be performed from the display screen currently being displayed on the display device.

[0020] An information processing system of a thirteenth aspect of the present disclosure is an information processing system according to the seventh aspect, wherein the processor sets a connection permission level for image information of a display screen during image processing for display on the display device, and issues the connection information for image information of a display screen that is permitted to be connected according to the connection permission level, and does not issue the connection information for image information of a display screen that is not permitted to be connected.

[0021] The program according to the fourteenth aspect of the present disclosure comprises: The computer of the information processing device generating a display screen of the information processing device; a step of making connection information for connecting to the generated image information of the display screen receivable by an external terminal device that is brought close enough to the information processing device to read the connection information; Execute the following.

[0022] The method of the fifteenth aspect of the present invention comprises: generating a display screen of the information processing device; a step of making connection information for connecting to the generated image information of the display screen receivable by an external terminal device that is brought close enough to the information processing device to read the connection information; Includes. [Effects of the Invention]

[0023] According to the information processing system of the first aspect of the present disclosure, an information processing system can be provided that allows a user to obtain connection information for connecting to image information on the display screen of an information processing device with simpler operations than when the user obtains the information by visual inspection or search.

[0024] According to the information processing system of the second aspect of the present disclosure, an image of a display screen showing the processing status of image processing currently being performed can be displayed without the user having to manually input connection information into an external terminal device.

[0025] According to the information processing system of the third aspect of the present disclosure, it is possible to transmit connection information to the external terminal device simply by bringing the external terminal device close to the contactless IC chip.

[0026] According to the information processing system of the fourth aspect of the present disclosure, it is possible to make it impossible to connect to image information of a display screen with different image processing from a terminal device that does not have connection information for that image.

[0027] According to the information processing system of the fifth aspect of the present disclosure, it is possible to transmit connection information to an external terminal device that has been wirelessly connected in advance to the terminal device without manually inputting the connection information into the external terminal device.

[0028] According to the information processing system of the sixth aspect of the present disclosure, an external terminal device can connect to image information on a display screen showing the processing status of image processing currently being performed without the user having to manually input connection information.

[0029] According to the information processing system of the seventh aspect of the present disclosure, when an image of a display screen is displayed on an external terminal device, it is possible to prevent the display screen from being operated by anything other than the external terminal device.

[0030] According to the information processing system of the eighth aspect of the present disclosure, when an image of the display screen is displayed on the external terminal device, it is possible to prevent the display device from being operated while viewing the display screen.

[0031] According to the information processing system of the ninth aspect of the present disclosure, when an image on the display screen is displayed on the external terminal device, it is possible to perform other image processing by operating the display device while viewing the display screen.

[0032] According to the information processing system of the tenth aspect of the present disclosure, the image on the display screen is transferred from the display device to an external terminal device, and then transferred from the external terminal device to the display device for display, making it possible to check the processing status of the image processing in progress and perform input operations.

[0033] According to the information processing system of the eleventh aspect of the present disclosure, when the input device is being operated, it is possible to prevent the image of the display screen that has been handed over to the external terminal device from being displayed again on the display device.

[0034] According to the information processing system of the twelfth aspect of the present disclosure, it is possible to operate the display screen only from an external terminal device that has entered an authenticated state.

[0035] According to the information processing system of the thirteenth aspect of the present disclosure, it is possible to continuously display only permitted display screens on the external terminal device.

[0036] According to the program of the 14th aspect of the present disclosure, it is possible to cause a computer to perform image processing in which connection information to a display screen showing the processing status of the image processing being performed can be obtained with simpler operations than when a user obtains it visually or by searching.

[0037] According to the method of the 15th aspect of the present disclosure, image processing can be performed in such a way that connection information for connecting to image information on the display screen of an information processing device can be obtained with simpler operations than when the user obtains it visually or by searching. [Brief explanation of the drawings]

[0038] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an image processing system according to a first embodiment. [Figure 2] FIG. 1 is a diagram illustrating a hardware configuration of an image processing apparatus according to a first embodiment. [Figure 3] FIG. 1 is a block diagram showing the functional configuration of an image processing apparatus according to a first embodiment. [Figure 4] FIG. 3 is a sequence diagram showing the flow of processing in the image processing system of the first embodiment. [Figure 5] FIG. 5 is a sequence diagram following FIG. 4 of the first embodiment. [Figure 6] FIG. 2 is a diagram showing an example of an initial screen displayed on a user IF device of the image processing apparatus of the first embodiment. [Figure 7] FIG. 4 is a diagram showing an example of a service screen displayed on a user IF device of the image processing apparatus of the first embodiment. [Figure 8] FIG. 10 is a diagram showing an example of a processing execution screen displayed on a user IF device of the image processing apparatus of the first embodiment. [Figure 9] FIG. 10 is a diagram showing an example of a processing execution screen displayed on a user IF device of the image processing apparatus of the first embodiment. [Figure 10]FIG. 10 is a diagram showing an example of a process execution screen displayed on a display device of a smartphone in the first embodiment. [Figure 11] FIG. 10 is a block diagram showing the functional configuration of an image processing apparatus according to a second embodiment. [Figure 12] FIG. 11 is a diagram showing an example of a process execution screen displayed on a display device of a smartphone in the third embodiment. [Figure 13] FIG. 11 is a diagram showing an example of a return operation acceptance screen displayed on a display device of a smartphone in the third embodiment. [Figure 14] 11 is a flowchart showing an example of processing when returning the operation screen to the image processing device in the third embodiment. [Figure 15] FIG. 11 is a diagram showing an example of a processing execution screen that is displayed again on the user IF device of the image processing apparatus according to the third embodiment. [Figure 16] FIG. 11 is a diagram showing an example of a display end screen displayed on a display device of a smartphone in the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0039] [Embodiment 1] An image processing system 10 according to a first embodiment of the present disclosure will be described in detail with reference to the drawings.

[0040] Fig. 1 is a diagram showing an example of the configuration of an image processing system 10 which is an embodiment of an information processing system of the present disclosure. As shown in Fig. 1, the image processing system 10 of the first embodiment includes an image processing device 100, a wireless LAN access point 200, and a smartphone 300 which is an external terminal device. The image processing device 100 and the wireless LAN access point 200 are connected to a network 400 such as a local area network. The wireless LAN access point 200 and the smartphone 300 are also network-connected via a wireless LAN. Note that in this embodiment, the external terminal device is described as the smartphone 300, but it may also be a computer terminal device with a communication function that can be carried by a user, such as a tablet computer or a notebook personal computer.

[0041] As will be described later, in embodiment 1, the image displayed on the user interface screen of the image processing device 100 is transferred to the smartphone 300, and the status of the job being executed on the image processing device 100 can be checked even after the user has left the image processing device 100.

[0042] Fig. 2 is a diagram showing the hardware configuration of image processing device 100. As shown in Fig. 2, image processing device 100 includes a CPU 101, a memory 102, and a storage device 103 such as a hard disk drive. Furthermore, image processing device 100 includes a communication IF device 104 that transmits and receives data via network 400, a user IF device 105 that includes a touch panel and a liquid crystal display, a scanning device 106, a printing device 107, and a contactless IC chip 108. These components are connected to each other via a control bus 109.

[0043] The CPU 101 executes predetermined processing based on a control program stored in the memory 102 or the storage device 103, and controls the operation of the image processing device 100. Note that this control program can also be stored in a portable storage medium such as a USB memory and provided to the CPU 101.

[0044] The memory 102 and the storage device 103 store a control program for operating the image processing device 100. Note that this control program can also be stored in a portable medium such as a USB memory instead of the memory 102 and the storage device 103, and provided from the portable medium.

[0045] The communication IF device 104 communicates with a wireless LAN access point 200 connected to a network 400 via a LAN cable (not shown) and with a smartphone 300. Furthermore, the communication IF device 104 is connected to a telephone line and transmits and receives facsimile data to and from other image processing devices or facsimile devices (not shown).

[0046] The user IF device 105 is an input / output device comprised of a liquid crystal display and a touch panel provided in the image processing device 100, and displays various screens on the liquid crystal display and accepts operations and inputs by the user when the user operates the touch panel.

[0047] The scanning device 106 reads an original placed on a platen (not shown), converts it into image data, and stores it in the memory 102 or the storage device 103. The printing device 107 forms an image on a recording medium such as paper, an image transmitted from a computer terminal (not shown) connected to the image processing device 100 via the network 400. The image data once stored in the memory 102 is printed on paper by the printing device 107, transmitted to a computer terminal connected to the image processing device 100 via the network 400, or transmitted to another image processing device or a facsimile machine via a telephone line.

[0048] The contactless IC chip 108 is, for example, an NFC (Near Field Communication) tag, and when the smartphone 300 is brought close to the contactless IC chip 108, wireless communication is established between the contactless IC chip 108 and the smartphone 300.

[0049] Next, the functional configuration of the image processing device 100 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the functional configuration of the image processing device 100 that is realized by the CPU 101 executing the above control program.

[0050] As shown in FIG. 3, the image processing device 100 includes a display control unit 110, an input operation control unit 111, a Web server unit 112, a scan control unit 113, an image formation control unit 114, and a communication control unit 115.

[0051] The display control unit 110 further includes a local screen generation control unit 116 and an external access screen generation control unit 117 .

[0052] The local screen generation control unit 116 generates a display screen image for displaying the status of the image processing device 100 on the liquid crystal display constituting the user IF device 105. Examples of the display screen include an image of an operation screen for accepting user operations, an image of a selection screen on which the user can perform operations to perform image processing in the image processing device 100, such as an initial screen or a processing in progress screen, as will be described later, or an image of a screen for displaying the status of that image processing.

[0053] The local screen generation control unit 116 makes the image of the operation screen displayed on the liquid crystal display constituting the user IF device 105 invisible to anything other than the external terminal device, depending on the connection status with the smartphone 300 from the communication control unit 115. For example, the image of the operation screen is erased or changed to an initial image.

[0054] The external access screen generation control unit 117 generates an image of an operation screen to be displayed on the screen of the smartphone 300, which corresponds to the operation screen displayed on the user IF device 105.

[0055] The processor of the image processing device 100 generates screen data required for displaying the display screen, specifically, HTML files and PNG images required for displaying the HTML files, image layout information (CSS), control information (Javascript (registered trademark)), etc.

[0056] The input operation control unit 111 accepts inputs made by a user operating the touch panel of the user IF device 105. For example, the user operates the touch panel to give input instructions for image processing such as copy operation, scan operation, and facsimile transmission operation, and the input operation control unit 111 accepts these operations and instructs the scan control unit 113, image formation control unit 114, and communication control unit 115 to perform corresponding operations.

[0057] For example, when a user operates the touch panel to perform a copy operation, the input operation control unit 111 outputs instructions to the scan control unit 113 and the image formation control unit 114. Then, the scan control unit 113 scans a sheet of paper placed on a platen and converts it into image data, and the image formation control unit 114 forms an image of the converted image data on the sheet of paper.

[0058] Furthermore, when a user operates the touch panel to perform a scan operation, the input operation control unit 111 outputs an instruction only to the scan control unit 113. The scan control unit 113 scans a sheet of paper placed on the platen, converts it into image data, and stores the image data in the memory 102 or the storage device 103.

[0059] When a user operates the touch panel to send a facsimile, the input operation control unit 111 outputs instructions to the scan control unit 113 and the communication control unit 115. The scan control unit 113 scans a sheet of paper placed on the platen, converts it into image data, and stores the image data in the memory 102 or the storage device 103. The stored image data is transmitted by the communication control unit 115 via a telephone line or the like to another image processing device or a facsimile transmitting / receiving device (not shown).

[0060] The web server unit 112 issues a URL, which is connection information for connecting from an external terminal device to the image information of the operation screen generated by the external access screen generation control unit 117. This connection information may be issued for each image processing. Alternatively, each time the operation screen generated by the local screen generation control unit 116 is switched, connection information for connecting to the image information of the operation screen generated by the external access screen generation control unit 117 in response to this may be issued.

[0061] This connection information is linked to the operation screen for the smartphone 300 that corresponds to the operation screen displayed on the liquid crystal display of the user IF device 105. After the operation screen is switched, even if previously generated connection information is accessed, the information of the operation screen is not transmitted. Alternatively, after the operation screen is switched, previously generated connection information cannot be accessed.

[0062] The scan control unit 113 controls the operation of the scanning device 106 in response to instructions from the input operation control unit 111 , and stores image data read by the scanning device 106 in the memory 102 or the storage device 103 .

[0063] The image formation control unit 114 controls the operation of the printing device 107 in response to instructions from the input operation control unit 111 or instructions from a computer terminal (not shown) connected to the image processing device 100 via the network 400, and forms an image of the image data on a recording medium such as paper.

[0064] The communication control unit 115 sets the image processing device 100 in a state where an external terminal device that has come close enough to read the connection information can directly receive the connection information. In other words, the communication control unit 115 sets the image processing device 100 in a state where a smartphone 300 that has come close enough to the non-contact IC chip 108 installed on the outer surface or inner surface of the housing of the image processing device 100 or the liquid crystal display of the user IF device 105 within a preset distance can directly receive the connection information.

[0065] Specifically, communication control unit 115 writes the connection information issued by web server unit 112 to contactless IC chip 108, thereby enabling the external terminal device to receive the connection information via close proximity wireless communication. When web server unit 112 issues new connection information, communication control unit 115 rewrites the connection information already written in contactless IC chip 108 with the newly issued connection information.

[0066] Furthermore, the communication control unit 115 detects or receives a connection to an image of an operation screen generated by the external access screen generation control unit 117, which is specified by the connection information, from the smartphone 300. In this case, the communication control unit 115 controls the operation of the communication IF device 104 and transmits the image of the operation screen to the smartphone 300 via the network 400.

[0067] Furthermore, the communication control unit 115 controls the operation of the communication IF device 104, and transmits image data read by the scanning device 106 to another image processing device or a facsimile device via a telephone line.

[0068] The operation of the image processing device 100 configured as above will be described with reference to Fig. 4 to Fig. 10. As shown in Fig. 4, in step S401, the local screen generation control unit 116 generates an initial screen 600 as shown in Fig. 6 and displays it on the liquid crystal display of the user IF device 105. As shown in Fig. 6, the initial screen 600 is an initial menu screen, and displays options from which processes such as "copy," "scan," "fax," "box," and "email" can be selected.

[0069] In step S402 , the external access screen generation control unit 117 generates an image of an operation screen for the smartphone 300 that corresponds to the initial screen 600 .

[0070] In step S403, the web server unit 112 issues a URL, which is connection information for connecting from an external terminal device, to the image information of the operation screen generated by the external access screen generation control unit 117. The issued connection information is then written to the contactless IC chip 108 installed on the outer or inner surface of the housing of the image processing device 100, thereby enabling the external terminal device to receive the connection information via near field wireless communication. The connection information written to the contactless IC chip 108 is written in, for example, NDEF (NFC Data Exchange Format) format.

[0071] In step S404, the input operation control unit 111 accepts an operation by the user on the touch panel of the user IF device 105. For example, suppose that the user selects the "Fax" button on the initial screen 600 in Fig. 6. Then, the process proceeds to step S405.

[0072] In step S405, the local screen generation control unit 116 generates a facsimile service screen 700 as shown in Fig. 7 and displays it on the liquid crystal display of the user IF device 105. As shown in Fig. 7, the facsimile service screen 700 includes a destination input field, a document feed method specification field, a transmission image quality setting field, etc. Furthermore, a "Start" button is displayed on the facsimile service screen 700.

[0073] In step S406 , the external access screen generation control unit 117 generates an image of an operation screen for the smartphone 300 that corresponds to the facsimile service screen 700 .

[0074] In step S407, the Web server unit 112 issues a URL, which is connection information for connecting from an external terminal device, to the image information of the operation screen generated by the external access screen generation control unit 117. The issued connection information then replaces the connection information already written in the contactless IC chip 108, thereby enabling the external terminal device to receive the new connection information via close proximity wireless communication.

[0075] In step S408, the input operation control unit 111 accepts an operation by the user on the touch panel of the user IF device 105. For example, suppose the user makes various settings on the facsimile service screen 700 in Fig. 7 and selects the "Start" button. Then, the process proceeds to step S409.

[0076] In step S409, the input operation control unit 111 outputs instructions to the scan control unit 113 and the communication control unit 115, and image processing, also called a job, is started. This image processing includes the scan control unit 113 controlling the scanning device 106 to scan a paper sheet placed on the platen and convert it into image data. The image processing also includes the communication control unit 115 controlling the communication IF device 104 to transmit the image data to another image processing device (not shown) or a facsimile transmitting / receiving device via a telephone line or the like. The scanned image data may be stored in the memory 102 and the storage device 103.

[0077] In step S410, the local screen generation control unit 116 generates a processing in progress screen 800 as shown in Fig. 8 and displays it on the liquid crystal display of the user IF device 105. As shown in Fig. 8, the processing in progress screen 800 includes a processing status display field 810, a setting content display field 820, and a "Stop" button 830. A message indicating the current status of image processing is displayed in the processing status display field 810. A message such as "Fax sending...reading" is displayed in the processing status display field 810 of Fig. 8.

[0078] In step S411 , the external access screen generation control unit 117 generates an image of an operation screen for the smartphone 300 that corresponds to the process execution screen 700 .

[0079] In step S412, the Web server unit 112 issues a URL, which is connection information for connecting from an external terminal device, to the image information of the operation screen generated by the external access screen generation control unit 117. The issued connection information then replaces the connection information already written in the contactless IC chip 108, thereby enabling the external terminal device to receive the new connection information via close proximity wireless communication.

[0080] Here, it is assumed that the state of image processing has changed in step S413 of Fig. 5. Specifically, for example, in the case where scanning processing is being performed, the scanning device 106 has finished reading the document and the communication IF device 104 has started transmitting the image data.

[0081] In this case, in step S414, the scan control unit 113 notifies the display control unit 110 that the document reading process has ended, and the communication control unit 115 notifies the display control unit 110 that the transmission of image data has started.

[0082] In step S415, when the display control unit 110 receives the notification, the local screen generation control unit 116 updates the display content of the processing in progress screen 700. For example, a processing in progress screen 900 such as that shown in FIG. 9 is generated and displayed on the liquid crystal display of the user IF device 105. The processing in progress screen 900 in FIG. 9 includes a processing status display field 910, a setting content display field 920, and a "Stop" button 930. A message indicating the current status of image processing is displayed in the processing status display field 910. A message such as "Fax sending...sending" is displayed in the processing status display field 910 in FIG. 9.

[0083] In step S416 , the external access screen generation control unit 117 generates an image of an operation screen for the smartphone 300 that corresponds to the process execution screen 900 .

[0084] In step S417, the Web server unit 112 issues a URL, which is connection information for connecting from an external terminal device, to the image information of the operation screen generated by the external access screen generation control unit 117. The issued connection information then replaces the connection information already written in the contactless IC chip 108, thereby enabling the external terminal device to receive the new connection information via close proximity wireless communication.

[0085] In step S418, it is assumed that the user brings the smartphone 300 close to the contactless IC chip 108. Here, "close" includes bringing the smartphone 300 close to or in contact with the contactless IC chip 108, and refers to moving the smartphone 300 within a distance where the connection information can be read from the operation screen of the image processing device 100.

[0086] Then, in step S419, the connection information written in the contactless IC chip 108 is read by the smartphone 300 carried by the user via close proximity wireless communication.

[0087] When the smartphone 300 reads the connection information, in step S420, it starts up a browser and connects to the web server unit 112 of the image processing device 100 based on the connection information.

[0088] In response to the connection information received from the smartphone 300, the web server unit 112 acquires image information of the operation screen generated by the external access screen generation control unit 117 in step S417.

[0089] In step S421, the web server unit 112 transmits the acquired image information of the operation screen to the smartphone 300.

[0090] Upon receiving the image information of the operation screen, the smartphone 300 displays the image of the operation screen on the browser in step S422. FIG. 10 shows an example of a processing in progress screen 1000 displayed on the display device of the smartphone 300. The content of the processing in progress screen 1000 is substantially the same as the content of the processing in progress screen 900 described in FIG. 9 , but the display format is adapted to the display device of the smartphone 300 and has a responsive layout, i.e., it can be displayed on different screen sizes. Specifically, the processing in progress screen 1000 includes a device name display field 1010 of the image processing device 100, a processing status display field 1020, a setting content display field 1030, and a "Stop" button 1040. The processing status display field 920 displays a message indicating the current status of image processing. The processing status display field 1020 in FIG. 10 displays a message such as "Fax sending...sending."

[0091] In step S423, the Web server unit 112 notifies the local screen generation control unit 116 that the image information of the operation screen has been transmitted to the smartphone 300.

[0092] In step S424, the local screen generation control unit 116 erases the image of the operation screen currently being displayed on the liquid crystal display of the user IF device 105. The local screen generation control unit 116 also changes the image of the operation screen currently being displayed on the liquid crystal display of the user IF device 105 to an initial image and displays it. That is, the local screen generation control unit 116 hides the processing in progress screen 1000 and generates an initial screen 600 as shown in FIG. 6 and displays it on the liquid crystal display of the user IF device 105. This allows another user to operate the touch panel and set up other image processing while viewing the liquid crystal display of the user IF device 105. Note that in this case, since image processing is already being executed at that time, image processing by another user cannot be started immediately, but image processing by another user can be started after the currently executing image processing is completed.

[0093] It is assumed that the state of image processing has changed in step S425, specifically when the transmission process of image data by the communication IF device 104 in the scan process has ended.

[0094] In this case, in step S426, the communication control unit 115 notifies the display control unit 110 that the image data transmission process has ended.

[0095] In step S427, when the display control unit 110 receives the above notification, the processing in progress screen 900 is hidden and has been switched to another screen, so the external access screen generation control unit 117 updates the image of the operation screen for the smartphone 300. For example, this screen is an image including a message that the fax transmission has been completed.

[0096] In step S428 , the web server unit 112 transmits image information of the updated operation screen for the smartphone 300 to the smartphone 300 .

[0097] In step S429, the smartphone 300 receives the image information of the operation screen and displays the image of the operation screen on the browser.

[0098] In the first embodiment, the process of transferring an image of an operation screen from the image processing device 100 to the smartphone 300 by issuing connection information for screen access and transmitting it to the smartphone 300 using close proximity wireless communication has been described. Note that close proximity wireless communication is used only to exchange connection information between the smartphone 300 and the image processing device 100, and the image data of the operation screen thereafter is transmitted and received via a network 400 such as the Internet.

[0099] However, the present disclosure is not limited to the above method, and the connection information may be receivable by the smartphone 300, which is an external terminal device, via short-range wireless communication such as Bluetooth (registered trademark) or WiFi (registered trademark) Direct.

[0100] In this case, a code for attempting a Bluetooth connection with the smartphone 300 is embedded in the contactless IC chip 108, and the smartphone 300 is brought close to the contactless IC chip 108. Then, a Bluetooth connection is established between the smartphone 300 and the image processing device 100. Next, connection information may be transmitted from the image processing device 100 via Bluetooth to the smartphone 300 that has been wirelessly connected in advance by the above method. The smartphone 300 receives an image of the operation screen from the image processing device 100 via Bluetooth based on the connection information. Note that similar connection and transmission / reception processes may also be performed via WiFi Direct communication.

[0101] Alternatively, connection information and images of the operation screen may be transmitted and received via a short-range wireless communication connection such as Bluetooth or WiFi Direct connection without using the contactless IC chip 108. Specifically, a user IF device of the image processing device 100 displays candidates for smartphones that can be connected via short-range wireless communication, and a connection is established via short-range wireless communication with the selected smartphone. Next, connection information is transmitted to the smartphone connected via short-range wireless communication, and the smartphone connects to the image of the operation screen based on the received connection information. Image data of the subsequent operation screen is transmitted and received directly between the image processing device 100 and the smartphone 300 via short-range wireless communication.

[0102] In the first embodiment, the connection information is transferred to the smartphone 300 via a wireless connection, but the present disclosure is not limited to the above method. For example, the connection information may be displayed as code information on the liquid crystal display of the user IF device 105 of the image processing device 100, thereby enabling the smartphone 300 to capture an image.

[0103] For example, the local screen generation control unit 116 of the display control unit 110 of the image processing device 100 may convert the connection information into a two-dimensional code and display it on the liquid crystal display of the user IF device 105, so that the smartphone 300 can capture the code.

[0104] In the first embodiment, after the image of the operation screen is handed over to the smartphone 300, the image of the operation screen is not displayed on the liquid crystal display of the user IF device 105 of the image processing device 100, and the image of the operation screen cannot be viewed anywhere other than the smartphone 300. However, the present disclosure is not limited to the above method, and the image of the operation screen may be displayed on the liquid crystal display of the user IF device 105 of the image processing device 100 even after the image of the operation screen is handed over to the smartphone 300. [Embodiment 2]

[0105] Next, an image processing system 10 according to a second embodiment will be described. In the second embodiment, the image processing device 100 differs from the image processing device 100 according to the first embodiment in that it has an authentication control unit 118, as shown in the functional configuration block diagram of Fig. 11. However, since the other configurations are substantially the same, the same components are denoted by the same reference numerals, and detailed descriptions of the components already mentioned will be omitted.

[0106] The authentication control unit 118 enables operations of the image processing device 100 by a previously authenticated user to be accepted. That is, the authentication control unit 118 instructs the local screen generation control unit 116 to display an authentication screen when the user attempts to operate the touch panel of the user IF device 105. When the user inputs authentication information into the authentication screen, the authentication control unit 118 checks the user information in the authentication information and determines whether or not to permit the user to operate the user IF device 105.

[0107] Assume that the user is permitted to operate the user IF device 105, and a connection to the image information of the operation screen specified by the connection information from the smartphone 300 is detected as in the first embodiment. In this case, the web server unit 112 transmits image information of the operation screen generated by the external access screen generation control unit 117 to the smartphone 300. The authentication control unit 118 also sets the smartphone 300 to an authenticated state in which operation from the operation screen is possible from the smartphone 300, and sets the smartphone 305 to an unauthenticated state in which operation from the operation screen being displayed on the liquid crystal display is not possible.

[0108] That is, when the operation screen is handed over to the smartphone 300 by close proximity wireless communication, the authentication status of the image processing device 100 is also handed over to the smartphone 300 in addition to the operation screen. This makes it possible to visually check the status of processing currently being executed in the image processing device 100 on the browser of the smartphone 300, and also to operate the processing currently being executed. Furthermore, information that should be kept secret from anyone other than the authenticated user, such as a user name and a document name, is also displayed on the browser of the smartphone 300.

[0109] In the second embodiment described above, an example has been described in which, if the smartphone 300 is owned by an authenticated user, the smartphone 300 can take over and display an operation screen from the image processing device 100 at any stage of processing being performed by the user of the image processing device 100. However, the present disclosure is not limited to the above method. For example, the authentication control unit 118 may set a connection permission level for image information of an operation screen during image processing. Then, the web server unit 112 issues connection information for image information of an operation screen that is permitted to be connected according to the permission level, and does not issue connection information for image information of an operation screen that is not permitted to be connected. This prevents information that should not be displayed on external terminal devices other than the image processing device 100 from being displayed on the smartphone 300.

[0110] [Embodiment 3] Next, a description will be given of the image processing system 10 of embodiment 3. In addition to the operations of embodiment 1, the image processing system 10 of embodiment 3 resumes displaying the image of the operation screen on the liquid crystal display of the user IF device 105 when a request to redisplay the image of the operation screen on the liquid crystal display is received from the smartphone 300.

[0111] 12 has substantially the same configuration as that of FIG. 10 of the first embodiment, but includes a device name display field 1210 for the image processing device 100, a processing status display field 1220, a setting content display field 1230, and a "Stop" button 1240. When the device name display field 1210 is selected, a return operation acceptance screen 1300 as shown in FIG. 13 is displayed on the browser of the smartphone 300.

[0112] The return operation reception screen 1300 includes a device name display field 1310 for the image processing device 100, an ongoing process display field 1320, an operation status display field 1330, and a return button 1340. The return button 1340 displays a message such as "Return screen to main unit."

[0113] Fig. 14 is a flowchart showing the process for returning the operation screen to the image processing device 100 in the third embodiment. In step S1401 of Fig. 14, when the user selects the return button 1240 displayed on the smartphone 300, the process proceeds to step S1402.

[0114] In step S1402, the smartphone 300 transmits a request to restore the operation screen to the image processing device 100. In step S1403, the image processing device 100 receives the request to restore the operation screen. In step S1404, the input operation control unit 111 of the image processing device 100 determines whether the touch panel of the user IF device 105 is being operated. If it is determined that the touch panel is being operated, the process proceeds to step S1405, and if it is determined that the touch panel is not being operated, the process proceeds to step S1408.

[0115] In step S1405, the local screen generation control unit 116 does not resume displaying the image of the operation screen on the liquid crystal display of the user IF device 105. In addition, in step S1406, the communication control unit 115 notifies the smartphone 300 that the touch panel is being operated and that the operation screen cannot be returned to the image processing device 100. In step S1407, upon receiving this notification, the smartphone 300 displays a message that the operation screen cannot be returned to the image processing device 100, displays the processing in progress screen 1200 shown in FIG. 12, and ends the return process.

[0116] In step S1408, the local screen generation control unit 116 displays an image of an operation screen for displaying the processing status of image processing on the liquid crystal display of the user IF device 105, and proceeds to the processing of step S1409. FIG. 15 is a diagram showing a processing in progress screen 1500 that is resumed on the liquid crystal display of the user IF device 105. The processing in progress screen 1500 includes a processing status display field 1510, a setting content display field 1520, and a "Stop" button 1530. A message indicating the current status of image processing is displayed in the processing status display field 1510. A message such as "Fax sending...sending" is displayed in the processing status display field 1510 of FIG. 15.

[0117] In step S1409, the communication control unit 115 notifies the smartphone 300 that the image processing device 100 has resumed displaying the operation screen, and instructs the smartphone 300 to end displaying the operation screen. At this time, the external access screen generation control unit 117 generates a display end screen 1600 as shown in FIG. 16 and transmits it to the smartphone 300. In step S1410, the smartphone 300 displays the received display end screen 1600.

[0118] The display end screen 1600 includes a device name display field 1610 for the image processing device 100, an end message display field 1620, and an end button 1630. The end message display field 1620 displays a message such as "Remote operation has ended. Please operate from the main unit side from now on." The end button 1630 also displays a message such as "Close screen," and when the user selects this end button 1630, the browser screen on the smartphone 300 closes and the process ends.

[0119] In each of the above embodiments, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0120] Furthermore, the operations of the processor in each of the above embodiments may be performed not only by a single processor but also by multiple processors located at physically separate locations working together. Furthermore, the order of the operations of the processor is not limited to the order described in each of the above embodiments and may be changed as necessary.

[0121] [Note] Preferred embodiments of the present disclosure will be described below.

[0122] (((1))) a processor; The processor: generating a display screen of the information processing device; An information processing system that makes connection information for connecting to the generated image information on the display screen available for reception by an external terminal device that is brought close enough to the information processing device to read the connection information.

[0123] (((2))) The information processing system according to (((1))), wherein the processor makes the connection information receivable by the external terminal device via close proximity wireless communication or short distance wireless communication.

[0124] (((3))) The information processing system described in (((2)))), wherein the processor writes the connection information to a contactless IC chip for close proximity wireless communication, thereby making the connection information receivable by the external terminal device via close proximity wireless communication.

[0125] (((4))) The information processing system according to (((3))), wherein the processor issues the connection information for each image processing, and rewrites the connection information written in the contactless IC chip with the newly issued connection information.

[0126] (((5))) The information processing system according to (((3))), wherein the processor transmits the connection information to an external terminal device that has been wirelessly connected in advance via the short-range wireless communication.

[0127] (((6))) Further comprising a display device, The information processing system according to (((1))), wherein the processor displays the connection information as code information on the display device, thereby enabling the external terminal device to capture an image.

[0128] (((7))) Further comprising a display device, The information processing system described in (((1))), wherein when the processor detects a connection from the external terminal device to the image information of the display screen identified by the connection information, the processor transmits the image information of the display screen displayed on the display device to the external terminal device and makes the image of the display screen invisible to anyone other than the external terminal device.

[0129] (((8))) The information processing system according to (((7))), wherein the processor erases the image currently being displayed on the display device.

[0130] (((9))) The information processing system according to (((7))), wherein the processor changes the image currently being displayed on the display screen of the display device to an initial image and displays the initial image.

[0131] (((10))) The information processing system according to any one of (((7))) to (((9))), wherein the processor resumes displaying the image on the display screen on the display device when a request to display the image on the display screen again is received from the external terminal device.

[0132] (((11))) further comprising an input device; The information processing system according to (((10))), wherein when the processor receives a request from the external terminal device to re-display the image on the display screen on the display device and the input device is being operated, the processor does not resume displaying the image on the display screen on the display device, but notifies the external terminal device that the input device is being operated.

[0133] (((12))) The information processing system described in (((7))) is configured so that the processor can accept operations from a pre-authenticated user, and when it detects a connection from the external terminal device to the image information of the display screen identified by the connection information, it puts the display screen into an authenticated state in which operations can be performed from the external terminal device, and puts the display screen into an unauthenticated state in which operations cannot be performed from the display screen currently being displayed on the display device.

[0134] (((13))) The processor sets a connection permission level for image information of a display screen during image processing for display on the display device, and issues the connection information for image information of a display screen that is permitted to be connected according to the connection permission level, and does not issue the connection information for image information of a display screen that is not permitted to be connected.

[0135] (((14))) On the computer, generating an image of a display screen for displaying a processing status of the image processing while the image processing is being performed; a step of making the external terminal device capable of directly receiving connection information for connecting to the generated image information of the display screen from the external terminal device by bringing the external terminal device close enough to the display screen to read the connection information; A program that executes the following.

[0136] (((15)))) generating a display screen of the information processing device; a step of making connection information for connecting to the generated image information of the display screen receivable by an external terminal device that is brought close enough to the information processing device to read the connection information; A method comprising:

[0137] The effects of the configuration described above will be described below.

[0138] According to the information processing system relating to (((1))), it is possible to provide an information processing system that enables a user to obtain connection information for connecting to image information on the display screen of an information processing device with simpler operations than when the user obtains the information by visual inspection or search.

[0139] According to the information processing system of (((2))), an image of a display screen showing the processing status of image processing in progress can be displayed without the user having to manually input connection information into an external terminal device.

[0140] According to the information processing system of (((3))), it is possible to transmit connection information to an external terminal device simply by bringing the external terminal device close to the contactless IC chip.

[0141] According to the information processing system of (((4))), it is possible to make it impossible to connect to image information of a display screen for different image processing from a terminal device that does not have connection information for that image.

[0142] According to the information processing system of (((5))), it is possible to transmit connection information to an external terminal device that has been wirelessly connected in advance to the terminal device without manually inputting the connection information to the external terminal device.

[0143] According to the information processing system of (((6))), an external terminal device can be connected to image information on a display screen that shows the processing status of image processing in progress, without the user having to manually input connection information.

[0144] According to the information processing system of (((7))), when an image of a display screen is displayed on an external terminal device, it is possible to prevent the display screen from being operated by anything other than the external terminal device.

[0145] According to the information processing system of (((8))), when an image of the display screen is displayed on the external terminal device, it is possible to prevent the display device from being operated while viewing the display screen.

[0146] According to the information processing system of (((9))), when an image on the display screen is displayed on the external terminal device, it is possible to perform other image processing by operating the display device while viewing the display screen.

[0147] According to the information processing system of (((10))), the image on the display screen is transferred from the display device to an external terminal device, and then transferred from the external terminal device to the display device for display, making it possible to check the processing status of the image processing in progress and to perform input operations.

[0148] According to the information processing system of (((11))), when the input device is being operated, it is possible to prevent the image of the display screen that has been handed over to the external terminal device from being displayed again on the display device.

[0149] According to the information processing system of (((12))), it is possible to operate the display screen only from an external terminal device that has been authenticated.

[0150] According to the information processing system of (((13))), it is possible to continuously display only permitted display screens on the external terminal device.

[0151] According to the program related to (((14))), it is possible to cause a computer to perform image processing in which connection information for connecting to image information on the display screen of an information processing device can be obtained with simpler operations than when a user obtains the connection information by visual inspection or search.

[0152] According to the method of (((15)))), it is possible to perform image processing in which connection information for connecting to image information on the display screen of an information processing device can be obtained with simpler operations than when the user obtains the connection information by visual inspection or search. [Explanation of symbols]

[0153] 10 Image Processing System 100 Image processing device 101 CPU 102 memory 103 Storage device 104 Communication IF equipment 105 User IF device 106 Scanning Device 107 Printing device 108 Contactless IC chip 109 Control Bus 110 Display control unit 111 Input operation control unit 112 Web Server Section 113 Scan control section 114 Image formation control unit 115 Communication control unit 116 Local screen generation control unit 117 External access screen generation control unit 118 Authentication control section 200 Wireless LAN Access Points 300 smartphones 400 Network 600 Initial screen 700 Facsimile service screen 800 Processing in progress screen 810 Processing status display field 820 Setting content display field 830 "Stop" button 900 Processing in progress screen 910 Processing status display field 920 Setting content display field 930 "Stop" button 1000 Processing in progress screen 1010 Device name display field 1020 Processing status display field 1030 Setting content display field 1040 "Stop" button 1200 Processing in progress screen 1210 Device name display field 1220 Processing status display field 1230 Setting content display field 1240 "Stop" button 1300 Recovery operation reception screen 1310 Device name display field 1320 Running Process Display Column 1330 Operation status display field 1340 Return button 1500 Processing in progress screen 1510 Processing status display field 1520 Setting content display field 1530 "Stop" button 1600 display end screen 1610 Device name display field 1620 End message display field 1630 Exit button

Claims

1. a processor; The processor: generating a display screen of the information processing device; An information processing system that makes connection information for connecting to the generated image information on the display screen available for reception by an external terminal device that is brought close enough to the information processing device to read the connection information.

2. The information processing system according to claim 1 , wherein the processor makes the connection information receivable by the external terminal device via close proximity wireless communication or short distance wireless communication.

3. The information processing system according to claim 2 , wherein the processor writes the connection information to a contactless IC chip for close proximity wireless communication, thereby making the connection information receivable by the external terminal device via close proximity wireless communication.

4. 4. The information processing system according to claim 3, wherein the processor issues the connection information for each image processing, and rewrites the connection information written in the contactless IC chip with the newly issued connection information.

5. The information processing system according to claim 3 , wherein the processor transmits the connection information to an external terminal device that has been wirelessly connected in advance via the short-range wireless communication.

6. Further comprising a display device, The information processing system according to claim 1 , wherein the processor displays the connection information as code information on the display device, thereby enabling the external terminal device to capture an image.

7. Further comprising a display device, The information processing system of claim 1, wherein when the processor detects a connection from the external terminal device to the image information of the display screen identified by the connection information, the processor transmits the image information of the display screen displayed on the display device to the external terminal device and makes the image of the display screen invisible to anyone other than the external terminal device.

8. The information processing system according to claim 7 , wherein the processor erases the image currently being displayed on the display device.

9. The information processing system according to claim 7 , wherein the processor changes the image currently displayed on the display screen of the display device to an initial image and displays the image.

10. 10. The information processing system according to claim 7, wherein the processor resumes displaying the image on the display screen on the display device when a request to display the image on the display screen again is received from the external terminal device.

11. further comprising an input device; 11. The information processing system according to claim 10, wherein when the processor receives a request from the external terminal device to re-display the image of the display screen on the display device and the input device is being operated, the processor does not resume displaying the image of the display screen on the display device, but notifies the external terminal device that the input device is being operated.

12. The information processing system of claim 7, wherein the processor is capable of accepting operations from a pre-authenticated user, and when it detects a connection from the external terminal device to the image information of the display screen identified by the connection information, it puts the display screen into an authenticated state in which operations can be performed from the external terminal device, and puts the display screen into an unauthenticated state in which operations cannot be performed from the display screen currently being displayed on the display device.

13. 8. The information processing system according to claim 7, wherein the processor sets a connection permission level for image information of a display screen during image processing for display on the display device, and issues the connection information for image information of a display screen that is permitted to be connected according to the connection permission level, and does not issue the connection information for image information of a display screen that is not permitted to be connected.

14. On the computer, generating an image of a display screen for displaying a processing status of the image processing while the image processing is being performed; a step of making the external terminal device capable of directly receiving connection information for connecting to the generated image information of the display screen from the external terminal device by bringing the external terminal device close enough to the display screen to read the connection information; A program that executes the following.

15. generating a display screen of the information processing device; a step of making connection information for connecting to the generated image information of the display screen receivable by an external terminal device that is brought close enough to the information processing device to read the connection information; A method comprising:

Images