Image forming apparatus

Abstract

To provide an image forming apparatus that can receive remote control from an information processing apparatus, and increases convenience for a user who performs the remote control.SOLUTION: A controller 11 of an MFP 10 can transmit remote screen data to a PC 30 and display a remote screen on the PC 30. When the controller 11 receives, from the PC 30, an instruction indicating that a print instruction is virtually performed on the remote screen through a communication IF 16 after the transmission of the remote image data, the controller transmits image data indicating the original details of printing to a predetermined address through the communication IF 16.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a technology for an image forming apparatus that can accept remote control by an information processing apparatus. [Background technology]

[0002] Patent Document 1 describes a technology in which a remote screen that virtually displays the user interface of an image forming device is displayed on a remote information processing device, and the image forming device is remotely controlled by operating the remote screen. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-10265 Summary of the Invention [Problem to be solved by the invention]

[0004] When a user who operates a remote screen causes an image forming apparatus to output an image by operating the remote screen, the user may not be able to view the output image nearby. In this case, for example, the user needs to request a person other than the user to obtain the output image or to view the image, which may reduce convenience for the user who operates the remote screen. [Means for solving the problem]

[0005] The image forming device disclosed as an embodiment includes a user interface, a communication interface, and a controller, and when the controller receives a first request from a device connected via the communication interface, it executes a transmission process to transmit remote screen data to the device that requested the first request, where the first request is a request to display the remote screen, the remote screen data is data for displaying the remote screen on the device that requested the first request, and the remote screen is a screen displayed on the device that requested the first request and is a screen that virtually reproduces the user interface. The controller executes a first process of performing a first operation that does not involve outputting an image in accordance with the received first operation when a first operation is received via the user interface; a second process of performing a second operation that involves outputting an image in accordance with the received second operation when a second operation different from the first operation is received via the user interface; a third process of performing the first operation when, after the transmission process, an instruction indicating that the first operation has been virtually performed on a remote screen is received via the communication interface from the device that originated the first request; and a fourth process of performing a third operation of transmitting data indicating an image to a predetermined address via the communication interface, data indicating an image to be output by the second operation, in accordance with the received first operation when, after the transmission process, an instruction indicating that the second operation has been virtually performed on a remote screen is received via the communication interface from the device that originated the first request.

[0006] In the above configuration, when the controller receives, via the communication interface, from the device that issued the first request, an instruction indicating that a first operation on the remote screen has been virtually performed, the controller executes a third process of performing a first operation that does not involve outputting an image. On the other hand, when the controller receives, via the communication interface, from the device that issued the first request, an instruction indicating that a second operation on the remote screen has been virtually performed, the controller executes a fourth process of performing a third operation of transmitting data indicating an image to be output by the second operation to a predetermined address via the communication interface. As a result, when a second operation for virtually performing the second operation is received on the remote screen, the data indicating the image is transmitted to the predetermined address without outputting the image. As a result, the user can view the image output from the image forming apparatus using the image data transmitted to the predetermined address, thereby improving convenience for the user performing remote operation. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a configuration diagram of an image forming system. [Figure 2] 10 is a timing chart illustrating a process when remote screen control is started. [Figure 3] FIG. 10 is a diagram illustrating an administrator screen. [Figure 4] 10 is a flowchart illustrating a process executed by the MFP in remote screen control. [Figure 5] FIG. 10 is a diagram illustrating a standby screen. [Figure 6] FIG. 10 is a diagram illustrating a remote screen. [Figure 7] 5 is a flowchart illustrating the process of S38 in FIG. 4. [Figure 8] FIG. 10 is a diagram illustrating a printer report screen. [Figure 9] FIG. 10 is a diagram illustrating a print execution screen. [Figure 10] 10 is a flowchart illustrating a registration process of setting information. [Figure 11]FIG. 10 is a diagram illustrating a transmission in progress screen. [Figure 12] FIG. 10 is a diagram illustrating a print execution screen. DETAILED DESCRIPTION OF THE INVENTION

[0008] (First embodiment) An image forming system 100 according to this embodiment will be described with reference to the drawings. The image forming system 100 shown in FIG. 1 includes an MFP 10 and PCs 30 and 50. MFP is an abbreviation for multifunction peripheral. The MFP 10 and the PCs 30 and 50 are connected to a network 200 and are capable of communicating with each other through the network 200. The network 200 is a LAN or the Internet. In this embodiment, the MFP 100 is an example of an image forming apparatus. The PCs 30 and 50 are examples of information processing apparatuses.

[0009] Next, we will explain the configuration of the MFP 10. The MFP 100 includes a controller 11, a memory 12, a printer 13, a scanner 14, a FAX-IF 15, a communication IF 16, a user IF 17, and a bus 18. IF is an abbreviation for interface.

[0010] The communication IF 16 connects the MFP 10 to the network 200 in accordance with a predetermined communication protocol. The user IF 17 is an interface that exists between the user who directly operates the MFP 10 and the controller 11, and has, for example, a touch panel or physical operation keys.

[0011] The printer 13 performs a printing operation to print an image on a recording medium such as a sheet or a disk. The printer 13 may use an inkjet method, an electrophotographic method, or the like as its recording method. The scanner 14 performs a scanning operation to read an image recorded on an original and generate image data. The FAX-IF 15 performs a FAX operation to send and receive image data in a method conforming to a FAX protocol. The MFP 10 may also be capable of performing a composite operation that combines multiple operations. A copy operation that combines a print operation by the printer 13 and a scan operation by the scanner 14 is an example of a composite operation.

[0012] The controller 11 is configured with a CPU, an ASIC (application specific integrated circuit), etc., and controls the operations of the printer 13, the scanner 14, the FAX-IF 15, the communication IF 16, and the user IF 17. The memory 12 has a data storage area. The data storage area is an area for storing data necessary for executing programs, etc. The memory 12 is configured by combining RAM, ROM, SSD, HDD, etc. Buffers provided in the controller 11 and used when executing various programs may also be considered part of the memory 12. The memory 12 may be a storage medium readable by the controller 11. A storage medium readable by the controller 11 is a non-transitory medium. In addition to the above examples, non-transitory media also include recording media such as CD-ROMs and DVD-ROMs. Non-transitory media are also tangible media. On the other hand, electrical signals carrying programs downloaded from servers on the Internet, etc., are computer-readable signal media, which are a type of computer-readable medium, but are not included in non-transitory computer-readable storage media.

[0013] The memory 12 stores firmware 20 as a program executable by the controller 11. In the following description, the controller 11 executing the program may be referred to simply as the program name. For example, the term "firmware" is used to mean "the controller 11 executing the firmware 20." In this embodiment, the term primarily refers to the processing of the controller 11 in accordance with instructions written in the program. In other words, processes such as "determine," "extract," "select," "calculate," "decide," "identify," "acquire," "receive," and "control" in the following description represent the processing of the controller 11. Note that "acquire" is used as a concept that does not necessarily require a request. In other words, the process of the controller 11 receiving data without a request is also included in the concept of "the controller 11 acquiring data." Furthermore, "data" in this specification refers to a bit string that can be read by the controller. Data with essentially the same meaning but different formats are treated as the same data. The same applies to "information" in this specification.

[0014] The firmware 20 also functions as a web server for displaying predetermined web pages on the PCs 30 and 50. The firmware 20 can also provide remote screen control to the PCs 30 and 50. The remote screen control is a function that causes the PCs 30 and 50 to display a remote screen that simulates the user IF 17 of the MFP 10, and allows the MFP 10 to be remotely operated by virtually operating the user IF 17 on this remote screen.

[0015] Management information 25 is stored in the data storage area of ​​memory 12. The management information 25 records authentication information such as login names and passwords in association with devices that can access MFP 10. Setting information 26 is stored in the data storage area of ​​memory 12. The setting information 26 records various setting information including information related to remote screen control settings.

[0016] Next, we will explain the configuration of the PC 30. The PC 30 includes a communication IF 31, a memory 32, a controller 33, a display 34, and a user IF 35. The units 31, 32, 33, and 35 included in the PC 30 have the same configuration as the controller 11, memory 12, communication IF 16, and user IF 17 included in the MFP 30, and therefore their explanation will be omitted.

[0017] The memory 32 stores an OS 40 and a browser 41. The browser 41 is a program that, under the execution of the OS 40, causes the controller 33 to display on the display 34 an image corresponding to the web page data transmitted from the MFP 10. The PC 50 has the same configuration as the PC 30, and therefore a description thereof will be omitted.

[0018] Next, the processing procedure when PC 30 requests the start of remote screen control will be described with reference to Figure 2. MFP 10 displays an operation screen on user IF 17 and changes the display of the operation screen in accordance with operations via user IF 17, the operating status of MFP 10, etc. The process of changing the operation screen is executed in parallel with the process of Figure 2. The operation screen includes an execution screen that indicates that printing, scanning, etc. is in progress, an instruction screen for receiving execution instructions for copying, scanning, etc., a setting screen for changing various settings, a status screen that indicates the status of MFP 10, an execution instruction screen, a standby screen that waits for an instruction to display the setting screen, etc.

[0019] 2, in step 10 (hereinafter, step will be simply referred to as "S"), browser 41 of PC 30 transmits a request for web page data to MFP 10. The web page data requested in S10 is web page data for displaying a home screen when firmware 20 functions as a web server. For example, browser 41 transmits the request to firmware 20 when it receives input of a URL specifying firmware 20 from the user. Communication between browser 41 and firmware 20 is performed in accordance with the http(s) protocol.

[0020] In S11, the firmware 20 transmits web page data to the PC 30. In S12, the browser 41 receives the web page data and displays the web page indicated by the received web page data on the display 34. In this embodiment, the browser 41 displays a home screen as the web page on the display 34.

[0021] When a login operation to the MFP 10 is performed on the home screen, the browser 41 transmits the login password and the like to the firmware 20. When a login permission response is received from the EWS, the browser 41 displays an administrator screen 300, which is a web page, on the display 34, as shown in Fig. 3. The administrator screen 300 includes an item display area 301 and a function display area 302.

[0022] When a selection operation of the "Remote Screen Control" item 303 included in the item display area 301 is accepted via the user IF 35, the browser 41 requests the MFP 10 to start remote screen control in S13. Upon receiving the request to start remote screen control, the firmware 20 transmits web page data for updating the web page in S14. This web page data includes an executable program that can be interpreted by the browser 41. The executable program is a script program, such as JavaScript.

[0023] In S15, a request is made to the MFP 10 to issue a token. The token is information for authenticating the device that executes the remote screen control, and in this embodiment is a one-time token created based on the authentication information. When the firmware 20 receives the token issuance request, it issues the token to the PC 30. At this time, the firmware 20 may request authentication information from the PC 30.

[0024] In S16, the firmware 20 issues a token to the PC 30. At this time, if information indicating that a token has already been issued is stored in the memory 12, the firmware 20 determines that the token has not yet been issued, and does not need to send the token. Upon receiving the token issued by the MFP 10, the browser 41 requests display of a remote screen together with the issued token in S17. In this embodiment, the request to display the remote screen sent by the browser 41 in S17 is an example of a first request.

[0025] If the firmware 20 determines that the token transmitted from the PC 30 is valid, it responds in S18 with permission to display the remote screen. If the firmware 20 determines that the transmitted token is invalid, it responds that it has refused to execute the remote screen. For example, if the token is valid too long after its issuance time, or if the token is a forged token, it is determined to be invalid.

[0026] Next, a description will be given of the procedure for remote screen control executed between the MFP 10 and the PC 30 when display of the remote screen is permitted. Fig. 4 shows the process executed by the firmware 20 of the MFP 10 when display of the remote screen is permitted, and the firmware 20 is the subject.

[0027] 5 is displayed on the user IF 17. The standby screen 150 includes a FAX instruction icon 151, a copy instruction icon 152, and a scan instruction icon 153. The FAX instruction icon 151 is an icon that accepts an operation when causing the MFP 10 to perform a FAX operation. The copy instruction icon 152 is an icon that accepts an operation when causing the MFP 10 to perform a copy operation. The FAX instruction icon 151 is an icon that accepts an operation when causing the MFP 10 to perform a scan operation. When any of the icons 151, 152, and 153 is operated on the standby screen 150, the standby screen 150 is switched to a FAX operation acceptance screen, a copy operation acceptance screen, or a scan operation acceptance screen according to the operated icon.

[0028] In S31, it is determined whether an initial screen request has been received from the PC 30 via the communication IF 16. The initial screen request is a request to transmit remote screen data corresponding to the standby screen 150 to the PC 30, which is the requesting device.

[0029] If the determination in S31 is affirmative, the process proceeds to S33, where an initial screen transmission process is executed. The initial screen transmission process is a process for transmitting an html script and remote screen data corresponding to the standby screen 150 to the requesting device, PC 30. The html script is a program for causing the browser 41 to execute various processes according to operations accepted on the remote screen displayed on PC 30. When the process in S33 is completed, the process returns to S31.

[0030] When the PC 30 receives remote image data and an HTML script corresponding to the standby screen 150 from the MFP 10 via the communication IF 16, the PC 30 displays a remote screen 330 including the standby screen 150. FIG. 6 shows the remote screen 330 displayed on the PC 30 when the standby screen 150 is displayed on the user IF 17. The remote screen 330 is displayed in the function display area 302 on the administrator screen 300. The remote screen 330 includes a screen display area 331 and an operation key display area 332. The screen display area 331 displays the same screen as the operation screen (here, the standby screen) currently displayed on the user IF 17 of the MFP 10. The operation key display area 332 displays button images that resemble the operation keys 172, which are physical keys provided on the user IF 17. Information indicating that a virtual operation on the user IF 16 has been executed on the remote screen 330 is notified to the MFP 10. The remote screen 330 also includes an end button 333.

[0031] The data indicating the operation screen, operation keys, and end button included in the remote image data for displaying the remote screen 330 may be in the same data format, such as raster data, or may be in another data format. The data indicating the operation screen, operation keys, and end button may be in different data formats. Alternatively, the firmware 20 may transmit only data indicating the operation screen to the browser 41 as remote image data, and the browser 41 may interpret the execution program to display the remote screen by superimposing data indicating the operation keys and end button on the remote image data. Alternatively, the firmware 20 may transmit data indicating the operation screen and operation keys to the browser 41 as remote image data, and the browser 41 may interpret the execution program to superimpose data indicating the end button on the remote screen data. Furthermore, instead of transmitting remote screen data to the browser 41, the firmware 20 may transmit web page data for displaying the entire administrator screen 300, including the remote screen 330, to the browser 41.

[0032] 4, if a negative decision is made in S31, the process proceeds to S32, where it is determined whether or not a screen update request has been received from PC 30 via communication IF 16. The screen update request is a request to MFP 10 for remote screen data for updating the remote screen currently being displayed on PC 30.

[0033] If the determination in S32 is affirmative, the process proceeds to S35, where a screen data transmission process is executed. The screen data transmission process is a process for transmitting an html script and remote screen data corresponding to the updated screen to PC 30. The remote screen data transmitted to PC 30 in S35 is, for example, data generated in the process of S37 or S38, which will be described later. When PC 30 receives the remote screen data together with the html script, it updates the currently displayed remote screen to the received new remote screen. When the process of S35 ends, the process returns to S31.

[0034] If a negative judgment is made in S32, the process proceeds to S34, in which it is judged whether or not a request including pressing information has been received from PC 30 via communication IF 16. The pressing information is information indicating that a certain position on the remote screen displayed on PC 30 has been pressed, and includes pressing coordinate information. The pressing coordinate information is information indicating the position on the remote screen 330 that has been pressed. Here, the explanation will be given taking as an example a case where the setting icon 334 has been operated on the remote screen 330 shown in FIG. 6 that is displayed on PC 30.

[0035] If the determination in S34 is affirmative, the process proceeds to S37, where a pressing process is executed. The pressing process is a process for executing a process corresponding to an operation specified by the pressing coordinate information on the MFP 10 and transmitting an html script generated in response to the specified operation to the PC 30. In the pressing process, the pressing coordinate information is first converted into coordinates indicating a pressed position on the user IF 17 of the MFP 10, and it is determined whether the converted pressing coordinates correspond to an operation icon or an operation key 172 displayed on the touch panel 171 of the user IF 17. If the pressing coordinates correspond to an operation icon on the touch panel 171, the corresponding operation icon displayed on the user IF 17 is switched to a pressing state indicating a pressed state. For example, as an example of the pressing state, the color of the operation icon is changed, or the shape of the operation icon is changed to a pressed state. In the example using the standby screen 150 shown in FIG. 5, the setting icon 154 is changed from the normal state to the pressing state.

[0036] Then, remote screen data virtually showing the current user IF 17 is generated and stored in memory 12. In the above example, remote image data corresponding to the standby screen 151 in a state in which the pressing manner of the setting icon 154 has been changed is created. Furthermore, an http(s) response is sent to PC 30. Note that if the pressed coordinates correspond to an operation icon or operation key 172 on touch panel 171, the body of the http(s) response includes a screen update script. The screen update script is a CGI script for instructing PC 30 to send an http(s) request, which is a request for a screen update, to MFP 10. When the processing of S37 ends, the process returns to S31.

[0037] If a negative judgment is made in S34, the process proceeds to S36, where it is judged whether or not lift-off information has been received from the PC 30 via the communication IF 16. The lift-off information is information indicating that a lift-off operation has been performed on the remote screen 330 displayed on the PC 30. The lift-off information includes lift-off coordinate information. The lift-off coordinate information is information indicating the position on the remote screen 330 where the indicator that was in contact has been lifted. If a positive judgment is made in S36, the process proceeds to S38, where lift-off processing is executed. The lift-off processing is a series of processes for executing processing according to the lift-off coordinate information on the MFP 10 and transmitting an html script to the PC 30. If a negative judgment is made in S36, the process returns to S31.

[0038] Fig. 7 is a flowchart illustrating the details of the lift-up process executed in S38. The following description will be given taking as an example a case where a lift-up operation is performed on the setting icon 334 on the remote screen 330 corresponding to the standby screen shown in Fig. 6 displayed on the PC 30. In S40, it is determined whether the received lift-up coordinate information is within the area of ​​any operation icon or operation key on the remote screen 330. If a negative determination is made in S40, the process proceeds to S51. On the other hand, if a positive determination is made in S40, the process proceeds to S41, where it is determined whether the lift-up operation within the area determined in S40 is an operation for switching the screen currently displayed on the user IF 17.

[0039] If the lift operation within the area specified in S40 is not an operation for switching the screen, a negative judgment is made in S41 and the process proceeds to S49. In S49, the icon of the user IF 17, which has been changed to the pressed state by the pressing process, is changed to the normal state. After the process of S49 is completed, the process proceeds to S50 and an http(s) response not including the screen update script is sent to the PC 30 via the communication IF 16.

[0040] On the other hand, if the setting icon 334 is operated on the remote screen 330 shown in FIG. 6 and a positive determination is made in S41, the firmware 20 proceeds to S42, where it is determined whether a lifting operation within the area identified in S40 is an instruction to start a printing operation. Since the operation of the setting icon 334 does not instruct the start of a printing operation, if a negative determination is made in S42, the firmware 20 proceeds to S44, where the screen currently displayed by the user IF 17 is switched to a screen corresponding to the lifting operation identified in S41. Specifically, if the setting icon 334 is lifted on the remote screen shown in FIG. 6, the firmware 20 switches the standby screen 150 displayed on the user IF 17 to a setting acceptance screen (not shown) in S44. Note that even if the setting icon 154 is operated on the standby screen 150 displayed on the user IF 17, the firmware 20 switches the standby screen 150 to the setting acceptance screen.

[0041] The setting reception screen is a screen that can receive instructions regarding various settings for each of the operations "Fax Operation," "Copy Operation," and "Scan Operation." It also has a "Print Reports" column that corresponds to various report printing.

[0042] If the process proceeds to S50 after the completion of the process of S44 or S49, remote screen data corresponding to the screen switched by the process of S44 or S49 is generated and stored in memory 12 in S50. Specifically, if a setting acceptance screen is displayed on user IF 17 in S44, remote screen data for displaying a remote screen corresponding to the setting acceptance screen is created in S50. In S51, an HTTP(S) response including a screen update script is sent to PC 30 via communication IF 16. The screen update script is a CGI script that instructs browser 41 of PC 30 to request the remote screen data generated in S50 from MFP 10. That is, upon receiving the HTTP(S) response sent in S51, browser 41 executes the screen update script to send a screen update request to MFP 10. As a result, in S32, the MFP 10 determines that the screen update request has been received, and executes screen data transmission processing in S35. When the PC 30 receives the remote image data, it displays on the display 34 a remote screen corresponding to the setting acceptance screen.

[0043] When an operation is performed on the remote screen 330 in the "Print Reports" field of the setting acceptance screen displayed on the PC 30, an affirmative determination is made in S40 and S41, and the process proceeds to S42. In S42, the lifting operation on the "Print Reports" field is not an operation to instruct the start of a printing operation, so an affirmative determination is made in S42, and the process proceeds to S44. In S44, the user IF 17 is caused to display a printer report screen. Furthermore, the processes of S50 and S51 generate remote screen data corresponding to the printer report screen. When the PC 30 receives the http(s) response from the MFP 10, it sends a screen update request to the MFP 10.

[0044] Note that, when the screen displayed on MFP 10 is changed by an operation on user IF 17, remote screen data corresponding to the screen displayed on user IF 17 is generated, as in S50. However, S51 is not executed. Note that a screen update request is periodically transmitted from browser 41 of PC 30. When a periodic screen update request is received, an affirmative determination is also made in S32. If an affirmative determination is made in S32, the process proceeds to S35, where remote screen data corresponding to the updated screen displayed on user IF 17 is transmitted to PC 30, thereby synchronizing the screen displayed on user IF 17 with the display on remote screen 330.

[0045] 8 shows a printer report screen 400 displayed as the remote screen 330. The printer report screen 400 includes fields 401, 402, and 403 that accept a selection operation of items to be printed out from among various setting items in the MFP 10. Specifically, when a selection operation is performed on the remote screen 330 in the "User Settings" field 401, the browser 41 sends an instruction to the MFP 10 to specify that items related to user settings are to be printed out. When a selection operation is performed on the remote screen 330 in the "Printer Settings" field 402 of the printer report screen 400, the firmware 20 sends an instruction to the MFP 10 to specify that items related to print settings are to be printed out. When a selection operation is performed on the remote screen 330 in the "Network Configuration" field 403 of the printer report screen 400, the firmware 20 sends an instruction to the MFP 10 to specify that items related to network connections are to be printed out. Here, the "items related to user settings," "items related to print settings," and "items related to network connection" are information included in setting information 26 stored in memory 12 of MFP 10. Note that when user IF 17 performs a selection operation on each of columns 401, 402, and 403 on the printer report screen displayed on user IF 17, firmware 20 receives instructions similar to those received from operations on remote screen 330 on each of columns 401, 402, and 403.

[0046] When a lift operation is performed on the remote screen 330 in the "Printer Settings" field 402 of the printer report screen 400, the firmware 20 receives a request including lift coordinate information (S36: YES) and executes the lift processing of S38. After making a positive determination in S41 of Fig. 7, the printer report screen 400 is not a screen for instructing the start of a printing operation (S42: NO), so the process proceeds to S44, and the printer report screen displayed on the user IF 17 is switched to an execution instruction acceptance screen.

[0047] When the process of S44 is completed, the process proceeds to S31 in Fig. 4 via the processes of S50 and S51. In this embodiment, the initial screen transmission process executed by the firmware 20 in S33 is an example of the transmission process. The transmission process may be a process of transmitting remote screen data corresponding to an initial screen other than the standby screen.

[0048] In this embodiment, an operation on the setting icon on the standby screen on the remote screen 330 is an example of a virtual first operation, and an operation on the user IF is an example of a first operation. An operation on the "Print Reports" field on the setting reception screen on the remote screen 330 is an example of a virtual first operation, and an operation on the user IF 17 is an example of a first operation. An operation on the "Printer Settings" field on the printer report screen 400 on the remote screen 330 is an example of a virtual first operation, and an operation on the user IF is an example of a first operation. The operation executed in S44 to switch the standby screen to the setting reception screen, the operation to switch the setting reception screen to the printer report screen, and further the operation to switch the printer report screen to the execution instruction reception screen are examples of first actions in response to the first operation.

[0049] Other than this, an operation that does not involve printing is also an example of the first operation. For example, an operation to switch the screen display, an operation to change the settings of the MFP 50, and an operation to transmit data from the MFP 50 are examples of the first operation.

[0050] 4 via the processes of S50 and S51. When the PC 30 receives the http(s) response from the MFP 10, it sends a screen update request to the MFP 10. Upon receiving the screen update request (S32: YES), the firmware 20 of the MFP 10 sends remote screen data corresponding to the execution instruction acceptance screen to the PC 30 in S35.

[0051] 9 is a screen that accepts an instruction operation to start or cancel print output of items related to print settings. When the "YES button 411" is operated on the execution instruction acceptance screen 410, the browser 41 transmits an instruction to the MFP 10 to execute print output of items related to print settings. On the other hand, when the "NO button 412" is operated on the execution instruction acceptance screen 410, the browser 41 transmits to the MFP 10 a message that print output of items related to print settings by the printer 13 has been canceled. When the "YES button" or "NO button" is operated on the execution instruction acceptance screen displayed on the user IF 17, the firmware 20 accepts the same instruction as the operation on the remote screen 330.

[0052] When it is detected that the "YES button 411" has been lifted on the remote screen 330 corresponding to the execution instruction acceptance screen 410, the PC 30 transmits a request including lift information. When the firmware 20 makes a positive determination in S36 of FIG. 4, it performs lift processing in S38. In the lift processing shown in FIG. 7, after passing through S40 and S41, it proceeds to S42. Since the operation of the YES button 411 on the remote screen 330 to the execution instruction acceptance screen 410 is an icon that instructs the start of a printing operation, it makes a positive determination in S42 and proceeds to S43.

[0053] In S43, it is determined whether the transmission of electronic data is valid. Specifically, the setting information 26 stored in the memory 12 is referenced, and if valid information indicating that "transmission of electronic data" is valid is stored in this setting information 26, a positive determination is made in S43. On the other hand, if invalid information indicating that "transmission of electronic data" is invalid is stored in the setting information 26, a negative determination is made in S43.

[0054] 10, a registration process in which the firmware 20 registers the contents of the setting information 26 stored in the memory 12 will be described. The process shown in FIG. 10 is a process performed separately from the processes shown in FIGS. 4 and 7. In S60, a setting screen is displayed on the user IF 17. The setting screen is a screen that accepts input operations for various setting items saved by the setting information 26. Specifically, the setting screen can accept an operation to enable or disable "electronic data transmission," and, if electronic data transmission is enabled, an input operation for information regarding "communication protocol setting items." In more detail, if the communication protocol is "email," the setting screen accepts an operation to input the address of an SMTP server and the address of a destination of data to be transmitted. On the other hand, if the communication protocol is "transfer to a service server," the setting screen can accept an operation to input the URL specifying the service server, the address, and the data format of data to be transmitted.

[0055] In S61, it is determined whether the setting operation has been completed. Specifically, if it is detected that the end button has been operated on the setting screen displayed on the user IF 17, an affirmative determination is made in S61, and the process proceeds to S62. If an affirmative determination is not made in S61, the process waits. In S62, the setting items stored in the setting information 26 are updated in accordance with the input accepted on the setting screen in S60. When an enabling operation for "sending electronic data" is performed on the setting screen, valid information is stored in the setting information 26 in association with "sending electronic data." On the other hand, when an invalid operation for "sending electronic data" is performed on the setting screen, invalid information is stored in the setting information 26 in association with "sending electronic data."

[0056] The setting information 26 stored in memory 12 can also be updated by a PC 50 connected to network 200. For example, like PC 30, PC 50 is a PC managed by an administrator. Specifically, when controller 11 of MFP 10 receives a selection operation for a "registration page" included in item display area 301 on administrator screen 300, controller 11 causes PC 50 to transmit web page data. In this case, in order to display administrator screen 300 on PC 30, authentication information must be transmitted to MFP 10, and PC 50 must be authenticated through authentication processing. The web page data transmitted to PC 50 is data for displaying a web page including a setting screen on the browser of PC 50. In this case, firmware 20 of MFP 10 updates setting information 26 based on instructions from PC 50 regarding the automatically determined setting items after transmitting the web page data.

[0057] In addition, when firmware 20 of MFP 10 receives an update instruction for setting information 26 from PC 30, 50 connected to network 200 via communication IF 16, it may update setting information 26 in accordance with the received update instruction.

[0058] 7, in S42, the NO button 412 on the execution instruction acceptance screen 410 is pressed on the remote screen 330 (S42: NO), and the process proceeds to S44. In this case, after the screen displayed on the user IF 17 is switched in S44, the processes of S50 and S51 are executed.

[0059] On the other hand, if the YES button 411 on the execution instruction acceptance screen 410 is pressed on the remote screen 330 (S42: YES), the process proceeds to S43. If the setting information 26 indicates that electronic data transmission is enabled (S43: YES), the process proceeds to S45, where electronic transmission data is generated from image data indicating the print setting items, and transmission of the generated transmission data is initiated. Specifically, the setting information 26 stored in the memory 12 is referenced to identify the communication protocol used to transmit the transmission data and the destination address. If the communication protocol stored in the setting information 26 is "email," the address of the SMTP server and the address of the destination of the transmission data are included. On the other hand, if the communication protocol stored in the setting information 26 is "transfer to a service server," the address and URL specifying the service server, as well as the data format of the transmission data, are included. The transmission data is then transmitted via the communication IF 16 to the identified address (in this case, the e-mail address of the PC 30) using a transmission method conforming to the identified communication protocol.

[0060] In S46, the execution instruction acceptance screen displayed on the user IF 17 is changed to a sending screen indicating that electronic data is being “sent.” FIG. 11 is a diagram illustrating a sending screen 420 displayed on the user IF 17 in S46. In S46, the sending screen 420 displayed on the user IF 17 displays a text image indicating that transmission data for an image showing print setting items is currently being sent. Specifically, a “Sending” text image 421 indicating that transmission data is currently being sent is displayed in the upper left corner of the sending screen 420. That is, while the transmission data is being sent in S46, a screen different from the screen displayed when printing is being executed in S48 is displayed on the user IF. This prevents the user from perceiving the fact that the print setting items are not being printed as a malfunction of the MFP 10, even though data showing the print setting items are being sent as transmission data. The sending screen 420 displayed on the user IF 17 in S46 remains displayed until transmission of the transmission data to the PC 30 via the communication IF 16 is completed.

[0061] When the processing of S46 is completed, the process proceeds to S50, where remote screen data is generated including the sending screen 430 displayed on the user IF 17 by the processing of S46. In S51, an http(s) response including a screen update script is sent to the PC 30 via the communication IF 16.

[0062] On the other hand, if the setting information 26 has disabled the transmission of electronic data (S43: NO), the process proceeds to S47, where printing by the printer 13 is initiated. Specifically, data indicating the print setting items is read from the setting information 26 already stored in the memory 12 in accordance with a predetermined printing protocol, and print data is generated. The generated print data is used to cause the printer 13 to print an image indicating the print setting items. In this embodiment, the data indicating the print setting items saved in the setting information 26 is an example of data stored in the memory 12 before the second operation is accepted.

[0063] In S48, the execution instruction acceptance screen 410 displayed on the user IF 17 is changed to a print execution screen indicating "Printing". FIG. 12 is a diagram illustrating a print execution screen 430 displayed on the touch panel 171 of the user IF 17 in S48. A text image 431 indicating that printing of an image is currently being executed is displayed on the print execution screen 430. Specifically, the text image 431 "Printing" indicating that printing is currently being executed is displayed on the upper left of the screen. The print execution screen displayed on the user IF 17 in S48 continues to be displayed until the printer 13 finishes printing the image showing the print setting items. When the process of S48 ends, the processes of S50 and S51 are executed.

[0064] In this embodiment, an operation on the remote screen 330 using the YES button 411 on the execution instruction acceptance screen 410 is an example of a virtual second operation, and an operation on the user IF 17 is an example of a second operation. Printing the print setting items by operating the YES button 411 is an example of a second action corresponding to the second operation. Sending the print setting items as transmission data in S45 is an example of a third action.

[0065] In this embodiment, the display of the execution instruction acceptance screen 410 shown in FIG. 9 may be omitted. Specifically, when the "Printer Settings" field 402 on the print report screen 400 is operated, the process proceeds to S43 without switching the screen to the execution instruction acceptance screen 410. If an affirmative determination is made in S43, transmission data may be generated and the generated transmission data may be transmitted. In this case, even when the "Printer Settings" field on the print report screen 400 is operated on the user IF 17, the print setting data may be printed by processing equivalent to S47 without switching the screen displayed on the user IF 17 to the execution instruction acceptance screen. In this example, the operation on the "Printer Settings" field on the remote screen 330 of the execution instruction acceptance screen is an example of a virtual second operation, and the operation on the user IF 17 is an example of a virtual second operation.

[0066] Data other than print setting data may also be set as the print target. Specifically, when an operation to specify the print target is performed on the remote screen 330, the print target data is acquired, and if the transmission of electronic data is enabled (S43: YES), the print target data is transmitted in S45. Even in this case, when an operation to specify the print target is performed on the user IF 17, the print target is printed in a process equivalent to S47. In this example, the operation to specify the print target on the remote screen 330 is an example of a virtual second operation, and the operation to specify the print target on the user IF 17 is an example of the second operation.

[0067] 8 is displayed, when the "User Settings" field 401 is operated, user setting data stored in memory 12 and used for user authentication on MFP 10 may be configured to be printed. In this case, an operation on the "User Settings" field of the printer report screen on remote screen 330 is an example of a virtual second operation, and an operation on user IF 17 is an example of the second operation. When the "NetWork Configuration" field 403 is operated on printer report screen 400, network setting data stored in memory 12 and used for communication on MFP 10 may be configured to be printed. In this case, an operation on the "NetWork Settings" field of the printer report screen on remote screen 330 is an example of a virtual second operation, and an operation on user IF 17 is an example of the second operation.

[0068] Log data that stores an operation log of the MFP 10 stored in memory 12 of the MFP 10 may be printed. In this case, a print instruction operation on remote screen 330 to a screen related to printing of a log report is an example of a virtual second operation, and a print instruction operation on user IF 17 is an example of a second operation. Received image data received by the MFP 10 via fax may be printed. In this case, a print instruction operation on remote screen 330 to a screen related to printing of the received image data is an example of a virtual second operation, and a print instruction operation on user IF 17 is an example of a second operation.

[0069] An instruction operation for downloading and printing image data uploaded to a server, known as "download printing," is also an example of a virtual second operation and a second operation. In this case, an execution instruction operation on the remote screen 330 to a screen that accepts an instruction to execute download printing is an example of a virtual second operation, and an execution instruction operation on the user IF 17 is an example of a second operation. Printing the downloaded image data by processing similar to S47 is an example of a second operation, and transmitting the downloaded image data in S45 by the virtual second operation is an example of a third operation.

[0070] Furthermore, when the browser 41 receives a user operation input on the end button 333 on the remote screen 330, it sends a request to the firmware 20 to end the remote screen control along with the token. When the firmware 20 receives the end request from the PC, it ends the remote screen control on the condition that the token is valid. When the firmware 20 ends the remote screen control, various information stored in the memory 12 is deleted, such as information indicating the usage status of the remote screen control, information indicating that a token has been issued, and information indicating the permission status of the remote screen control. The firmware 20 may end the remote screen control after deleting this information, or another program may delete this information when the end of the remote screen control is triggered. Even if there is no access from the browser 41 executing the execution program for a certain period of time after the start of the remote screen control, the firmware 20 ends the remote screen control in the same manner as when the end button is pressed.

[0071] The present embodiment described above can achieve the following effects. In remote screen control, firmware 20 of MFP 10 can suppress a decrease in security caused by printing an image from a remotely controlled MFP 10. Furthermore, the user can view the image output from MFP 10 using the image data sent to a specified address, which is convenient for the user who performs remote control.

[0072] The firmware 20 is capable of transmitting data representing an image to a predetermined address using a communication protocol set in accordance with an operation on a setting screen displayed on the user IF 17.

[0073] The firmware 20 can transmit data representing an image to a registered address in response to an operation accepted on the setting screen displayed on the user IF 17.

[0074] The firmware 20 can prevent the user from recognizing that the MFP 10 is broken when an image is not printed even though data indicating the contents of the print settings has been sent.

[0075] (Other embodiments) The image forming apparatus is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the present invention. In the above-described embodiment, the second operation executed by firmware 20 of MFP 10 is described as an operation for printing an image. Alternatively, firmware 20 may execute a process for displaying an image on touch panel 171 as the second operation. Examples of data to be displayed include print setting data, user setting data, network setting data, log data storing an operation log of MFP 10, and even downloaded image data. Even in this case, when a lift-up operation is performed on remote screen 330 to display the display target on touch panel 171, the transmission of electronic data is determined to be valid in S43 of FIG. 7, and the process proceeds to S45. Then, in S45, instead of displaying an image on touch panel 171 in S47, transmission data is generated and transmitted to PC 30. This not only provides the same effects as the first embodiment, but also reduces a decrease in security caused by an image being continuously displayed on the remotely controlled MFP 10 during remote screen control. In the above-described embodiment, an example has been described in which the MFP 10 that created the remote screen data transmits the remote screen data to the PC 30 in response to receiving a screen update request from the PC 30. Alternatively, the MFP 10 that created the remote screen data may transmit the remote screen data to the PC 30 without receiving a screen update request. In the above-described embodiment, an example has been described in which MFP 10 transmits pre-created remote screen data to PC 30 in response to receiving a screen update request from PC 30. Alternatively, MFP 10 may not create remote screen data in advance, but may instead create remote screen data corresponding to the screen currently being displayed by MFP 10 in response to receiving a screen update request from PC 30, and transmit the created remote screen data to PC 30. In the above-described embodiment, an example has been described in which step S51 is not executed when the screen displayed on MFP 10 is switched by an operation on user IF 17. Alternatively, when the screen displayed on MFP 10 is switched by an operation on user IF 17, remote screen data may be transmitted to PC 30.

[0076] In the above-described embodiment, the MFP 10 has been described as an example of an image forming apparatus, but the image forming apparatus may be a printer, a scanner, or a copier. The PC has been described as an example of an information processing apparatus, but the image forming apparatus may be a mobile terminal such as a smartphone. [Explanation of symbols]

[0077] 10...MFC, 11...controller, 16...communication IF, 17...user IF, 20...firmware, 30...PC, 41...browser, 100...image forming system

Claims

1. A user interface; a communication interface; a controller; when the controller receives a first request from a device connected via the communication interface, the controller executes a transmission process to transmit remote screen data to a device that has issued a request for the first request, the first request being a request to display a remote screen, the remote screen data being data for displaying the remote screen on the device that has issued the request for the first request, the remote screen being a screen that is displayed on the device that has issued the request for the first request and that virtually reproduces the user interface; The controller a first process of performing a first operation that does not involve outputting an image in response to a first operation received via the user interface; a second process of performing a second operation involving outputting an image in response to a second operation received via the user interface, the second operation being different from the first operation; a third process of performing the first operation when, after the transmission process, an instruction indicating that the first operation has been virtually performed on the remote screen is received from the request source device of the first request via the communication interface; and a fourth process that, after the transmission process, performs a third operation of transmitting data representing the image output by the second operation to a predetermined address via the communication interface when an instruction indicating that the second operation has been virtually performed on the remote screen is received from the requesting device of the first request via the communication interface.

2. Equipped with a web server, when the controller receives a request to display a web page related to the image forming apparatus, the controller causes the web server to transmit web page data to the apparatus that has made the display request, the web page data being data for displaying the web page on the apparatus that has made the display request; 2. The image forming apparatus according to claim 1, wherein the controller executes the transmission process when, after transmitting the web page data, the controller receives the first request via the web page from the device to which the web page data is to be transmitted.

3. The controller displaying a setting screen relating to the fourth process on the user interface, and registering a communication protocol used in the fourth process in the image forming apparatus in accordance with an operation accepted on the setting screen; 3. An image forming apparatus according to claim 1, wherein in the fourth process, as the third operation, data representing an image output by the second operation is sent to a predetermined address via the communication interface using the registered communication protocol.

4. The controller displaying a setting screen relating to the fourth process on the user interface, and registering a destination address of data representing the image output by the second operation in the image forming apparatus in response to an operation accepted on the setting screen; The image forming apparatus according to any one of claims 1 to 3, wherein in the fourth process, as the third operation, data indicating the image output by the second operation is sent to the registered destination address.

5. It has memory, In the second processing, when the second operation is accepted via the user interface, an image data of which is stored in the memory before the second operation is accepted is output as the second action; In the fourth process, when an instruction indicating that the second operation has been virtually performed on the remote screen is received via the communication interface from the requesting device of the first request, the image forming device described in any one of claims 1 to 4 transmits data indicating the image stored in the memory by the second operation to a predetermined address via the communication interface as data indicating the image output by the third operation.

6. In the second processing, when the second operation is accepted via the user interface, image data is received via the communication interface as the second action, and the image of the received data is output; In the fourth process, when an instruction indicating that the second operation has been virtually performed on the remote screen is received via the communication interface from the requesting device of the first request, the image forming device described in any one of claims 1 to 4 transmits image data received via the communication interface by the second operation to a predetermined address via the communication interface as data indicating the image output by the third operation.

7. In the second processing, a predetermined screen is displayed on the user interface during execution of the second operation; An image forming apparatus according to any one of claims 1 to 6, wherein in the fourth process, while the third operation is being executed, a screen different from the screen displayed when the second operation in the second process is being executed is displayed on the user interface.

8. In the second process, during the execution of the second operation, a screen including text indicating that an image is being output is displayed on the user interface; The image forming apparatus according to claim 7 , wherein the fourth process displays, on the user interface, a screen including text indicating that data representing an image is being transmitted during execution of the third operation.

Images