Image forming apparatus and information transmission method

Abstract

To protect information in a state where an operation from an external device can be carried out when performing the operation by displaying a part or the whole of an operation image of the image forming apparatus from the external device via a network.SOLUTION: An image forming apparatus according to an aspect of the present invention comprises a communication unit 14, an operating unit 13, a display unit 12 that displays an operation image operable from the operating unit 13, a transmission processing unit 10a, and a switching unit 10c. The transmission processing unit 10a transmits display information for displaying a remote control image to an external device 2 through the communication unit 14. The switching unit 10c switches a disclosure mode related to information disclosure in the remote control image. The disclosure mode includes first and second modes. The first mode is a mode for including, in the display information, prescribed information included in a part of the operation image, and including, in the display information, registration information being information included in a part of the operation image and registered by a user. The second mode is a mode for including the prescribed information in the display information and not including the registration information in the display information.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an image forming apparatus and an information transmission method.

Background Art

[0002] It has been known for a long time to display the operation panel of a printing apparatus on a browser of a terminal device located remotely. For example, Patent Document 1 discloses a technique that enables language change when displaying an operation panel on a browser of a terminal device.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in recent years, awareness of personal information protection has been increasing. In order to prevent personal information and the like from being viewed remotely, the inventor considered temporarily blocking the display of the operation panel remotely. However, in a state where such a block is performed, there arises a problem that an operator acting as an agent cannot operate from a remote location. Note that the technique described in Patent Document 1 is not a technique that can solve such a problem.

[0005] Therefore, when displaying and operating part or all of the operation image of an image forming apparatus from an external device via a network, it is desired to develop a technique that enables protection of information while allowing operation from the external device.

Means for Solving the Problems

[0006] An image forming apparatus according to an aspect of the present invention includes a communication unit, an operation unit, a display unit that displays an operation image operable from the operation unit, a transmission processing unit that transmits display information for displaying a remote operation image based on the operation image to an external device via the communication unit, and a switching unit that switches a disclosure mode regarding information disclosure in the remote operation image. The disclosure mode includes a first mode in which specified information included in a part of the operation image is included in the display information and registered information, which is information registered by a user and included in a part of the operation image, is included in the display information, and a second mode in which the specified information is included in the display information and the registered information is not included in the display information.

[0007] An information transmission method according to an aspect of the present invention is such that an image forming apparatus including a communication unit, an operation unit, and a display unit that displays an operation image operable from the operation unit transmits display information for displaying a remote operation image based on the operation image to an external device via the communication unit, the image forming apparatus switches a disclosure mode regarding information disclosure in the remote operation image, and the disclosure mode includes a first mode in which specified information included in a part of the operation image is included in the display information and registered information, which is information registered by a user and included in a part of the operation image, is included in the display information, and a second mode in which the specified information is included in the display information and the registered information is not included in the display information.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that each drawing is merely an example for explaining the embodiments of the present invention. Also, not all of the components described in the embodiments of the present invention are essential components of the present invention.

[0010] (Embodiment) An image forming system including an image forming apparatus and an external apparatus according to the embodiment will be described with reference to FIG. 1. FIG. 1 is a block diagram showing one configuration example of such an image forming system.

[0011] As shown in FIG. 1, an image forming system (hereinafter referred to as "this system") 100 according to this embodiment can include an image forming apparatus 1 and an external apparatus 2. The external apparatus 2 can be connected to the image forming apparatus 1 via a network N.

[0012] [Schematic Configuration of Image Forming Apparatus 1] As shown in FIG. 1, the image forming apparatus 1 can include a control unit 10, a storage unit 11, a display unit 12, an operation unit 13, a communication unit 14, and a printing unit 15.

[0013] The control unit 10 of the image forming apparatus 1 can also be referred to as a controller and performs overall control of the image forming apparatus 1. Although the details will be described later, the control unit 10 can include a transmission processing unit 10a, a reception processing unit 10b, and a switching unit 10c.

[0014] The control unit 10 can be configured to include, for example, an arithmetic processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), a working memory, and a storage device that stores control programs, parameters, etc. The control unit 10 can also be configured as a SoC (System on a Chip). As can be seen from these examples, the control unit 10 can be configured to store a control program in an executable state. However, the control unit 10 can also be configured to store a control program as a circuit configuration like an FPGA (field-programmable gate array), or configured as a dedicated circuit. The transmission processing unit 10a and the reception processing unit 10b can be implemented as the above programs. The above programs can include programs for realizing the functions of the transmission processing unit 10a, the reception processing unit 10b, and the switching unit 10c while cooperating with the storage unit 11, the display unit 12, the operation unit 13, and the communication unit 14. Alternatively, the above programs can include programs for realizing the functions of the transmission processing unit 10a, the reception processing unit 10b, and the switching unit 10c while cooperating with the storage unit 11, the display unit 12, the operation unit 13, the communication unit 14, and the printing unit 15.

[0015] The storage unit 11 is, for example, a hard disk drive, a solid state drive, or other memory. A part of the memory included in the control unit 10 may be regarded as the storage unit 11. The storage unit 11 can also be regarded as a part of the control unit 10.

[0016] The storage unit 11 can store registration information 11a, which is information registered by a user. Here, the user can be the administrator of the image forming apparatus 1, but any user of the image forming apparatus 1 is acceptable. Also, the above registration can be performed from the operation unit 13 or from an external device connected via a network. Note that the external device for performing the above registration may be the external device 2 for remote operation. In that case, it is preferable to perform the registration in the disclosure mode in which the registration information 11a is disclosed among the disclosure modes described later, or to set access rights regarding the registration for the user of the external device 2.

[0017] The registration information 11a can include contact information indicating a contact destination, user setting information indicating user settings regarding the display of operation images in the image forming apparatus 1, and the like. This contact information can include a telephone number, an email address, and the like. This contact information can also be referred to as address book information, telephone directory information, or the like.

[0018] In addition, the above user setting information can include information for reflecting the customization, for example, when customizing the operation image. The customization of the operation image may include, for example, customizing the icon image from the specified icon image. This icon image is an image showing an icon included in the operation image for selecting functions such as the copy function of the image forming apparatus 1. Of course, the icon image may be an image showing an icon used when selecting functions other than those of the image forming apparatus 1. Further, the customization of the operation image can include various customizations such as customizing the background image serving as the background in the operation image from the specified background image. Thus, the registration information 11a may be information in which a part of the specified information is changed and registered by the user, for example.

[0019] The customization of the icon image and the background image can also be performed by selecting from among the candidate images stored in the storage unit 11, or can be performed by the user selecting an image stored in an external recording medium or the like connected to the image forming apparatus 1. Thus, the user setting information can include information indicating such customized icon images, background images, and the like.

[0020] In addition, the above user setting information may include information indicating a password registered by the user. This password can be used, for example, as a password for managing access rights to the image forming apparatus 1, such as the access right to a file stored in the storage unit 11 of the image forming apparatus 1.

[0021] In addition, the storage unit 11 can store, for example, a table 11b. The table 11b will be described later with reference to FIG. 4, and the table 11b refers to a table storing protection setting information, which is setting information regarding information protection.

[0022] The display unit 12 is a part for displaying information. The display unit 12 displays an operation image, which is a user interface (UI) image, as at least a part of this information. This operation image is an image operable from the operation unit 13. This operation image can be stored in the storage unit 11. The display unit 12 is constituted by, for example, a display device such as a liquid crystal display or an organic EL display. The display unit 12 can also have a configuration including a display and a drive circuit for driving the display.

[0023] The operation unit 13 is a part for receiving operations and inputs by the user and can also be referred to as an operation reception unit. The operation unit 13 can be provided with a touch panel or a touch sensor mounted on the display unit 12. In this case, when the user performs a touch operation on the operation image displayed on the display unit 12, the operation unit 13 can receive an operation corresponding to the area where the touch operation was performed. Such a display unit 12 for displaying an operation image and an operation unit 13 provided with a touch panel or a touch sensor mounted on the display unit 12 can constitute the operation panel of the image forming apparatus 1. Additionally, the operation unit 13 can also be provided with, for example, a group of physical buttons. A part of the group of physical buttons can also be configured to be able to receive operations on the operation image. Of course, a part or all of the group of physical buttons can also be configured to receive operations independent of the operation image.

[0024] The communication unit 14 can be one or more communication interfaces for the image forming apparatus 1 to communicate with a plurality of external devices via a wired or wireless network N in accordance with a predetermined communication protocol including a predetermined communication standard. This external device is, for example, a device equipped with a communication function such as a personal computer (PC), a server device, a smartphone, or a tablet terminal. This external device in the case of performing communication regarding processing of the operation image will include the external device 2.

[0025] The communication unit 14 can transmit, via the network N, display information for causing an external device 2 to display an operation image. Note that this display information may be the operation image itself. Hereinafter, in order to distinguish it from the operation image to be displayed on the display unit 12, the operation image to be displayed on the display unit 22 of the external device 2 based on this display information is referred to as a remote operation image. Further, the communication unit 14 can receive, via the network N, operation events received by the external device 2 from the external device 2.

[0026] In addition, the communication unit 14 can receive a print target file from an external device. The external device that transmits the print target file can be an external device other than the external device 2. However, the communication unit 14 may be configured to be able to receive a print target file from the external device 2 via the network N as well.

[0027] The printing unit 15 executes printing on a medium based on, for example, a print target file received from an external device other than the external device 2 or the external device 2 via the communication unit 14, or a print target file obtained by reading an image with a scanner (not shown). Thereby, an image indicated by the print target file is formed on the medium. Any printing method can be applied to the printing unit 15, and various printing methods such as an inkjet printing method and a laser printing method can be applied. When the image forming apparatus 1 adopts an inkjet printing method, it can be referred to as an inkjet printer, and when it adopts a laser printing method, it can be referred to as a laser printer.

[0028] [Schematic Configuration of External Device 2] The external device 2 can be a device having a communication function such as a smartphone, a tablet terminal, or a PC. The external device 2 is not limited to a portable type and may be an installed type device. The external device 2 can also be referred to as a terminal device. As illustrated in FIG. 1, the external device 2 can include a control unit 20, a storage unit 21, a display unit 22, an operation unit 23, and a communication unit 24.

[0029] The control unit 20 of the external device 2 controls the entire external device 2. Although the details will be described later, the control unit 20 can include a reception processing unit 20a and a transmission processing unit 20b.

[0030] The control unit 20 can be configured to include, for example, an arithmetic processing device such as a CPU or GPU, a working memory, and a storage device that stores control programs, parameters, etc. The control unit 20 can also be configured as a SoC. As can be seen from these examples, the control unit 20 can be configured to store a control program in an executable state. However, the control unit 20 can also be configured to store a control program as a circuit configuration like an FPGA, or configured as a dedicated circuit. The reception processing unit 20a and the transmission processing unit 20b can be implemented as the above program. The above program can be a program for realizing the functions of the reception processing unit 20a and the transmission processing unit 20b while cooperating with the storage unit 21, the display unit 22, the operation unit 23, and the communication unit 24.

[0031] The storage unit 21 is, for example, a hard disk drive, a solid state drive, or other memory. A part of the memory included in the control unit 20 may be regarded as the storage unit 21. The storage unit 21 can also be regarded as a part of the control unit 20.

[0032] The display unit 22 is a part for displaying information. The display unit 22 can display the remote operation image provided from the image forming apparatus 1 as at least a part of this information. The display unit 22 is configured by, for example, a display device such as a liquid crystal display or an organic EL display. The display unit 22 can also be configured to include a display and a drive circuit for driving the display.

[0033] The operation unit 23 is a part that receives operations and inputs by the user, and can also be referred to as an operation reception unit. The operation unit 23 can receive operations on the remote operation image displayed on the display unit 22. The operation unit 23 can be realized by, for example, any one or a plurality of physical buttons, a touch panel or a touch sensor mounted on the display unit 22, a pointing device, and a keyboard. In a configuration where the operation unit 23 includes a touch panel or a touch sensor, including the display unit 22 and the touch panel, it can also be referred to as an operation panel of the external device 2.

[0034] The communication unit 24 can be one or more communication interfaces for the external device 2 to communicate with one or more external devices via a wired or wireless network N in accordance with a predetermined communication protocol including a predetermined communication standard. In the case of performing communication regarding processing of the operation image, this external device will include the image forming apparatus 1.

[0035] The communication unit 24 can receive, from the image forming apparatus 1, display information for displaying a remote operation image on the display unit 22 of the external device 2 via the network N. As described above, this display information may be the remote operation image itself. Also, the communication unit 24 can transmit, via the network N, the operation event received by the operation unit 23 to the image forming apparatus 1. In addition, the communication unit 24 may be configured to be able to transmit a print target file to the image forming apparatus 1 via the network N.

[0036] [Specific Configuration of this System 100] Details of the control unit 10 of the image forming apparatus 1 will be described together with details of the external device 2. In this system 100, as a general flow, the external device 2 accesses the image forming apparatus 1 via the network N and receives display information based on the operation image displayed on the display unit 12 of the image forming apparatus 1, and displays a remote operation image on the display unit 22 based on the display information. In this system 100, this includes the case where the remote operation image is an image subjected to personal information protection processing.

[0037] Then, the external device 2 receives a user operation on its remote operation image at the operation unit 23, and transmits an operation event indicating the user operation to the image forming apparatus 1 via the network N. The image forming apparatus 1 can receive an operation on the operation image based on the received operation event, and thereby execute the process indicated by the operation event. For example, based on the operation event, the image forming apparatus 1 can change the current operation image and the current remote operation image by, for example, transitioning them to the next operation image and the next remote operation image, respectively.

[0038] First, a configuration example on the side of the image forming apparatus 1 will be described. As described above, the control unit 10 of the image forming apparatus 1 can include a transmission processing unit 10a, a reception processing unit 10b, and a switching unit 10c.

[0039] The transmission processing unit 10a transmits display information based on the operation image displayed on the display unit 12 to the external device 2 via the communication unit 14. The transmission of such display information by the transmission processing unit 10a is executed via the network N. Since the display information is the information displayed on the screen of the display unit 12, it can also be referred to as screen information. The display information is information for displaying a remote operation image on the display unit 22 of the external device 2. Also, the display information can be displayed on the display unit 22 of the external device 2 using, for example, a web browser or the like, and in that case, the display information can also be referred to as web screen information. As in this example, the transmission processing unit 10a may transmit the display information as information to be displayed on the browser of the external device 2.

[0040] The reception processing unit 10b can be configured to receive an operation event received at the external device 2 from the external device 2 via the communication unit 14. The reception of such an operation event by the reception processing unit 10b is executed via the network N. This operation event is an event indicating an operation received via the remote operation image displayed based on the display information transmitted to the external device 2.

[0041] The image forming apparatus 1 is provided with a function of remotely providing an operation panel to the external device 2 by transmitting such display information and receiving operation events by the transmission processing unit 10a and the reception processing unit 10b, that is, it is provided with a function of providing a remote panel. However, the operation of the operation image by the operation event is not essential in the present embodiment. In the present system 100, the system excluding the processing related to such an operation becomes a system that remotely monitors the operation image displayed on the display unit 12 of the image forming apparatus 1 among the functions of the remote panel.

[0042] The switching unit 10c switches the disclosure mode regarding the information disclosure in the remote operation image. This disclosure mode includes a first mode and a second mode. That is, the switching unit 10c can switch the disclosure mode at least between the first mode and the second mode. Since the disclosure mode is a mode regarding the protection of information, it can also be referred to as a protection mode.

[0043] The first mode is a mode in which the specified information included in a part of the operation image is included in the display information used for the display of the remote operation image, and the registration information 11a included in a part of the operation image is included in the display information used for the display of the remote operation image. Since the first mode is a mode in which both the specified information and the registration information 11a are included in the remote operation image and disclosed to the external device 2, it can be referred to as a public disclosure mode.

[0044] The specified information can be, for example, information that is included in the operation image by default. To give a more specific example, the specified information is information that is preset when the image forming apparatus 1 is shipped from a factory, a sales store, etc., that is, information that has not been customized by the user, and can include, for example, a default icon image and a default background image. Further, the specified information may include, for example, contact information of the maintenance destination of the image forming apparatus 1. Here, the maintenance destination may be the contact information of the remote operator who displays the remote operation image on the external device 2.

[0045] Note that the specified information only needs to be included in a part of the operation image and does not have to be included in all of the operation images to be displayed on the display unit 12. Operation images that do not include the specified information may be included in the display information for displaying remote operation images without being subject to processing even in this first mode, the second mode, and the third mode described later.

[0046] As described above, the registration information 11a is information registered in the image forming apparatus 1 by the user. The registration information 11a can include contact information indicating a contact registered by user input, user setting information, and the like. The user setting information may include an icon image customized by the user, a background image, information indicating a password registered by the user, and the like. The registration information 11a may be information in which a part of the specified information is changed and registered by the user. Note that the registration information 11a only needs to be included in a part of the operation image and does not have to be included in all of the operation images to be displayed on the display unit 12.

[0047] The second mode is a mode in which the above-described specified information is included in the display information and the above-described registration information 11a is not included in the display information. The second mode can be referred to as a semi-public mode because the specified information is included in the remote operation image and made public to the external device 2, while the registration information 11a is not included in the remote operation information and made non-public to the external device 2.

[0048] Also, when the switching unit 10c switches the disclosure mode between the first mode and the second mode in this way, the default mode can be set to the second mode. That is, the switching unit 10c may set the disclosure mode to the second mode when the transmission processing unit 10a starts transmitting the display information. Thereby, the remote panel can be started from the second mode in which more information protection is provided.

[0049] The disclosure mode may further include a third mode in which the specified information is not included in the display information and the registration information 11a is also not included in the display information. That is, the switching unit 10c may be configured to switch the disclosure mode at least among the first mode, the second mode, and the third mode. The third mode can be referred to as a non-disclosure mode.

[0050] Also, when the switching unit 10c switches the disclosure mode among the first mode, the second mode, and the third mode in this way, the default mode can be set to the third mode. That is, when the transmission processing unit 10a starts transmitting the display information, the switching unit 10c may set the disclosure mode to the third mode. Thereby, the remote panel can be started from the third mode in which the information is most protected among the three modes.

[0051] Next, a configuration example of the external device 2 will be described. As described above, the control unit 20 of the external device 2 can include a reception processing unit 20a and a transmission processing unit 20b.

[0052] The reception processing unit 20a receives the display information based on the operation image displayed on the display unit 12 of the image forming apparatus 1 from the image forming apparatus 1 via the communication unit 24. The reception of such display information by the reception processing unit 20a is executed via the network N. Note that since the reception processing unit 20a acquires the display information from the image forming apparatus 1, it can also be referred to as an acquisition processing unit.

[0053] Then, the display unit 22 displays a remote operation image based on the display information received by the reception processing unit 20a. Also, as described above, the display information can be displayed on the display unit 22 using, for example, a Web browser or the like. As in this example, the reception processing unit 20a may receive the display information as information to be displayed on the browser of the external device 2.

[0054] Further, the transmission processing unit 20b can be configured to transmit the operation event received by the operation unit 23 to the image forming apparatus 1 via the communication unit 24. The transmission of such an operation event by the transmission processing unit 20b is executed via the network N. Examples of such an operation event include an event of a click operation or a touch operation on the remote operation image displayed on the display unit 22 by a pointing device. Note that the pointing device can also be referred to as a mouse.

[0055] The external device 2 is provided with a function of remotely enjoying the provision of the operation panel from the image forming apparatus 1, that is, a function of enjoying the remote panel, by receiving such display information and transmitting the operation event by the reception processing unit 20a and the transmission processing unit 20b. However, as described above, the operation of the operation image by the operation event is not essential in the present embodiment.

[0056] [Processing Example of the Present System 100] The configurations of the image forming apparatus 1 and the external device 2 have been described above. Next, in the above configuration, a process in which the remote operation image is changed according to the disclosure mode will be described with specific examples. Here, with reference to FIGS. 2 to 12, the flow of processing of the image forming apparatus 1 mainly including processing for changing such a remote operation image will be described. Here, for the sake of simplicity of explanation, an example will be given in which the display information transmitted from the image forming apparatus 1 is the remote operation image itself to be displayed on the browser that can be displayed on the display unit 22 of the external device 2. Also, here, the description of the display process of the operation image on the display unit 22 will be omitted.

[0057] FIG. 2 is a flowchart for explaining a processing example of the image forming apparatus 1 in the present system 100. FIG. 3 is a flowchart for explaining an example of the display component protection process in the processing example of FIG. 2. FIG. 4 is a diagram showing an example of a table referred to in the process of FIG. 2. FIGS. 5 to 11 are schematic diagrams showing an example of an operation image displayed in the present system 100 and an example of a remote operation image displayed corresponding thereto. FIG. 12 is a schematic diagram showing an example of an operation image displayed in the present system 100.

[0058] Prior to explaining the processing flow, the disclosure mode will be described. When the image forming apparatus 1 starts providing a remote panel to the external device 2, it determines the disclosure mode. Since the disclosure mode is a mode indicating how to protect information, it will be described hereinafter as the protection mode. The protection mode can be preset from the operation unit 13 and can also be changed as necessary.

[0059] Also, the above-described first mode is a mode that does not protect information, and will be described hereinafter as the standard mode. In the standard mode, all operation images are directly disclosed to the user of the external device 2 serving as the remote operator as remote operation images.

[0060] The above-described second mode is a mode that includes specified information in the remote operation image and does not include the registered information 11a in the remote operation image, but can also have a plurality of modes according to the type of the registered information 11a. For example, the second mode can include a personal information lock mode, a privacy lock mode, and a personal information / privacy lock mode, and the following will describe with such examples.

[0061] The personal information lock mode refers to a mode in which personal information represented by contact information among the registered information 11a is not included in the remote operation image. Also, in the personal information lock mode, it becomes a mode in which prescribed information is included in the remote operation image. In the personal information lock mode, a remote operation image in which personal information such as contact information in the address book is made non-public is provided to the user of the external device 2.

[0062] The privacy lock mode refers to a mode in which prescribed information is included in the remote operation image and privacy information indicating the preferences of the user himself / herself among the registered information 11a is not included in the remote operation image. In the privacy lock mode, a remote operation image in which the background image and icon image customized by the user who is the administrator of the image forming apparatus 1, for example, the owner of the image forming apparatus 1 are made non-public is provided to the user of the external device 2. For example, this privacy lock mode can be set as the default protection mode when starting the process of providing the remote operation image to the external device 2. Of course, the default protection mode may be a mode other than the privacy lock mode such as the personal information lock mode.

[0063] The personal information / privacy lock mode is a mode in which the prescribed information is made public and both the information made non-public in the personal information lock mode and the privacy lock mode are made non-public. Therefore, in the personal information / privacy lock mode, the prescribed information is included in the remote operation image, and customized background images, icon images, and personal information such as contact information are not included in the remote operation image.

[0064] The third mode described above is a mode that protects both the prescribed information and the registered information 11a, and will be described hereinafter as the full lock mode. In the full lock mode, a remote operation image in which the information included in basically all operation images is made non-public is provided to the user of the external device 2.

[0065] The processing flow will be described below. First, the transmission processing unit 10a determines whether the current protection mode is the full lock mode (step S11). If information indicating the current protection mode is stored in the storage unit 11, the transmission processing unit 10a can make the determination by reading it. If the answer in step S11 is NO, the transmission processing unit 10a determines whether the current protection mode is the standard mode (step S12).

[0066] If the answer in step S12 is YES, that is, if the current protection mode is the standard mode, the transmission processing unit 10a copies the main body display buffer to the virtual buffer (step S16). Here, the main body display buffer is, for example, a buffer set in the internal memory of the control unit 10 for drawing an operation image. The display unit 12 can display the operation image stored in this main body display buffer. The virtual buffer is a buffer set in the internal memory of the control unit 10 for drawing a remote operation image. Next, the transmission processing unit 10a transmits the remote operation image stored in this virtual buffer to the external device 2 (step S15), and the process ends.

[0067] For example, in the scenario where the operation image 50p shown in FIG. 5 is displayed on the display unit 12, in step S15 after the process of step S16, the remote operation image 50r shown in FIG. 5, in which the operation image 50p is copied as it is, is transmitted to the external device 2. Then, the reception processing unit 20a of the external device 2 receives the remote operation image 50r and causes it to be displayed on the display unit 22.

[0068] Here, the operation image 50p is an example of the operation image displayed on the display unit 12 in the standard mode. The operation image 50p includes a mark 51p indicating the current protection mode, a return button 52p for returning to the previous operation image, information 53p indicating the user name of the image forming apparatus 1, and contact information 54p. The contact information 54p includes information 55p indicating the name of the contact person or organization and information 56p indicating the email address corresponding to each name.

[0069] Since an example where the current protection mode is the standard mode is shown, the mark 51p becomes a predetermined mark corresponding to the standard mode. However, the mark 51p may be used as a mode switch button that can be pressed to change to another protection mode. This also applies to other operation images described later. An example of the operation of switching the protection mode by the mode switch button will be described later.

[0070] The remote operation image 50r is an example of a remote operation image that is transmitted to the external device 2 corresponding to the operation image 50p and displayed on the display unit 22. The remote operation image 50r includes a mark 51r, a return button 52r, information 53r, and contact information 54r including information 55r, 56r, which respectively correspond to the mark 51p, the return button 52p, the information 53p, and the contact information 54p including information 55p, 56p. However, even when the mark 51p is a mode switch button, the mark 51r is a mark indicating the current protection mode rather than a mode switch button. This also applies to other remote operation images described later.

[0071] On the other hand, if YES in step S11, that is, if the current protection mode is the full lock mode, the transmission processing unit 10a fills the virtual buffer with black (step S17). Note that other colors may be adopted instead of black. Next, the transmission processing unit 10a draws a protection mode mark, which is a mark indicating the current protection mode, on the virtual buffer (step S18). Then, the transmission processing unit 10a transmits the content of the virtual buffer to the external device 2 as a remote operation image (step S15), and the process ends.

[0072] For example, in the scene where the operation image 60pa shown in FIG. 6 is displayed on the display unit 12, in step S15 after the process of step S18, the remote operation image 60ra shown in FIG. 6 is transmitted to the external device 2. Then, the reception processing unit 20a of the external device 2 receives the remote operation image 60r and causes it to be displayed on the display unit 22.

[0073] Here, the operation image 60pa is an example of an operation image displayed on the display unit 12 in the full lock mode. The operation image 60pa includes a predetermined mark 61pa corresponding to the full lock mode which is the current protection mode, an icon group 62p including a plurality of icon images, and information 63p indicating the user name of the image forming apparatus 1. The icon group 62p includes icon images indicating the selectable printing function, scanner function, copy function, and setting function of the image forming apparatus 1. Although not shown, in a scene where an operation image similar to the operation image 60pa is displayed in the standard mode, only the mark 61pa is replaced with a mark for the standard mode, and the same operation image is displayed for the icon group 62p and the information 63p.

[0074] The remote operation image 60ra is an example of a remote operation image transmitted to the external device 2 corresponding to the operation image 60pa and displayed on the display unit 22. The remote operation image 60ra is an image in which a mark 61ra as a protection mode mark is drawn on a blackened image. Note that the mark 61ra is a mark corresponding to the mark 61pa. Thus, although the remote operation image 60ra is an image corresponding to the operation image 60pa, it is an image in the full lock mode. As a result, compared with the operation image 60pa, it is an image with the same image size and protection mode mark.

[0075] If the answer is NO in step S12, that is, if the current protection mode is any of the second modes, the transmission processing unit 10a sets the pointer to the head of the display component list of the remote operation image (step S13). Here, the display component list of the remote operation image refers to a list of a plurality of display components that make up the remote operation image. The display component can also be referred to as an object. The plurality of display components that make up the remote operation image can be components corresponding to each of the plurality of display components that make up the operation image to be displayed on the display unit 12. However, the definition of the display component may be arbitrarily determined. Also, the display component may be individually defined according to the type of the display component, such as whether it is an icon image or an information display frame. Also, the pointer refers to the address of the storage area set in the internal memory of the control unit 10 for drawing each display component of the remote operation image to be transmitted to the external device 2. In step S13, the pointer is set in the internal memory as information indicating the head of the display component list.

[0076] Following step S13, the transmission processing unit 10a executes a protection process on the display component indicated by the pointer (step S14). Hereinafter, this protection process is referred to as a display component protection process.

[0077] As shown in FIG. 3, the display component protection process can be a loop process that is executed until the processes shown in steps S22 to S29 are completed for all the display components included in the display component list (steps S21s, S21e). That is, this loop process is repeated the number of times equal to the number of display components.

[0078] In this loop process, first, the transmission processing unit 10a determines whether the current protection mode is the personal information lock mode or the personal information / privacy lock mode (step S22). In step S22, it is determined whether the mode is one in which personal information is protected. If the result in step S22 is NO, the transmission processing unit 10a determines whether the current protection mode is the privacy lock mode or the personal information / privacy lock mode (step S26). In step S26, it is determined whether the mode is one in which privacy information is protected.

[0079] If the result in step S22 is YES, that is, if the current protection mode is a mode in which personal information is protected, the transmission processing unit 10a determines whether the protection type of the setting data of the target display component is "Personal" (step S23). The setting data here refers to the data set to be included in the target display component. For example, if the display component is composed of a character string and a frame surrounding the character string, the setting data is the data indicating the character string. Examples of such character strings include character strings such as the name of a contact and an email address. If the result in step S23 is NO, the transmission processing unit 10a executes the process of step S26.

[0080] For the determination in step S23, for example, protection setting information such as the table 11b shown in FIG. 4 can be used. Protection setting information such as the table 11b can be stored in the storage unit 11. Protection setting information such as the table 11b can also be set in advance from the operation unit 13 and can be changed as necessary.

[0081] In the table 11b, for "Data" indicating each of the display components, its "Data Type" which is the data type and "Protection Type" which is the protection type are associated and set. In the table 11b, each "Data" can be classified and recorded, for example, by being divided into a large category "Category1" and a finer category "Category2".

[0082] Table 11b includes, as display components, a plurality of contact information, such as each item of the contact "Address1" included in the contact information. Here, as each item of the contact information, an example including "User Name", "Mail Address", and "Phone Number" indicating the name of the person or organization of the contact, the email address, and the phone number respectively is given. Further, Table 11b includes, as display components, "Time", "Date", and "Language" indicating the current time, the current date, and the language used, which are classified into the basic settings of the image forming apparatus 1. Further, Table 11b includes, as display components, "Function Icon" and "Home BG" indicating the function icon and the background image of the home screen, which are classified into the custom settings of the image forming apparatus 1. Further, Table 11b includes, as display components, "IP Address" and "Subnet Mask" indicating the IP (Internet Protocol) and the subnet mask, which are classified into the network settings of the image forming apparatus 1.

[0083] In Table 11b, as the "Data Type", a data type corresponding to each "Data" is set from, for example, "String (MultiByte)", "String (ASCII)", "Integer", and "Image (Binary)".

[0084] Also, in Table 11b, as the "Protection Type", for each "Data", a protection type corresponding to it is set from, for example, "Personal" indicating protection of personal information, "Normal" indicating no protection, and "Privacy" indicating protection of privacy information. Here, the "Data" set to "Personal" indicates that it is a display component to be protected for personal information. The "Data" set to "Normal" indicates that it is a display component that does not protect personal information and privacy information unless in the full lock mode. The "Data" set to "Privacy" indicates that it is a display component to be protected for privacy information.

[0085] In addition, Table 11b includes, as settings other than the display components, "Default Protection Mode" indicating the default protection mode classified into the security settings of the image forming apparatus 1. Here, an example where the protection mode is set to "Personal" indicating the personal information lock mode is given. The protection mode can be set from among "Personal" indicating the personal information lock mode, "All" indicating the full lock mode, "Privacy" indicating the privacy lock mode, and "Personal and Privacy" indicating the personal information and privacy lock mode. The determinations in steps S11, S12, S22, and S26 described above can be made with reference to this setting.

[0086] If YES in step S23, that is, if the target display component is a display component for which personal information is to be protected, the transmission processing unit 10a replaces the setting data of the target display component with a predetermined character string and draws it in the virtual buffer (step S24). Hereinafter, an example using "**********" as the predetermined character string is given. However, the predetermined character string may be any character string as long as it indicates that the character string to be displayed in that area is hidden when not protected.

[0087] Next, the transmission processing unit 10a sets the pointer to the next display component (step S25) and performs the process of step S22.

[0088]

[0088] If the answer in step S26 is YES, that is, if the current protection mode is a mode in which privacy information is protected, the transmission processing unit 10a determines whether the protection type of the setting data that the display component has is "Privacy" (step S27). Table 11b can also be used for the determination in step S27.

[0089] If the answer in step S27 is NO, the transmission processing unit 10a draws the target display component as it is in the virtual buffer without processing it (step S29), and proceeds to step S25. In step S29, the display component in the operation image will be drawn in the virtual buffer. Even if the answer in step S26 is NO, the process will proceed to step S29.

[0090] If the answer in step S27 is YES, that is, if the target display component is a display component that protects privacy information, the transmission processing unit 10a replaces the icon image of the target display component with the default icon image and draws it in the virtual buffer (step S28). After step S28, the process will proceed to step S25.

[0091]

[0089] After the display component protection process as described above, the transmission processing unit 10a transmits the content of the virtual buffer to the external device 2 as a remote operation image (step S15), and the process ends. Through such a display component protection process, the remote operation image transmitted to the external device 2 becomes an image in which information is protected with respect to the operation image, as exemplified in the following (1) to (4), for example.

[0092] (1) Example of a remote operation image in the personal information lock mode For example, in the scenario where the operation image 50pi shown in FIG. 7 is displayed on the display unit 12, in step S15 after the process of step S24, the remote operation image 50ri in which personal information is made non - public is transmitted to the external device 2. Then, the reception processing unit 20a of the external device 2 receives the remote operation image 50ri and causes it to be displayed on the display unit 22.

[0093] Here, the operation image 50pi is an example of the operation image displayed on the display unit 12 in the personal information lock mode. The operation image 50pi is an image in which, in the operation image 50p of FIG. 5, the mark 51p indicating the standard mode is replaced with the mark 51pi indicating the personal information lock mode.

[0094] And the remote operation image 50ri is an image in which, for the operation image 50pi, all of the information 53p indicating the user name, the information 55p indicating the name of the contact, and the information 56p indicating the email address as display components are replaced with "**********". In the remote operation image 50ri, it can be seen that the contact information 54p including the information 53p, information 55p, and 56p in the operation image 50pi is replaced with the contact information 54ri including the information 53ri, information 55ri, and 56ri, respectively. Also, similar to the mark 51pi, the remote operation image 50ri includes a mark 51ri indicating the personal information lock mode.

[0095] Also, when the mark 57p included in the contact information 54p of the operation image 50pi is selected by the operation unit 13 from the state of FIG. 7, the operation image 80pi and the remote operation image 80ri shown in FIG. 8 can be displayed on the display unit 12 and the display unit 22, respectively. Note that such a display may provide the remote operation image 50ri so that it can be executed by a selection operation from the operation unit 23 for the remote operation image 50ri. However, even in this case, as a result, the operation image 80pi and the remote operation image 80ri are displayed on the display unit 12 and the display unit 22, respectively.

[0096] Here, the operation image 80pi is an example of the operation image displayed on the display unit 12 in the personal information lock mode. The operation image 80pi includes a mark 81pi indicating the current protection mode, a return button 82pi, information 83pi indicating the user name, and information about the contact indicated by the mark 57p. As the information about this contact, it includes information 84pi indicating the name, information 85pi indicating the email address, and information 86pi indicating the phone number.

[0097] The remote operation image 80ri is an example of a remote operation image that is transmitted to the external device 2 and displayed on the display unit 22 corresponding to the operation image 80pi. The remote operation image 80ri includes marks 81ri, a return button 82ri, information 83ri, information 84ri, information 85ri, and information 86ri that respectively correspond to the mark 81pi, the return button 82pi, information 83pi, information 84pi, information 85pi, and information 86pi. It can be seen that in the information 83ri, 84ri, 85ri, and 86ri, the information of the corresponding operation image 80pi is replaced with "**********". Also, similar to the mark 81pi, the remote operation image 80ri includes a mark 81ri indicating the personal information lock mode.

[0098] (2) Example of a remote operation image in the privacy lock mode For example, in the scenario where the operation image 90pp shown in FIG. 9 is displayed on the display unit 12, at step S15 after the process of step S28, a remote operation image 90rp with private information made non - public is transmitted to the external device 2. Then, the reception processing unit 20a of the external device 2 receives the remote operation image 90rp and causes it to be displayed on the display unit 22.

[0099] Here, the operation image 90pp is an example of an operation image displayed on the display unit 12 in the privacy lock mode. The operation image 90pp includes a predetermined mark 91pp corresponding to the privacy lock mode which is the current protection mode, an icon group 92p including a plurality of customized icon images, information 93p indicating the user name of the image forming apparatus 1, and a background image 94p. In the icon group 92p, an example is given where different customizations are made for each icon, but the same customizations such as making each icon the same color may also be made. Although not shown, in the scenario where an operation image similar to the operation image 90pp is displayed in the standard mode, only the mark 91pp is replaced for the standard mode, and the same operation image will be displayed for the icon group 92p and the information 93p.

[0100] The remote operation image 90rp is an example of a remote operation image that is transmitted to the external device 2 and displayed on the display unit 22 corresponding to the operation image 90pp. The remote operation image 90rp is an image in which the icon group 92p is replaced with the icon group 92rp before customization, and the background image 94p is deleted or replaced with a white background image before customization, with respect to the operation image 90pp. In the remote operation image 90rp, similar to the mark 91pp and the information 93p, it includes the mark 91rp and the information 93rp respectively.

[0101] (3) First example of remote operation image in personal information / privacy lock mode For example, in the scenario where the operation image 90pip shown in FIG. 10 is displayed on the display unit 12, in step S15 after the processes of steps S24 and S28, a remote operation image 90rip in which personal information and privacy information are made non-public is transmitted to the external device 2. Then, the reception processing unit 20a of the external device 2 receives the remote operation image 90rip and causes it to be displayed on the display unit 22.

[0102] Here, the operation image 90pip is the first example of an operation image displayed on the display unit 12 in the personal information / privacy lock mode. The operation image 90pip includes a predetermined mark 91pp corresponding to the personal information / privacy lock mode which is the current protection mode, an icon group 92p including a plurality of customized icon images, information 93p indicating the user name of the image forming apparatus 1, and a background image 94p.

[0103] The remote operation image 90rip is a first example of a remote operation image that is transmitted to the external device 2 and displayed on the display unit 22 corresponding to the operation image 90pip. The remote operation image 90rip is an image in which the icon group 92p is replaced with the icon group 92rip before customization, and the background image 94p is deleted or replaced with a white background image before customization. Note that the icon group 92rip is the same as the icon group 92rp in FIG. 9. Further, the remote operation image 90rip is an image in which the information 93p is replaced with the information 93rip indicating "**********" with respect to the operation image 90pip. The remote operation image 90rip includes a mark 91rip similar to the mark 91pip.

[0104] (4) Second example of remote operation image in personal information and privacy lock mode For example, in the scenario where the operation image 50pip shown in FIG. 11 is displayed on the display unit 12, in step S15 after the process of step S24, a remote operation image 50rip in which personal information and privacy information are made non-public is transmitted to the external device 2. Then, the reception processing unit 20a of the external device 2 receives the remote operation image 50rip and causes it to be displayed on the display unit 22. Note that since the operation image 50pip does not originally contain privacy information, the process of step S28 is not performed. Therefore, the remote operation image 50rip is an image in which only personal information is made non-public with respect to the operation image 50pip.

[0105] Here, the operation image 50pip is a second example of an operation image displayed on the display unit 12 in the personal information and privacy lock mode. The operation image 50pip is an image in which the mark 51p indicating the standard mode is replaced with the mark 51pip indicating the personal information and privacy lock mode in the operation image 50p of FIG. 5.

[0106] The remote operation image 50rip is a second example of the remote operation image that is transmitted to the external device 2 corresponding to the operation image 50pip and displayed on the display unit 22. The remote operation image 50rip includes a return button 52rip, information 53rip, and contact information 54rip including information 55rip and 56rip. It can be seen that in the information 53rip, 55rip, and 56rip, the information of the corresponding operation image 50pip is replaced with "**********". Also, similar to the mark 51pip, the remote operation image 50rip includes a mark 51rip indicating the personal information / privacy lock mode. Note that the remote operation image 50rip corresponds to an image in which the mark 51ri indicating the standard mode in the remote operation image 50ri in FIG. 5 is replaced with the mark 51rip indicating the personal information / privacy lock mode.

[0107] As described above, the processing examples in FIGS. 2 and 3 have been described while giving examples of the operation image and the remote operation image. However, the processing examples in FIGS. 2 and 3 are merely examples, and for example, the determination order of the protection mode can be changed, and the corresponding processing can be applied.

[0108] Next, an example of the process of receiving the switching operation of the protection mode will be described with reference to FIG. 12. FIG. 12 shows an example of the operation image in the personal information lock mode displayed in the present system 100, an example of the operation image for changing the setting from the operation image to the full lock mode, and an example of the operation image in the full lock mode after the change.

[0109] The operation image 60pi shown in FIG. 12 is an image in which, in the operation image 60pa of FIG. 6, the mark 61pa is replaced with a mode switching button 61pi indicating the personal information lock mode. Here, the mode switching button 61pi can be selected from the operation unit 13 so as to function as a button capable of switching the protection mode. In this way, the operation image to be displayed on the display unit 12 can include a mode switching button for switching the protection mode. Hereinafter, the protection mode switching operation from such an operation image 60pi will be described. However, as can be understood from the fact that the marks indicating the protection mode are shown in the operation images in FIGS. 5 to 11, regardless of which mode the protection mode is and regardless of which scene image the operation image is, the mode switching button can be included in the operation image to be displayed on the display unit 12.

[0110] When the mode switching button 61pi included in the operation image 60pi is selected from the operation unit 13, the switching unit 10c causes the display unit 12 to display an operation image that can select a destination protection mode such as the operation image 60pim. Since the operation unit 13 includes a touch sensor or a touch panel, the selection of the mode switching button 61pi from the operation unit 13 can be received by a touch operation on the mode switching button 61pi.

[0111] The operation image 60pim is obtained by covering the entire operation image 60pi with a light-colored image such as gray by α-blending and superimposing a mode selection image 66 thereon. The mode selection image 66 includes buttons for all selectable protection modes so that they can be selected respectively. The mode selection image 66 in FIG. 12 is an image of a cross key in which a button for the standard mode is arranged in the center and buttons for other modes are arranged above, below, left, and right thereof. Also, in the mode selection image 66, for example, in order to make the current protection mode known, the selection area 66a for the personal information lock mode may be emphasized by surrounding it with a frame or the like.

[0112] From this state, for example, when the user makes a selection from the operation unit 13 such as by touching the all-lock mode button 66c, the switching unit 10c switches to the all-lock mode, updates the table 11b, and causes the display unit 12 to display the operation image 60pa shown also in FIG. 6. The operation image 60pa will include a mode switching button 61pa indicating the all-lock mode.

[0113] Here, for the touch operation for the mode selection image 66 to shift from the personal information lock mode to the all-lock mode, it is preferable to accept it by a single tap or a long press with a short detection time. In this case, it is not necessary to display a warning image or the like for confirming the change of the protection mode. This is because this touch operation is an operation for protecting information more.

[0114] Conversely, for the touch operation for the mode selection image 66 to shift from the personal information lock mode to the standard mode, it is preferable to accept it by a double tap or a long press that requires a long detection time. Requiring a long detection time means that it is not accepted as a touch operation unless it is touched longer than the detection time of the touch operation for shifting from the personal information lock mode to the all-lock mode. Alternatively, when a touch operation for the mode selection image 66 to shift from the personal information lock mode to the standard mode is performed, a warning image may be displayed, and the shift to the standard mode may be accepted only when an approval button included in the warning image is selected.

[0115] Thus, for the first operation to switch from any of the second modes to the standard mode, it is preferable that the operation time of the mode switching button by the operation unit 13 is set longer than that of the second operation to switch from the standard mode to any of the second modes. The first operation is an operation to change in the direction of disclosing information with the remote operation image. The second operation is an operation to change in the direction of protecting the operation with the remote operation image. By setting the first operation to have a longer operation time than the second operation in this way, it is possible to prevent an accidental operation such as accidentally disclosing information.

[0116] The length of the operation time can be, for example, the length of the detection time of a touch for receiving the selection of the mode switching button, that is, the length of the long-press operation time. In this case, the first tap operation for switching from any of the second modes to the standard mode is set to be longer than the second tap operation for switching from the standard mode to any of the second modes. As a result, when the user tries to perform the first tap operation, the switching cannot be performed unless the touch is made for a longer time than the second tap operation, that is, unless a long tap is performed compared to the second tap operation.

[0117] A similar concept can also be applied to the buttons of other protection modes. For example, for the operation of switching from the full lock mode to any of the second modes or the standard mode, it is preferable that the operation time of the switching button by the operation unit 13 is set to be longer than the operation of switching from any of the second modes or the standard mode to the full lock mode.

[0118] Also, in the example of FIG. 12, the buttons of each protection mode are arranged in a cross shape, but each button may be arranged in a row, for example, in the vertical direction or the horizontal direction. In that case, it is preferable to arrange the protection modes with more protected information closer to the position of the button of the current protection mode.

[0119] Also, the concept of information protection according to the difficulty of operating the mode selection image 66 can also be applied to the operation of the mode switching button 61pi and the like of the operation image 60pi for displaying the mode selection image 66, that is, the operation on the mode switching button 61pi. For example, in a scenario where a mode switching button indicating the current full lock mode is displayed on the operation image, compared to a scenario where a mode switching button indicating another protection mode is displayed on the operation image, the touch operation is made to require a larger number of times or a longer detection time to be accepted. In a scenario where a mode switching button indicating the current standard mode is displayed on the operation image, compared to a scenario where a mode switching button indicating another protection mode is displayed on the operation image, the touch operation is made to require a smaller number of times or a shorter detection time to be accepted. Also, in a scenario where a mode switching button indicating any of the current second modes is displayed on the operation image, the number of times or the detection period for accepting the touch operation is set to a value between the scenario where a mode switching button indicating the full lock mode is displayed on the operation image and the scenario where a mode switching button indicating the standard mode is displayed on the operation image.

[0120] Also, the mark or mode switching button indicating the protection mode shown in FIGS. 5 to 12 may be always displayed. However, for example, when the display area is limited and there are other display items to be prioritized, it may be displayed only during the remote operation. Also, when the mode switching button is displayed only during the remote operation, immediately after the remote operation is started, for example, it is advisable to always set the full lock mode as the default protection mode. Thereby, it is possible to avoid the risk that information is all disclosed immediately when starting the remote operation.

[0121] Also, when the operation image includes a mode switching button, as exemplified in FIGS. 5 to 11, a corresponding mark may be displayed on the remote operation image as well, but it is not necessary to display such a mark on the remote operation image. In this way, on the remote operation image, it is advisable to include the switching button in a non-selectable state, that is, as a mere mark, or not to include the mode switching button. Thereby, it is possible to avoid the risk that the remote operator changes the protection mode.

[0122] [Effects of the Present Embodiment] As can be understood from the above description, according to the present embodiment, when displaying and operating a part or all of the operation image of the image forming apparatus 1 from the external device 2 via the network, it is possible to protect information while the operation from the external device 2 is enabled. For example, in the protection mode of hiding at least one of personal information and privacy information described as the second mode, unlike the full lock mode, parts not related to the information to be hidden and parts necessary for the operation are displayed in the remote operation image. Therefore, in this case, it is possible for the remote operator to operate the remote operation image on behalf of the user in the same way as in the standard mode. As described above, according to the present embodiment, it is possible to protect personal information and the owner's privacy of the image forming apparatus 1 while allowing the remote operator to operate the operation image via the remote operation image.

[0123] Further, according to the present embodiment, by adopting a configuration that enables switching to the protection mode from the operation unit 13 of the image forming apparatus 1, such protection can be performed in accordance with the intention of the user of the image forming apparatus 1. In other words, according to the present embodiment, in the image forming apparatus 1 having the remote panel function, it is possible to set the sharing of the operation image to be displayed on the display unit 12 for the remote operator step by step. Thereby, according to the present embodiment, it is possible to switch the display of personal information and information related to the owner's privacy managed by the image forming apparatus 1 according to the situation.

[0124] For example, in this embodiment, regarding the registration information 11a of the image forming apparatus 1, after classifying it into protection types such as privacy and personal information, the information displayed on the remote panel can be gradually switched according to the protection mode set by the owner who owns the image forming apparatus 1. The background image and icon image customized by the owner of the image forming apparatus 1 are related to privacy that can reveal the owner's preferences. When the owner sets the privacy information to be non-disclosed, the remote operator can replace it with the default background and icon images for sharing, so as to protect the user's privacy while executing the functions of the remote panel. For example, information such as the contact information registered in the image forming apparatus 1 is personal information. When the owner of the image forming apparatus 1 sets the personal information to be non-disclosed, the remote operator can replace the personal information with a predetermined character string for sharing, so as to protect the personal information while executing the functions of the remote panel.

[0125] Here, the usage scenarios of this system 100 will be supplementarily explained. This system 100 can provide a remote panel through an external device 2 used by a remote operator who is, for example, far away from the image forming apparatus 1. Examples of such remote operators include IT (Information Technology) administrators, service technicians, and reseller engineers. These remote operators can perform troubleshooting and training for end-users without having to go to the site where the image forming apparatus 1 is installed. For example, an IT administrator within the company where the image forming apparatus 1 is installed can directly access and use the image forming apparatus 1 from within the same intranet using the external device 2.

[0126] [Modification Example of Image Forming System] Using FIGS. 13 to 17, a modified example of the present system 100 will be described. FIG. 13 is a flowchart for explaining a processing example of an image forming apparatus in a modified example of the present system 100. FIG. 14 is a flowchart for explaining an example of display component protection processing in the processing example of FIG. 13. FIG. 15 is a schematic diagram showing an example of an operation image in the personal information / privacy lock mode displayed in the processing example of FIG. 13 and an example of a remote operation image displayed corresponding thereto. FIG. 16 is a schematic diagram showing another example of an operation image in the personal information / privacy lock mode displayed in the processing example of FIG. 13 and an example of a remote operation image displayed corresponding thereto. FIG. 17 is a schematic diagram showing an example of an operation image displayed when setting the image forming apparatus 1 to a simple mode in order to execute the processing example of FIG. 13.

[0127] The image forming apparatus 1 according to this modified example is configured to simplify the drawing process compared to the processing examples of FIGS. 2 and 3. Hereinafter, the mode for performing such a simplified drawing process will be referred to as a simple drawing mode, and the processing examples of FIGS. 2 and 3 will be referred to as a normal drawing mode for explanation.

[0128] Hereinafter, the flow of the processing according to this modified example will be described. First, the transmission processing unit 10a determines whether the current protection mode is the full lock mode (step S31). If YES in step S31, that is, if the current protection mode is the full lock mode, the transmission processing unit 10a fills the virtual buffer with black (step S37) and draws a protection mode mark on the virtual buffer (step S38) in the same manner as steps S17 and S18 in FIG. 3. Thereafter, the transmission processing unit 10a transmits the content of the virtual buffer to the external device 2 as a remote operation image (step S36) and ends the processing. In this case, for example, as illustrated in FIG. 6, a blackened remote operation image 60ra is displayed on the external device 2 except for the same mark 61ra as the mark 61pa indicating the protection mode in the operation image 60pa.

[0129] If the answer in step S31 is NO, the transmission processing unit 10a copies the main body display buffer to the virtual buffer (step S32). Next to step S32, the transmission processing unit 10a determines whether the current protection mode is the standard mode (step S33).

[0130] If the answer in step S33 is YES, that is, if the current protection mode is the standard mode, the transmission processing unit 10a transmits the content of the virtual buffer as a remote operation image to the external device 2 (step S36) and ends the process. In this case, for example, as illustrated in FIG. 5, the operation image 50p is directly displayed as the remote operation image 50r on the external device 2.

[0131] On the other hand, if the answer in step S33 is NO, that is, if the current protection mode is any mode of the second mode, the transmission processing unit 10a sets the pointer to the head of the display component list of the remote operation image in the same manner as step S13 in FIG. 2 (step S34). Subsequently to step S34, the transmission processing unit 10a executes a display component protection process for the display component indicated by the pointer (step S35).

[0132] The display component protection process in this modification example can be a loop process that executes the processes shown in steps S42 to S45 for all the display components included in the display component list until completion, as shown in FIG. 14 (steps S41s, S41e). That is, this loop process is repeated the number of times equal to the number of display components.

[0133] In this loop process, first, the transmission processing unit 10a determines whether the current protection mode is the personal information lock mode or the personal information / privacy lock mode in the same manner as step S22 in FIG. 3 (step S42). If the answer in step S42 is NO, the transmission processing unit 10a determines whether the current protection mode is the privacy lock mode or the personal information / privacy lock mode in the same manner as step S26 in FIG. 3 (step S46).

[0134] If YES in step S42, that is, if the current protection mode is the mode in which personal information is protected, the transmission processing unit 10a performs the same processing as step S23 in FIG. 3 (step S43). In step S43, it is determined whether the protection type of the setting data of the target display component is "Personal". If NO in step S43, the transmission processing unit 10a executes the processing of step S46.

[0135] If YES in step S43, that is, if the target display component is a display component in which personal information is protected, the transmission processing unit 10a acquires the area of the target display component and fills the virtual buffer with black (step S44). In step S44, after filling with black, a character string or symbol indicating the protection type can also be drawn. Here, for example, "Personal" can be used as the character string. Next, the transmission processing unit 10a sets the pointer to the next display component (step S45) and performs the processing of step S42.

[0136] If YES in step S46, that is, if the current protection mode is the mode in which privacy information is protected, the transmission processing unit 10a performs the same processing as step S27 in FIG. 3 (step S47). In step S47, it is determined whether the protection type of the setting data of the display component that is the target display component is "Privacy".

[0137] If YES in step S47, that is, if the target display component is a display component in which privacy information is protected, the transmission processing unit 10a executes the processing of step S44. In step S44, after filling with black, a character string or symbol indicating the protection type can also be drawn. Here, for example, "Privacy" can be used as the character string. If NO in step S47, the transmission processing unit 10a sets the pointer to the next display component (step S45) and performs the processing of step S42. Also when NO in step S46, it proceeds to step S45.

[0138] After the display component protection process as described above, the transmission processing unit 10a transmits the content of the virtual buffer to the external device 2 as a remote operation image (step S36), and the process ends. Through such a display component protection process, the remote operation image transmitted to the external device 2 becomes an image in which information is protected with respect to the operation image, as exemplified in the following (5) to (6), for example.

[0139] (5) Example of a remote operation image in the personal information / privacy lock mode For example, in the scenario where the operation image 60pip shown in FIG. 15 is displayed on the display unit 12, in step S36 after the process of step S44, the remote operation image 60rips in which personal information and privacy information are made non-public is transmitted to the external device 2. Then, the reception processing unit 20a of the external device 2 receives the remote operation image 60rips and causes it to be displayed on the display unit 22.

[0140] The remote operation image 60rips is an example of a remote operation image that is transmitted to the external device 2 corresponding to the operation image 60pip and is displayed on the display unit 22. The remote operation image 60rips is an image in which the icon group 62p is painted black and replaced with an icon group 62rips on which the character string "Privacy" is drawn with respect to the operation image 60pip. Further, in the remote operation image 60rips, with respect to the operation image 60pip, the information 63p indicating the user name of the image forming apparatus 1 is painted black and becomes an image on which the character string "Personal" is drawn. Also, the remote operation image 60rips includes a mark 61rips similar to the mark 61pip.

[0141] (6) Example of a remote operation image in the personal information lock mode For example, in the scenario where the operation image 50pip shown in FIG. 16 is displayed on the display unit 12, in step S36 after the process of step S44, the remote operation image 50rips in which personal information is made non-public is transmitted to the external device 2. Then, the reception processing unit 20a of the external device 2 receives the remote operation image 50rips and causes it to be displayed on the display unit 22.

[0142] Here, the operation image 50pip is the operation image 50pip in FIG. 11. The remote operation image 50rips is an example of a remote operation image that is transmitted to the external device 2 corresponding to the operation image 50pip and displayed on the display unit 22. The remote operation image 50rips is an image in which the information 53p and the information 55p, 56p included in the contact information 54p are both painted black and the character string "Personal" is drawn with respect to the operation image 50pip. It can be seen that the information 53rips and the information 55rips, 56rips included in the contact information 54rips in the remote operation image 50rips are both painted black with the corresponding information of the operation image 50pip and the character string "Personal" is drawn thereon. Also, in the remote operation image 50rips, similar to the mark 51pip and the return button 52p, it includes a mark 51rips and a return button 52rips, respectively.

[0143] As described above, the processing examples in FIGS. 13 and 14 as the simple drawing mode have been described while giving examples of the operation image and the remote operation image. However, the processing examples in FIGS. 13 and 14 are merely examples in this modification example. For example, the determination order of the protection mode can be changed and the corresponding processing can be applied.

[0144] In the normal drawing mode described with reference to FIGS. 2 and 3, it is necessary to perform processing for determining the protection mode and replacing information for each display component. Therefore, in the normal drawing mode, the content of the operation image to be displayed on the display unit 12 cannot be transferred all at once, and it is necessary to redraw for the remote operation image for each drawing component, so the processing load for the drawing process is high.

[0145] On the other hand, in the simple drawing mode described as this modification example, once the operation image to be displayed on the display unit 12 is copied to the virtual buffer, the display area of each display component is acquired, and the area is filled later. Therefore, in the simple drawing mode, there is no need to consider the drawing order, and only a minimum overwrite process is required, so the processing load can be reduced compared to the normal drawing mode.

[0146] However, in the simple drawing mode, fine drawing components cannot be replaced, and when there is an area to be protected that occupies most of the area such as a background image, overpainting is done more than necessary. Therefore, in scenes where there are fine display components or background images, or in the specifications of the image forming apparatus 1, the normal drawing mode looks better than the simple drawing mode.

[0147] As described above, since both the simple drawing mode and the normal drawing mode have their own advantages, it is preferable that these drawing modes can be used properly. Therefore, the image forming apparatus 1 preferably has a function of switching the drawing mode between the simple drawing mode and the normal drawing mode. Such switching of the drawing mode may also be executed by the switching unit 10c, for example, based on the drawing mode set by a user operation from the operation unit 13.

[0148] The setting of the drawing mode can be received by displaying an operation image such as the operation image 170pi shown in FIG. 17 on the display unit 12. The operation image 170pi can include, for example, a check box 174pi for selecting "Normal Mode" indicating the normal drawing mode and a check box 175pi for selecting "Simple Mode" indicating the simple drawing mode. In addition, the operation image 170pi can include a mark 171pi indicating the current protection mode, information 173pi indicating the user, a return button 172pi, and the like.

[0149] The user can select the drawing mode by selecting either of the check boxes 174pi and 175pi from the operation unit 13 for the operation image 170pi. The drawing mode can be registered as part of, for example, the security settings in the table 11b so that it can be referred to at least before the drawing process. For example, based on the user's selection operation, it may be registered in the table 11b whether the default drawing mode is the normal drawing mode or the simple drawing mode. Then, before starting the transmission of the remote operation image, the switching unit 10c of the image forming apparatus 1 preferably switches the drawing mode between the normal drawing mode and the simple drawing mode.

[0150] Regardless, the image forming apparatus 1 according to this modification example may not have a function to switch the drawing mode, and the drawing process may always be performed in the simple drawing mode.

[0151] Also, since the setting of the drawing mode affects the remote operation image, it may also be possible to execute it by operating from the operation unit 23 on the remote operation image displayed on the display unit 22 of the external device 2. However, the remote operation image to be displayed when accepting the setting operation of the drawing mode from such an operation unit 23 shall also be an image in which information is protected according to the protection mode.

[0152] [Modification Example of Operation Image] With reference to FIGS. 18 and 19, a modification example of the operation image displayed on the display unit 12 will be described. FIG. 18 is a schematic diagram showing another example of the operation image in the personal information / privacy lock mode displayed in the present system 100. FIG. 19 is a schematic diagram showing another example of the operation image in the full lock mode displayed in the present system 100.

[0153] The operation image displayed on the display unit 12 may be displayed so that the user of the image forming apparatus 1 can determine whether or not it is a portion protected in the remote operation image, for example, like the operation image 50pipc shown in FIG. 18 or the operation image 50pae shown in FIG. 19.

[0154] The operation image 50pipc shown in FIG. 18 is an example of the operation image displayed on the display unit 12 in the personal information / privacy lock mode. The operation image 50pipc is an image in which the mark 51p indicating the standard mode in the operation image 50p in FIG. 5 is replaced with the mark 51pipc indicating the personal information / privacy lock mode. The operation image 50pipc also includes a return button 52pipc, information 53pipc, and contact information 54pipc including information 55pipc and 56pipc, similar to the return button 52p, information 53p, and contact information 54p including information 55p and 56p of the operation image 50p, respectively.

[0155] However, the information 53pipc, information 55pipc, and information 56pipc in the operation image 50pipc cover the information 53p, information 55p, and information 56p in the operation image 50p of FIG. 5 by α-blending a light-colored image. The light color here may be any color that becomes lighter as a result of α-blending, such as green, blue, yellow, red, etc.

[0156] The operation image 50pae shown in FIG. 19 is an example of an operation image displayed on the display unit 12 in the full lock mode. The operation image 50pae is an image in which the mark 51p indicating the standard mode in the operation image 50p of FIG. 5 is replaced with the mark 51pa indicating the full lock mode. Further, the operation image 50pae changes its outer frame to a predetermined color in order to indicate that the corresponding remote operation image protects the whole. Note that the predetermined color may be any color such as green, yellow, red, etc.

[0157] In this way, the display unit 12 may display the operation image while varying the display form of the registered information 11a according to the protection mode. Thereby, the information to be protected can be notified to the user of the image forming apparatus 1. In addition, the display form for notifying the user of the information to be protected is not limited to the examples of FIGS. 18 and 19, and for example, notifications by balloons or messages can also be adopted. In any example, for example, drawing for such notification may be executed according to the protection mode before the operation image is displayed on the display unit 12.

[0158] [Other Modification Examples of the Image Forming Apparatus 1] As described above, the user who registers the registration information 11a may be the administrator of the image forming apparatus 1, but may be any user of the image forming apparatus 1. When a plurality of users register the registration information 11a, the registration information 11a can be collectively subjected to processing according to the protection mode to display a remote operation image. Alternatively, when a plurality of users register the registration information 11a, processing according to the protection mode can be performed on the registration information 11a of the user who is in a state of using the image forming apparatus 1, such as being currently logged in to the image forming apparatus 1, to display a remote operation image. In that case, the registration information 11a registered by other users who are not logged in may not be displayed on the remote operation image regardless of the protection mode.

[0159] Also, the display components to be protected and the protection granularity may be varied according to the functions, display performance, operation performance, etc. of the image forming apparatus 1. Further, the image forming apparatus 1 may be provided with a dedicated button for setting the protection mode, drawing mode, display components to be protected, etc.

[0160] [Another Network Configuration Example of the Image Forming System] With reference to FIG. 20, another configuration example of the image forming system according to the present embodiment will be described. FIG. 20 is a schematic block diagram showing another configuration example of the image forming system including the image forming apparatus and the terminal apparatus according to the present embodiment.

[0161] The image forming system according to the present embodiment can be an image forming system 100A having a network configuration example as shown in FIG. 20. In the image forming system 100A, an external device 2 and an image forming apparatus 1 are connected by a LAN (Local Area Network), and a communication control device 3 such as a router is connected to the LAN. This LAN can be, for example, the LAN of a company where the image forming apparatus 1 is installed. The communication control device 3 is a device that controls communication between the devices in this LAN and the network N1. A server device 4 is connected to the network N1.

[0162] The server device 4 can be a server computer having a function of providing a remote panel to the external device 2, although its details are omitted. The server device 4 may have a configuration in which functions are distributed, for example, to a reception server device that communicates with the external device 2 and a base server device that is connected to the reception server device and communicates with the image forming apparatus 1. The reception server device can be a server device that receives operation processing from the external device 2 and provides it to the external device 2. The base server device can be a server device that provides processing for operating the operation image of the image forming apparatus 1 based on the operation received by the reception server device to the image forming apparatus 1. Further, the image forming system 100A may be a system including three or more server devices with further distributed functions. That is, the image forming apparatus 1 may have a configuration in which it communicates with the external device 2 via at least one information processing device such as at least one server device. In this case, the external device 2 has a configuration in which it communicates with the image forming apparatus 1 via at least one information processing device such as at least one server device. Of course, the network configuration applicable in the present embodiment is not limited to those illustrated in FIGS. 1 and 20.

[0163] Here, the usage scenarios of the image forming system 100A will be described. In the image forming system 100A, similar to the present system 100, for example, a remote operator who is far away from the image forming apparatus 1 can receive the provision of a remote panel by using the external device 2. For example, in the image forming system 100A, an IT administrator within the company where the image forming apparatus 1 is installed can use the external device 2 within the same intranet to access and use the image forming apparatus 1 via the server device 4 installed outside the intranet. Also, in the image forming system 100A, a service technician or reseller engineer outside the company where the image forming apparatus 1 is installed can use the external device 2 to access and use the image forming apparatus 1 via the server device 4.

[0164] (Other Modifications) The present invention is not limited to the above-described embodiments and can be appropriately modified without departing from the spirit thereof. For example, the image forming apparatus applied to the image forming system according to the present embodiment can be widely applied to a copying machine, a facsimile machine, a multifunction machine having these functions, etc., as can be understood from, for example, the operation image of FIG. 6.

[0165] Moreover, each apparatus provided in the image forming system according to the above-described embodiment can each have, for example, the following hardware configuration. FIG. 21 is a diagram showing an example of the hardware configuration of the apparatus.

[0166] The apparatus 1000 shown in FIG. 21 can include a processor 1001, a memory 1002, and an interface 1003. The interface 1003 can include an interface necessary according to the apparatus, for example, a communication interface, a sensor, an interface with an input / output device, etc.

[0167] The processor 1001 may be, for example, a CPU, a GPU (Graphics Processing Unit), an MPU (Micro Processor Unit) also referred to as a microprocessor, etc. The processor 1001 may include a plurality of processors. The memory 1002 is constituted by, for example, a combination of a volatile memory and a non-volatile memory. The functions in each apparatus are realized by the processor 1001 reading a program stored in the memory 1002 and executing it while exchanging necessary information via the interface 1003.

[0168] Also, when the above-described program is loaded into a computer, it includes a set of instructions (or software code) for causing the computer to perform one or more functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD), or other memory technologies. Also, by way of example and not limitation, the computer-readable medium or tangible storage medium includes CD-ROM, digital versatile disc (DVD), Blu-ray (registered trademark) disc, or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage devices. The program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, the transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0169] As described above, the present invention has been described with reference to the above embodiments. However, the present invention is not limited only to the configurations of the above embodiments, and of course includes various modifications, corrections, and combinations that can be made by those skilled in the art within the scope of the invention of the claims of the present patent application.

Description of Reference Numerals

[0170] 1... Image forming apparatus, 2... External device, 3... Communication control device, 4... Server device, 10... Control unit, 10a... Transmission processing unit, 10b... Reception processing unit, 10c... Switching unit, 11... Storage unit, 11a... Registered information, 11b... Table, 12... Display unit, 13... Operation unit, 14... Communication unit, 15... Printing unit, 20... Control unit, 20a... Reception processing unit, 20b... Transmission processing unit, 21... Storage unit, 22... Display unit, 23... Operation unit, 24... Communication unit, 100... Image forming system, 100A... Image forming system, 1000... Device, 1001... Processor, 1002... Memory, 1003... Interface, N... Network, N1... Network.

Claims

1. A communication unit, an operation unit, a display unit that displays an operation image operable from the operation unit, a transmission processing unit that transmits display information for displaying a remote operation image based on the operation image to an external device via the communication unit, a switching unit that switches a disclosure mode regarding information disclosure in the remote operation image, comprising: the disclosure mode is a first mode in which specified information included in a part of the operation image is included in the display information, and registered information, which is information registered by a user and included in a part of the operation image, is included in the display information; a second mode in which the specified information is included in the display information and the registered information is not included in the display information; including: an image forming apparatus.

2. The disclosure mode further includes a third mode in which the specified information is not included in the display information and the registered information is not included in the display information, The image forming apparatus according to claim 1.

3. The operation image includes a switching button for switching the disclosure mode, The operation for switching from the second mode to the first mode is set such that the operation time of the switching button by the operation unit is longer than the operation for switching from the first mode to the second mode, The image forming apparatus according to claim 1 or 2.

4. The registered information includes at least one of a background image that is a background in the operation image and an icon image indicating a selectable icon, The image forming apparatus according to claim 1 or 2.

5. The registered information includes information indicating a contact registered by the user, The image forming apparatus according to claim 1 or 2.

6. The registered information includes information indicating a password registered by the user, The image forming apparatus according to claim 1 or 2.

7. The operation image includes a switching button for switching the disclosure mode, The display information includes the switching button in a non-selectable state or does not include the switching button, The image forming apparatus according to claim 1 or 2.

8. The display unit displays the operation image in a state where the display form of the registered information is different according to the disclosure mode, The image forming apparatus according to claim 1 or 2.

9. When the transmission processing unit starts transmitting the display information, the switching unit sets the disclosure mode to the second mode, The image forming apparatus according to claim 1.

10. When the transmission processing unit starts transmitting the display information, the switching unit sets the disclosure mode to the third mode. The image forming apparatus according to claim 2.

11. An image forming apparatus including a communication unit, an operation unit, and a display unit that displays an operation image operable from the operation unit transmits display information for displaying a remote operation image based on the operation image to an external device via the communication unit. The image forming apparatus switches the disclosure mode regarding information disclosure in the remote operation image. The disclosure mode is a first mode in which specified information included in a part of the operation image is included in the display information, and registered information, which is information registered by a user and included in a part of the operation image, is included in the display information; a second mode in which the specified information is included in the display information and the registered information is not included in the display information; including An information transmission method.

Images