Communication device, control method for communication device, program

Abstract

To improve the convenience of remotely controlling communication devices. [Solution] A communication device comprising: a first receiving means for receiving a request for a network connection for remote operation of the communication device from an information processing device; and a first executing means for executing a first authentication process for establishing the network connection for remote operation between the information processing device and the communication device, wherein, upon receiving the request, the communication device is controlled to establish the network connection for remote operation between the communication device and the information processing device without executing the first authentication process based on whether certain conditions are met, and to execute the first authentication process based on whether the certain conditions are not met, thereby establishing the network connection for remote operation between the communication device and the information processing device.

Description

Technical Field

[0001] The present invention relates to a communication device, a control method for the communication device, and a program.

Background Art

[0002] There is a function called remote operation for operating a communication device from a remote location. This is realized by using software called VNC (Virtual Network Computing). VNC consists of server software and client software. The VNC server software is started on the server side, and the VNC client software is started from the client side to connect to the server for remote operation. The communication between the VNC server and the client uses the RFB (Remote FrameBuffer) protocol (RFC6143). If the VNC server software is started on the communication device, the communication device can be remotely operated from an information processing device such as a PC or a mobile terminal using the VNC client software. For example, Patent Document 1 discloses the following points about a communication device that communicates with other devices existing at a remote location. The communication device receives user information input by a user at another device and an operation instruction request for the present device, and determines whether the user is a legitimate user based on the received user information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] As the technology related to remote operation becomes widespread, it is required to improve the convenience when remotely operating a communication device.

[0005] The present invention aims to improve the convenience of remotely controlling communication devices. [Means for solving the problem]

[0006] According to the present invention, a communication device is provided, comprising: a first receiving means for receiving a request for a network connection for remote operation of the communication device from an information processing device; and a first executing means for executing a first authentication process for establishing the network connection for remote operation between the information processing device and the communication device, wherein, upon receiving the request, the communication device is controlled to establish the network connection for remote operation between the communication device and the information processing device without executing the first authentication process based on whether certain conditions are met, and to execute the first authentication process based on whether the certain conditions are not met, thereby establishing the network connection for remote operation between the communication device and the information processing device. [Effects of the Invention]

[0007] According to the present invention, the convenience of remotely controlling a communication device can be improved. [Brief explanation of the drawing]

[0008] [Figure 1] A diagram showing an example of a communication system configuration. [Figure 2] A diagram showing an example of the hardware configuration of a communication device. [Figure 3] A diagram showing an example of the software configuration of a communication device. [Figure 4] A diagram showing an example of a mobile device hardware configuration. [Figure 5] A diagram showing an example of a mobile device's software configuration. [Figure 6] A flowchart illustrating an example of server connection processing. [Figure 7] A flowchart illustrating an example of the client connection process. [Figure 8]A diagram showing an example of a screen displayed on the operation display unit of a communication device. [Figure 9] A diagram showing an example of a screen displayed on the operation display unit of a communication device. [Figure 10] A diagram illustrating the settings managed by the communication device. [Figure 11] A diagram showing an example of a screen displayed on the control panel of a mobile device. [Figure 12] A diagram showing an example of a screen displayed on the control panel of a mobile device. [Figure 13] A flowchart illustrating an example of the server login process. [Figure 14] A flowchart illustrating an example of the server login process. [Modes for carrying out the invention]

[0009] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0010] <First Embodiment> The system configuration of the present invention will be explained using Figure 1. The communication system of this embodiment includes an information processing device and a communication device. In this embodiment, a mobile terminal such as a smartphone is exemplified as the information processing device, but it is not limited to this, and various devices such as notebook PCs, tablet terminals, PDAs (Personal Digital Assistants), and digital cameras can be applied. Similarly, in this embodiment, a printer is exemplified as the communication device, but it is not limited to this, and various devices capable of communicating with the information processing device can be applied. For example, if it is a printer, it can be an inkjet printer, a full-color laser beam printer, a monochrome printer, etc. Furthermore, it can be applied not only to printers but also to copiers, facsimile machines, terminal devices, smartphones, notebook PCs, tablet terminals, PDAs, digital cameras, music playback devices, televisions, smart speakers, etc. In addition, it can be applied to multifunction devices that have multiple functions such as copying, faxing, and printing. In this embodiment, the communication device is, as an example, a multifunction printer having printing and scanning functions.

[0011] Communication device 102 is the communication device of this embodiment. Mobile terminal 103 is the information processing device of this embodiment. The communication device 102, personal computer (PC) 101, and access point (AP) 104 are connected to LAN 105 (Local Area Network). The mobile terminal 103 is also connected to LAN 105 via AP 104. AP 104 refers to a device that operates as an AP, and specifically, it is a device such as a wireless LAN router. Note that AP 104 is not limited to a wireless LAN router and may be a device capable of relaying wireless communication. For example, AP 131 may be a device that has AP functionality, which is the function of operating as an AP, but does not have router functionality.

[0012] When the communication device 102 and the mobile terminal 103 have a wireless direct communication function, they can communicate directly without going through the LAN 105. In this embodiment, an example in which the mobile terminal 103 having a VNC (Virtual Network Computing) client function makes a VNC connection to the communication device 102 having a VNC server function will be described. The VNC server function is a function that operates as a VNC server by VNC server software. The VNC client function is a function that operates as a VNC client by VNC client software.

[0013] In the following description, the communication device 102 operating as a VNC server may be referred to as a server. Also, the mobile terminal 103 operating as a VNC client and making a network connection to the server with VNC or the like may be referred to as a client.

[0014] Here, the remote operation for operating the communication device 102 from a remote location realized by VNC will be described. First, the communication device 102 starts the VNC server software. Then the server waits for a connection from the client. Next, the mobile terminal 103 starts the VNC client software. Then, the client makes a network connection to the desired server.

[0015] The communication between the server and the client is performed according to the RFB (Remote FrameBuffer) protocol. Between the server and the client, a handshake process is first performed according to the RFB protocol. In the handshake process, the security type to be used in that connection is agreed upon between the server and the client. The security type to be used is determined in advance on the server side. In this embodiment, the security type can be selected from either a method of executing VNC authentication processing as described later or a method of not executing VNC authentication processing. In VNC authentication processing, the user of the client inputs a password. Then, the password input by the user is transmitted from the client to the server. The server performs VNC authentication based on the password received from the client. If the VNC authentication is successful, a network connection (hereinafter referred to as a VNC connection) between the server and the client is established. That is, the handshake process is a process for establishing a VNC connection between the client and the server and starting communication. In the following description, in the handshake process, the processes performed in each device may be referred to as connection processes.

[0016] After a VNC connection is established in the handshake process, the client can remotely operate the server by transmitting and receiving information such as the display screen and screen operations between the server and the client. Here, when user authentication processing is executed on the server, the screen first displayed on the client is a user authentication screen (login screen). The server performs user authentication when the user inputs authentication information such as a password on the user authentication screen displayed on the client. When the user authentication is successful, the client can remotely operate the server. Thus, by enabling the client to remotely operate the server, for example, the user can remotely operate the communication device 102 using the mobile terminal 103 that they are accustomed to using. Also, for example, even a user who has difficulty operating the operation display unit 207 of the communication device 102 or a user who does not want to touch the operation display unit 207 of the communication device 102 shared with others can operate the communication device 102.

[0017] Figure 2 is a hardware configuration diagram of the communication device 102. Within the controller unit 201 of the communication device 102, the CPU 202 is the arithmetic unit that controls the entire system. The CPU 202 comprehensively controls each device connected to the system bus 212.

[0018] ROM204 is a non-volatile memory that stores image data, other data, and various programs necessary for the CPU202 to operate.

[0019] RAM203 is volatile memory and is used as the main memory and temporary storage area for the CPU202, such as the work area. RAM203 also houses programs and data, including the operating system (hereinafter referred to as OS), system software, and application software.

[0020] The CPU 202 controls the various parts of the communication device 102 by loading programs stored in ROM 204, etc., into RAM 203 and executing them. Note that the programs required for the CPU 202 to operate are not limited to those stored in ROM 204; programs pre-stored in a hard disk drive (HDD) 205, etc., may also be used.

[0021] The HDD205 stores the OS, system software, application software, image data, configuration data, etc. However, other storage devices such as SSDs, SD memory cards, or eMMCs can be used as long as they can store the data.

[0022] The operation display unit I / F 206 is an interface unit with the operation display unit 207 and outputs information to be displayed on the operation display unit 207. The operation display unit I / F 206 also receives information input by the user from the operation display unit 207. The operation display unit 207 is equipped with a touch panel and hard keys for receiving user operations. The touch panel is a flat panel and notifies the operation display unit I / F 206 of the coordinate information of the user's touch. The hard keys are physically pressable keys such as numeric keys, start keys, and stop keys, and notify the operation display unit I / F 206 when a key is pressed. The operation display unit 207 is also equipped with a display for displaying images. The display receives the GUI (Graphical User Interface) screen generated by the CPU 202 from the operation display unit I / F 206 and displays it. By installing the touch panel integrated on top of the display, it becomes possible for the user to control the screen displayed on the display as if they were directly operating it.

[0023] The network interface 208 connects to the network (LAN) 105 and performs information input and output with the mobile terminal 103 via the PC 101, other communication devices (not shown), and AP 104, all connected to the same LAN.

[0024] Device I / F 209 connects the image input / output devices, scanner 210 and printer 211, to the controller unit 201, and performs image data input and output.

[0025] Figure 3 is a software configuration diagram of the communication device 102. The system software 301 is stored in one of the following memory locations: RAM 203, ROM 204, or HDD 205, and executed by the CPU 202.

[0026] The job control processing unit 302 controls each software module, including software modules not shown, and controls jobs executed by the communication device 102, such as copying, printing, and scanning.

[0027] The scan processing unit 303 controls the scanner 210 via the device I / F 209 based on instructions from the job control processing unit 302, and performs the process of scanning the document placed on the document tray of the scanner 210.

[0028] The print processing unit 304 controls the printer 211 via the device interface 209 based on instructions from the job control processing unit 302, and performs the printing process of the specified image onto the recording medium.

[0029] The operation input analysis unit 305 analyzes the information supplied from the operation display unit 207 via the operation display unit I / F 206 and notifies the event processing unit 307 of events corresponding to user operations. The information analyzed by the operation input analysis unit 305 includes instances where the user touches the touch panel or presses a hard key.

[0030] The event analysis unit 306 receives and analyzes various events occurring in the communication device 102 in addition to user input, from the job control processing unit 302 and other devices, and notifies the event processing unit 307 of the events corresponding to those events. The various events analyzed by the event analysis unit 306 are events other than those caused by user operations, such as the completion of a job or running out of printing paper.

[0031] The event processing unit 307 receives events from the operation input analysis unit 305, the event analysis unit 306, or the operation information receiving unit 322, etc. Depending on the event, the event processing unit 307 notifies the job control processing unit 302, the screen generation unit 308, or the soft keyboard control unit 310 of the event and controls the respective parts of the communication device 102. The event processing unit 307 also notifies the authentication unit 311 of the authentication information received from the operation input analysis unit 305 and receives the user authentication result from the authentication unit 311. The event processing unit 307 also notifies the connection processing unit 321 of the disconnection of the VNC connection.

[0032] The screen generation unit 308 performs the process of generating screen data to be displayed on the display on the RAM 203.

[0033] The screen display unit 309 reads the screen data generated by the screen generation unit 308 from the RAM 203 and displays it on the display of the operation display unit 207 via the operation display unit I / F 206.

[0034] The soft keyboard control unit 310 receives notifications from the event processing unit 307 and controls the display of the soft keyboard screen. The soft keyboard control unit 310 also holds information indicating whether or not the soft keyboard is displayed on the display.

[0035] The authentication unit 311 receives authentication information from the event processing unit 307, performs user authentication, and returns the result.

[0036] The VNC server 320 is a software module for communicating with the VNC client 520, which operates on the mobile terminal 103, via the LAN 105. The VNC server 320 includes, for example, a screen transmission unit 323, an operation information receiving unit 322, a connection processing unit 321, and the like.

[0037] The connection processing unit 321 receives a connection request from the VNC client 520 and performs connection processing. The connection processing unit 321 also receives notification of VNC disconnection from the event processing unit 307 and disconnects the VNC connection.

[0038] The operation information receiving unit 322 receives operation information from the operation information transmitting unit 522 of the VNC client 520 and notifies the event processing unit 307 of events corresponding to user operations. The events notified by the operation information receiving unit 322 are equivalent to the events notified by the operation input analysis unit 305 and are events for the user to operate the communication device 102.

[0039] The screen transmission unit 323 reads the screen data generated by the screen generation unit 308 from the RAM 203 and sends it to the screen receiving unit 523 of the VNC client 520.

[0040] Figure 4 is a hardware configuration diagram of the mobile terminal 103. Within the mobile terminal 103, the CPU 401 is the arithmetic unit that controls the entire system. The CPU 401 comprehensively controls each device connected to the system bus 411.

[0041] ROM402 is a non-volatile memory that stores image data, other data, and various programs necessary for the CPU401 to operate.

[0042] RAM403 is a volatile memory used as the main memory and temporary storage area for the CPU401, such as the work area. RAM403 also stores programs and data, including the OS, system software, and application software.

[0043] The CPU 401 controls various parts of the mobile terminal 103 by loading programs stored in ROM 402, etc., into RAM 403 and executing them. Note that the programs required for the CPU 401 to operate are not limited to those stored in ROM 402; programs pre-stored in HDD 404, etc., may also be used.

[0044] The HDD404 stores the OS, system software, application software, photos, electronic documents, and configuration data. However, other storage devices such as SSDs, SD memory cards, or eMMCs can be used as long as they can store the data.

[0045] The RTC (Real Time Clock) 405 measures time.

[0046] The control panel 406 has a touch panel function that can detect user touch operations and displays various screens provided by the OS 530 and the MFP application 502. By inputting touch operations on the control panel 406, the user can input desired operation instructions to the mobile terminal 103.

[0047] Speaker 407 and microphone 408 are used when the user makes phone calls to other mobile devices or landlines.

[0048] Camera 409 takes images according to the user's imaging instruction. The images taken by camera 409 are stored in a predetermined area of ​​HDD 404.

[0049] The wireless communication unit 410 performs wireless communication such as wireless communication LAN.

[0050] Figure 5 is a software configuration diagram of the mobile terminal 103. The system software 501 is stored in one of the following memory locations: RAM 403, ROM 402, or HDD 404, and executed by the CPU 401.

[0051] OS530 is software for controlling the overall operation of the mobile terminal 103. Various applications can be installed on the mobile terminal 103, including the MFP application 502 described later. OS530 exchanges information with these applications and changes the screen displayed on the operation panel 406 according to instructions received from the applications. OS530 also includes a group of device drivers for controlling various hardware and provides APIs for applications running on OS530 to utilize various hardware. In this embodiment, the wireless LAN control unit 531 is one of the device drivers.

[0052] The wireless LAN control unit 531 is a device driver for controlling the wireless communication unit 410.

[0053] The MFP application (hereinafter referred to as the MFP app) 502 is an application program installed on the mobile terminal 103. The MFP app 502 is installed on the mobile terminal 103 from an external source, for example, by a store application program. The MFP app 502 is an app provided by the vendor of the communication device 102. The MFP app 502 is an app that provides functions such as remote control of the communication device 102 and printing image data, document data, etc., from the mobile terminal 103 to the communication device 102. The remote control function is a function that allows the mobile terminal 103 to operate the communication device 102.

[0054] Furthermore, the MFP application 502 may have functions other than remote control and the function to execute printing on the communication device 102. For example, if the communication device 102 has a scanning function, the MFP application 502 may have a function to scan a document placed in the communication device 102, a function to configure other settings for the communication device 102, and a function to check the status of the communication device 102. Also, the MFP application 502 has a function to execute remote control, but does not have to have other functions such as the function to execute printing on the communication device 102. Specifically, the function to execute printing on the communication device 102 is a function to send a print job to the communication device 102 to execute printing. Specifically, the function to scan a document placed in the communication device 102 is a function to send a scan job to the communication device 102 to execute scanning. Furthermore, the function for checking the status of the communication device 102 is specifically a function that obtains and displays information indicating the status of the communication device 102 from the communication device 102.

[0055] Let's explain the software configuration of MFP app 502 in more detail.

[0056] The screen control unit 503 controls the screen displayed on the operation panel 406 via the OS 530. The screen control unit 503 displays the MFP application screen on the operation panel 406. The screen control unit 503 also identifies operation instructions entered by the user via the operation panel 406. Furthermore, the screen control unit 503 reads image data recorded in the application storage unit 506 by the screen receiving unit 523 and displays it on the operation panel 406 via the OS 530.

[0057] The communication unit 504 controls the wireless communication performed by the wireless communication unit 410 via the OS 530, and performs tasks such as sending and receiving commands.

[0058] The timing unit 505 measures time.

[0059] The application memory unit 506 temporarily stores various information in the RAM 403.

[0060] The device search control unit 507 generates search data to search for the communication device 102 to connect to, transmits it to devices on the LAN 105 via the wireless communication unit 410, and receives a response from the corresponding communication device 102. The search data may be broadcast to all devices on the LAN 105, or it may be transmitted to a specific address.

[0061] The print job generation unit 508 generates a print job. The print job generated by the print job generation unit 508 is transmitted to the communication device 102 by the wireless communication unit 410, and printing is performed.

[0062] The scan job control unit 509 issues a scan command to the communication device 102 via the wireless communication unit 410 and displays the scan data received from the communication device 102. If the scan data is to be saved, it is stored in the application storage unit 506.

[0063] The VNC client 520 is a software module for communicating with the VNC server 320, which operates on the communication device 102, via the LAN 105. The VNC client 520 includes, for example, a connection processing unit 521, an operation information transmission unit 522, a screen receiving unit 523, and the like.

[0064] The connection processing unit 521 receives a request from the user, sends a connection request to the connection processing unit 321 of the VNC server 320, and performs connection processing.

[0065] The operation information transmission unit 522 receives operation instructions entered by the user via the operation panel 406 from the screen control unit 503 and transmits them to the operation information receiving unit 322 of the VNC server 320.

[0066] The screen receiving unit 523 receives screen data from the screen transmitting unit 323 of the VNC server 320 and records it in the application storage unit 506.

[0067] Furthermore, communication between the VNC server 320 and the VNC client 520 is achieved by CPU 202 and CPU 401 controlling the network interface 208 and wireless communication unit 410, respectively.

[0068] Through the processing of each software module as described above, the same screen displayed on the display of the operation display unit 207 of the communication device 102 is also displayed on the operation panel 406 of the mobile terminal 103. The user can then perform various operations on the communication device 102 remotely by using the operation panel 406 of the mobile terminal 103.

[0069] As mentioned above, VNC authentication is performed between the server and the client during the handshake process. In conventional technology, VNC authentication could not be omitted in order to remotely control the server from the client. Therefore, users had to perform authentication operations such as entering a password for VNC authentication in order to remotely control the server from the client, which could be cumbersome. Thus, there is a need to improve user convenience when remotely controlling the communication device 102.

[0070] In this embodiment, during the handshake process, the communication device 102, which operates as a VNC server, is operated as follows: The communication device 102 receives a request for a VNC connection for remote control of the communication device 102 from the mobile terminal 103, which operates as a VNC client. The communication device 102 performs VNC authentication processing to establish a VNC connection for remote control between the mobile terminal 103 and the communication device 102. When the communication device 102 receives a request for a VNC connection, it establishes the VNC connection without performing VNC authentication processing, based on the fulfillment of certain conditions. On the other hand, the communication device 102 controls the establishment of the VNC connection by performing VNC authentication processing, based on the failure to fulfill certain conditions.

[0071] Thus, in this embodiment, if certain conditions are met, a VNC connection is established without performing VNC authentication. This operation makes it possible to eliminate operations such as user input of a password related to VNC authentication.

[0072] Furthermore, in this embodiment, as will be described later, the communication device 102 can perform user authentication processing in order to use the communication device 102. The VNC authentication processing described above is a process that may be performed when establishing a VNC connection between the server and the client, while the user authentication processing is a process that may be performed in order to use the server. Since the user authentication processing and the VNC authentication processing have different authentication purposes, both can be used.

[0073] In the communication device 102 capable of executing such user authentication processing, when the user remotely operates the communication device 102 from the mobile terminal 103, authentication operations such as inputting authentication information twice may be required for VNC authentication processing and user authentication processing. In the present embodiment, as described above, when specific conditions are satisfied, a VNC connection can be established without executing the VNC authentication processing, so that the number of authentication times when the user remotely operates the communication device 102 can be reduced. That is, the user convenience when remotely operating the communication device 102 can be improved.

[0074] <Settings related to VNC> The communication device 102 can receive various settings related to VNC through the remote operation setting screen. The administrator of the communication device 102, for example, performs settings related to VNC using the remote operation setting screen at an arbitrary timing.

[0075] Here, refer to FIG. 8(a). FIG. 8(a) shows an example of the remote operation setting screen 800 displayed on the operation display unit 207 of the communication device 102. The setting screen 800 is a screen for setting the VNC of the communication device 102. When the CPU 202 receives a user operation for displaying the setting screen 800, the setting screen 800 is displayed on the operation display unit 207.

[0076] The setting screen 800 displays setting interfaces 801 to 804 that can receive user operations for various settings related to remote operation, an OK button 805, and a cancel button 806.

[0077] The ON button 801 is a button that can receive a selection for enabling the VNC server function based on the startup of the communication device 102. The OFF button 802 is a button that can receive a selection for disabling the VNC server function when the communication device 102 starts up.

[0078] The password input field 803 is an area that can accept input of a password used for VNC authentication (hereinafter referred to as the VNC authentication password). The checkbox 804 is an area that can accept the selection of whether or not to skip the VNC authentication process when the setting for executing the user authentication process of the communication device 102 is enabled. In other words, the checkbox 804 is an area for setting whether or not to execute the VNC authentication process when the user authentication process for using the communication device 102 is executed.

[0079] Furthermore, the CPU 202 may, for example, control the display of the password input field 803 and checkbox 804 to enable user selection based on whether the user has selected either the ON button 801 or the OFF button 802. For example, the CPU 202 may, based on the user pressing the ON button 801, display the password input field 803 and checkbox 804 to enable user selection. On the other hand, the CPU 202 may, based on the user pressing the OFF button 802, display the password input field 803 and checkbox 804 to disable user selection.

[0080] The OK button 805 is a button that can accept a confirmation command for the user's selection in each setting interface 801 to 804. The Cancel button 806 is a button that can accept a cancellation command for the user's selection in each setting interface 801 to 804. When the OK button 805 is pressed by the user, the CPU 202 stores the setting values ​​corresponding to the user's operation in each setting interface 801 to 804 in memory such as the HDD 205. On the other hand, when the Cancel button 806 is pressed by the user, the CPU 202 does not accept user operation in each setting interface 801 to 804 and stops displaying this setting screen 800.

[0081] When the OK button 805 is pressed, the CPU 202 registers each setting value corresponding to the user operation on the setting screen 800 into a table. Refer to Figure 10(a) here. Figure 10(a) shows an example of a table 1000 of setting values ​​related to remote operation managed by the CPU 202. Table 1000 registers setting values ​​1001 to 1003 for each setting item corresponding to the setting interfaces 801 to 804 displayed on the setting screen 800. Table 1000 is stored in memory such as the HDD 205 by the CPU 202. Table 1000 may also be stored in an authentication server (not shown).

[0082] The setting value 1001 corresponds to either the ON button 801 or the OFF button 802. Based on the activation of the communication device 102, the CPU 202 registers the setting value 1001, which determines whether to enable or disable the VNC function, in table 1000 as either ON or OFF. For example, if the OK button 805 is pressed on the settings screen 800, "ON" is registered as the setting value 1001 in table 1000.

[0083] The setting value 1002 corresponds to the password entered in the password input field 803. The CPU 202 registers the VNC authentication password (the password entered by the user) as setting value 1002 in table 1000. For example, if "vnc123" is entered in the password input field 803 on the settings screen 800, "vnc123" will be registered as setting value 1002 in table 1000.

[0084] The setting value 1003 corresponds to the user selection in checkbox 804. When the setting for executing user authentication processing of the communication device 102 is enabled, the CPU 202 registers the setting value 1003, which determines whether or not to skip the VNC authentication process, as either ON or OFF in table 1000. For example, if checkbox 804 is pressed on the settings screen 800, "ON" is registered as the setting value 1003 in table 1000.

[0085] The details of the handshake process based on the RFB protocol will now be explained. The handshake process is performed by the connection processing unit 321 of the communication device 102 and the connection processing unit 521 of the mobile terminal 103. The communication processing of each connection processing unit 321 and connection processing unit 521 is realized by the CPU of each device controlling its respective network interface and wireless communication unit.

[0086] <Server connection process> Figure 6(a) is a flowchart illustrating the connection process performed by the communication device 102, which operates as a VNC server. This flowchart is realized when the CPU 202 reads a program stored in the ROM 204 into the RAM 203 and executes it. Based on the power being turned on to the communication device 102, the VNC server 320 is started by the communication device 102 system (not shown). In the startup process of the VNC server 320, the connection processing unit 321 determines whether the VNC server function is enabled or not. If the connection processing unit 321 determines that the VNC server function is enabled, it starts the connection process shown in Figure 6(a). Specifically, the connection processing unit 321 refers to the table 1000 stored in memory such as the HDD 207 and obtains the setting value 1001. Then, if the setting value 1001 is ON, the connection processing unit 321 starts the connection process shown in Figure 6(a). Furthermore, if the setting value 1001 is OFF, the connection processing unit 321 may wait until the setting value 1001 is turned ON, and then start the connection process shown in Figure 6.

[0087] In the S600, the connection processing unit 321 opens a port for VNC connection and waits for a connection from a client.

[0088] In S601, the connection processing unit 321 receives a connection request from a client. For example, when a user operates a mobile terminal 103, which is one of the clients, and starts the remote control function, a connection request is sent from the connection processing unit 521 to the connection processing unit 321. The connection processing unit 321 receives this connection request. In other words, in S601, the connection processing unit 321 receives a request from the client (mobile terminal 103) for a VNC connection for remote control of the server (communication device 102).

[0089] In S602, the connection processing unit 321 sends the protocol version to the client. The protocol version sent by the connection processing unit 321 is the version number of the RFB protocol supported by the server. For example, if the server supports RFB protocol 3.3, it will send "RFB 003.003\n".

[0090] In S603, the connection processing unit 321 sends the protocol version to the client and then receives the protocol version from the client. The protocol version received by the connection processing unit 321 is the version number of the RFB protocol actually used in the communication between the server and the client. For example, when using RFB protocol 3.3, it receives "RFB 003.003\n". In other words, in S603, the connection processing unit 321 checks whether the client supports the version of the RFB protocol supported by the server.

[0091] In S604, the connection processing unit 321 executes a determination process to determine whether or not a specific condition is met. The determination process will be described in detail later using Figure 6(b).

[0092] In S605, the connection processing unit 321 determines whether a specific condition is met based on the result of the determination process in S604. If the connection processing unit 321 determines that the specific condition is met, it proceeds to S607 without performing the VNC authentication process. At this time, the connection processing unit 321 sends information to the client indicating the security type, corresponding to the fact that the VNC authentication process will not be performed. Upon receiving this information, the client identifies that the VNC authentication process will not be performed and establishes a VNC connection between the server and the client without displaying a screen for entering a password for VNC authentication. On the other hand, if the connection processing unit 321 determines that the specific condition is not met, it proceeds to S606.

[0093] In S606, the connection processing unit 321 performs VNC authentication processing. VNC authentication processing is a process based on the RFB protocol. VNC authentication processing is performed to establish a VNC connection for remote operation between the client and the server. Here, an example of the VNC authentication processing performed by the connection processing unit 321 is described. The connection processing unit 321 sends information to the client that indicates whether or not to perform VNC authentication, as information indicating the security type. Information indicating the security type is information that indicates whether or not to perform VNC authentication. Upon receiving this information, the client identifies that VNC authentication processing will be performed and displays a screen for entering a password for VNC authentication. Then, when the password input from the user is accepted on the screen, the client sends the entered password to the server. That is, after the connection processing unit 321 sends information to the client that indicates whether or not to perform VNC authentication processing as information indicating the security type, it receives the password from the client as authentication information. Then, based on the receipt of the password, the connection processing unit 321 refers to the table 1000 stored in memory such as the HDD 207. As described above, the password for VNC authentication is pre-registered in table 1000. The connection processing unit 321 compares the password received from the client with the password for VNC authentication. The connection processing unit 321 then determines whether the password received from the client and the password for VNC authentication match. The password received from the client may be encrypted by the client based on a challenge number received by the client from the server. In this case, the connection processing unit 321 may encrypt the password for VNC authentication using the challenge number sent to the client. The connection processing unit 321 may then compare the password it has encrypted with the password received from the client, which has been encrypted by the client. If the connection processing unit 321 determines that they match, it authenticates the client's connection. On the other hand, if the connection processing unit 321 determines that they do not match, it notifies the client of an error.Upon receiving the error notification, the client displays an error screen indicating that the entered password is incorrect and prompts the user to enter the password again. After notifying the error, the connection processing unit 321 waits, for example, for the client to re-enter the password.

[0094] In S607, the connection processing unit 321 allows the client to connect. That is, a VNC connection between the server and the client is established in S607.

[0095] Thus, in this embodiment, when the server receives a VNC connection request from a client, it controls the system to establish a VNC connection between the server and the client without performing VNC authentication processing, based on whether certain conditions are met. On the other hand, the server controls the system to establish a VNC connection between the server and the client by performing VNC authentication processing, based on whether certain conditions are not met. This type of control makes it possible to omit authentication operations such as user input of a password related to VNC authentication.

[0096] After the handshake process, the connection processing unit 321 receives the client's initialization message and sends the server's initialization message based on the RFB protocol. Subsequently, the server and client exchange information such as display screens and screen operations based on the RFB protocol. Specifically, based on the user's operation on the operation panel 406, the operation information receiving unit 322 receives information (key information or location information) sent by the operation information transmission unit 522 of the VNC client 520. Based on the received information (key information or location information), it generates an event equivalent to pressing the corresponding hard key on the operation display unit 207, or generates an event equivalent to pressing the operation display unit 207, and processes the information. If the display screen information is updated as a result of processing based on the information received by the operation information receiving unit 322, the screen transmission unit 323 transmits the screen information. The screen transmission unit 323 also transmits screen information if the display screen information is updated due to an internal event occurring in the communication device 102. Furthermore, the screen receiving unit 523 of the VNC client 520 receives the information transmitted by the screen transmission unit 323 and displays it on the operation panel 406. As a result, it becomes possible to remotely control the communication device 102 from the mobile terminal 103 in the same way as operating the operation display unit 207 of the communication device 102.

[0097] Next, referring to Figure 6(b), the determination process executed by the connection processing unit 321 in S604 will be explained. This flowchart is realized when the CPU 202 reads the program stored in the ROM 204 into the RAM 203 and executes it.

[0098] In S608, the connection processing unit 321 determines whether a password for VNC authentication has been set. If the connection processing unit 321 determines that a password has been set, it proceeds to S609. On the other hand, if the connection processing unit 321 determines that a password has not been set, it proceeds to S611.

[0099] In S608, specifically, the connection processing unit 321 refers to table 1000 stored in memory such as HDD 205. If the setting value 1002 for the VNC authentication password is registered in table 1000, the connection processing unit 321 determines that a VNC authentication password has been set. On the other hand, if the setting value 1002 for the VNC authentication password is not registered in table 1000, the connection processing unit 321 determines that a VNC authentication password has not been set. In other words, in S608, the connection processing unit 321 determines whether or not a VNC authentication password has been registered in table 1000 beforehand. As described above, the VNC authentication process executed by the server includes a process to determine whether or not the password received from the client matches the set VNC authentication password. Therefore, the determination in S608 is made.

[0100] In S609, the connection processing unit 321 determines whether the setting to omit the VNC authentication process is enabled when the user authentication process is enabled. If the connection processing unit 321 determines that the setting to omit the VNC authentication process is enabled, it proceeds to S610. On the other hand, if the connection processing unit 321 determines that the setting to omit the VNC authentication process is not enabled, it proceeds to S612. Specifically, the connection processing unit 321 refers to the table 1000 stored in memory such as the HDD 205. The connection processing unit 321 then determines that the VNC authentication process should be omitted if the setting value 1003 corresponding to the user operation of checkbox 804 is ON. On the other hand, if the setting value 1003 is OFF, the connection processing unit 321 determines that the VNC authentication process should not be omitted.

[0101] In S610, the connection processing unit 321 determines whether the setting for performing user authentication is enabled. If the connection processing unit 321 determines that it is enabled, it proceeds to S611. On the other hand, if the connection processing unit 321 determines that it is disabled, it proceeds to S612.

[0102] Here, we will explain the settings related to user authentication processing. The communication device 102 can perform user authentication processing when a user uses the communication device 102. The administrator of the communication device 102 can configure settings related to user authentication processing, for example, using the user authentication processing settings screen. Figure 8(b) shows an example of the user authentication processing settings screen 810.

[0103] The settings screen 810 is a screen for making various settings related to the user authentication process of the communication device 102. When the CPU 202 receives a user operation to display the settings screen 810, it displays the settings screen 810 on the operation display unit 207. The settings screen 810 displays setting interfaces 811 to 815 that can accept user operations for various settings related to the user authentication process, as well as an OK button 816 and a Cancel button 817.

[0104] The ON button 811 is a button that accepts a selection to enable the user authentication process for using the communication device 102. The OFF button 812 is a button that accepts a selection to disable the user authentication process for using the communication device 102. In other words, the settings screen 810 can also be described as a screen that accepts a user selection to enable or disable (execute or disable) the user authentication process for using the communication device 102.

[0105] The Simple Login setting button 813 allows users to select whether or not to use Simple Login as a method of user authentication. Users select ON if they wish to use Simple Login, and OFF if they do not. Simple Login is a method of logging in by pressing the username displayed on the operation display unit 207, eliminating the need to manually enter a username. A PIN can also be set for Simple Login.

[0106] The IC card authentication setting button 814 is a button that allows the user to select whether or not to use IC card authentication as a method of user authentication. The user selects ON if they want to use IC card authentication, and OFF if they do not. IC card authentication is a method of user authentication that uses an IC card. Since the user only needs to hold the IC card over an IC card reader (not shown), they do not need to remember their username or password and can log in easily.

[0107] The keyboard authentication setting button 815 is a button that allows the user to select whether or not to use keyboard authentication as a method of user authentication. It is set to ON when keyboard authentication is to be used as a method of user authentication, and to OFF when it is not to be used. The user selects ON when using keyboard authentication and OFF when not using IC card authentication. Keyboard authentication is a process in which authentication information (username and password) is received from the user via the keyboard displayed on the operation display unit 207, and the system determines whether or not the user is eligible to use the communication device 102 based on the received authentication information.

[0108] Furthermore, the CPU 202 may, for example, control the display to determine whether or not to show that user selection is possible for the setting buttons 813-815 based on whether or not a user selection has been received for either the ON button 811 or the OFF button 812. For example, the CPU 202 may, based on the user pressing the ON button 811, show that user selection is possible for the setting buttons 813-815. On the other hand, the CPU 202 may, based on the user pressing the OFF button 812, show that user selection is not possible for the setting buttons 813-815.

[0109] The OK button 816 is a button that can accept a confirmation command for the user's selection in each setting interface 811 to 815. The Cancel button 817 is a button that can accept a cancellation command for the user's selection in each setting interface 811 to 815. When the OK button 816 is pressed by the user, the CPU 202 stores the setting values ​​corresponding to the user's operation in each setting interface 811 to 815 in memory such as the HDD 205. On the other hand, when the Cancel button 817 is pressed by the user, the CPU 202 does not accept user operation in each setting interface 811 to 815 and stops displaying this setting screen 810.

[0110] When the OK button 816 is pressed, the CPU 202 registers each setting value corresponding to the user operation on the setting screen 810 into a table. Refer to Figure 10(b) here. Figure 10(b) shows an example of a table 1010 for managing setting values ​​related to user authentication. Table 1010 registers setting values ​​1011 to 1014 for each setting item corresponding to the setting interfaces 811 to 815 displayed on the setting screen 810. Table 1010 is stored in memory such as the HDD 205 by the CPU 202. Note that table 1010 may also be stored in an authentication server (not shown).

[0111] The setting value 1011 corresponds to a user selection of either the ON button 811 or the OFF button 812. The CPU 202 registers the setting value 1011, which determines whether or not to perform user authentication processing for using the communication device 102, in the table 1010 as either ON or OFF. For example, if the ON button 811 is pressed on the setting screen 810, "ON" is registered as the setting value 1011 in the table 1010.

[0112] The setting value 1012 corresponds to the user selection on the setting button 813. The CPU 202 registers the setting value 1012, which determines whether or not to use simple login as a method of user authentication, in table 1010 as either ON or OFF. For example, if OFF is pressed on the setting button 813 on the setting screen 810, "OFF" will be registered as the setting value 1012 in table 1010.

[0113] The setting value 1013 corresponds to the user selection of the setting button 814. The CPU 202 registers the setting value 10113, which indicates whether or not to use IC card authentication as a method of user authentication, in table 1010 as either ON or OFF. For example, if OFF is pressed on the setting button 814 on the setting screen 810, "OFF" will be registered as the setting value 1013 in table 1010.

[0114] The setting value 1014 corresponds to the user selection of the setting button 815. The CPU 202 registers the setting value 1014, which determines whether or not to use keyboard authentication as a method of user authentication, in table 1010 as either ON or OFF. For example, if ON is pressed on the setting button 815 on the setting screen 810, "ON" will be registered as the setting value 1014 in table 1010.

[0115] Returning to the explanation of Figure 6(b), in S610, specifically, the connection processing unit 321 refers to the table 1010 stored in memory such as the HDD 205. The connection processing unit 321 then determines that the setting value 1011 is enabled if it is ON. On the other hand, the connection processing unit 321 determines that the setting value 1011 is disabled if it is OFF. In other words, in S610, the connection processing unit 321 determines whether or not the user authentication process is set to be executed.

[0116] In S611, the connection processing unit 321 determines that a specific condition is met. In S612, the connection processing unit 321 determines that a specific condition is not met. These determination results are used in the process of S605.

[0117] Thus, in this embodiment, certain conditions are met when it is determined that user authentication processing for using the communication device 102 will be performed (YES in S610). On the other hand, if it is determined that user authentication processing will not be performed (NO in S610), certain conditions are not met. In this way, when S610 is YES, certain conditions are met, so that when user authentication processing is performed, a VNC connection can be established without performing VNC authentication processing. Therefore, the user can remotely operate the communication device 102 with a single authentication operation in the user authentication process, without having to perform two authentication operations, one for VNC authentication processing and one for user authentication processing.

[0118] Furthermore, in this embodiment, certain conditions are met when it is determined that user authentication processing will be performed on the communication device 102 (YES in S610) and that the setting is not to perform VNC authentication processing (YES in S609). On the other hand, certain conditions are not met when it is determined that the setting is to perform user authentication processing (NO in S609). In other words, whether or not to perform VNC authentication processing is controlled based on the user selection in checkbox 804.

[0119] <Client connection process> Next, the connection process performed by the mobile terminal 103 acting as a VNC client will be described. Figure 7 is a flowchart showing an example of the connection process performed by the mobile terminal 103 acting as a VNC client. This flowchart is realized by the CPU 401 reading a program stored in the ROM 402 into the RAM 403 and executing it. In this embodiment, the mobile terminal 103 performs this process using the MFP application 502.

[0120] Furthermore, this flowchart assumes that the process begins when the user initiates the launch of the MFP application 502 on the screen displayed on the operation panel 406 of the mobile terminal 103. Here, the launch operation of the MFP application 502 will be explained using Figure 11(a). Figure 11(a) shows an example of the screen displayed on the operation panel 406 of the mobile terminal 103. When the mobile terminal 103 is started, the OS 530 displays the home screen 1100 on the operation panel 406. The home screen 1100 displays icons representing application programs installed on the mobile terminal 103. Icon 1101 is the icon representing the MFP application 502. The OS 530 launches the MFP application 502 based on the fact that icon 1101 is pressed by the user on the home screen 1100.

[0121] In the S700, the screen control unit 503 displays the application home screen on the operation panel 406. Figure 11(b) shows an example of the application home screen 1110 (device not selected) displayed on the operation panel 406 by the screen control unit 503 in the S700. The application home screen 1110 displays the selected device icon 1111, items indicating each menu including the remote operation menu 1112, a device search button 1113, etc.

[0122] The selected device icon 1111 displays information about the communication device selected by the user as the communication device to be used by the MFP application 502. If no communication device is selected, the selected device icon 1111 will display information indicating that it is not selected (in this example, "No Printer").

[0123] The remote operation menu 1112 is a menu for using remote operation. The device search button 1113 is a button that can receive a command to perform a device search. The device search control unit 507 performs a device search, as described later, based on the screen control unit 503 detecting that the device search button 1113 has been pressed by the user.

[0124] In S701, the device search control unit 507 performs a device search. The device search control unit 507 searches for communication devices on the network to which the mobile terminal 103 belongs, for example. Then, the screen control unit 503 displays the device search screen on the operation panel 406. Figure 11(c) shows an example of the device search screen 1120 that the screen control unit 503 displays on the operation panel 406 in S702.

[0125] The device search screen 1120 displays a list of communication devices found by the device search control unit 507. Search result 1121 represents communication device 102. Search result 1121 displays information (device name, etc.) about the communication device found by the device search control unit 507 as options that can be selected by the user.

[0126] In S702, the screen control unit 503 determines whether a communication device has been selected on the device search screen 1120. If no communication device has been selected, the screen control unit 503 returns to S702. On the other hand, if the screen control unit 503 determines that a communication device has been selected, it displays the application home screen (device selected) 1130 shown in Figure 10(c) on the operation panel 406. The selected device icon 1131 displays the device selected on the device search screen 1120.

[0127] In S703, the screen control unit 503 determines whether the remote operation menu 1132 is selected on the application home screen (device selected) 1130. If the screen control unit 503 determines that it is not selected, it returns to S703. On the other hand, if the determination in S706 determines that the remote operation menu 1132 is selected, it proceeds to S704.

[0128] In S704, the MFP application 502 starts the remote control function. Specifically in S704, the connection processing unit 521 sends a connection request to the server. The screen control unit 503 also displays the connection screen 1200 shown in Figure 12(a) on the operation panel 406. The connection screen 1200 displays, for example, a message indicating that an attempt is being made to connect to the server. The hard key display button 1201 is a button that displays a hard key screen (not shown) for operating the hard keys of the communication device 102 from the mobile terminal 103.

[0129] In S705, the connection processing unit 521 receives the protocol version from the server. For example, if the server supports RFB protocol 3.3, it receives "RFB 003.003\n".

[0130] In S706, the connection processing unit 521 transmits the protocol version. As described above, the protocol version transmitted by the client is the version number of the RFB protocol actually used in the communication between the server and the client. For example, when using RFB protocol 3.3, "RFB 003.003\n" is transmitted.

[0131] In S707, the connection processing unit 521 determines whether or not to use VNC authentication processing. If the connection processing unit 521 determines that VNC authentication processing should be used, it proceeds to S708. On the other hand, if the connection processing unit 521 determines that VNC authentication processing should not be used, it terminates the process shown in Figure 7. Specifically, the connection processing unit 321 makes a determination based on the security type received from the server. If it receives information indicating that VNC authentication processing should be performed as the security type, the connection processing unit 521 determines that VNC authentication processing should be used. On the other hand, if the connection processing unit 521 receives information indicating that VNC authentication processing should not be performed as the security type, it determines that VNC authentication processing should not be used.

[0132] In S708, the connection processing unit 521 performs VNC authentication processing based on the RFB protocol. Here, an example of client-side VNC authentication processing is described. The screen control unit 503 displays the VNC authentication screen 1210 for password input shown in Figure 12(b) on the operation panel 406. The VNC authentication screen 1210 displays a password input field 1211 that can accept user input of a password for VNC authentication. The connection processing unit 521 then sends information to the server based on the password entered by the user in the password input field 1211. Specifically, the connection processing unit 521 sends information about the user operation of the VNC authentication screen 1210 to the server based on the RFB protocol. For example, if the user taps the hard key display button 1201 and inputs characters from a hard key screen (not shown), the operation information transmission unit 522 sends key information corresponding to the entered characters to the server as a KeyEvent of the RFB protocol. Furthermore, if the user taps the screen displayed on the control panel 406, the operation information transmission unit 522 sends the tapped location information to the server as a PointerEvent of the RFB protocol. If VNC authentication is successful, the connection processing unit 521 terminates the handshake process.

[0133] As a result, it becomes possible to remotely control the communication device 102 from the mobile terminal 103 in the same way as operating the operation display unit 207 of the communication device 102.

[0134] <User Authentication Process> From here, we will explain the details of the user authentication process for using the communication device 102, which is a VNC server, by operating the control panel 406 of the mobile terminal 103, which is a VNC client. The user authentication process can also be described as the login process for logging into the communication device 102.

[0135] User authentication is achieved by the operation information receiving unit 322 and screen transmission unit 323 of the communication device 102, and the operation information transmission unit 522 and screen receiving unit 523 of the mobile terminal 103, which transmit and receive information such as the display screen and screen operations.

[0136] If user authentication is enabled on the server (setting value 1011 is ON), the first screen displayed on the operation display unit 207 after the server starts up will be the user authentication screen (login screen). If the CPU 202 uses keyboard authentication as the user authentication method (setting value 1014 is ON), it will display the keyboard login screen as the user authentication screen on the operation display unit 207.

[0137] Figure 9(a) shows an example of a keyboard login screen 900. The keyboard login screen 900 includes an input field 901 that can accept user input for a username and an input field 902 that can accept user input for a password. In other words, the keyboard login screen 900 is a reception screen that can accept user input for a username and password as authentication information. The keyboard login screen 900 also includes a login button 903 that can accept an authentication request (login request). When the login button 903 is tapped, the CPU 202 starts the user authentication process.

[0138] If a VNC connection is established between the client and the server, the screen transmission unit 323 sends information from the keyboard login screen 900 to the client. The screen reception unit 523 receives the information from the keyboard login screen 900. Based on the information from the keyboard login screen 900 received by the screen reception unit 523, the screen control unit 503 displays the keyboard login screen 1220 shown in Figure 12(c) on the operation panel 406. The input fields 1221, 1222, and login button 1223 on the keyboard login screen 1220 are the same as those displayed on the keyboard login screen 900. In other words, the user can remotely control the keyboard login screen 1220 as if they were operating the keyboard login screen 900 by operating the keyboard login screen 1220.

[0139] Here, the server and client only exchange information such as display screen data and screen operation data; the functional processing of user authentication is performed on the server. Therefore, the following explanation will focus on the user authentication process performed on the server (communication device 102).

[0140] Figure 13 is a flowchart illustrating the user authentication process performed by the communication device 102. This flowchart is implemented when the CPU 202 reads a program stored in the ROM 204 into the RAM 203 and executes it.

[0141] In S1300, the event processing unit 307 determines whether or not an authentication request has been received. If the event processing unit 307 determines that an authentication request has been received, it proceeds to S1301. On the other hand, if the event processing unit 307 determines that an authentication request has not been received, it repeats S1300. In other words, S1300 is the process of accepting an authentication request. For example, when the login button 1223 is tapped, the event processing unit 307 receives an authentication request from the operation information receiving unit 322.

[0142] In S1301, the event processing unit 307 notifies the authentication unit 311 of the authentication information (username and password entered by the user) included in the received authentication request. The authentication unit 311 then performs user authentication. The authentication unit 311 limits the users who can use the communication device 102 by performing user authentication based on the authentication information registered for each user. The authentication information used for user authentication is set in advance by the administrator of the communication device 102 using an authentication information setting screen (not shown) displayed on the operation display unit 207 by the CPU 202. The CPU 202 then stores the setting values ​​corresponding to the management items in a table based on the user operation on the setting screen (not shown).

[0143] Here, a table for managing user authentication information will be described with reference to Figure 10(c). Figure 10(c) shows an example of a table 1020 for managing user authentication information in this embodiment. User authentication information refers to information about users who can use the communication device 102.

[0144] Table 1020 contains management items such as username 1021, password 1022, email address 1023, department ID 1024, and role name 1025. Table 1020 stores the setting values ​​corresponding to each management item.

[0145] Username 1021 is an item for setting the username used during user authentication. For example, any username can be pre-registered as the setting value corresponding to Username 1021. Password 1022 is an item for setting the password used during user authentication. For example, any password can be pre-registered as the setting value corresponding to Password 1022. Department ID 1024 is an item for registering the department ID to which the user belongs when using departmental ID management. Role name 1025 is an item for registering the user's privileges (roles) related to the communication device 102. For example, if Administrator is registered in table 1020 as the setting value corresponding to Role name 1025, that user will be granted administrator privileges. A user with administrator privileges can, for example, perform all operations on the communication device 102 after user authentication. Also, if GeneralUser is registered in table 1020 as the setting value corresponding to Role name 1025, that user will be granted general user privileges. Users granted general user privileges can perform some operations on the communication device 102 after user authentication processing. The settings in this table 1020 can be accessed by the CPU 202 at any time.

[0146] In S1301, the authentication unit 311 specifically compares the authentication information (username and password) received from the client with the authentication information (settings) registered in table 1020. The authentication unit 311 then determines whether the received authentication information and the authentication information registered in table 1020 match. If the authentication unit 311 determines that they match, it determines that user authentication was successful. On the other hand, if the authentication unit 311 determines that they do not match, it determines that user authentication failed. The authentication unit 311 returns the result of user authentication to the event processing unit 307.

[0147] In S1302, the event processing unit 307 determines whether user authentication was successful based on the results of user authentication by the authentication unit 311. If it is determined in S1302 that user authentication was successful, the process proceeds to S1304. On the other hand, if it is determined that user authentication failed, the process proceeds to S1303.

[0148] In S1303, the screen generation unit 308 generates information for an error screen (not shown). Then, the screen display unit 309 displays the error screen on the operation display unit 207.

[0149] In S1304, the screen generation unit 308 generates initial screen information. The screen display unit 309 then displays the initial screen on the operation display unit 207. If a VNC connection is established between the client and the server, the screen transmission unit 323 sends the initial screen information to the client. The screen reception unit 523 receives the initial screen information sent from the server. The screen control unit 503 displays the initial screen on the operation panel 406 based on the initial screen information received by the screen reception unit 523. If the home screen is set as the initial screen, the operation panel 406 displays, for example, the home screen 1230 shown in Figure 12(d). The home screen 1230 displays, for example, buttons for executing various functions of the communication device 102.

[0150] As described above, according to this embodiment, when the communication device 102 receives a VNC connection request from the mobile terminal 103, if certain conditions are met, it establishes a VNC connection without performing VNC authentication processing. On the other hand, the communication device 102 is controlled to establish a VNC connection by performing VNC authentication processing if certain conditions are met. Thus, in this embodiment, if certain conditions are met, a VNC connection is established without performing VNC authentication processing. This operation makes it possible to eliminate operations such as user input of a password related to VNC authentication. In other words, it is possible to improve user convenience when remotely operating the communication device 102.

[0151] <Second Embodiment> The second embodiment will now be described in terms of its differences from the first embodiment. In the first embodiment, after a VNC connection is established between the client and the server, if user authentication processing is disabled on the communication device 102, the user can remotely operate the communication device 102. If user authentication processing is enabled on the communication device 102, the user can remotely operate the communication device 102 after successful user authentication.

[0152] On the other hand, there are cases where it is necessary to limit the users who can remotely operate the communication device 102. For example, there are cases where remote operation is limited to certain users for security reasons. Also, for example, there are cases where it is limited to administrators who perform maintenance on the communication device 102 from a remote location. Also, for example, there are cases where its use is limited to administrators who remotely operate the communication device 102 and provide support for screen operation.

[0153] Therefore, in this embodiment, when a VNC connection is established, the communication device 102 determines whether or not the user has the authority to remotely control the device. If the communication device 102 determines that the user has the authority to remotely control the device, it continues the VNC connection. On the other hand, if the communication device 102 determines that the user does not lack the authority to remotely control the device, it disconnects the VNC connection. This configuration makes it possible to limit the users who can remotely control the communication device 102 via VNC, further improving the convenience of remotely controlling the communication device 102.

[0154] In this embodiment, the communication device 102 allows for setting operation privileges for each user to remotely control the communication device 102. Operation privileges are set using the role setting screen 910 shown in Figure 9(b). When the CPU 202 receives a user request to display the setting screen 910, it displays the setting screen 910 on the operation display unit 207. The administrator of the communication device 102 sets roles related to the communication device 102 using the setting screen 910.

[0155] The settings screen 910 is executed by the CPU 202 of the communication device 102. Role settings are to be made for each user. The settings screen 910 is a screen that allows setting whether the user's privileges for using the communication device 102 are administrator privileges or general user privileges. It is also a screen that allows setting the operation privileges for remotely controlling the communication device 102. The settings screen 910 displays setting interfaces 911 to 912 for setting various privileges for users using the communication device 102, and an OK button 913.

[0156] List 911 displays selection items that allow the user to select either administrator privileges or general user privileges for setting the user's privileges for using the communication device 102.

[0157] Checkbox 912 is a selection box that accepts the option of whether or not to set operational privileges for remotely controlling the communication device 102 via VNC. For example, the administrator of the communication device 102 selects checkbox 912 if they want to grant operational privileges to users who will be using the communication device 102.

[0158] The OK button 913 is a button that can accept confirmation instructions for user selections in each setting interface 801 to 804. When the OK button 913 is pressed by the user, the CPU 202 stores the setting values ​​corresponding to the user operation in each setting interface 912 to 913 in memory such as the HDD 205. These setting values ​​can be accessed by the CPU 202 at any time.

[0159] Now, refer to Figure 10(d). Figure 10(d) shows an example of a table 1030 of settings related to remote operation in this embodiment, which is managed by the CPU 202.

[0160] Table 1030 contains management items such as username 1031, password 10322, email address 1033, department ID 1034, and role name 13045. These management items are the same as those in Table 1020, so their explanation is omitted. In this embodiment, Table 1030 contains a VNC user 1036 as a management item. Table 1030 registers the setting values ​​corresponding to each management item.

[0161] VNC user 1036 is an entry for registering a user who can remotely control the communication device 102. A setting value, such as ON or OFF, is pre-registered for VNC user 1036. In other words, table 1030 registers the operational authority for remotely controlling the communication device 102 for each user.

[0162] <User Authentication Process> Figure 14 is a flowchart illustrating the server user authentication process in this embodiment, which is executed by the CPU 202 of the communication device 102. This flowchart is realized when the CPU 202 reads a program stored in the ROM 204 into the RAM 203 and executes it.

[0163] Since processes S1400-S1401 and S1403 are the same as those in S1300-S1301 and S1303, their explanations will be omitted.

[0164] In S1402, the event processing unit 307 determines whether user authentication was successful based on the results of user authentication by the authentication unit 311. If it is determined in S1402 that user authentication was successful, the process proceeds to S1404. On the other hand, if it is determined that user authentication failed, the process proceeds to S1403.

[0165] In the first embodiment, if it was determined in S1302 that user authentication was successful, the process proceeded to S1304 and the initial screen was displayed. In this embodiment, if it was determined in S1402 that user authentication was successful, the following process is performed.

[0166] In S1404, the event processing unit 307 determines whether the currently running user authentication process was executed because an authentication request was received from the VNC client. This is determined by whether the operation information received by the event processing unit 307 is operation information from the operation information receiving unit 322 of the VNC server 320. In other words, the event processing unit 307 determines whether an authentication operation was performed via the client. That is, in S1404, the event processing unit 307 determines whether the user authentication process was executed based on remote control of the communication device 102. If the event processing unit 307 determines that an authentication request was received from the VNC client, it proceeds to S1405. On the other hand, if the event processing unit 307 determines that an authentication request was not received from the VNC client, it proceeds to S1406.

[0167] In S1405, the event processing unit 307 determines whether the logged-in user has the authority to remotely control the communication device 102. Specifically, the event processing unit 307 makes this determination by querying the authentication unit 311. The authentication unit 311 checks the setting value of VNC user 926, which corresponds to the setting value of the logged-in user's username 921. The authentication unit 311 then determines that the user has the authority to operate if the setting value of VNC user 926 is ON. On the other hand, the authentication unit 311 determines that the user does not have the authority to operate if the setting value of VNC user 926 is OFF. The authentication unit 311 returns the determination result to the event processing unit 307. If the determination in S1405 determines that the user has the authority to operate, the process proceeds to S1406. On the other hand, if the determination in S1405 determines that the user has the authority to operate, the process proceeds to S1407.

[0168] Since S1406 is the same as S1304, the explanation is omitted.

[0169] In S1407, the event processing unit 307 notifies the connection processing unit 321 of the VNC disconnection. The connection processing unit 321 then disconnects the VNC connection between the client and the server.

[0170] Thus, in this embodiment, based on the determination in S1405 that the user has operational privileges, the information of the initial screen displayed on the operation display unit 207 of the communication device 102 is transmitted to the mobile terminal 103 via the VNC connection in the process of S1407. On the other hand, based on the determination in S1405 that the user does not have operational privileges, the VNC connection is disconnected in the process of S1407. In other words, it can be said that the event processing unit 307 controls the system to allow remote operation of the communication device 102 based on the determination that the user has operational privileges. Conversely, it can also be said that the event processing unit 307 controls the system to deny remote operation of the communication device 102 based on the determination that the user does not have operational privileges.

[0171] In this embodiment, when a VNC connection is established, the communication device 102 determines whether or not the user has the authority to remotely control the device. If the communication device 102 determines that the user has the authority to remotely control the device, it continues the VNC connection. On the other hand, if the communication device 102 determines that the user does not lack the authority to remotely control the device, it disconnects the VNC connection. This configuration allows for limiting the users who can remotely control the communication device 102 via VNC, further improving the convenience of remotely controlling the communication device 102.

[0172] In this embodiment, the user authentication process is performed in S1404 only when the event processing unit 307 determines in S1402 that user authentication has been successful. However, the process is not limited to this. For example, the process may proceed to S1404 when the event processing unit 307 determines in S1400 that an authentication request has been received. In this configuration, the process may proceed as follows based on the result of the determination in S1404.

[0173] For example, if the result in S1404 is NO, the processes in S1401 to S1402 may be performed. If the result in S1402 is YES, the process may proceed to S1406, and if the result in S1402 is NO, the process may proceed to S1403.

[0174] On the other hand, if the result in S1404 is YES, the process may proceed to S1405. If the result in S1405 is YES, the processes in S1401 to S1402 may be performed. If the result in S1402 is YES, the process may proceed to S1406, and if the result in S1402 is NO, the process may proceed to S1403. If the result in S1405 is YES, the process may proceed to S1407.

[0175] <Other Embodiments> Furthermore, in the embodiments described above, the process of S607 was performed when YES was determined in S605, or after S606. However, the process is not limited to these cases. For example, when YES is determined in S605, or after S606 but before the process of S607 is performed, the connection processing unit 321 may determine whether or not there is a user logged into the communication device 102. That is, the connection processing unit 321 may determine whether or not there are other users using the communication device 102. If the connection processing unit 321 determines that there is no user logged in, it may proceed to S607. On the other hand, if the connection processing unit 321 determines that there is a user logged in, it may control the system to prevent the logged-in user from taking any further actions. For example, if a logged-in user is remotely controlling the server via a VNC connection from a client, the connection processing unit 321 may disconnect the VNC connection between the client and the server. Also, for example, the connection processing unit 321 may control the system to log out the logged-in user.

[0176] For example, when S601 receives a connection request from a client, another user may be using the operation display unit 207 of the communication device 102. If another user is using the operation display unit 207 of the communication device 102, the screen information that the communication device 102 sends to the mobile terminal 103 after the VNC connection is established between the client and the server will not be the initial screen information, but rather the information of the operation screen being operated by the other user. Furthermore, in such a case, even if user authentication processing is enabled, the screen information that the communication device 102 sends to the mobile terminal 103 will not be the user authentication screen, but rather the information of the operation screen being operated by the other user. Therefore, before establishing a connection between the client and the server in S607, it may be possible to determine whether there is a logged-in user, and if there is a logged-in user, control the system to not accept operations from the logged-in user as described above.

[0177] Furthermore, for example, if the connection processing unit 321 determines that there is a logged-in user, it may display a confirmation screen 920 for VNC connection requests on the operation display unit 207 (see Figure 9(c)). The confirmation screen 920 is a screen that allows the logged-in user to select the process to be executed by the server when a VNC connection request is received from a client. The confirmation screen 920 displays checkboxes 921 to 923 and an OK button 924. Checkbox 921 is an area where the user can select to reject the connection request. Checkbox 922 is an area where the user can select to stop their operations and log out. Checkbox 923 is an area where the user can select to allow the connection request while continuing their operations. For example, checkbox 923 is used when the logged-in user has trouble operating the screen and wants to share the screen with an operator connected via VNC from a remote location to receive support. Note that the CPU 202 controls the display of checkboxes 921 to 923 to accept only one user selection at a time. The OK button 924 is a button that can accept confirmation instructions from the user regarding the selections of each checkbox 921 to 923. When the OK button 924 is pressed by the user, the connection processing unit 321 may execute the processing accepted by each checkbox 921 to 924. For example, if checkbox 921 is selected, the connection processing unit 321 may not permit the connection with the client that received the connection request in S601 and terminate the connection processing shown in Figure 6(a). Also, if checkbox 922 is selected, the connection processing unit 321 may log out other users logged into the communication device 102 and proceed to S607. Also, if checkbox 923 is selected, the connection processing unit 321 may leave other users logged into the communication device 102 managed by the authentication unit 311 logged in and proceed to S607.

[0178] The display of screens related to the VNC function and the management of settings related to the VNC function may be performed in a manner different from that described using Figures 8 and 10(a). Specifically, for example, the screen related to the VNC function may include an area that accepts instructions on whether or not to use VNC authentication when the VNC function is enabled. Furthermore, a setting value indicating whether or not to use VNC authentication when the VNC function is enabled may be managed as a setting value related to the VNC function. If an instruction to use VNC authentication is received, a setting value indicating the use of VNC authentication is managed, and if an instruction not to use VNC authentication is received, a setting value indicating that VNC authentication will not be used is managed. Then, in S605, the connection processing unit 321 may determine that certain conditions are not met if a setting value indicating the use of VNC authentication is managed. Also, the connection processing unit 321 may determine that certain conditions are met if a setting value indicating the not to use VNC authentication is managed. Furthermore, if the server manages a setting that indicates whether or not to use VNC authentication, and setting 1011 is changed from a setting that indicates not to perform user authentication to a setting that indicates to perform user authentication, the server may automatically change the setting that indicates whether or not to use VNC authentication from a setting that indicates to use VNC authentication to a setting that indicates not to use VNC authentication. This configuration also allows for control to prevent both user authentication and VNC authentication from being executed at the same time.

[0179] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0180] This embodiment discloses the inventions of the following items: (Item 1) A communication device, A first receiving means that receives a request from an information processing device for a network connection for remote operation of the aforementioned communication device, The system comprises a first execution means for performing a first authentication process to establish a network connection for remote operation between the information processing device and the communication device, Upon receiving the aforementioned request, and based on the fulfillment of specific conditions, a network connection for remote operation is established between the communication device and the information processing device without performing the first authentication process. Based on the failure to meet the aforementioned specific conditions, the system is controlled to establish a network connection for remote operation between the communication device and the information processing device by executing the first authentication process. A communication device characterized by the following features. (Item 2) The system further comprises a second execution means for performing a second authentication process for using the aforementioned communication device. A communication device as described in item 1, characterized by the features described herein. (Item 3) If the second authentication process for using the communication device is performed, and the specific conditions are met, and the second authentication process is not performed, the specific conditions are not met. A communication device as described in item 2, characterized by the features described herein. (Item 4) The system further includes a first setting means for setting whether or not to perform the first authentication process when the second authentication process for using the communication device is performed, If the second authentication process is performed and the setting is not to perform the first authentication process, the specific condition is met, and if the setting is to perform the first authentication process, the specific condition is not met. A communication device as described in item 2, characterized by the features described herein. (Item 5) The system further comprises a second setting means for determining whether or not to perform the second authentication process for using the communication device, A communication device as described in item 3 or 4, characterized by the features described herein. (Item 6) The aforementioned second authentication process is: This includes processing to limit the users who can use the aforementioned communication device, A communication device according to any one of items 2 to 5, characterized in that it is a communication device. (Item 7) The system further comprises a first registration means for registering authentication information used in the second authentication process, The aforementioned second authentication process is: The system includes a process for receiving authentication information from a user and determining whether the received authentication information matches the authentication information registered by the first registration means. A communication device according to any one of items 2 to 6, characterized in that it is a communication device. (Item 8) A second registration means for registering operational authority for remotely controlling the aforementioned communication device, The system further includes a first determination means for determining whether the user using the communication device is a user with the necessary operating privileges, once the network connection has been established and authentication in the second authentication process has been successful. The system is controlled to allow remote operation of the communication device based on whether the user is determined to have the aforementioned operational authority, and to deny remote operation of the communication device based on whether the user is determined to not have the aforementioned operational authority. A communication device according to any one of items 2 to 7, characterized by the features described herein. (Item 9) Based on the determination by the first determination means that the user does not have the necessary operating privileges, the network connection is disconnected. A communication device as described in item 8, characterized by the features described above. (Item 10) Based on the determination by the first determination means that the user has the operation authority, the information on the screen displayed by the display means of the communication device is transmitted to the information processing device via the network connection. A communication device as described in item 8 or 9, characterized by the features described herein. (Item 11) The system further includes a second determination means for determining whether the second authentication process was performed based on remote control of the communication device, if the authentication in the second authentication process is successful. The first determination means is, If the second determination means determines that the second authentication process was performed based on remote operation of the communication device, it is determined whether the user using the communication device is a user with the operation authority. A communication device according to any one of items 8 to 10, characterized in that it is a communication device. (Item 12) The aforementioned first authentication process is: This is a process based on the RFB protocol. A communication device according to any one of items 1 to 11, characterized by the features described herein. (Item 13) The system further comprises a second registration means for registering authentication information used in the first authentication process, The aforementioned first authentication process is: The information processing device receives authentication information entered by a user from the information processing device, and includes a process to determine whether the authentication information received from the information processing device matches the authentication information registered by the second registration means. A communication device according to any one of items 1 to 12, characterized by the features described herein. (Item 14) The system further comprises a third determination means for determining whether or not the aforementioned specific conditions are met, If the third determination means determines that the specific conditions are met, the first execution means executes the first authentication process. If the third determination means determines that the specific conditions are not met, the first execution means does not execute the first authentication process. A communication device according to any one of items 1 to 13, characterized by the features described herein. (Item 15) It further includes a printing means for printing an image onto a recording medium. A communication device according to any one of items 1 to 14, characterized by the features described herein. (Item 16) A method for controlling a communication device, A receiving step in which a request for a network connection for remote operation of the aforementioned communication device is received from an information processing device, The first execution step includes performing a first authentication process to establish a network connection for remote operation between the information processing device and the communication device, Upon receiving the aforementioned request, and based on the fulfillment of specific conditions, a network connection for remote operation is established between the communication device and the information processing device without performing the first authentication process. Based on the failure to meet the aforementioned specific conditions, the system is controlled to establish a network connection for remote operation between the communication device and the information processing device by executing the first authentication process. A method for controlling a communication device, characterized by the features described above. (Item 17) The computer of the communication device, A receiving means that receives a request from an information processing device for a network connection for remote operation of the aforementioned communication device. It functions as a first execution means that performs a first authentication process for establishing a network connection for remote operation between the information processing device and the communication device, Upon receiving the aforementioned request, and based on the fulfillment of specific conditions, a network connection for remote operation is established between the communication device and the information processing device without performing the first authentication process. Based on the failure to meet the aforementioned specific conditions, the system is controlled to establish a network connection for remote operation between the communication device and the information processing device by executing the first authentication process. A program characterized by the following features.

[0181] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]

[0182] 102 Communication device: 103 Mobile terminal: 202 CPU: 203 RAM: 204 ROM: 320 VNC server: 520 VNC client:

Claims

1. A communication device, A first receiving means that receives a request for a network connection for remote operation of the communication device from an information processing device, The system comprises a first execution means for performing a first authentication process to establish a network connection for remote operation between the information processing device and the communication device, Upon receiving the aforementioned request, and based on the fulfillment of specific conditions, a network connection for remote operation is established between the communication device and the information processing device without executing the first authentication process. Based on the failure to meet the aforementioned specific conditions, the system is controlled to establish a network connection for remote operation between the communication device and the information processing device by executing the first authentication process. A communication device characterized by the following features.

2. The system further comprises a second execution means for performing a second authentication process for using the aforementioned communication device. The communication device according to feature 1.

3. If the second authentication process for using the communication device is performed, and the specific conditions are met, the second authentication process is not performed, The communication device according to feature 2.

4. The system further includes a first setting means for setting whether or not to perform the first authentication process when the second authentication process for using the communication device is performed, If the second authentication process is performed and the setting is not to perform the first authentication process, the specific condition is met, and if the setting is to perform the first authentication process, the specific condition is not met. The communication device according to feature 2.

5. The system further comprises a second setting means for determining whether or not to perform the second authentication process for using the communication device, The communication device according to feature 3 or 4.

6. The second authentication process described above is: This includes processing to limit the users who can use the aforementioned communication device, The communication device according to feature 2.

7. The system further comprises a first registration means for registering authentication information used in the second authentication process, The second authentication process described above is: The system includes a process for receiving authentication information from a user and determining whether the received authentication information matches the authentication information registered by the first registration means. The communication device according to feature 2.

8. A second registration means for registering operational authority for remotely controlling the aforementioned communication device, The system further includes a first determination means for determining whether the user using the communication device is a user with the necessary operating privileges, once the network connection has been established and authentication in the second authentication process has been successful. The system is controlled to allow remote operation of the communication device based on whether the user is determined to have the aforementioned operational authority, and to deny remote operation of the communication device based on whether the user is determined to not have the aforementioned operational authority. The communication device according to feature 2.

9. Based on the determination by the first determination means that the user does not have the necessary operating privileges, the network connection is disconnected. The communication device according to feature 8.

10. Based on the determination by the first determination means that the user has the operation authority, the information on the screen displayed by the display means of the communication device is transmitted to the information processing device via the network connection. The communication device according to feature 8.

11. The system further includes a second determination means for determining whether the second authentication process was performed based on remote control of the communication device, if the authentication in the second authentication process is successful. The first determination means is, If the second determination means determines that the second authentication process was performed based on remote operation of the communication device, it is determined whether the user using the communication device is a user with the operation authority. The communication device according to feature 8.

12. The first authentication process is, This is a process based on the RFB protocol. The communication device according to feature 1.

13. The system further comprises a second registration means for registering authentication information used in the first authentication process, The first authentication process is, The information processing device receives authentication information input by a user from the information processing device, and includes a process to determine whether the authentication information received from the information processing device matches the authentication information registered by the second registration means. The communication device according to feature 1.

14. The system further comprises a third determination means for determining whether or not the aforementioned specific conditions are met, If the third determination means determines that the specific conditions are met, the first execution means executes the first authentication process. If the third determination means determines that the specific conditions are not met, the first execution means does not execute the first authentication process. The communication device according to feature 1.

15. It further includes a printing means for printing an image onto a recording medium. The communication device according to feature 1.

16. A method for controlling a communication device, A receiving step in which a request for a network connection for remote operation of the aforementioned communication device is received from an information processing device, The first execution step includes performing a first authentication process to establish a network connection for remote operation between the information processing device and the communication device, Upon receiving the aforementioned request, and based on the fulfillment of specific conditions, a network connection for remote operation is established between the communication device and the information processing device without executing the first authentication process. Based on the failure to meet the aforementioned specific conditions, the system is controlled to establish a network connection for remote operation between the communication device and the information processing device by executing the first authentication process. A method for controlling a communication device, characterized by the features described above.

17. The computer of the communication device, A receiving means that receives a request from an information processing device for a network connection for remote operation of the aforementioned communication device. It functions as a first execution means that performs a first authentication process for establishing a network connection for remote operation between the information processing device and the communication device, Upon receiving the aforementioned request, and based on the fulfillment of specific conditions, a network connection for remote operation is established between the communication device and the information processing device without executing the first authentication process. Based on the failure to meet the aforementioned specific conditions, the system is controlled to establish a network connection for remote operation between the communication device and the information processing device by executing the first authentication process. A program characterized by the following features.

Images