Image processing apparatus, information processing apparatus, system, method for controlling the same, and program

Abstract

To improve usability when a function of remotely operating an apparatus is used.SOLUTION: A VNC server 320 of an image forming apparatus 102 provides a VNC client 520 of a PC 101 with a URL for calling, from a web server 330, a function for performing an alternative operation of an operation that can be performed from an operation screen based on screen information being provided by the VNC server 320 (S905-S909). The VNC client 520 of the PC 101 displays the URL received from the VNC server 320, and notifies a web browser 530 of the URL in response to an instruction related to the URL. The web browser 530 sends a HTTP request to the web server 330 of the image forming apparatus 102 by using the URL.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The present invention relates to an image processing apparatus, an information processing apparatus, a system, a control method thereof, and a program. [Background technology]

[0002] A function for remotely controlling a device is known. The function for remotely controlling a device is, for example, a remote operation function, which is realized by using software such as VNC (Virtual Network Computing). VNC server software is started on the server side, and VNC client software is started on the client side to connect to the server and perform remote control. RFB (Remote FrameBuffer) protocol (RFC6143) is used for communication between the VNC server and the VNC client. For example, a device with a VNC server function transmits screen information of an operation screen to a terminal with a VNC client function. The terminal displays a screen that is the same as the operation screen displayed on the operation panel of the device with the VNC server function. Then, a user can operate the device on the screen displayed on the terminal, without operating the operation panel of the device, to execute processing.

[0003] Patent Document 1 discloses a technique for displaying a screen on the operation unit of an image forming apparatus, when an abnormality is detected in the operation unit, which prompts the user to access the image forming apparatus via VNC. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-191501 A Summary of the Invention [Problem to be solved by the invention]

[0005] When a function for remotely operating a device is used, there is a demand for further improvement in usability.

[0006] The present invention has been made to solve the above-mentioned problems, and has an object to further improve usability when a function for remotely operating a device is used. [Means for solving the problem]

[0007] The present invention is an image processing device comprising: a first providing means for providing screen information of an operation screen displayed on an operation unit of the image processing device to an external device connected via a network, and for providing a function of receiving operation information corresponding to an operation on the screen from the external device which displays a screen corresponding to the operation screen based on the screen information; and a second providing means different from the first providing means for providing a function for operating the image processing device from the external device, wherein the first providing means further provides to the external device identification information for calling from the second providing means a function for performing an alternative operation to an operation possible from an operation screen based on the screen information being provided by the first providing means. Effect of the Invention

[0008] According to the present invention, it is possible to improve usability when a function for remotely operating a device is used. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an information processing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of a hardware configuration of an image forming apparatus. [Diagram 3] FIG. 2 is a diagram showing an example of a software configuration of an image forming apparatus. [Figure 4] FIG. 2 is a diagram showing an example of the hardware configuration of a PC. [Diagram 5] FIG. 2 is a diagram showing an example of the software configuration of a PC. [Figure 6]4A and 4B are diagrams showing examples of screens displayed on a display / operation unit of the image forming apparatus. [Figure 7] FIG. 13 is a diagram showing an example of a screen displayed on a VNC client of a PC. [Figure 8] FIG. 13 is a diagram showing an example of a destination data input screen displayed on a web browser of a PC. [Figure 9] 5 is a flowchart for explaining a process of a VNC server in the image forming apparatus according to the first embodiment. [Figure 10] FIG. 13 is a diagram illustrating a display screen-RUI correspondence table. [Figure 11] 6 is a flowchart for explaining a process of a VNC client in a PC according to the embodiment. [Figure 12] FIG. 4 is a diagram showing an example of a Remote UI top page displayed on a web browser of a PC. [Figure 13] FIG. 4 is a diagram showing an example of a login screen displayed on a display / operation unit of the image forming apparatus. [Figure 14] FIG. 4 is a diagram showing user session information. [Figure 15] 10 is a flowchart illustrating a process of a VNC server in an image forming apparatus according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. Note that the following embodiments do not limit the invention according to the claims, and not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention. In addition, the following embodiments will be described using an image forming apparatus as an example of an information processing apparatus, but the present invention is not limited to this.

[0011] [First embodiment] FIG. 1 is a diagram showing an example of the configuration of an information processing system according to an embodiment of the present invention. An image forming apparatus 102 and a personal computer (PC) 101 are communicatively connected to a LAN (Local Area Network) 105. If the image forming apparatus 102 or the PC 101 has a wireless communication function, the LAN 105 may be configured as a wireless LAN, or may be configured as a wired LAN and a wireless LAN. The image forming apparatus 102 has a VNC (Virtual Network Computing) server function and a web server function. The PC 101 is an information processing apparatus having a VNC client function and a web browser function.

[0012] In this embodiment, an example will be described in which a PC 101 having a VNC client function and a web browser function connects to an image forming apparatus 102 having a VNC server function and a web server function. However, the connecting client may be another device (such as a mobile terminal or another image forming apparatus) as long as it has a VNC client function and a web browser function.

[0013] Hereinafter, the image forming apparatus 102 operating as a VNC server and a web server function will be referred to as a "server." Also, an information processing apparatus such as the PC 101 connected to this server will be referred to as a "client."

[0014] First, the remote operation function will be described. Image forming apparatus 102, which has a VNC server function, transmits screen information corresponding to a screen displayed on the display unit of its own apparatus to a client. The client, which receives the screen information, displays the same screen as that displayed on image forming apparatus 102 based on the received screen information. When an operation is performed on the screen displayed on the client, the operation information is transmitted to image forming apparatus 102, and image forming apparatus 102 performs processing according to the operation. In other words, the client can remotely operate image forming apparatus 102 by establishing a VNC connection to image forming apparatus 102.

[0015] First, the image forming apparatus 102 starts VNC server software. Then, the image forming apparatus 102 waits for a connection request from a client. The PC 101 starts VNC client software. Then, the PC 101 connects to the image forming apparatus 102 in response to a user operation or the like. Communication between the server and the client is performed according to the RFB (Remote Frame Buffer) protocol. The RFB protocol first performs a handshake process, and after the handshake process is completed, screen information and operation information are transmitted and received.

[0016] Next, the remote UI function will be described. It is widely known that image forming devices have a web server function and enable communication with a web browser running on the client side using the HTTP protocol. In such image forming devices, it is possible to use the client side web browser to check the status of the image forming device (information on whether it is running or not, job status, etc.) and various setting information, and to change various setting values. This function is called the remote UI function. When an image forming apparatus 102 having a web server function receives a request from a client's web browser, the image forming apparatus 102 processes the requested URL and transmits web page data written in HTML, a script language, or the like to the client. The client's web browser creates and displays a screen based on the web page data received from the server. At this time, communication between the image forming apparatus 102 and the client's web browser is performed according to the HTTP protocol. This makes it possible to use the client's web browser to check the status of the image forming apparatus 102 (information on whether it is operating, job status, etc.) and various setting information, and to change various setting values.

[0017] Here, with the above-mentioned remote operation function, the screen displayed on the operation panel of the image forming device is displayed on the client as is, so that the same operability as operating on the operation panel of the image forming device can be provided to the user on the client side. In this respect, the remote operation function may be easier to use than the remote UI function. However, there are some cases where using the remote UI function is easier than using the remote operation function, such as when inputting character strings on various setting screens of the image forming device. When inputting character strings using the remote operation function, a soft keyboard screen that is displayed on the screen of the image forming device is displayed on the client side, and input operations are performed on that screen, but inputting characters using a soft keyboard is more difficult than inputting characters using a general hardware keyboard. On the other hand, when inputting text using the Remote UI function, input operations can be performed using the hard keyboard of the client PC that is normally used, making operation easier. Input can also be performed by copy and paste from other software running on the client PC. In addition, since the operation screen of the client PC is generally larger than the operation screen of the image forming device, using the Remote UI function for the job history display screen, etc., can display a larger number of jobs on one screen, providing a higher level of visibility and making operation easier.

[0018] In this way, depending on the operation, other remote operation functions such as the remote UI function may be easier to operate than the remote operation function. However, conventional devices do not have a mechanism for appropriately guiding a user who is using a remote operation function from an external device to another remote operation function (for example, a remote UI function). In this embodiment, a mechanism is provided that can appropriately guide a user who is using a remote operation function from an external device to another remote operation function (e.g., a remote UI function) that allows the user to perform operations equivalent to those on a screen displayed by the remote operation function. This makes it possible to appropriately guide a user who is using a remote operation function from an external device to another remote operation function that allows the user to perform operations equivalent to those on a screen displayed by the remote operation function. As a result, it is possible to improve user convenience.

[0019] FIG. 2 is a diagram illustrating an example of a hardware configuration of the image forming apparatus 102. As shown in FIG. In the controller unit 201 in the image forming apparatus 102, a CPU 202 is a computing device that controls the entire system. The CPU 202 comprehensively controls each device connected to a system bus 212.

[0020] The ROM 204 is a non-volatile memory that stores image data and other data, as well as various programs for operating the CPU 202. The RAM 203 is a volatile memory that is used as a temporary storage area such as the main memory and work area of ​​the CPU 202. The RAM 203 also stores programs and data such as an operating system (OS), system software, and application software.

[0021] The CPU 202 loads a program stored in the ROM 204 or the like into the RAM 203 and executes the program to control each unit of the image forming apparatus 102. Note that the program for the CPU 202 to operate is not limited to the one stored in the ROM 204, and may be one stored in advance in the HDD 205 or the like.

[0022] The HDD (Hard Disk Drive) 205 stores the OS, system software, application software, image data, setting data, etc. Note that other storage devices such as SSDs (Solid State Drives), SD memory cards, and eMMCs (embedded MultiMediaCards) may be used instead of or in combination with the HDD (Hard Disk Drive) as long as they can store similar data.

[0023] The display / operation unit I / F 206 is an interface with the display / operation unit 207, and outputs information to be displayed on the display / operation unit 207 to the display / operation unit 207. The display / operation unit I / F 206 also accepts information input by the user from the display / operation unit 207. The display / operation unit 207 is equipped with hard keys and a touch panel for accepting user operations.

[0024] A network I / F 208 is connected to a network (LAN) 105, and communicates with the PC 101 and the like connected to the same LAN. The device I / F 209 connects the scanner 210 and printer 211, which are image input / output devices, to the controller unit 201, and inputs and outputs image data. In other words, the device I / F 209 inputs and outputs data when printing image data on paper, scanning an original, etc. Here, the image processing apparatus of this embodiment is an image forming apparatus 102 having functions such as copying, printing, and scanning, but is not limited to this. For example, the image processing apparatus may have only a scanning function, only a printing function, or may further have other functions such as a facsimile function.

[0025] FIG. 3 is a diagram showing an example of the software configuration of the image forming apparatus 102. As shown in FIG. Each function of the system software 301 shown in FIG. 3 is realized by the CPU 202 executing a program stored in any one of the storage devices, the RAM 203, the ROM 204, and the HDD 205.

[0026] A job control processing unit 302 controls each software module including an application 310, and controls jobs executed by the image forming apparatus 102, such as copying, printing, and scanning. The scan processing unit 303 controls the scanner 210 via the device I / F 209 based on an instruction from the job control processing unit 302 , and performs processing to read a document placed on the document platen of the scanner 210 . A print processing unit 304 controls a printer 211 via a device I / F 209 based on an instruction from a job control processing unit 302, and performs printing of a specified image.

[0027] The operation input analysis unit 305 analyzes information supplied from the display / operation unit 207 via the display / operation unit I / F 206, and notifies an event corresponding to a user operation to the event processing unit 307. The information analyzed by the operation input analysis unit 305 is operation information indicating that the user has pressed a hard key or a touch panel.

[0028] An event analysis unit 306 receives and analyzes various events occurring in the image forming apparatus 102 other than operation input from the job control processing unit 302 or the like, and notifies an event corresponding to the event to an event processing unit 307. The various events analyzed by the event analysis unit 306 are events other than those occurring due to user operations, such as the end of a job or a shortage of printing paper.

[0029] The event processing unit 307 receives an event from the operation input analysis unit 305, the event analysis unit 306, the operation information receiving unit 322, the application 310, etc. The event processing unit 307 notifies the job control processing unit 302, the screen generation unit 308, or the application 310 of the event in response to the event, and controls each unit of the image forming apparatus 102.

[0030] The screen generation unit 308 performs processing for generating data of a screen to be displayed on the display / operation unit 207 or the display unit of an external device on the RAM 203. The screen generation unit 308 also holds an ID for uniquely identifying the generated screen. The screen display unit 309 reads the screen data generated by the screen generation unit 308 from the RAM 203 , and performs display control to display the data on the display of the display / operation unit 207 via the display / operation unit I / F 206 .

[0031] The application 310 is a group of applications that run on the image forming apparatus 102, and receives instructions from a user via the event processing unit 307 or the web server 330, and performs predetermined processing such as notifying the event processing unit 307 of an event for controlling a job in accordance with the instructions. For example, the image forming apparatus 102 has the following applications:

[0032] An application corresponding to a “copy” function that reads an image on a document using the scanner 210 and prints the generated image data using the printer 211. An application corresponding to a "print" function that prints image data on the printer 211 based on a print job input from an external device such as the PC 101. An application that supports a “scan and send” function that reads an image on a document using the scanner 210 and transmits the generated image data to an external device via the network I / F 208. The applications held by the image forming apparatus 102 are not limited to those mentioned above, and applications can be added later at the user's instruction.

[0033] The authentication / access restriction processing unit 311 performs a process of authenticating a user and a process of restricting access for each authenticated user.

[0034] The VNC server 320 is a software module for performing VNC communication with a client via the LAN 105. For example, it communicates with a VNC client 520 (FIG. 5) running on the PC 101 and performs processing for accepting remote operations.

[0035] In the VNC server 320, a connection processing unit 321 accepts a connection request from, for example, a connection processing unit 521 (FIG. 5) of a VNC client 520, and performs connection control. The operation information receiving unit 322 receives operation information from, for example, an operation information transmitting unit 522 (FIG. 5) of the VNC client 520, and notifies the event processing unit 307 of an event corresponding to a user operation. The screen transmission unit 323 reads the screen data generated by the screen generation unit 308 from the RAM 203 and transmits it to the screen reception unit 523 of the VNC client 520 (FIG. 5).

[0036] Furthermore, the VNC server 320 of this embodiment has a URL information transmitting unit 324. The URL information transmitting unit 324 transmits, to a URL information receiving unit 524 (FIG. 5) of the VNC client 520, a URL for executing (calling) an operation equivalent to an operation possible on the screen generated by the screen generating unit 308 and displayed on the screen display unit 309, using a remote UI function. The URL information transmitting unit 324 will be described in detail later.

[0037] Web server 330 is a software module for performing HTTP communication with a client via LAN 105. For example, it communicates with web browser 530 (FIG. 5) running on PC 101 and performs processing to provide a remote UI function. Specifically, web server 330 receives an HTTP request from web browser 530, analyzes the HTTP request, controls application 310 in response to the request, and responds with web page data as an HTTP response.

[0038] FIG. 4 is a diagram illustrating an example of the hardware configuration of the PC 101. A CPU 401, a ROM 402, a RAM 403, an input unit 404, a display control unit 405, an external memory I / F 406, and a communication I / F controller 407 are connected to a system bus 420. A keyboard 408 and a mouse 409 are also connected via the input unit 404, a display 410 is connected via the display control unit 405, and an external memory 411 is connected via the external memory I / F 406. The units connected to the system bus 420 are configured to be able to exchange data with each other via the system bus 420.

[0039] The ROM 402 is a non-volatile memory, and image data and other data, various programs for operating the CPU 401, and the like are stored in respective predetermined areas. The RAM 403 is a volatile memory, and is used as a temporary storage area such as a main memory or a work area for the CPU 401.

[0040] The CPU 401 uses the RAM 403 as a work memory in accordance with a program stored in, for example, the ROM 402 to control each unit of the PC 101. Note that the program for the operation of the CPU 401 is not limited to being stored in the ROM 402, and may be stored in advance in an external memory (such as a hard disk) 411.

[0041] The input unit 404 receives a user operation, generates a control signal corresponding to the operation, and supplies the control signal to the CPU 401. A keyboard 408 and a mouse 409 are connected to the input unit 404 as input devices that receive the user operation. The CPU 401 controls each part of the PC 101 according to a program based on the control signal generated and supplied by the input unit 404 in response to the user operation performed on the input device. This makes it possible to cause the PC 101 to perform an operation corresponding to the user operation.

[0042] The display control unit 405 outputs a display signal for displaying an image on the display 410. For example, a display control signal generated by the CPU 401 in accordance with a program is supplied to the display control unit 405. The display control unit 405 generates a display signal based on the display control signal and outputs the display signal to the display 410. For example, the display control unit 405 causes the display 410 to display a GUI screen constituting a GUI (Graphical User Interface) based on the display control signal generated by the CPU 401.

[0043] An external memory 411, such as an HDD, SSD, flexible disk, CD, DVD, or memory card, can be attached to the external memory I / F 406. Under the control of the CPU 401, data is read from the attached external memory 411 and data is written to the external memory 411. A communication I / F controller 407 performs communication with various networks 105 such as a LAN, the Internet, wired networks, wireless networks, etc., based on the control of the CPU 401.

[0044] FIG. 5 is a diagram illustrating an example of the software configuration of the PC 101. The functions of the software modules shown in FIG. 5 are realized by the CPU 401 executing a program stored in any one of the storage devices, the RAM 403, the ROM 402, and the external memory 411.

[0045] The VNC client 520 is a software module for remotely controlling the image forming apparatus 102 by communicating with the VNC server 320 running on the image forming apparatus 102 via the LAN 105 .

[0046] In the VNC client 520, a connection processing unit 521 receives a request from a user, transmits a connection request to the connection processing unit 321 of the VNC server 320, and performs connection processing. The operation information transmitting unit 522 transmits operation instructions input by the user via the keyboard 408 or mouse 409 to the operation information receiving unit 322 of the VNC server 320 . The screen receiving unit 523 receives screen data from the screen transmitting unit 323 of the VNC server 320 , and displays the screen on the display 410 via the display control unit 115 .

[0047] By the processing of each software module as described above, the same screen as that displayed on the display of the display / operation unit 207 of the image forming apparatus 102 is also displayed on the display 410 of the PC 101. Then, the user can operate that screen from the PC 101 to cause the image forming apparatus 102 to execute various processes remotely (remote operation function).

[0048] Furthermore, VNC client 520 of this embodiment has a URL information receiving unit 524. URL information receiving unit 524 receives URL information sent from URL information sending unit 324 of VNC server 320, and displays the received URL on display 410 of PC 101. Details of the processing of URL information receiving unit 524 will be described later.

[0049] The web browser 530 is a commonly known web browser application that is capable of HTTP communication with a web server. It communicates with the web server 330 running on the image forming apparatus 102 and displays each screen provided by the remote UI function of the image forming apparatus 102.

[0050] 6 is a diagram showing an example of a screen displayed on the display / operation unit 207 of the image forming apparatus 102. Here, a screen for inputting destination data in a destination table held in the image forming apparatus 102 will be described as an example.

[0051] Fig. 6(a) shows a screen that is called up when inputting destination data in a destination table held in the image forming apparatus 102. Button 601 is a name input button, and when this button is pressed by the user, a soft keyboard screen shown in Fig. 6(b) is called up. The user inputs the name of the destination using the displayed soft keyboard and presses OK button 610. When OK button 610 is pressed, the screen returns to that of Fig. 6(a). At this time, the name input on the soft keyboard as described above is set in name input area 604.

[0052] Button 602 is an address input button, and when this button is pressed by the user, the soft keyboard screen shown in Fig. 6(b) is called up, as in the case of name input button 601. The user inputs an address using the displayed soft keyboard and presses OK button 610. When the screen returns to that of Fig. 6(a), the address input using the soft keyboard as described above is set in address input area 605.

[0053] The user sets the name and address and presses the OK button 603. When the OK button 603 is pressed, destination data according to the input settings is generated and stored in the image forming apparatus .

[0054] FIG. 7 is a diagram showing an example of a screen displayed on the screen of PC 101 when the VNC client 520 of PC 101 is operated to connect to image forming apparatus 102 while the screen of FIG. 6(a) is being displayed on image forming apparatus 102.

[0055] Area 701 is a received screen data display area, and displays the screen data received by image receiving unit 523, i.e., the same screen as the screen (FIG. 6(a)) displayed on display / operation unit 207 of image forming apparatus 102. By operating each button on the screen displayed in area 701, the user can perform operations equivalent to those performed on each screen in FIG. 6. That is, when the name input button or address input button is pressed, a soft keyboard screen such as that shown in FIG. 6(b) is called up, and the user can use the displayed soft keyboard to input the name or address of the destination.

[0056] An area 702 is a URL information display area, in which the URL information receiving unit 524 displays the URL notified of by the URL information transmitting unit 324 of the image forming apparatus. In this example, a URL for executing an operation for inputting destination data using the remote UI function is displayed in the URL information display area 702.

[0057] When the user presses URL information display area 702, VNC client 520 notifies web browser 530 of the URL information displayed in URL information display area 702. Web browser 530 transmits an HTTP request to the notified URL. Web server 330 of image forming apparatus 102 receives the HTTP request and transmits the corresponding Web page data to web browser 530 as an HTTP response. Web browser 530 displays a screen (for example, a screen as shown in FIG. 8) in accordance with the response.

[0058] FIG. 8 is a diagram showing an example of a screen displayed on web browser 530 when a URL for executing an operation for inputting destination data is specified.

[0059] Area 801 is a name input area, and area 802 is an address input area. The user inputs information into each area using keyboard 408 and mouse 409, and presses OK button 803. This operation causes an HTTP request to be sent from web browser 530 to web server 330, and a destination corresponding to the settings input into each area can be generated and stored in image forming apparatus 102. In other words, the remote UI function can be used to perform operations equivalent to those performed on a screen (such as the screen shown in FIG. 6) displayed in area 701 of VNC client 520. Note that input into name input area 801 and address input area 802 can also be performed by copy and paste operations from other software running on PC 101.

[0060] 9 is a flowchart for explaining the processing of the VNC server 320 in the image forming apparatus 102 according to the first embodiment. Each processing of this flowchart is realized by the CPU 202 reading into the RAM 203 a program for implementing each control module stored in the ROM 204 or the HDD 205 and executing the program.

[0061] First, in S901, the CPU 202 determines whether or not operation information has been received. The operation information received here is an operation instruction input by the user via the keyboard 408 or mouse 409 of the PC 101 and transmitted from the operation information transmitting unit 522 to the operation information receiving unit 322 of the VNC server 320.

[0062] When the operation information is received (Yes in S901), the CPU 202 advances the process to S902. In S902, the CPU 202 processes the operation information received in S901. Specifically, the operation information receiving unit 322 notifies the event processing unit 307 of the received operation information, and the event processing unit 307 controls each unit of the image forming apparatus 102 according to the operation information. Thereafter, the CPU 202 returns the process to S901.

[0063] On the other hand, if no operation information is received (No in S901), the CPU 202 proceeds to S903. In S903, the CPU 202 determines whether a screen transition has occurred. A screen transition may occur, for example, when the operation input analysis unit 305 receives a user operation input, or when the event processing unit 307 receives an event according to the status of a job processed by the job control processing unit 302. Here, if no screen transition occurs (No in S903), the CPU 202 returns the process to S901.

[0064] On the other hand, if a screen transition has occurred (Yes in S903), CPU 202 advances the process to S904. In S904, CPU 202 transmits screen information to VNC client 520. Specifically, screen transmission unit 323 reads the screen data generated by screen generation unit 308 from RAM 203, and transmits the read screen data to screen reception unit 523 of VNC client 520.

[0065] Next, in S905, the CPU 202 searches for the "display screen-RUI correspondence table." The "display screen-RUI correspondence table" is held in advance in the ROM 204 or HDD 205 of the image forming apparatus 102. Here, the "screen-RUI correspondence table" will be described.

[0066] FIG. 10 is a diagram showing a schematic diagram of the "screen-RUI correspondence table." Column 1001 indicates a display screen, column 1002 indicates an ID for uniquely identifying the display screen, and column 1003 indicates a path (URL) for executing (calling) an operation equivalent to an operation possible on the display screen (alternative operation) using the remote UI function. For example, line 1010 indicates that the path of the remote UI for performing operations equivalent to those available on the destination data input screen using the remote UI function is " / address_edit."

[0067] Returning now to the explanation of the flowchart in FIG. In the above S905, the CPU 202 searches whether or not there is anything in column 1002 of the "display screen-RUI correspondence table" that matches the ID of the currently displayed screen.

[0068] Next, in S906, the CPU 202 determines whether or not a corresponding path (URL) of the remote UI (i.e., a path that matches the ID of the currently displayed screen) has been found as a result of the search in S905. If a path has been found (Yes in S906), the CPU 202 advances the process to S907.

[0069] In S907, CPU 202 generates corresponding URL information. Specifically, the URL information is generated by concatenating the IP address of the own device held by network I / F 208 with the path found in the "display screen-RUI correspondence table." For example, if the IP address of the own device is "192.168.0.1" and the screen being displayed is an address edit screen (screen ID=3) as shown in FIG. 6, URL information "http: / / 192.168.0.1 / address_edit" is generated. When this URL is requested by the web browser, web server 330 responds with web page data for displaying a screen as shown in FIG. 8.

[0070] On the other hand, if there is no corresponding path (No in S906), the CPU 202 advances the process to S908. In S908, CPU 202 generates URL information for the remote UI top page. For example, if the IP address of the device itself is "192.168.0.1", URL information "http: / / 192.168.0.1 / " is generated. When this URL is requested from a web browser, web server 330 responds with web page data for displaying a remote UI top screen such as that shown in FIG. FIG. 12 is a diagram showing an example of the remote UI top page.

[0071] After the process of S907 or S908, the CPU 202 advances the process to S909. In S909, the CPU 202 transmits the URL information generated in S907 or S908 to the connected VNC client. The URL information may be transmitted as ServerCutText data defined in the RFB protocol, or may be transmitted as unique extended data not defined in the RFB protocol. After the process of S909, the CPU 202 returns the process to S901.

[0072] 11 is a flowchart for explaining the processing of the VNC client 520 in the PC 101 of this embodiment. Each process of this flowchart is realized by the CPU 401 reading into the RAM 403 a program for implementing each control module stored in the ROM 402 or the external memory 411 and executing the program.

[0073] First, in S1101, the CPU 401 determines whether or not screen information has been received. Specifically, the CPU 401 determines whether or not the screen receiving unit 523 has received screen data from the screen transmitting unit 323 of the VNC server 320.

[0074] Here, if it is determined that screen information has been received (Yes in S1101), the CPU 401 advances the process to S1102. In S1102, the CPU 401 displays the received screen data. Specifically, the CPU 401 displays the screen data received by the image receiving unit 523 (i.e., the same screen as the screen displayed on the display / operation unit 207 of the image forming apparatus 102) in the received screen data display area 701. After the process of S1102, the CPU 401 returns the process to S1101.

[0075] Moreover, if screen information has not been received (No in S1101), the CPU 401 advances the process to S1103. In S1103, the CPU 401 determines whether or not a UI operation has been performed. Specifically, it determines whether or not the user has operated the keyboard 408 or the mouse 409 to perform an operation on the screen displayed in the received screen data display area 701.

[0076] Here, if it is determined that a UI operation has been performed (Yes in S1103), the CPU 401 advances the process to S1104. In S1104, the CPU 401 transmits operation information. Specifically, the operation information transmission unit 522 transmits information on the operated key or clicked coordinates as a KeyEvent or PointerEvent of the RFB protocol to the operation information reception unit of the VNC server 320. After the process of S1104, the CPU 401 returns the process to S1101.

[0077] Moreover, if it is determined that no UI operation has been performed (No in S1103), the CPU 401 advances the process to S1105. In S1105, the CPU 401 determines whether or not URL information has been received. Specifically, the CPU 401 determines whether or not URL information receiving unit 524 has received URL information from the URL information transmitting unit 324 of the VNC server.

[0078] Here, when URL information is received (Yes in S1105), the CPU 401 advances the process to S1106. In S1106, the CPU 401 displays the URL information received in S1105 above. Specifically, the received URL information is displayed as link information in the URL information display area 702. After the process of S1106, the CPU 401 returns the process to S1101.

[0079] Moreover, if it is determined that URL information has not been received (No in S1105), the CPU 401 advances the process to S1107. In S1107, CPU 401 determines whether or not the URL information display area has been clicked. Specifically, it determines whether or not the coordinates operated by mouse 409 are within URL information display area 702.

[0080] Here, if it is determined that the URL information display area has been clicked (Yes in S1107), the CPU 401 advances the process to S1108. In S1108, the CPU 401 notifies the web browser 530 of the URL displayed in the URL information display area, and returns the process to S1101. Web browser 530 sends an HTTP request to the notified URL and displays a screen according to the response. For example, when the destination input screen shown in Fig. 7 is displayed, the notified URL is "http: / / 192.168.0.1 / address_edit". When web browser 530 sends an HTTP request to the notified URL "http: / / 192.168.0.1 / address_edit", the screen shown in Fig. 8 is displayed on web browser 530.

[0081] Moreover, if it is determined that the URL information display area has not been clicked (No in S1107), the CPU 401 returns the process to S1101.

[0082] 9 and 11, the image forming apparatus 102 can appropriately guide a user who is using the remote operation function to the remote UI function that allows the user to perform operations equivalent to those available on the screen displayed by the remote operation function. This allows the user to easily use the remote UI function to perform operations equivalent to those available on the screen displayed on the VNC client. As a result, the usability of remotely operating the image forming apparatus can be improved.

[0083] Second Embodiment In the second embodiment, when a user is logged in to the image forming apparatus 102, control is performed so that the same user also logs in to the remote UI function. In the second embodiment, the image forming apparatus 102 is operated with user authentication. When a user uses the image forming apparatus 102, a login operation is first requested. The image forming apparatus 102 determines whether a valid user has logged in, and controls the remote UI function so that only processes permitted to the user can be executed. The same applies when using the remote UI function. That is, when a URL of the remote UI function of the image forming apparatus 102 is accessed using a web browser, the image forming apparatus 102 transmits web page data of a login screen for performing a login operation to a client. The user inputs a user name, a password, and the like from the login screen displayed on the web browser. The image forming apparatus 102 determines whether a valid user has logged in, and controls the remote UI function so that only processes permitted to the user can be executed.

[0084] FIG. 13 is a diagram showing an example of a login screen displayed on the display / operation unit 207 of the image forming apparatus 102. As shown in FIG. In the case where user authentication is performed, when the image forming apparatus 102 is started up, the image forming apparatus 102 displays a login screen as shown in FIG. An area 1301 is a user name input area, and an area 1302 is a password input area. When the user presses either area, the image forming apparatus 102 calls up a soft keyboard screen as shown in Fig. 6(b). The user inputs a user name and password using the displayed soft keyboard. When a login button 1303 is pressed, the image forming apparatus 102 performs authentication processing.

[0085] The authentication process may be performed using a user database stored in advance in the image forming apparatus 102, or may be executed by an authentication server (not shown) located on the LAN 105. Note that instead of having the user input a user name and password, an IC card or biometric authentication may be used.

[0086] When a user logs in, the image forming apparatus 102 stores login session information within the image forming apparatus 102 (eg, in the RAM 203). FIG. 14 is a diagram showing a schematic diagram of login session information held and managed within the image forming apparatus 102. As shown in FIG. In the login session information, a logged-in user name 1404, a logged-in user's authority 1402, and a session ID 1403 for uniquely identifying the session are associated with each other. The session ID is an ID generated during login processing, and is a random character string. When the user logs out, the image forming apparatus 102 discards the login session information as shown in FIG.

[0087] Fig. 15 is a flowchart for explaining the processing of the VNC server 320 in the image forming apparatus 102 of the second embodiment. Each process of this flowchart is realized by the CPU 202 reading into the RAM 203 a program for implementing each control module stored in the ROM 204 or HDD 205 and executing it. In the flowchart of Fig. 15, the same step numbers are assigned to steps that are the same as those in the flowchart of Fig. 9 described in the first embodiment, and the differences will be explained here.

[0088] The process up to S904 is the same as the process in Fig. 9. After S904, in S1501, the CPU 202 acquires login session information. Specifically, the CPU 202 reads out the information shown in Fig. 14 that was held in the image forming apparatus 102 during the login process. After S1501, S905 and S906 are the same as the process in Fig. 9.

[0089] If the answer is Yes in S906, the CPU 202 advances the process to S1502. On the other hand, if the answer is No in S906, the CPU 202 advances the process to S1503. The processes of S1502 and S1503 are similar to the processes of S907 and S908, respectively, except that the processes of S1502 and S1503 add the login session information acquired in S1501 to the generated URL information.

[0090] For example, when userA is logged in and the session information shown in Fig. 14 is held, the URL information generated in S1502 is "http: / / 192.168.0.1 / address_edit?sessionID=xxx123456ABC". Similarly, the URL information generated in S1503 is "http: / / 192.168.0.1 / ?sessionID=xxx123456ABC". It should be noted that S909 is the same as the process in FIG.

[0091] The processing of the VNC client 520 and the web browser 530 is the same as that described in the first embodiment. Therefore, the URL notified to the web browser 530 by the VNC client 520 is the URL to which the login session information is added. Then, the web browser 530 transmits an HTTP request to the URL to which the login session information is added. When the web server 330 receives the HTTP request, it checks the login session information (FIG. 14) held in the image forming apparatus 102. If the requested URL does not contain the login session information or does not match the session ID held in the image forming apparatus 102, the web page data of the login screen is transmitted to the client, and the user is made to execute a login operation.

[0092] On the other hand, if the login session information included in the requested URL matches the session ID stored in the image forming apparatus 102, login processing is performed for the remote UI function by the same user as the user who is logged in to the image forming apparatus 102. Then, the application 310 is controlled in response to the HTTP request, and Web page data is returned as an HTTP response.

[0093] By the process of the above flowchart, when a connection is made from the VNC client 520 while logged in to the image forming apparatus 102, a URL including an ID for identifying the login session is transmitted to the VNC client 520. When the transmitted URL is accessed, the same user as the currently logged-in user can use the remote UI function in a logged-in state, so there is no need to perform a login operation again, which is highly convenient.

[0094] Although the above describes an example of control when remotely operating an image processing device, the present invention can also be applied to control of remote operation of other devices such as network cameras and various network home appliances.

[0095] In the first and second embodiments, the VNC client 520 may be implemented as a web application that runs on the web browser 530. In that case, when the URL information display area 702 is clicked, the web browser 530 may open a tab or a window other than the one displaying the VNC client 520 to display the remote UI. Also, instead of displaying the remote UI when the URL information display area 702 is clicked, when URL information is received, the remote UI may be displayed by automatically accessing the received URL. Also, a link to the remote operation function may be provided on, for example, the top page of the remote UI, so that transition from the remote UI function to the remote operation function is possible.

[0096] As described above, the image forming apparatus 102 of each embodiment has a VNC server 320 that provides a function of providing screen information of an operation screen displayed on an operation unit of the image forming apparatus 102 to the PC 101, which is an external apparatus connected via a network, and receiving operation information according to an operation on the screen from the PC 101 that displays a screen corresponding to the operation screen based on the screen information. The image forming apparatus 102 also has a web server 330 that can provide a function for operating the image forming apparatus 102 from the PC 101. The VNC server 320 further provides the PC 101 with identification information (URL) for calling, from the web server 330, a function for performing an alternative operation to an operation possible from an operation screen based on the screen information being provided by the VNC server 320. Meanwhile, PC 101 has a VNC client 520 that displays an operation screen based on the screen information provided by VNC server 320 and transmits an operation request based on the operation to VNC server 320 in response to an operation on the operation screen. PC 101 also has a web browser 530 that calls a function of web server 330 (makes an HTTP request). VNC client 520 further displays identification information (URL) received from VNC server 320 and notifies web browser 530 of the identification information in response to an instruction related to the identification information. In response to the notification of the identification information, web browser 530 makes an HTTP request to web server 330 using the identification information (calls a function).

[0097] With the above configuration, a user who is using the remote operation function from an external device can be appropriately guided to another remote operation function (a remote UI function in this embodiment) that allows the same operations as those on the screen displayed by the remote operation function. As a result, the convenience for the user can be improved.

[0098] It goes without saying that the configurations and contents of the various data described above are not limited to those described above, and the data may have various configurations and contents depending on the application and purpose. Although one embodiment has been described above, the present invention can be embodied, for example, as a system, an apparatus, a method, a program, a storage medium, etc. Specifically, the present invention may be applied to a system composed of multiple devices, or may be applied to an apparatus composed of a single device. Furthermore, any combination of the above-described embodiments is also included in the present invention.

[0099] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. Furthermore, the present invention may be applied to a system made up of a plurality of devices, or to an apparatus made up of a single device. The present invention is not limited to the above-mentioned embodiment, and various modifications (including organic combinations of the embodiments) are possible based on the spirit of the present invention, and are not excluded from the scope of the present invention. In other words, the present invention includes all configurations that combine the above-mentioned embodiments and their modifications.

[0100] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) An image processing device, a first providing means for providing screen information of an operation screen displayed on an operation unit of the image processing apparatus to an external device connected via a network, and for receiving operation information corresponding to an operation on the screen from the external device which displays a screen corresponding to the operation screen based on the screen information; a second providing means different from the first providing means, the second providing means providing a function for operating the image processing device from the external device, The image processing device is characterized in that the first providing means further provides to the external device identification information for calling, from the second providing means, a function for performing an alternative operation to an operation possible from an operation screen based on the screen information being provided by the first providing means. (Configuration 2) the first providing means is a VNC server, the second providing means is a web server, 2. The image processing device according to configuration 1, wherein the identification information is a URL for causing the web server to execute a process for performing the alternative operation. (Configuration 3) An authentication means for performing user authentication; a management means for managing a login session of a user authenticated by the authentication means, 3. The image processing device according to claim 1, wherein the first providing means includes, in the identification information, information for identifying a login session managed by the management means. (Configuration 4) An information processing device capable of communicating with an image processing device, a control means for displaying an operation screen based on screen information of an operation screen displayed on an operation unit of the image processing device provided from the image processing device, and for transmitting an operation request based on an operation of the operation screen to the image processing device in response to an operation of the operation screen; The information processing device further characterized in that, when the control means receives from the image processing device identification information for calling up a function from the image processing device to perform an alternative operation to an operation possible from the operation screen being displayed, the control means notifies the web browser operating on the information processing device of the identification information. (Configuration 5) The system according to configuration 4, wherein the control means displays the received identification information and notifies the web browser of the identification information in response to a user instruction related to the identification information. (Configuration 6) 6. The information processing device according to configuration 4 or 5, wherein the identification information is a URL for causing a web server of the image processing device to execute a process for performing the alternative operation. (Configuration 7) 7. The information processing device according to any one of configurations 4 to 6, wherein the control means is realized by an application executed on the web browser. (Configuration 8) 8. The information processing device according to any one of configurations 4 to 7, wherein the identification information includes information for identifying a login session of a user authenticated by the image processing device. (Configuration 9) A system in which an image processing device and an external device can communicate with each other, The image processing device includes: a first providing means for providing screen information of an operation screen displayed on an operation unit of the image processing apparatus to an external device connected via a network, and for receiving operation information corresponding to an operation on the screen from the external device which displays a screen corresponding to the operation screen based on the screen information; a second providing means different from the first providing means, the second providing means providing a function for operating the image processing device from the external device, The first providing means further provides, to the external device, identification information for invoking, from the second providing means, a function for performing an alternative operation to an operation possible from an operation screen based on screen information being provided by the first providing means; The external device is a first control means for displaying an operation screen based on the screen information provided by the first providing means, and for transmitting an operation request based on an operation performed on the operation screen to the first providing means; and second control means for calling up a function of the second providing means to enable operation of the image processing device, The first control means further notifies the second control means of the identification information received from the first provision means; The system, wherein the second control means calls a function of the second providing means using the notified identification information. (Configuration 10) The system described in configuration 9, wherein the first control means displays the identification information received from the first providing means, and notifies the second control means of the identification information in response to a user instruction related to the identification information. (Configuration 11) the first providing means is a VNC server, the second providing means is a web server, the identification information is a URL for causing the web server to execute a process for performing the substitute operation, the first control means is a VNC client; The system according to configuration 9 or 10, wherein the second providing means is a web browser. (Configuration 12) The system described in configuration 11, wherein the first control means is realized by an application executed on the web browser. (Configuration 13) The image processing device includes: An authentication means for performing user authentication; a management means for managing a login session of a user authenticated by the authentication means, 13. The system according to any one of configurations 9 to 12, wherein the first providing means includes, in the identification information, information for identifying a login session managed by the managing means. (Method 1) A control method for an image processing device, comprising: a first providing step in which a first providing means provides screen information of an operation screen displayed on an operation unit of the image processing device to an external device connected via a network, and provides a function of receiving operation information corresponding to an operation on the screen from the external device that displays a screen corresponding to the operation screen based on the screen information; a second providing step in which a second providing means different from the first providing means provides a function for operating the image processing device from the external device; The control method for an image processing device, characterized in that in the first providing step, identification information for calling up from the second providing means a function for performing an alternative operation to an operation possible from an operation screen based on the screen information being provided by the first providing means is provided to the external device. (Method 2) A method for controlling an information processing device capable of communicating with an image processing device, comprising: a control step of displaying an operation screen based on screen information of an operation screen displayed on an operation unit of the image processing device provided from the image processing device, and transmitting an operation request based on the operation to the image processing device in response to an operation on the operation screen; The control step further comprises receiving, from the image processing device, identification information for calling up a function for performing an alternative operation to an operation possible from the operation screen being displayed, the identification information being sent to a web browser running on the information processing device, the control method comprising: (Method 3) A method for controlling a system in which an image processing device and an external device can communicate with each other, comprising the steps of: Executed by the image processing device, a first providing step in which a first providing means provides screen information of an operation screen displayed on an operation unit of the image processing device to an external device connected via a network, and provides a function of receiving operation information corresponding to an operation on the screen from the external device that displays a screen corresponding to the operation screen based on the screen information; a second providing step in which a second providing means different from the first providing means provides a function for operating the image processing device from the external device; The first providing step further includes providing, to the external device, identification information for calling, from the second providing means, a function for performing an alternative operation to an operation possible from an operation screen based on screen information being provided by the first providing means; Executed by the external device, a first control step in which a first control means displays an operation screen based on the screen information provided by the first providing means, and transmits an operation request based on an operation performed on the operation screen to the first providing means in response to the operation; a second control step in which a second control means calls a function of the second providing means to enable operation of the image processing device; The first control step further includes notifying the second control means of the identification information received from the first providing means; A system control method, comprising: in the second control step, calling a function of the second providing means by using the notified identification information. (Program 1) A program for causing a computer to function as the first providing means according to any one of configurations 1 to 3. (Program 2) A program for causing a computer to function as the control means according to any one of configurations 4 to 8. [Explanation of symbols]

[0101] 101 PC 102 Image forming device 320 VNC Server 330 Web Server 520 VNC Client 530 Web Browser

Claims

1. An image processing device, a first providing means for providing screen information of an operation screen displayed on an operation unit of the image processing apparatus to an external device connected via a network, and for receiving operation information corresponding to an operation on the screen from the external device which displays a screen corresponding to the operation screen based on the screen information; a second providing means different from the first providing means, the second providing means providing a function for operating the image processing device from the external device, The image processing device is characterized in that the first providing means further provides to the external device identification information for calling up from the second providing means a function for performing an alternative operation to an operation possible from an operation screen based on the screen information being provided by the first providing means.

2. the first providing means is a VNC server, the second providing means is a web server, 2. The image processing apparatus according to claim 1, wherein the identification information is a URL for causing the web server to execute a process for performing the alternative operation.

3. An authentication means for performing user authentication; a management means for managing a login session of a user authenticated by the authentication means, 3. The image processing apparatus according to claim 1, wherein the first providing means includes, in the identification information, information for identifying a login session managed by the management means.

4. An information processing device capable of communicating with an image processing device, a control means for displaying an operation screen based on screen information of an operation screen displayed on an operation unit of the image processing device provided from the image processing device, and for transmitting an operation request based on an operation of the operation screen to the image processing device in response to an operation of the operation screen; The information processing device further characterized in that, when the control means receives from the image processing device identification information for calling up a function from the image processing device to perform an alternative operation to an operation possible from the operation screen being displayed, the control means notifies the web browser operating on the information processing device of the identification information.

5. 5. The system according to claim 4, wherein said control means displays the received identification information and notifies said web browser of the identification information in response to a user instruction relating to the identification information.

6. 5. The information processing apparatus according to claim 4, wherein the identification information is a URL for causing a web server of the image processing apparatus to execute a process for performing the alternative operation.

7. 5. The information processing apparatus according to claim 4, wherein the control means is realized by an application executed on the web browser.

8. 8. The information processing apparatus according to claim 4, wherein the identification information includes information for identifying a login session of a user authenticated by the image processing apparatus.

9. A system in which an image processing device and an external device can communicate with each other, The image processing device includes: a first providing means for providing screen information of an operation screen displayed on an operation unit of the image processing apparatus to an external device connected via a network, and for receiving operation information corresponding to an operation on the screen from the external device which displays a screen corresponding to the operation screen based on the screen information; a second providing means different from the first providing means, the second providing means providing a function for operating the image processing device from the external device, The first providing means further provides, to the external device, identification information for invoking, from the second providing means, a function for performing an alternative operation to an operation possible from an operation screen based on screen information being provided by the first providing means; The external device is a first control means for displaying an operation screen based on the screen information provided by the first providing means, and for transmitting an operation request based on an operation performed on the operation screen to the first providing means; and second control means for calling up a function of the second providing means to enable operation of the image processing device, The first control means further notifies the second control means of the identification information received from the first provision means; The system according to claim 1, wherein the second control means calls a function of the second providing means using the notified identification information.

10. The system according to claim 9, characterized in that the first control means displays the identification information received from the first providing means, and notifies the second control means of the identification information in response to a user instruction related to the identification information.

11. the first providing means is a VNC server, the second providing means is a web server, the identification information is a URL for causing the web server to execute a process for performing the substitute operation, the first control means is a VNC client, 10. The system of claim 9, wherein the second providing means is a web browser.

12. 12. The system according to claim 11, wherein the first control means is realized by an application executed on the web browser.

13. The image processing device includes: An authentication means for performing user authentication; a management means for managing a login session of a user authenticated by the authentication means, The system according to any one of claims 9 to 12, characterized in that the first providing means includes, in the identification information, information for identifying a login session managed by the management means.

14. A control method for an image processing device, comprising: a first providing step in which a first providing means provides screen information of an operation screen displayed on an operation unit of the image processing device to an external device connected via a network, and provides a function of receiving operation information corresponding to an operation on the screen from the external device that displays a screen corresponding to the operation screen based on the screen information; a second providing step in which a second providing means different from the first providing means provides a function for operating the image processing device from the external device; The control method for an image processing device, characterized in that in the first providing step, identification information for calling up from the second providing means a function for performing an alternative operation to an operation possible from an operation screen based on the screen information being provided by the first providing means is provided to the external device.

15. A method for controlling an information processing device capable of communicating with an image processing device, comprising: a control step of displaying an operation screen based on screen information of an operation screen displayed on an operation unit of the image processing device provided from the image processing device, and transmitting an operation request based on the operation to the image processing device in response to an operation on the operation screen; The control step further comprises receiving, from the image processing device, identification information for calling up a function for performing an alternative operation to an operation possible from the operation screen being displayed, the identification information being sent to a web browser running on the information processing device, the control method comprising:

16. A method for controlling a system in which an image processing device and an external device can communicate with each other, comprising the steps of: Executed by the image processing device, a first providing step in which a first providing means provides screen information of an operation screen displayed on an operation unit of the image processing device to an external device connected via a network, and provides a function of receiving operation information corresponding to an operation on the screen from the external device that displays a screen corresponding to the operation screen based on the screen information; a second providing step in which a second providing means different from the first providing means provides a function for operating the image processing device from the external device; The first providing step further includes providing, to the external device, identification information for calling, from the second providing means, a function for performing an alternative operation to an operation possible from an operation screen based on screen information being provided by the first providing means; Executed by the external device, a first control step in which a first control means displays an operation screen based on the screen information provided by the first providing means, and transmits an operation request based on an operation performed on the operation screen to the first providing means in response to the operation performed on the operation screen; a second control step in which a second control means calls a function of the second providing means to enable operation of the image processing device; The first control step further includes notifying the second control means of the identification information received from the first provision means; A system control method, comprising: in said second control step, calling a function of said second providing means using said notified identification information.

17. A program for causing a computer to function as the first providing means according to claim 1 or 2.

18. A program for causing a computer to function as the control means according to any one of claims 4 to 7.

Images