Portable terminal system, information apparatus system, and program

Abstract

To reduce the number of an operator's operations compared with a case where an operator operates and reset an operation screen of an information apparatus system after a reboot.SOLUTION: A CPU 37A of a portable terminal device 30 connects, by using connection information, to an image forming apparatus 20 in which a remote control mode is executed for mirroring an operation screen 22 of the image forming apparatus 20 on a terminal screen 32 to allow remote control of the operation screen 22, logs in to the image forming apparatus 20 by using input log-in information and stores the log-in information, stores the history of operations of the terminal screen 32, when the image forming apparatus 20 is rebooted and the connection is cut off, connects to the rebooted image forming apparatus 20 again by using the connection information, logs in to the image forming apparatus 20 in the remote control mode by using the stored log-in information, and resets to the terminal screen 32 when the connection is cut off by using the stored history of operations.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to a mobile terminal system, an information device system, and a program.

Background Art

[0002] Patent Document 1 discloses a technique related to a remote maintenance system and an information processing method. In this prior art, an image forming apparatus stores user login information and a first interruption screen for resuming from the interrupted location at the time of reconnection in the memory of the image forming apparatus. After the restart process, the user is automatically logged in based on the user login information. When the connection of wireless communication with the mobile terminal is completed, the screen of the image forming apparatus is transitioned to the first interruption screen. The mobile terminal stores authentication information for wireless communication with the image forming apparatus and a second interruption screen for resuming from the interrupted location at the time of reconnection in the memory of the mobile terminal. When the reconnection button is selected, the mobile terminal connects to the image forming apparatus by wireless communication based on the authentication information, and the screen of the mobile terminal is transitioned to the second interruption screen.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When an operator such as an administrator operates the operation screen of an information device to change various settings, restart may be required. However, when the information device is restarted, an operation to restore the operation screen before restart is required after the restart, increasing the number of operations.

[0005] An object of the present invention is to reduce the number of operations of an operator as compared with the case where the operator operates and restores the operation screen of the information device system after restart.

Means for Solving the Problems

[0006] The first aspect is a mobile terminal system having one or more processors. When a remote operation mode in which the operation screen of an information device system is mirrored to a terminal screen to enable remote operation of the operation screen is executed, the processor connects to the information device system using connection information, logs in to the information device system using the input login information and saves the login information, saves the operation history of the terminal screen, and when the information device system restarts and the connection is disconnected, reconnects to the restarted information device system using the connection information, logs in to the information device system using the saved login information, and restores the terminal screen at the time of disconnection using the saved operation history.

[0007] The second aspect is the mobile terminal system according to the first aspect, wherein the processor connects to an access point for remote operation that is activated when the information device system executes the remote operation mode.

[0008] The third aspect is the mobile terminal system according to the second aspect, wherein the processor instructs the information device system to change the setting of the communication interface, instructs the information device system to confirm communication with a communication line using the changed communication interface, and receives a communication result.

[0009] The fourth aspect is the mobile terminal system according to the first aspect, wherein the processor acquires the connection information from the information device system and saves the acquired connection information.

[0010] The fifth aspect is the mobile terminal system according to the fourth aspect, wherein the processor reads a matrix-type two-dimensional code displayed on the operation screen when the information device system executes the remote operation mode to acquire the connection information.

[0011] The sixth aspect is the mobile terminal system according to the fourth aspect, wherein the processor obtains the connection information from the information device system via short-range wireless communication in the mobile terminal system.

[0012] The seventh aspect is the mobile terminal system according to the first aspect, wherein when the processor fails to reconnect to the information device system within a set time, the processor displays a corresponding method on the terminal screen.

[0013] The eighth aspect is an information device system having one or more processors, wherein the processor accepts execution of a remote operation mode in which an operation screen is mirrored on a terminal screen of a connected mobile terminal system so that the operation screen can be remotely operated on the mobile terminal system, accepts login using the login information of the connected mobile terminal system, accepts a restart instruction from the mobile terminal system and restarts, and then accepts login using the login information of the reconnected mobile terminal system. When receiving a logout of the mobile terminal system, the execution of the remote operation mode is terminated.

[0014] The ninth aspect is the information device system according to the eighth aspect, wherein when the processor receives execution of the remote operation mode, the processor disconnects the communication line and activates an access point for remote operation to which the mobile terminal system connects, accepts login using the login information of the mobile terminal system connected to the access point, accepts a restart instruction from the mobile terminal system and restarts, restarts the access point, accepts login using the login information of the mobile terminal system reconnected to the access point, and when receiving a logout of the mobile terminal system, terminates the execution of the remote operation mode, connects to the communication line and terminates the access point.

[0015] In a tenth aspect, when receiving an execution of the remote operation mode, the processor saves pre-execution settings before executing the remote operation mode, and when the mobile terminal system fails to connect to the access point within a set time, ends the execution of the remote operation mode and returns to the saved pre-execution settings. The information device system according to the ninth aspect.

[0016] In an eleventh aspect, when receiving an execution of the remote operation mode, the processor presents connection information for connecting to the access point acquired by the mobile terminal system. The information device system according to the ninth aspect.

[0017] In a twelfth aspect, when receiving an execution of the remote operation mode, the processor displays a matrix-type two-dimensional code having the connection information on the operation screen. The information device system according to the eleventh aspect.

[0018] In a thirteenth aspect, when receiving an execution of the remote operation mode, the processor presents the connection information via short-range wireless communication. The information device system according to the eleventh aspect.

[0019] In a fourteenth aspect, when the mobile terminal system is connected to the access point, the processor ends the presentation of the connection information. The information device system according to the eleventh aspect.

[0020] In a fifteenth aspect, when receiving an instruction to confirm communication to the communication line, the processor connects to the communication line to perform communication confirmation, sends the communication result to the mobile terminal system, and reconnects the communication line. The information device system according to the ninth aspect.

[0021] In a sixteenth aspect, the processor does not receive a job from an external device via the communication line. The information device system according to the fifteenth aspect.

[0022] The seventeenth aspect is the information device system according to the eighth aspect, wherein the processor permits login only with the registered login information.

[0023] The eighteenth aspect is a program for a mobile terminal system that connects to the information device system in which a remote operation mode is executed to mirror an operation screen of the information device system on a terminal screen and enable remote operation of the operation screen, the program causing a computer, which is the mobile terminal system, to execute processing of connecting to the information device system using connection information, logging in to the information device system using the input login information and saving the login information, saving an operation history of the terminal screen, reconnecting to the information device system restarted using the connection information when the information device system restarts and the connection is disconnected, logging in to the information device system using the saved login information, and restoring the terminal screen at the time of disconnection using the saved operation history.

Advantages of the Invention

[0024] According to the mobile terminal system of the first aspect, the number of operations by the operator is reduced as compared with the case where the operator operates and restores the operation screen of the information device system after restart.

[0025] According to the mobile terminal system of the second aspect, security is improved as compared with the case of connecting to the information device system via a communication line.

[0026] According to the mobile terminal system of the third aspect, communication of the communication interface with the settings changed can be confirmed.

[0027] According to the mobile terminal system of the fourth aspect, security is improved as compared with the case where the connection information is stored in advance in the mobile terminal system.

[0028] According to the mobile terminal system of the fifth aspect, the number of operations by the operator is reduced as compared with the case where the operator manually inputs, into the mobile terminal system, the character information in which the connection information is displayed on the operation screen.

[0029] According to the mobile terminal system of the sixth aspect, the number of operations of the operator is reduced as compared with the case where the operator manually inputs the character information in which the connection information is displayed on the operation screen into the mobile terminal system.

[0030] According to the mobile terminal system of the seventh aspect, the operator can respond earlier as compared with the case where the terminal screen remains the operation screen.

[0031] According to the information device system of the eighth aspect, the number of operations of the operator is reduced as compared with the case where the operator operates the operation screen of the information device system after restart and returns it.

[0032] According to the information device system of the ninth aspect, the number of operations of the operator is reduced as compared with the case where the operator operates the operation screen of the information device system after restart and returns it.

[0033] According to the information device system of the tenth aspect, the number of operations of the operator is reduced as compared with the case where the operator operates the operation screen and returns to the pre-execution settings.

[0034] According to the information device system of the eleventh aspect, the security is improved as compared with the case where the connection information is stored in the mobile terminal system in advance.

[0035] According to the information device system of the twelfth aspect, the number of operations of the operator is reduced as compared with the case where the connection information is displayed as character information on the operation screen and the operator manually inputs it into the mobile terminal system.

[0036] According to the information device system of the thirteenth aspect, the number of operations of the operator is reduced as compared with the case where the connection information is displayed as character information on the operation screen and the operator manually inputs it into the mobile terminal system.

[0037] According to the information device system of the fourteenth aspect, the security is improved as compared with the case where the connection information is continuously presented.

[0038] According to the information device system of the fifteenth aspect, communication confirmation of a communication line can be performed.

[0039] According to the information device system of the sixteenth aspect, a job received during communication confirmation does not stop midway due to re-disconnection of a communication line.

[0040] According to the information device system of the seventeenth aspect, security is improved as compared with the case where login is always permitted.

[0041] According to the program of the eighteenth aspect, the number of operations by an operator is reduced as compared with the case where the operator operates and resumes the operation screen of the information device system after restart.

Brief Description of Drawings

[0042]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Mode for Carrying Out the Invention

[0043] <Embodiment> Hereinafter, with reference to the drawings, an example of a mode for carrying out the technology of the present disclosure will be described. In addition, components and processes that perform the same operations, actions, and functions are given the same reference numerals throughout all the drawings, and redundant explanations may be omitted or simplified as appropriate. Each drawing only schematically shows to the extent that the technology of the present disclosure can be sufficiently understood. Therefore, the technology of the present disclosure is not limited only to the illustrated examples. In addition, in this embodiment, configurations not directly related to the present invention and well-known configurations may be omitted or simplified in the description.

[0044] <Remote Operation System> First, the schematic configuration of the remote operation system will be described.

[0045] As shown in FIG. 1, the remote operation system 10 of the present embodiment includes an image forming apparatus 20 as an example of an information device system, a mobile terminal device 30 and a server 50 that constitute the mobile terminal system 16. The mobile terminal device 30 is a portable information device that can be carried and used, and can be used while being held in the hand or worn on the body. For example, it is a notebook computer, a smartphone, a tablet terminal, or the like.

[0046] In the remote operation system 10 of the present embodiment, an operation screen 22 of an image forming apparatus 20 described later is mirrored on a terminal screen 32 of a portable terminal device 30 directly connected to the image forming apparatus 20. Then, an operator PA (see FIG. 6) operates the mirrored terminal screen 32 to remotely operate the operation screen 22 and change the settings of the image forming apparatus 20.

[0047] The image forming apparatus 20 is implemented with a remote operation mode that enables the operation screen 22 to be mirrored on the terminal screen 32 of the portable terminal device 30 for remote operation. Similarly, the portable terminal device 30 is implemented with a remote operation application that enables the operation screen 22 of the image forming apparatus 20 to be mirrored on the terminal screen 32 for remote operation. Note that the mirroring in the present embodiment means that the same screen as the operation screen 22 is projected onto the terminal screen 32 and can be remotely operated on the terminal screen 32, and a technology such as VNC is used.

[0048] <Image forming apparatus> Next, the image forming apparatus of the present embodiment will be described.

[0049] The image forming apparatus 20 has a printing function of receiving various data and the like via a communication line 12 such as a LAN (Local Area Network) and performing image forming processing based on the received data and the like, a reading function of reading a document to obtain image information representing the document, a copying function of copying an image recorded on the document onto a recording medium such as paper, and a facsimile function of transmitting and receiving various data via a telephone line (not shown), and is a so-called multifunction device.

[0050] The image forming apparatus 20 is provided with a touch panel type operation screen 22 that receives various instruction operations by a user by means of a software program and on which various information and the like are displayed. The operation screen 22 receives various instruction operations by the user and displays various information and the like. A matrix type two-dimensional code such as a QR code (registered trademark) can be displayed on the operation screen 22.

[0051] In addition, the image forming apparatus 20 is provided with an IC card reader 24 such as NFC (Near Field Communication). The IC card reader 24 transmits and receives information by short-range wireless communication with a contactless IC card.

[0052] Also, inside the image forming apparatus 20 of the present embodiment, an access point 26 such as Wi-Fi Direct is provided. The access point 26 is dedicated for remote operation in the remote operation mode and can be directly connected to the aforementioned mobile terminal device 30. Note that although the access point 26 of the present embodiment is dedicated for remote operation in this way, the image forming apparatus 20 may have a general access point other than dedicated for remote operation.

[0053] Next, the hardware configuration of the image forming apparatus of the present embodiment will be described.

[0054] As shown in FIG. 2, the image forming apparatus 20 includes a first communication interface 21A, a second communication interface 21B, a third communication interface 21C, an operation unit 21D, a storage device 21E, a reading processing unit 21F, a printing processing unit 21G, and a control unit 28, and these are electrically connected by a system bus 29.

[0055] The first communication interface 21A is a communication interface for connecting the image forming apparatus 20 to the communication line 12 (see FIG. 1). The second communication interface 21B is a communication interface for directly connecting to the mobile terminal device 30 (see FIG. 1) via the access point 26 (see FIG. 1). The third communication interface 21C is a communication interface for connecting to the contactless IC card of the mobile terminal device 30 (see FIG. 1) by short-range wireless communication via the card reader 24 (see FIG. 1).

[0056] The operation unit 21D performs processing related to operations on the operation screen 22 (see FIG. 1). The storage device 21E is composed of an HDD (hard disk drive), an SSD (Solid State Drive), etc., and stores various data and programs such as a remote operation mode. The reading processing unit 21F performs processing related to the reading function of the image forming apparatus 20. The printing processing unit 21G performs processing related to the printing function and the copying function of the image forming apparatus 20.

[0057] As shown in FIG. 3, the control unit 28 includes a CPU (Central Processing Unit) 27A that executes various processes in the image forming apparatus 20, a ROM (Read Only Memory) 27B that stores various programs, a RAM (Random Access Memory) 27C that is used as a temporary work area for the CPU 27A, and an input / output interface (I / O) 27D. The CPU 27A, the ROM 27B, the RAM 27C, and the I / O 27D are each connected via a bus 27E. To the I / O 27D, the first communication interface 21A, the second communication interface 21B, the third communication interface 21C, the operation unit 21D, the storage device 21E, the reading processing unit 21F, and the printing processing unit 21G shown in FIG. 2 described above are electrically connected by a system bus 29.

[0058] As an example of the processor shown in FIG. 3, the CPU 27A is a central processing unit and controls the overall operation of the image forming apparatus 20. The CPU 27A executes various programs such as a remote operation mode and controls each unit. That is, the CPU 27A reads a program from the ROM 27B or the storage device 21E (see FIG. 2) and executes the program using the RAM 27C as a work area.

[0059] <Portable terminal device> Next, the portable terminal device of the present embodiment will be described.

[0060] As shown in Fig. 1, the mobile terminal device 30 is a smartphone or a tablet terminal configured to have a touch panel type terminal screen 32 on the front surface. The mobile terminal device 30 includes a camera, a speaker, a microphone, etc. (not shown) and has a built-in non-contact IC card.

[0061] In addition, the mobile terminal device 30 can install and use various application programs. Note that the mobile terminal device 30 of the present embodiment may operate in cooperation with the server 50 connected to the communication line 12 when executing an application program.

[0062] In the present embodiment, as described above, by installing a remote operation application for remotely operating the image forming apparatus 20 in the mobile terminal device 30, the operator PA (see Fig. 6) can remotely operate the operation screen 22 of the image forming apparatus 20 by operating the terminal screen 32 of the mobile terminal device 30 and change various settings.

[0063] Next, the hardware configuration of the terminal operation device of the present embodiment will be described.

[0064] As shown in Fig. 4, the mobile terminal device 30 includes a first communication interface 31A, a second communication interface 31B, a third communication interface 31C, an operation unit 31D, a camera unit 31E, a speaker unit 31F, a microphone unit 31G, and a control unit 38, which are electrically connected by a system bus 39.

[0065] The first communication interface 31A is a communication interface for connecting the mobile terminal device 30 to the communication line 12 (see Fig. 1). The second communication interface 31B is a communication interface for directly connecting to the access point 26 (see Fig. 1) of the image forming apparatus 20. The third communication interface 31C is a communication interface for connecting to the card reader 24 (see Fig. 1) of the image forming apparatus 20 by short-range wireless communication using a built-in non-contact IC card.

[0066] The operation unit 31D performs processing related to the operation of the terminal screen 32 (see FIG. 1). The camera unit 31E performs processing related to the camera function of the mobile terminal device 30. The speaker unit 31F performs processing related to the speaker function of the mobile terminal device 30. The microphone unit 31G performs processing related to the microphone function of the mobile terminal device 30.

[0067] As shown in FIG. 5, the control unit 38 includes a CPU (Central Processing Unit) 37A that executes various processes in the mobile terminal device 30, a ROM (Read Only Memory) 37B that stores various programs such as a remote operation application, a RAM (Random Access Memory) 37C that is used as a temporary working area for the CPU 37A, and an input / output interface (I / O) 37D. The CPU 37A, ROM 37B, RAM 37C, and I / O 37D are each connected via a bus 37E. To the I / O 37E, the first communication interface 31A, the second communication interface 31B, the third communication interface 31C, the operation unit 31D, the camera unit 31E, the speaker unit 31F, and the microphone unit 31G shown in FIG. 4 described above are electrically connected by a system bus 39.

[0068] As an example of the processor shown in FIG. 5, the CPU 37A is a central arithmetic processing unit and controls the overall operation of the mobile terminal device 30. The CPU 37A executes various programs such as a remote operation application and controls each unit. That is, the CPU 37A reads a program from the ROM 37B and executes the program using the RAM 37C as a working area.

[0069] <Server> Next, the server 50 of the present embodiment will be described.

[0070] FIG. 15 is a block diagram showing the main configuration of the electrical system of the server 50 in the present embodiment. Note that the server 50 basically has the same configuration as a general computer.

[0071] The server 50 includes a CPU 52A, a ROM 52B, a RAM 52C, an HDD 52D, a keyboard 52E, a display 52F, a communication line I / F (interface) section 52G, and the like.

[0072] The CPU 52A controls the overall operation of the server 50. The ROM 52B stores various control programs and various parameters in advance. The RAM 52C is used as a work area when various programs are executed by the CPU 52A. The HDD 52D stores various data and application programs. The keyboard 52E is used to input various information. The display 52F is used to display various information. The communication line I / F section 52G is connected to the communication line 12 (see FIG. 1), and performs transmission and reception of various data with other devices such as the mobile terminal device 30 connected to the communication line 12. Each part of the server 50 is electrically connected to each other by a system bus 52H.

[0073] Note that in the server 50 according to the present embodiment, the HDD 52D is applied as a storage unit, but it is not limited thereto, and other non-volatile storage units such as a flash memory may be applied.

[0074] With the above configuration, the server 50 executes access to the ROM 52B, the RAM 52C, and the HDD 52D, acquisition of various data via the keyboard 52E, and display of various information on the display 52F by the CPU 52A, respectively. Further, the server 50 executes control of transmission and reception of communication data via the communication line I / F section 52G by the CPU 52A.

[0075] <Remote operation>

[0076] Next, the setting change for remotely operating and changing various settings of the image forming apparatus 20 in the remote operation system 10 of the present embodiment shown in FIG. 1 with the portable terminal device 30 will be described. The various settings for changing the image forming apparatus 20 are important settings performed by an operator PA (see FIG. 6) such as an administrator who manages the image forming apparatus 20, and for example, settings of an authentication method, communication settings, and configuration settings of device options.

[0077] Also, as described above, when changing the settings by remotely operating the image forming apparatus 20 by the remote operation system 10, the operation screen 22 is mirrored on the terminal screen 32 of the portable terminal device 30 connected to the image forming apparatus 20. Then, the operator PA (FIG. 6) operates the terminal screen 32 to remotely operate the operation screen 22 and change the settings. Further, the operator activates the remote operation mode of the image forming apparatus 20 and activates the remote operation application of the portable terminal device 30 to perform the remote operation.

[0078] [Overall flow of the process] First, the overall flow of remotely operating using the portable terminal device 30 to change various settings of the image forming apparatus 20 will be described with reference to FIG. 6. The flow of the remote operation in FIG. 6 is from top to bottom. Also, this flow is an example and is not limited to this.

[0079] As shown in FIG. 6, an operator PA such as an administrator who manages the image forming apparatus 20 goes next to the image forming apparatus 20 to be set and operates the operation screen 22 (see FIG. 1) to activate and execute the remote operation mode. When the remote operation mode is executed in the image forming apparatus 20, the communication line 12 is disconnected and the access point 26 dedicated to the remote mode is activated. Since the communication line 12 is disconnected, the image forming apparatus 20 is in a state where it does not accept print jobs and the like from external devices such as a personal computer via the communication line 12. The image forming apparatus 20 stores various setting information when the remote operation mode is executed. That is, thereafter, the setting information before being changed by the operator PA is stored.

[0080] Further, on the operation screen 22 of the image forming apparatus 20, a matrix type two-dimensional code having connection information for connecting to the access point 26 is displayed. The connection information includes an SSID (Service Set Identifier), a password, and the like.

[0081] The operator PA operates the terminal screen 32 of the portable terminal device 30 to start and execute a remote operation application. When the remote operation application is started, the operator PA reads the matrix type two-dimensional code displayed on the operation screen 22 with the camera (not shown) of the portable terminal device 30 to acquire the connection information. The portable terminal device 30 performs a polling search with the read connection information and connects to the access point 26 (step N1 described later). Further, the portable terminal device 30 stores the acquired connection information.

[0082] Note that when the portable terminal device 30 is connected to the access point 26, the display of the matrix type two-dimensional code having the connection information on the operation screen 22 of the image forming apparatus 20 disappears.

[0083] Until the connection to the access point 26 is established, a waiting message such as "Connecting to the access point. Please wait a moment" is displayed on the terminal screen 32 of the portable terminal device 30, and the waiting message disappears when the connection is established. That is, during the polling search, the above-described waiting message is displayed on the terminal screen 32.

[0084] The operator PA operates the terminal screen 32 of the portable terminal device 30 to input login information and log in to the image forming apparatus 20 in which the remote operation mode is being executed. Further, the portable terminal device 30 stores the input login information. The login information includes an ID, a password, and the like. Note that the image forming apparatus 20 cannot be logged in with login information other than the pre-registered login information. In the present embodiment, the pre-registered login information is the ID and password of the operator PA such as an administrator who has the authority to remotely operate the image forming apparatus 20.

[0085] When the mobile terminal device 30 logs in to the image forming apparatus 20 that is executing the remote operation mode, the operation screen 22 (see FIG. 1) of the image forming apparatus 20 is mirrored on the terminal screen 32 of the mobile terminal device 30. Then, the operator PA remotely operates the operation screen 22 of the image forming apparatus 20 by operating the terminal screen 32 of the mobile terminal device 30, and changes the settings of various settings of the image forming apparatus 20 (step N2 described later). The mobile terminal device 30 saves the terminal screen 32 every time the terminal screen 32 is operated and the terminal screen 32 is changed, that is, saves the operation history information of the terminal screen 32.

[0086] In the present embodiment, the above-described connection information, login information, and operation history information are stored in the server 50 that executes the remote operation application in cooperation with the mobile terminal device 30.

[0087] Here, in step N2 in which the operator PA in FIG. 6 described above operates the terminal screen 32 of the mobile terminal device 30 to remotely operate the operation screen 22 of the image forming apparatus 20 and make a setting change, after the setting of the image forming apparatus 20 is changed, it may be necessary to restart in order to reflect the change content. In that case, the operator PA instructs the image forming apparatus 20 to restart from the terminal screen 32 of the mobile terminal device 30.

[0088] Setting changes that require restarting are, for example, authentication method settings, communication settings, and device option configuration settings. In the present embodiment, while the remote operation mode is being executed, the communication line 12 is disconnected except when temporarily connecting as described later. Therefore, setting changes that are performed by downloading a program or the like to the image forming apparatus 20 via the communication line 12 are not made.

[0089] When the image forming apparatus 20 receives an instruction to restart and restarts, the access point 26 (see FIG. 1) once drops and then restarts. Also, the remote operation mode is re-executed with the restart. However, the operation screen 22 (see FIG. 1) returns to the home screen.

[0090] On the one hand, when the image forming apparatus 20 restarts, the access point 26 is disconnected from the mobile terminal device 30. When the connection between the mobile terminal device 30 running the remote operation application and the access point 26 is disconnected, the mobile terminal device 30 performs a polling search using the connection information stored in the server 50 and reconnects to the access point 26. Note that, as in the beginning, until it reconnects to the access point 26, a waiting message such as "Connecting to the access point. Please wait a moment" is displayed on the terminal screen 32, and the waiting message disappears when the connection is established.

[0091] When the mobile terminal device 30 running the remote operation application reconnects to the access point 26, it re-logs in to the image forming apparatus 20 in the remote operation mode using the login information stored in the server 50. Then, when it re-logs in, the mobile terminal device 30 returns to the terminal screen 32 before restart using the operation history information stored in the server 50. As a result, the operation screen 22 of the image forming apparatus 20 that is being mirrored also returns to the screen before restart.

[0092] In this way, after the image forming apparatus 20 restarts, the mobile terminal device 30 running in the remote operation mode automatically reconnects to the access point 26 (step N3 described later), re-logs in, and further traces back to the screen before restart based on the operation history information, restoring the state before restart.

[0093] The operator PA operates the operation screen 22 of the image forming apparatus 20 by operating the terminal screen 32 of the mobile terminal device 30 again, and continues to change the settings of various settings. Note that if a restart is performed again later to reflect the changed content, the above is repeated.

[0094] When the setting change operation is completed, the operator PA operates the terminal screen 32 of the mobile terminal device 30, logs out, and terminates the remote operation application. When the mobile terminal device 30 logs out, the image forming apparatus 20 automatically terminates the execution of the remote operation mode, disconnects the access point 26, and connects to the communication line 12 (see FIG. 1).

[0095] Next, in step N3 of FIG. 6, the process when the operator PA changes the settings of the first communication interface 21A (see FIG. 2) of the image forming apparatus 20 will be described.

[0096] In step N3 of FIG. 6, when the operator PA changes the settings of the first communication interface 21A, the image forming apparatus 20 displays "Change settings" and "Conduct communication test" on the operation screen 22 and prompts the operator PA to make a selection. At this point, the settings of the first communication interface 21A have not been changed yet. Also, "Change settings" and "Conduct communication test" are similarly displayed on the mirrored terminal screen 32.

[0097] When the operator PA selects "Change settings" on the terminal screen 32, the image forming apparatus 20 performs the setting change process. When the operator PA selects "Conduct communication test", the image forming apparatus 20 conducts the communication test.

[0098] Specifically, the image forming apparatus 20 temporarily connects to the communication line 12 (see FIG. 1) and checks the communication with the settings changed by the first communication interface 21A. Then, the communication result is displayed on the operation screen 22 and a display is made to prompt the selection of "Change settings" and "Reset", and the connection to the communication line 12 is disconnected.

[0099] Note that while the remote operation mode is being executed, jobs such as print jobs from the personal computer connected to the communication line 12 are not accepted. Specifically, the port for accepting jobs of the first communication interface 21A is closed or the like to prevent accepting jobs.

[0100] Operator PA checks the result on the terminal screen 32 of the mobile terminal device 30 where the operation screen 22 is mirrored. If the result is okay, "Change settings" is selected, and the image forming apparatus 20 accepts it and performs the setting change process. When "Reset" is selected, operator PA changes the settings of the first communication interface 21A again. The image forming apparatus 20 again displays "Change settings" and "Conduct communication test".

[0101] Next, in steps N1 and N3 of FIG. 6, the processing when the mobile terminal device 30 fails to connect to the access point 26 dedicated for the remote mode of the image forming apparatus 20 for some reason will be described. Note that the same processing applies when the access point 26 dedicated for the remote mode fails to start for some reason.

[0102] If the mobile terminal device 30 fails to connect to the access point 26 dedicated for the remote mode of the image forming apparatus 20 even after the preset time (for example, about 2 minutes) has elapsed, the image forming apparatus 20 times out, ends the execution of the remote operation mode, disconnects the access point 26, and connects to the communication line 12. Also, the image forming apparatus 20 changes various settings based on the stored setting information and restarts.

[0103] Note that when a timeout occurs in step N1 of FIG. 6, since the settings have not been changed yet, the settings remain the same even if various settings are changed based on the stored setting information. However, when a timeout occurs in step N3 of FIG. 6 after restart, although the settings have been changed until then, various settings return to the settings before the execution of the remote operation mode based on the stored setting information.

[0104] On the other hand, if the mobile terminal device 30 fails to connect even after the preset time (for example, about 1 minute) has elapsed for the access point 26 dedicated to the remote mode, a timeout occurs, and an end message such as "Failed to connect to the access point" is displayed instead of a waiting message such as "Connecting to the access point. Please wait a moment". It is desirable that the preset time for the mobile terminal device 30 to timeout is the same as the time for the image forming apparatus 20 to timeout or shorter than the preset time for the image forming apparatus 20 to timeout.

[0105] In addition to the end message such as "Failed to connect to the access point", a guide message for guiding the countermeasure method may be displayed together. The guide message is, for example, a display indicating that if the image forming apparatus 20 times out, the remote operation mode ends and automatically returns to the settings before the execution of the remote operation mode. Or it is a display prompting a return operation by operating the operation screen 22 of the image forming apparatus 20.

[0106] [Processing in the Image Forming Apparatus] Next, the remote operation process in the image forming apparatus 20 will be described with reference to the flowchart of FIG. 7.

[0107] First, the CPU 27A (see FIG. 3) of the control unit 28 of the image forming apparatus 20 (see FIG. 1) receives the execution of the remote operation mode by the operation of the operation screen 22 (see FIG. 1) of the operator PA (see FIG. 6) in step S100. In step S102, the CPU 27A saves various setting information at the current time.

[0108] In step S104, the CPU 27A disconnects the communication line 12 (see FIG. 1) and activates the access point 26 dedicated to the remote mode. In step S106, the CPU 27A displays a matrix-type two-dimensional code having connection information for connecting to the access point 26 on the operation screen 22 (see FIG. 1).

[0109] In step S108, the CPU 27A sets a timer. In step S110, the CPU 27A waits for the connection of the mobile terminal device 30 to the access point 26. In step S112, the CPU 27A checks whether the mobile terminal device 30 is connected to the access point 26. If not connected (No), it proceeds to step S114.

[0110] In step S114, the CPU 27A checks whether the timer has expired. If not expired (No), it returns to step S110. If the timer has expired in step S114 (Yes), it proceeds to step S116. In step S116, the CPU 27A ends the remote operation mode, changes the settings with the setting information saved in step S102, and restarts.

[0111] In the aforementioned step S112, if the CPU 27A determines that the mobile terminal device 30 is connected to the access point 26 (Yes), it proceeds to step S118. In step S118, the CPU 27A deletes the matrix - type two - dimensional code from the operation screen 22. In step S120, the CPU 27A sets a timer. In step S122, the CPU 27A accepts the login based on the login information from the mobile terminal device 30 (see FIG. 1) and performs login authentication. In step S124, the CPU 27A checks whether the login authentication is successful. If the login authentication fails (No), it proceeds to step S126.

[0112] In step S126, the CPU 27A checks whether the timer has expired. If not expired (No), it returns to step S122. If the timer has expired (Yes), it proceeds to step S116. In step S116, the CPU 27A ends the remote operation mode, changes the settings with the setting information saved in step S102, and restarts.

[0113] If the login authentication is successful in step S124 (Yes), it proceeds to step S128. In step S128, the CPU 27A mirrors the operation screen 22 to the terminal screen 32 (see FIG. 1) and accepts and executes the operations on the operation screen 22 by the terminal screen 32.

[0114] As described below, when receiving an instruction to log out and logging out, the remote operation mode ends. Alternatively, when receiving an instruction to restart and restarting, if the mobile terminal device 30 is not reconnected to the image forming apparatus 20, the remote operation mode ends. Until then, step S128 is repeated.

[0115] Next, in step S128 (see FIG. 7), the case where an instruction to log out is received will be described using the flowchart of FIG. 8.

[0116] In step S130, the CPU 27A receives an instruction to log out by operating the operation screen 22 (see FIG. 1) on the terminal screen 32 by remote operation. In step S132, the CPU 27A logs out. In step S134, the CPU 27A ends the execution of the remote operation mode, disconnects the access point 26 dedicated to the remote mode, and connects the communication line 12 (see FIG. 1).

[0117] Next, in step S128 (see FIG. 7), the process when receiving an instruction to restart and restarting will be described using the flowchart of FIG. 9.

[0118] After restarting, in step S140, the CPU 27A receives an instruction to restart and restarts. After restarting, in step S142, the CPU 27A checks whether the remote operation mode is being executed. If the remote operation mode is not being executed (No), the process ends. If the remote mode is being executed (Yes), the process proceeds to step S144.

[0119] In step S144, the CPU 27A sets a timer. In step S146, the CPU 27A waits for the connection of the mobile terminal device 30 (see FIG. 1) to the access point 26 (see FIG. 1). In step S148, the CPU 27A checks whether the mobile terminal device 30 is connected to the access point 26. If not connected (No), the process proceeds to step S150.

[0120] In step S150, the CPU 27A checks whether the timer has expired. If it has not expired (No), the process returns to step S146. If the timer has expired in step S150 (Yes), the process proceeds to step S152. In step S152, the CPU 27A ends the remote operation mode, changes the settings with the setting information saved in step S102 (see FIG. 7), and restarts.

[0121] In the aforementioned step S148, if the CPU 27A determines that the mobile terminal device 30 is connected to the access point 26 (Yes), the process proceeds to step S154. In step S154, the CPU 27A accepts the login based on the login information from the mobile terminal device 30 (see FIG. 1) and performs login authentication, and then returns to step S128 (see FIG. 7).

[0122] Next, the processing when the setting change of the first communication interface 21A (see FIG. 2) is accepted in step S128 (see FIG. 7) will be described using the flowchart of FIG. 10.

[0123] In step S160, the CPU 27A accepts the setting change of the first communication interface 21A. In step S162, the CPU 27A checks whether to perform the setting change process by reflecting the setting change. At this time, the displays on the operation screen 22 and the terminal screen 32 (see FIG. 1) are selections between "Change settings" and "Perform communication test".

[0124] If "Change settings" is selected (Yes), the process proceeds to step S170, and the CPU 27A performs the setting change process for the first communication interface 21A. If "Perform communication test" is selected, that is, if the settings are not changed (No), the process proceeds to step S164.

[0125] In step S164, the CPU 27A performs a communication test. Specifically, after preventing the acceptance of jobs from other devices via the communication line 12 (see FIG. 1), the CPU 27A performs a setting change process on the first communication interface 21A, connects to the communication line 12 to perform a communication check, then disconnects from the communication line 12 and restores the settings of the first communication interface 21A to their original state.

[0126] In step S166, the CPU 27A displays the communication result information of the communication test in S164 on the operation screen 22 (see FIG. 1). Note that the communication result information is also displayed on the mirrored terminal screen 32 (see FIG. 1).

[0127] In step S168, the CPU 27A checks again whether to perform a setting change. At this time, the displays on the operation screen 22 and the terminal screen 32 (see FIG. 1) are "Change settings" or "Perform reset". If "Change settings" is selected (Yes), the process proceeds to step S170, and the CPU 27A performs a setting change process. If "Perform reset" is selected, that is, if no setting change is performed (No), the process returns to step S160.

[0128] [Processing in the mobile terminal device] Next, the remote operation processing in the mobile terminal device 30 will be described with reference to the flowchart of FIG. 11.

[0129] In step S200, the CPU 37A (see FIG. 5) of the control unit 38 of the mobile terminal device 30 accepts the execution of a remote operation application. In step S202, the CPU 37A acquires and stores the connection information read by the operator PA (see FIG. 6) using the camera of the mobile terminal device 30 from the matrix-type two-dimensional code displayed on the operation screen 22 of the image forming apparatus 20.

[0130] In step S204, the CPU 37A sets a timer. In step S206, the CPU 37A performs a polling search using the read connection information and connects to the access point 26 (see FIG. 1). In step S208, the CPU 37A displays a waiting message such as "Connecting to the access point. Please wait a moment" on the terminal screen 32.

[0131] In step S210, the CPU 37A checks whether it has connected to the access point 26. If not connected (No), it proceeds to step S212. In step S212, the CPU 37A checks whether the timer has expired. If not expired (No), it returns to step S210. If the timer has expired in step S212 (Yes), it proceeds to step S214.

[0132] In step S214, the CPU 37A deletes the aforementioned waiting message displayed on the terminal screen 32 (see FIG. 1) and displays an end message such as "Could not connect to the access point", and proceeds to step S216. In step S216, the CPU 37A deletes the saved connection information.

[0133] Note that in step S214, a guide message on the coping method due to timeout may also be displayed. For example, when the image forming apparatus 20 (see FIG. 1) times out, it displays that the remote operation mode ends and automatically returns to the settings before the execution of the remote operation mode. Or it is a display prompting a return operation by directly operating the operation screen 22 (see FIG. 1) of the image forming apparatus 20.

[0134] If it is connected to the access point 26 (see FIG. 1) in the aforementioned step S210 (Yes), it proceeds to step S218. In step S218, the CPU 37A deletes the waiting message on the terminal screen 32. In step S220, the CPU 37A receives the login information input by the operator PA (see FIG. 6). In step S222, the CPU 37A saves the login information.

[0135] In step S224, the CPU 37A logs in to the image forming apparatus 20 (see FIG. 1) in which the remote operation mode is being executed using the login information. In step S226, the CPU 37A mirrors the operation screen 22 of the logged-in image forming apparatus 20 onto the terminal screen 32 (see FIG. 1).

[0136] In step S228, the CPU 37A accepts operations on the operation screen 22 via the terminal screen 32 and saves the operation screen each time the terminal screen 32 is operated and changed, that is, saves the operation history information of the terminal screen 32.

[0137] As will be described later, when an instruction to log out is received and logging out is performed, the process ends. Alternatively, when an instruction to restart is received and after restarting, if the portable terminal device 30 is not reconnected to the image forming apparatus 20, the process ends. Until then, step S228 is repeated.

[0138] Next, in step S228 (see FIG. 11), the process when an instruction to log out is received will be described using the flowchart of FIG. 12.

[0139] In step S230, the CPU 37A accepts logging out from the terminal screen 32 (see FIG. 1). In step S232, the CPU 37A logs out from the image forming apparatus 20 (see FIG. 1) and deletes the saved login information.

[0140] In step S234, the CPU 37A disconnects the access point 26 (see FIG. 1) dedicated to the remote mode of the image forming apparatus 20 and deletes the connection information. Note that the access point 26 of the image forming apparatus 20 may have been disconnected earlier due to logging out, but in that case as well, the connection information is deleted in the same manner.

[0141] Next, in step S228 (see FIG. 11), the process when the image forming apparatus 20 (see FIG. 1) is restarted will be described using the flowchart of FIG. 13.

[0142] In step S240, the CPU 37A accepts a restart operation. With the restart of the image forming apparatus 20, it is disconnected from the access point 26 (see FIG. 1).

[0143] In step S242, the CPU 37A sets a timer. In step S244, the CPU 37A performs a polling search using the saved connection information and connects to the access point 26. In step S246, the CPU 37A displays a waiting message such as "Connecting to the access point. Please wait a moment" on the terminal screen 32 (see FIG. 1).

[0144] In step S248, the CPU 37A checks whether it is connected to the access point 26. If it is connected (Yes), it proceeds to step S250. In step S250, the CPU 37A clears the waiting message on the terminal screen 32 (see FIG. 1). Then, in step S252, the CPU 37A logs in to the image forming apparatus 20 using the saved login information and returns to step S226 (see FIG. 11).

[0145] In step S248, if the CPU 37A is not connected to the access point 26 (No), it proceeds to step S254. In step S254, it checks whether the timer has expired. If the timer has not expired (No), it returns to step S248. If the timer has expired (Yes), it proceeds to step S256.

[0146] In step S256, the CPU 37A clears the aforementioned waiting message on the terminal screen 32 and displays an end message such as "Could not connect to the access point". In step S258, the CPU 37A deletes the saved connection information and login information.

[0147] Note that in step S256, a guide message on the countermeasure method may also be displayed. For example, if the image forming apparatus 20 times out, it is a display indicating that the remote operation mode ends and automatically returns to the settings before the execution of the remote operation mode. Or, it is a display prompting a return operation by operating the operation screen 22 of the image forming apparatus 20.

[0148] In step S228 (see FIG. 11), when a setting change of the first communication interface 21A (see FIG. 2) is received, since there is no disconnection and reconnection of the access point 26, etc., the explanation using the flowchart is omitted.

[0149] <Function> Next, the function of this embodiment will be described.

[0150] After the image forming apparatus 20 is restarted by the remote operation of the portable terminal device 30, the portable terminal device 30 automatically performs a polling search for the access point 26, reconnects, and re-logs in, and further traces back to the screen before restart based on the operation history information to restore the state before restart. Therefore, compared with the case where the operator PA operates the operation screen 22 to restore the image forming apparatus 20 after restart, the number of operations of the operator PA is reduced.

[0151] Also, the remote operation with the portable terminal device 30 can be performed at a location away from the image forming apparatus 20, for example, sitting on a chair and working at a desk, as long as it is within the range where the access point 26 can be connected. Therefore, compared with the case where the operator PA operates the operation screen 22 of the image forming apparatus 20, the work freedom of the operator PA is high.

[0152] Also, the operator PA changes the settings of the image forming apparatus 20 by remote operation using the portable terminal device 30. Therefore, the operator PA can reduce the number of times of touching the operation screen 22 of the image forming apparatus 20. Therefore, for example, it is desirable from the viewpoint of hygiene management when infectious diseases such as influenza and novel coronavirus infection are prevalent.

[0153] Also, the portable terminal device 30 directly connects to the access point 26 dedicated to the remote operation of the image forming apparatus 20. Therefore, compared with the case where the portable terminal device 30 is connected to the image forming apparatus 20 via the communication line 12, the security is improved.

[0154] Also, it temporarily connects to the communication line 12 using the first communication interface 21A with the settings changed to perform a communication check, and the communication result is displayed on the mobile terminal device 30. Therefore, when the mobile terminal device 30 is connected to the image forming apparatus 20 via the communication line 12, it is possible to perform a communication check for the first communication interface 21A whose settings have been changed, which would otherwise be difficult.

[0155] Also, while the remote operation mode is being executed, the image forming apparatus 20 does not accept jobs such as print jobs from peripheral devices such as a personal computer connected to the communication line 12. Therefore, a job received during the communication check while temporarily connected to the communication line 12 will not stop when the communication line is re-disconnected.

[0156] Also, the mobile terminal device 30 reads the matrix-type two-dimensional code displayed on the operation screen 22 of the image forming apparatus 20 to acquire connection information for connecting to the access point 26. Therefore, compared with the case where the connection information is displayed as character information on the operation screen 22 and the operator PA manually inputs the character information into the mobile terminal device 30, the number of operations of the operator PA is reduced and the security is improved.

[0157] Also, when the mobile terminal device 30 connects to the access point 26, the matrix-type two-dimensional code displayed on the operation screen 22 of the image forming apparatus 20 disappears. Therefore, compared with the case where the matrix-type two-dimensional code displayed on the operation screen 22 continues to be displayed, the security is improved.

[0158] Also, the image forming apparatus 20 permits login only for the login information of an operator PA such as an administrator who has the authority to change the settings of the image forming apparatus 20. Therefore, compared with the case where login is always permitted regardless of authority, the security is improved.

[0159] <Settings change of multiple image forming apparatuses>

[0160] The case where operator PA changes the settings of a plurality of image forming apparatuses 20 will be described with reference to FIG. 14(A). In this description, for the sake of clarity, three image forming apparatuses 20A, 20B, and 20C will be described. Note that when it is not necessary to distinguish between the image forming apparatuses 20A, 20B, and 20C, the A, B, and C after the reference numeral 20 will be omitted as appropriate in the description.

[0161] The portable terminal device 30 associates and stores and manages connection information, login information, and operation history information with the image forming apparatuses 20A, 20B, and 20C, respectively. Specifically, the connection information of the image forming apparatus 20 includes a unique number such as a MAC address. Then, the portable terminal device 30 stores and manages each piece of information associated with the unique number such as the MAC address for each of the image forming apparatuses 20A, 20B, and 20C. As described above, the connection information, login information, and operation history information are stored in association with the image forming apparatuses 20A, 20B, and 20C in the server 50.

[0162] Note that when operator PA changes the settings of a plurality of image forming apparatuses 20 in parallel, the operator performs a process of removing the control that times out even when not connected to the access point 26 on the operation screen 22 of the image forming apparatus 20 and the terminal screen 32 of the portable terminal device 30.

[0163] Operator PA changes the settings while switching between the image forming apparatuses 20A, 20B, and 20C whose settings are to be changed by the portable terminal device 30. Specifically, as shown in FIG. 14(A), when the image forming apparatus 20A restarts due to a setting change, operator PA connects the portable terminal device 30 to the image forming apparatus 20B, logs in, and changes the settings. Note that the connection information, login information, and operation history information of the image forming apparatus 20A are stored. Similarly, the connection information, login information, and operation history information of the image forming apparatuses 20B and 20C are stored when the image forming apparatuses 20B and 20C restart thereafter.

[0164] Next, when the image forming apparatus 20B is restarted due to a setting change, the operator PA connects the portable terminal device 30 to the image forming apparatus 20C, logs in, and makes the setting change. Similarly, the connection information, login information, and operation history information of the image forming apparatus 20A are saved.

[0165] Then, when the image forming apparatus 20C is restarted due to a setting change, the operator PA connects the portable terminal device 30 to the access point 26 of the image forming apparatus 20A that is in a state of waiting for a restart connection. At this time, the operator PA operates the terminal screen 32 to instruct reconnection to the access point 26 of the image forming apparatus 20A. As a result, the portable terminal device 30 automatically polls and searches for the access point 26 of the image forming apparatus 20A using the connection information, login information, and operation history information of the image forming apparatus 20A, reconnects, relogs in, and further traces back to the screen before restart based on the operation history information to restore the state before restart.

[0166] Similarly, for the access points 26 of the image forming apparatuses 20B and 20C that are in a state of waiting for a restart connection, the operator PA operates the terminal screen 32 to instruct reconnection to the access points 26 of the image forming apparatuses 20B and 20C, so that the access points 26 of the image forming apparatuses 20B and 20C are automatically polled and searched for reconnection and relogin, and further traced back to the screen before restart based on the operation history information to restore the state before restart.

[0167] [Operation] Next, the operation of the present embodiment will be described.

[0168] After the image forming apparatuses 20A, 20B, and 20C are restarted by remote operation using the portable terminal device 30, the portable terminal device 30 automatically polls and searches for the access point 26 for reconnection and relogin, and further traces back to the screen before restart based on the operation history information to restore the state before restart. Therefore, compared with the case where the operator PA operates the operation screen 22 to restore the restarted image forming apparatus 20, the number of operations of the operator PA is reduced.

[0169] In addition, for the remote operation with the mobile terminal device 30, as long as it is within the range connectable to the access point 26, the operation can be performed at a location away from the image forming apparatuses 20A, 20B, and 20C, for example, sitting on a chair and working at a desk. Therefore, compared with the case where the operator PA operates the operation screen 22 of the image forming apparatus 20, the work freedom of the operator PA is high.

[0170] Note that if the image forming apparatuses 20A, 20B, and 20C are close to each other and there is a work location where all of them can be connected to the three access points 26, the operator PA may first read the connection information of all of the image forming apparatuses 20A, 20B, and 20C and perform the setting work while appropriately switching the connections of the image forming apparatuses 20A, 20B, and 20C at that work location.

[0171] In addition, the operator PA uses one mobile terminal device 30 to remotely change the settings of a plurality of image forming apparatuses 20A, 20B, and 20C. Therefore, the operator PA can reduce the number of times of touching the operation screens 22 of the image forming apparatuses 20A, 20B, and 20C. Thus, for example, it is desirable from the viewpoint of hygiene management when infectious diseases such as influenza and novel coronavirus infection are prevalent.

[0172] In addition, since the setting of another image forming apparatus 20 can be changed during the waiting time until the image forming apparatus 20 restarts, the total working time of the operator PA can be reduced.

[0173] Here, FIG. 14(B) shows the case where the settings are changed in the order of the image forming apparatus 20A, the image forming apparatus 20B, and the image forming apparatus 20C. FIG. 14(A) shows the case where the connection is made to the image forming apparatus 20B and the settings are changed during the restart of the aforementioned image forming apparatus 20A, and the connection is made to the image forming apparatus 20C and the settings are changed during the restart of the image forming apparatus 20B. Comparing FIG. 14(A) and FIG. 14(B), it can be seen that the total working time of the operator PA can be reduced by the time TM minutes.

[0174] <Others> Note that the present invention is not limited to the above-described embodiment.

[0175] For example, in the above embodiment, the connection information for connecting to the access point 26 of the image forming apparatus 20 is obtained by displaying a matrix type two-dimensional code having the connection information on the operation screen 22, and the portable terminal device 30 reads the matrix type two-dimensional code with a camera to obtain the connection information. However, the present invention is not limited to this. The connection information for connecting to the access point 26 of the image forming apparatus 20 may be presented by other methods. For example, the IC card of the portable terminal device 30 may be brought close to the card reader 24 of the image forming apparatus 20 to obtain the connection information. Also in this case, the CPU 28 controls the second communication interface 21B so that the connection information cannot be read from the card reader 24 when connected to the access point 26. Further, the connection information may be presented to the portable terminal device 30 by a method other than the matrix type two-dimensional code and the card reader 24. For example, the connection information may be displayed as character information on the operation screen 22.

[0176] Also, for example, in the above embodiment, the portable terminal device 30 directly connects to the access point 26 of the image forming apparatus 20 and disconnects the communication line 12. However, the present invention is not limited to this. The portable terminal device 30 may be connected to the image forming apparatus 20 via the communication line 12. In this case, the image forming apparatus 20 is configured not to accept jobs from external devices while the remote operation mode is being executed. Further, when the image forming apparatus 20 is restarted, it reconnects to the image forming apparatus 20 via the communication line 12, re-logs in, and further traces back to the screen before restart based on the operation history information to restore the state before restart.

[0177] Also, for example, in the above embodiment, the portable terminal device 30 times out and ends the connection process when a preset time elapses. However, the present invention is not limited to this. For example, an upper limit may be set for the number of polling searches, and the connection process may be ended when the upper limit is reached.

[0178] Further, for example, the configurations of the image forming apparatus 20, the mobile terminal device 30, and the server 50 described in the above embodiments are merely examples, and may be changed according to the situation or new components may be added without departing from the gist.

[0179] Further, for example, in the above embodiment, the mobile terminal device 30 and the server 50 cooperate to execute the remote operation application, but the remote operation application may be executed only by the mobile terminal device 30. Further, the image forming apparatus 20 and a server or the like connected to the communication line 12 may cooperate to execute the remote operation mode. Further, it may be an information device system other than the image forming apparatus 20. The information device system may be any system that can mirror the operation screen to the terminal screen of the mobile terminal system and change the settings, and may be, for example, a personal computer, a vending machine, or the like.

[0180] Further, the flow of the processing of the program described in the above embodiment is merely an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed without departing from the gist.

[0181] Further, in the above embodiment, the case where the processing according to the embodiment is realized by software configuration using a computer by executing a program has been described, but the present invention is not limited to this. The embodiment may be realized by, for example, a hardware configuration, or may be realized by a combination of a hardware configuration and a software configuration.

[0182] Further, the operation of the processor in the above embodiment may be achieved not only by one processor but also by a plurality of physically separated processors cooperating with each other. Also, the order of each operation of the processor is not limited to the order described in the above embodiments, and may be changed as appropriate.

[0183] Furthermore, the present invention can be implemented in various modes without departing from the gist of the invention.

[0184] [Appendix]

[0185] (((1))) Having one or more processors, The processor, When a remote operation mode is executed in which the operation screen of the information device system is mirrored on the terminal screen to enable remote operation of the operation screen, connect to the information device system using connection information, Log in to the information device system using the input login information and save the login information, Save the operation history of the terminal screen, When the information device system restarts and the connection is disconnected, reconnect to the restarted information device system using the connection information, Log in to the information device system using the saved login information, Restore to the terminal screen at the time of disconnection using the saved operation history, Portable terminal system.

[0186] (((2))) The processor, Connect to the access point for remote operation activated when the information device system executes the remote operation mode, The portable terminal system according to ((1)).

[0187] (((3))) The processor, Instruct the information device system to change the setting of the communication interface, Instruct the information device system to confirm communication with the communication line using the changed communication interface, Receive the communication result,

[0188] The portable terminal system according to ((2)). (((4))) The processor, Obtain the connection information from the information device system, Save the obtained connection information. The mobile terminal system according to any one of ((1)) to ((3)).

[0189] ((5)) The processor When the information device system executes the remote operation mode, read the matrix-type two-dimensional code displayed on the operation screen to obtain the connection information. The mobile terminal system according to ((4)).

[0190] ((6)) The processor The mobile terminal system obtains the connection information from the information device system via short-range wireless communication.

[0191] The mobile terminal system according to ((4)).

[0192] ((7)) The processor When it is impossible to reconnect to the information device system within the set time, display the corresponding method on the terminal screen. The mobile terminal system according to any one of ((1)) to ((6)).

[0193] ((8)) Having one or more processors The processor Receive the execution of the remote operation mode that mirrors the operation screen on the terminal screen of the connected mobile terminal system so that the operation screen can be remotely operated by the mobile terminal system. Accept login based on the login information of the connected mobile terminal system. After receiving the restart instruction from the mobile terminal system and restarting, accept login based on the login information of the reconnected mobile terminal system. When receiving the logout of the mobile terminal system, end the execution of the remote operation mode. Information device system.

[0194] (((9))) When the processor receives the execution of the remote operation mode, it disconnects the communication line and activates an access point for remote operation to which the mobile terminal system connects, accepts login using the login information of the mobile terminal system connected to the access point, when it receives a restart instruction from the mobile terminal system and restarts, it restarts the access point, accepts login using the login information of the mobile terminal system reconnected to the access point, when it accepts logout of the mobile terminal system, it ends the execution of the remote operation mode, connects to the communication line, and ends the access point, the information device system according to ((8)).

[0195] (((10))) When the processor receives the execution of the remote operation mode, it saves the pre-execution settings before executing the remote operation mode, when the mobile terminal system is not connected to the access point within the set time, it ends the execution of the remote operation mode and returns to the saved pre-execution settings, the information device system according to ((9)).

[0196] (((11))) When the processor receives the execution of the remote operation mode, it presents connection information for connecting to the access point acquired by the mobile terminal system, the information device system according to ((9)) or ((10)).

[0197] (((12))) When the processor receives When accepting the execution of the remote operation mode, display the matrix two-dimensional code with the connection information on the operation screen, (((11))) The information device system described in.

[0198] (((13))) The processor, When accepting the execution of the remote operation mode, present the connection information via short-range wireless communication, (((11))) The information device system described in.

[0199] (((14))) The processor, when the mobile terminal system is connected to the access point, end the presentation of the connection information, (((11))) to (((13))) The information device system according to any one of.

[0200] (((15))) The processor, when receiving an instruction for communication confirmation to the communication line, connect to the communication line, perform communication confirmation, and send the communication result to the mobile terminal system, re-disconnect the communication line, (((9))) to (((14))) The information device system according to any one of.

[0201] (((16))) The processor, does not accept a job from an external device via the communication line, (((15))) The information device system described in.

[0202] (((17))) The processor, permits login only to the registered login information, (((8))) to (((16))) The information device system according to any one of the preceding claims.

[0203] (((18))) A program for a mobile terminal system that connects to an information device system in which a remote operation mode is executed to mirror an operation screen of the information device system on a terminal screen so that the operation screen can be remotely operated, connects to the information device system using connection information, logs in to the information device system using the input login information and saves the login information, saves the operation history of the terminal screen, when the information device system restarts and the connection is disconnected, reconnects to the restarted information device system using the connection information, logs in to the information device system using the saved login information, restores to the terminal screen at the time of disconnection using the saved operation history, A program for causing a computer, which is the mobile terminal system, to execute the processing.

[0204] According to the mobile terminal system of ((1)), the number of operations by the operator is reduced as compared with the case where the operator operates and restores the operation screen of the information device system after restarting.

[0205] According to the mobile terminal system of ((2)), security is improved as compared with the case of connecting to the information device system via a communication line.

[0206] According to the mobile terminal system of ((3)), communication of the set communication interface can be confirmed.

[0207] According to the mobile terminal system of ((4)), security is improved as compared with the case where the connection information is pre-stored in the mobile terminal system.

[0208] According to the mobile terminal system of ((5)), the number of operations by the operator is reduced as compared with the case where the operator manually inputs the character information in which the connection information is displayed on the operation screen into the mobile terminal system.

[0209] According to the mobile terminal system of ((6)), the number of operations by the operator is reduced as compared with the case where the operator manually inputs the character information in which the connection information is displayed on the operation screen into the mobile terminal system.

[0210] According to the mobile terminal system of ((7)), the operator can take countermeasures earlier as compared with the case where the terminal screen remains the operation screen.

[0211] According to the information device system of ((8)), the number of operations by the operator is reduced as compared with the case where the operator operates the operation screen of the information device system after restart and restores it.

[0212] According to the information device system of ((9)), the number of operations by the operator is reduced as compared with the case where the operator operates the operation screen of the information device system after restart and restores it.

[0213] According to the information device system of ((10)), the number of operations by the operator is reduced as compared with the case where the operator operates the operation screen and restores it to the pre-execution settings.

[0214] According to the information device system of ((11)), the security is improved as compared with the case where the connection information is stored in the mobile terminal system in advance.

[0215] According to the information device system of ((12)), the number of operations by the operator is reduced as compared with the case where the connection information is displayed as character information on the operation screen and the operator manually inputs it into the mobile terminal system.

[0216] According to the information device system of ((13)), the number of operations by the operator is reduced as compared with the case where the connection information is displayed as character information on the operation screen and the operator manually inputs it into the mobile terminal system.

[0217] According to the information device system of ((14)), the security is improved as compared with the case where the connection information is continuously presented.

[0218] According to the information device system of ((15)), communication confirmation of a communication line can be performed.

[0219] According to the information device system of ((16)), jobs received during communication confirmation do not stop halfway due to reconnection of a communication line.

[0220] According to the information device system of ((17)), security is improved as compared with the case where login is always permitted.

[0221] According to the program of ((18)), the number of operations by an operator is reduced as compared with the case where the operator operates and restores the operation screen of the information device system after restart.

Explanation of Signs

[0222] 10 Remote operation system 12 Communication line 16 Mobile terminal system 20 Image forming apparatus (an example of an information device system) 21A First communication interface (an example of a communication interface) 22 Operation screen 26 Access point 27A CPU (an example of a processor) 30 Mobile terminal device 32 Terminal screen 37A CPU (an example of a processor)

Claims

1. having one or more processors, wherein the processor connects to the information device system in which a remote operation mode is executed to mirror an operation screen of the information device system on a terminal screen and enable remote operation of the operation screen, using connection information; logs in to the information device system using the input login information and saves the login information; saves an operation history of the terminal screen; when the information device system restarts and the connection is disconnected, reconnects to the restarted information device system using the connection information; logs in to the information device system using the saved login information; restores the terminal screen at the time of disconnection using the saved operation history; a mobile terminal system.

2. wherein the processor connects to an access point for remote operation activated when the information device system executes the remote operation mode; The mobile terminal system according to claim 1.

3. wherein the processor instructs the information device system to change the setting of the communication interface; instructs the information device system to confirm communication to a communication line using the communication interface with the setting changed; receives a communication result; The mobile terminal system according to claim 2.

4. wherein the processor acquires the connection information from the information device system; saves the acquired connection information; The mobile terminal system according to claim 1.

5. wherein the processor reads a matrix-type two-dimensional code displayed on the operation screen when the information device system executes the remote operation mode to acquire the connection information; The mobile terminal system according to claim 4.

6. wherein the processor the mobile terminal system acquires the connection information from the information device system via short-range wireless communication; The mobile terminal system according to claim 4.

7. wherein the processor displays a correspondence method on the terminal screen when it is not possible to reconnect to the information device system within a set time; The mobile terminal system according to claim 1.

8. having one or more processors, wherein the processor receives execution of a remote operation mode that mirrors an operation screen on a terminal screen of a connected mobile terminal system and enables remote operation of the operation screen with the mobile terminal system; receives login using the login information of the connected mobile terminal system; After receiving an instruction to restart from the mobile terminal system and restarting, it accepts login based on the login information of the reconnected mobile terminal system. When it accepts the logout of the mobile terminal system, it ends the execution of the remote operation mode. An information device system.

9. The processor When it receives an instruction to execute the remote operation mode, It disconnects the communication line and activates an access point for remote operation to which the mobile terminal system connects. It accepts login based on the login information of the mobile terminal system connected to the access point. When it receives an instruction to restart from the mobile terminal system and restarts, it restarts the access point. It accepts login based on the login information of the mobile terminal system reconnected to the access point. When it accepts the logout of the mobile terminal system, it ends the execution of the remote operation mode, connects to the communication line, and terminates the access point. The information device system according to claim 8.

10. The processor When it receives an instruction to execute the remote operation mode, It saves the pre-execution settings before executing the remote operation mode. When the mobile terminal system is not connected to the access point within the set time, it ends the execution of the remote operation mode and returns to the saved pre-execution settings. The information device system according to claim 9.

11. The processor When it receives an instruction to execute the remote operation mode, It presents connection information for connecting to the access point acquired by the mobile terminal system. The information device system according to claim 9.

12. The processor When it receives an instruction to execute the remote operation mode, It displays a matrix-type two-dimensional code with the connection information on the operation screen. The information device system according to claim 11.

13. The processor When it receives an instruction to execute the remote operation mode, It presents the connection information via short-range wireless communication. The information device system according to claim 11.

14. The processor When the mobile terminal system is connected to the access point, it ends the presentation of the connection information. The information device system according to claim 11.

15. The processor When it receives an instruction to confirm communication to the communication line, It connects to the communication line, performs communication confirmation, and sends the communication result to the mobile terminal system. Re-disconnect the communication line. The information device system according to claim 9.

16. The processor does not accept jobs from external devices via the communication line. The information device system according to claim 15.

17. The processor permits login only for the registered login information. The information device system according to claim 8.

18. A program for a mobile terminal system that connects to the information device system in which a remote operation mode is executed to mirror an operation screen of the information device system to a terminal screen and enable remote operation of the operation screen, connects to the information device system using connection information, logs in to the information device system using the input login information and saves the login information, saves an operation history of the terminal screen, when the information device system restarts and the connection is disconnected, reconnects to the information device system restarted using the connection information, logs in to the information device system using the saved login information, restores the terminal screen at the time of disconnection using the saved operation history, a program for causing a computer, which is the mobile terminal system, to execute the processing.

Images