Terminal, terminal communication method, terminal communication control program, and communication system

Abstract

To provide an terminal capable of establishing communication with an external device more efficiently than before when trying to remotely operate the device via a network.SOLUTION: A control device comprising: a communication unit configured to perform communication with an external device via a network; and a terminal configured to control the communication unit, wherein the control unit is configured to establish communication with the device or a mediation device that mediates the device and perform remote control of the device in a case where direct communication with an address of the device or the mediation device is possible when remote control of the external device is attempted, On the other hand, in a case where the direct communication with the address of the device or the mediating device is not possible, the terminal establishes communication with the device by using a predetermined external system that relays the remote operation with the device or the mediating device, and performs the remote operation of the device.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] This disclosure relates to a terminal device, a communication method for a terminal device, a communication control program for a terminal device, and a communication system, and more particularly to a terminal device that remotely controls external equipment via a network, a communication method for a terminal device, a communication control program for a terminal device, and a communication system. [Background technology]

[0002] 2. Description of the Related Art Conventionally, a remote device operation system is known in which an intermediary device connectable to devices present on a local network is provided within the local network, and the devices present on the local network are remotely operated via the cloud.

[0003] For example, in a remote device management system in which an intermediary device capable of acquiring device information from devices present within a local network is provided within the local network and remotely managed from outside the local network, a technology has been disclosed in which the intermediary device communicates with a specific device based on a communication definition corresponding to a specific communication protocol (see, for example, Patent Document 1).

[0004] Also disclosed is a management system that remotely controls a control device (PLC) connected to a gateway device in a factory from a mobile terminal via the cloud, in which a mobile terminal that has been moved into the factory connects to the control device (PLC) via an access point in the factory based on route information obtained from the cloud using the mobile terminal itself as a gateway, and the mobile terminal that has been moved into the factory accesses the cloud via the gateway and executes management processing from the cloud via the gateway; furthermore, a technology has been disclosed in which the cloud searches a database using the mobile terminal's presence information obtained via a LAN connection, and can identify the factory in which the mobile terminal is located (see, for example, Patent Document 2). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2020-087006 [Patent Document 2] International Publication No. 2015 / 140908 Summary of the Invention [Problem to be solved by the invention]

[0006] However, in such remote device control systems, direct communication with the device to be remotely controlled may be prevented due to firewalls, etc. In such cases, one method of realizing two-way communication is to build and operate a web server that acts as a proxy for the communication, but building and operating such a server is costly.

[0007] In particular, when building such an environment using a pay-as-you-go cloud service, users are charged only for the amount of communication they use, so there has been a desire to keep communication using such an environment as low as possible.

[0008] This disclosure has been made in consideration of the above circumstances, and its purpose is to provide a terminal device, a communication method for the terminal device, a communication control program for the terminal device, and a communication system that enable communication with an external device to be established more efficiently than before when attempting to remotely control the device via a network. [Means for solving the problem]

[0009] This disclosure provides a terminal device that includes a communication unit that communicates with an external device via a network and a control unit that controls the communication unit, wherein when attempting to remotely control an external device, if direct communication is possible with the address of the device or an intermediary device that mediates the device, the control unit establishes communication with the device or the intermediary device and remotely controls the device, and on the other hand, if direct communication is not possible with the address of the device or the intermediary device, the control unit establishes communication with the device using a predetermined external system that relays remote operation with the device or the intermediary device and remotely controls the device. This disclosure also provides a communication method for a terminal device that communicates with an external device via a network, characterized in that when attempting to remotely control the external device, if direct communication is possible with the address of the device or an intermediary device that mediates the device, communication with the device or the intermediary device is established to remotely control the device, and if direct communication is not possible with the address of the device or the intermediary device, communication with the device is established using a predetermined external system that relays remote operation with the device or the intermediary device to remotely control the device. This disclosure also provides a communication control program for a terminal device that is executed by a processor of the terminal device that communicates with an external device via a network, characterized in that when attempting to remotely control the external device, if direct communication is possible with the address of the device or an intermediary device that mediates the device, communication with the device or the intermediary device is established to remotely control the device, and on the other hand, if direct communication is not possible with the address of the device or the intermediary device, communication with the device is established using a predetermined external system that relays remote operation with the device or the intermediary device to remotely control the device. This disclosure also provides a communication system comprising an apparatus and a terminal device communicatively connected via a network, wherein when the terminal device attempts to remotely control the apparatus, if direct communication is possible with the address of the apparatus or an intermediary device that mediates the apparatus, the terminal device establishes communication with the apparatus or the intermediary device to remotely control the apparatus, and on the other hand, if direct communication is not possible with the address of the apparatus or the intermediary device, the terminal device establishes communication with the apparatus using a predetermined external system that relays remote operation of the apparatus or the intermediary device to remotely control the apparatus. [Effects of the Invention]

[0010] According to this disclosure, when attempting to remotely control an external device via a network, it is possible to realize a terminal device, a communication method for the terminal device, a communication control program for the terminal device, and a communication system that can establish communication with the device more efficiently than before by selecting a connection via an appropriate route depending on the communication conditions. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is an explanatory diagram illustrating an example of a configuration of an image forming system including a digital multifunction peripheral according to the present disclosure. [Figure 2] FIG. 2 is an explanatory diagram showing a schematic configuration of the digital multifunction peripheral shown in FIG. [Figure 3] FIG. 2 is an explanatory diagram showing a schematic configuration of the user terminal shown in FIG. [Figure 4] FIG. 2 is an explanatory diagram showing a schematic configuration of the server shown in FIG. [Figure 5] 1 is an explanatory diagram illustrating a problem with remote control of a digital multifunction peripheral by a user terminal in a conventional image forming system. [Figure 6] 2 is a flowchart illustrating an example of the flow of a remote control process of the digital multifunction peripheral shown in FIG. 1. FIG. [Figure 7]2 is an explanatory diagram showing an example of a process when a digital multifunction peripheral in the local system shown in FIG. 1 is remotely operated from a user terminal outside the local system. [Figure 8] 2 is an explanatory diagram showing an example of a process when a digital multifunction peripheral in the local system shown in FIG. 1 is remotely operated from a user terminal in the local system. [Figure 9] 2 is an explanatory diagram showing an example of a configuration for remotely controlling a digital multifunction peripheral by a user terminal in the image forming system shown in FIG. 1. FIG. [Figure 10] 1. FIG. 4 is an explanatory diagram showing an example of a remote operation request screen displayed on a display unit of the user terminal shown in FIG. [Figure 11] 1. FIG. 4 is an explanatory diagram showing an example of a remote operation screen of the digital multifunction peripheral when it is displayed on a display unit of the user terminal shown in FIG. 1 via a cloud network. [Figure 12] 1. FIG. 4 is an explanatory diagram showing an example of a remote operation screen of the digital multifunction peripheral displayed on the display unit of the user terminal shown in FIG. 1 without going through a cloud network. [Figure 13] 1. FIG. 4 is an explanatory diagram showing another example of the process when a digital multifunction peripheral in the local system shown in FIG. 1 is remotely operated from a user terminal outside the local system. DETAILED DESCRIPTION OF THE INVENTION

[0012] In this disclosure, a "terminal device" is, for example, a terminal such as a personal computer (PC) or a tablet, or a mobile terminal such as a smartphone. "Devices" are devices that have communication functions and can be remotely controlled from outside, such as copiers, multifunction devices, or MFPs (Multifunctional Peripherals) that include functions other than copying, televisions, DVD recorders, personal computers (PCs), and electronic whiteboards. An "intermediary device" is a device that connects to a terminal device and a device via a network and mediates by sending and receiving various data between the terminal device and the device. An "external system" is a system consisting of, for example, an equipment management device that sends connection information to a terminal device to establish a connection with an intermediary device within a local network when attempting to remotely control an equipment from a terminal device, and a cloud network that connects a terminal device connected via the network to an intermediary device within the local system.

[0013] Further, preferred embodiments of this disclosure will be described.

[0014] In the terminal device disclosed herein, the device is provided within a predetermined local network and communicates with the communication unit via the intermediary device, and when the control unit attempts to remotely control the device, if direct communication is possible with the address of the intermediary device, it establishes communication with the device via the intermediary device and remotely controls the device, while if direct communication is not possible with the address of the intermediary device, it uses the external system to establish communication with the device via the intermediary device and remotely controls the device.

[0015] In this way, when attempting to remotely control an external device located within a local network, a terminal device can be realized that can establish communication with the device more efficiently than before by selecting either a direct connection to an intermediary device or a connection using an external system depending on the communication situation.

[0016] In the terminal device disclosed herein, the external system may include a device management device that communicates with the intermediary device via a firewall, and when attempting to remotely control the device, the control unit may cause the communication unit to obtain connection information from the device management device to establish a connection with the intermediary device within the local network, and if direct communication with the address of the intermediary device is possible based on the connection information, establish communication with the device via the intermediary device to remotely control the device; on the other hand, if direct communication with the address of the intermediary device is not possible based on the connection information, establish communication with the device via the intermediary device using the external system to remotely control the device.

[0017] In this way, when attempting to remotely control an external device located within a local network, connection information for establishing a connection with the intermediary device is obtained from a device management device that communicates with the intermediary device via a firewall, and depending on the communication situation, the terminal device can select either a direct connection with the intermediary device or a connection using an external system, thereby realizing a terminal device that can establish communication with the device more efficiently than before.

[0018] In the terminal device disclosed herein, the connection information may include information for determining that the communication unit is communicating with the address of the intermediary device as intended when communicating with the address of the intermediary device.

[0019] In this way, when attempting to remotely control an external device via a network, a terminal device can be realized that can establish communication with the device more efficiently than before by not only checking whether the address of the intermediary device is reachable, but also by sending predetermined information when communicating with the intermediary device to determine that the intended party is the intended party.

[0020] In the terminal device disclosed herein, when the communication unit establishes communication with the device via the intermediary device, the control unit may transmit information related to the operation of the device to the intermediary device to remotely control the device, and when the communication unit establishes communication with the device via the intermediary device using the external system, the control unit may transmit information related to the operation of the device to the device management device to remotely control the device.

[0021] In this way, when attempting to remotely control an external device via a network, information related to the operation of the device can be sent directly to an intermediary device or to a device management device depending on the communication conditions, thereby realizing a terminal device that can remotely control the device more efficiently than before.

[0022] This disclosure will be described in further detail below with reference to the accompanying drawings. Note that the following description is illustrative in all respects and should not be construed as limiting this disclosure.

[0023] [Embodiment 1] <Schematic Configuration of Image Forming System 100> A schematic configuration of an image forming system 100 including a digital multifunction peripheral 1 according to a first embodiment of the present disclosure will be described with reference to FIGS. FIG. 1 is an explanatory diagram showing an example of the configuration of an image forming system 100 including a digital multifunction peripheral 1 of this disclosure.

[0024] As shown in FIG. 1, in the image forming system 100 of this disclosure, a digital multifunction peripheral 1 is connected to user terminals 2A and 2B (hereinafter collectively referred to as user terminals 2) and a server 3 via a wired or wireless local network 4 and the Internet 5.

[0025] The digital multifunction peripheral 1 is an image forming apparatus such as a multifunction peripheral or MFP that digitally processes image data and has a copy function, a printer function, a scanner function, and a facsimile function.

[0026] The user terminal 2 is a terminal such as a personal computer (PC) or a tablet, or a mobile terminal such as a smartphone. The user terminal 2 transmits and receives various data to and from the digital multifunction peripheral 1 via the local network 4 .

[0027] The server 3 is an intermediary device that connects to the digital multifunction peripheral 1 via a local network 4 and to the user terminal 2 via the Internet 5, and mediates the sending and receiving of various data between the user terminal 2 and the digital multifunction peripheral 1 via these networks.

[0028] The local network 4 is a network such as a LAN or a dedicated communication line that interconnects the digital multifunction peripheral 1, the user terminal 2B, and the server 3, and constitutes the local system 200. On the other hand, the user terminal 2A is assumed to be located outside the local system 200.

[0029] The Internet 5 is a wide area network (WAN) that interconnects the user terminal 2A and the local system 200.

[0030] The cloud network 6 is a network provided by a cloud service, and connects the user terminal 2A connected via the Internet 5 to the server 3 in the local system 200.

[0031] The cloud network 6 includes a device management device that communicates with the server 3 via a firewall. When a user terminal 2 attempts to remotely control the digital multifunction peripheral 1, the device management device transmits connection information to the user terminal 2 for establishing a connection with the server 3 within the local network 4.

[0032] Furthermore, when the user terminal 2 establishes communication with the digital multifunction printer 1 via the server 3 using the cloud network 6, information related to the operation of the digital multifunction printer 1 is received from the user terminal 2 and transmitted to the digital multifunction printer 1 via the server 3, thereby enabling the user terminal 2 to remotely operate the digital multifunction printer 1.

[0033] <Outline of Digital Multifunction Printer 1> FIG. 2 is an explanatory diagram showing a schematic configuration of the digital multifunction peripheral 1 shown in FIG. As shown in FIG. 2, the digital multifunction peripheral 1 includes a control unit 10, an image data acquisition unit 11, an image forming unit 12, a storage unit 13, an image processing unit 14, a communication unit 15, a VNC server 16, and an operation panel 17.

[0034] Each component of the digital multifunction peripheral 1 will be described below.

[0035] The control unit 10 controls the digital multifunction peripheral 1 in an integrated manner and consists of at least one CPU (Central Processing Unit), at least one RAM (Random Access Memory), at least one ROM (Read only memory), various interface circuits, etc.

[0036] The control unit 10 monitors and controls all loads such as the detection of each sensor, motor, clutch, operation panel 17, etc., in order to control the overall operation of the digital multifunction peripheral 1.

[0037] The image data acquisition unit 11 is a part that acquires image data received from an external device via the local network 4, the Internet 5, and the cloud network 6.

[0038] The image forming unit 12 is a part that prints out an image based on the image data acquired by the image data acquiring unit 11 and processed by the image processing unit 14 onto a sheet of paper.

[0039] The storage unit 13 is an element or storage medium that stores information, control programs, etc., necessary to realize various functions of the digital multifunction peripheral 1. For example, a storage medium such as a semiconductor element such as a RAM or a ROM, a hard disk, a flash storage unit, or an SSD (Solid State Drive) is used. The program and the data may be stored in different devices, such as by configuring the area for storing data as a hard disk drive and the area for storing the program as a flash memory unit.

[0040] The image processing unit 14 converts the image data input from the image data acquisition unit 11 into an appropriate electrical signal based on the analysis results of job commands such as printing acquired from a user terminal via the communication unit 15 or job commands such as printing input from the operation unit 172, and processes the image data so that it is suitable for output such as enlargement / reduction.

[0041] The communication unit 15 is a part that communicates with external devices such as the user terminal 2 via a network, and transmits and receives data to and from these external devices.

[0042] The VNC server 16 is a server related to the VNC (Virtual Network Computing) service. When the VNC server 16 receives a connection request from a VNC client 36 (described later) of an external device, the screen of the digital multifunction device 1 is displayed on the display unit 241 of the user terminal 2 of the external device via the network, making it possible to remotely operate the digital multifunction device 1.

[0043] The VNC server 16 may be configured by installing a predetermined application. When the VNC server 16 receives a connection request from a VNC client 36 (described later), the digital multifunction peripheral 1 becomes remotely operable from an external device.

[0044] The operation panel 17 is composed of a display panel made up of a liquid crystal panel or the like, and a touch panel such as a capacitive type that is placed on top of the display panel and detects the position touched by a finger, and is equipped with a display unit 171 and an operation unit 172.

[0045] The display unit 171 is a part that displays various types of information. The display unit 171 is configured by, for example, a CRT display, a liquid crystal display, an EL display, or the like, and is a display device such as a monitor or line display for displaying electronic data such as the processing status of the operating system and application software.

[0046] The control unit 10 displays the operation and status of the digital multifunction peripheral 1 through the display unit 171.

[0047] The operation unit 172 is an interface for operating the digital multifunction peripheral 1, and is a part that receives commands from the user.

[0048] The entire operation unit 172 does not have to be compatible with touch panel operation, and a part or the entire operation unit 172 may be configured as physical keys independent of the display unit 171.

[0049] <Overview of User Terminal 2> FIG. 3 is an explanatory diagram showing a schematic configuration of the user terminal 2 shown in FIG. As shown in FIG. 3, the user terminal 2 includes a control unit 20, a storage unit 21, an image processing unit 22, a communication unit 23, and an operation panel 24.

[0050] Each component of the user terminal 2 will be described below.

[0051] The control unit 20 controls the user terminal 2 in an integrated manner, and is composed of at least one CPU, at least one RAM, at least one ROM, various interface circuits, and the like.

[0052] The control unit 20 monitors and controls all loads such as the detection of each sensor and the operation unit 242 in order to control the overall operation of the user terminal 2 .

[0053] The storage unit 21 is an element or storage medium that stores information necessary to realize various functions of the user terminal 2, control programs, and the like. For example, semiconductor elements such as RAM and ROM, hard disks, flash storage units, SSDs, and other storage media are used.

[0054] The storage unit 21 stores information about jobs such as printing, image data, and other data required for executing jobs. The program and the data may be stored in different devices, such as by configuring the area for storing data in a hard disk drive and the area for storing the program in a flash memory unit.

[0055] The image processing unit 22 is a part that converts image data into an appropriate electrical signal and performs processing such as enlarging or reducing the signal so that the signal is suitable for output.

[0056] The communication unit 23 communicates with the external digital multifunction peripheral 1 and server 3 via the network, and transmits and receives job commands such as printing, document image data, and the like.

[0057] The communication unit 23 communicates with external devices such as an image forming apparatus, a mobile information terminal, an information processing apparatus, and a facsimile machine, and transmits and receives various information such as e-mail and fax to and from these external devices.

[0058] The operation panel 17 is composed of a display panel made up of a liquid crystal panel or the like, and a touch panel such as a capacitive type that is placed on top of the display panel and detects the position touched by a finger, and is equipped with a display unit 241 and an operation unit 242.

[0059] The display unit 241 is a part that displays various types of information. The display unit 241 is a display device such as a monitor or line display, which is configured by, for example, a CRT display, a liquid crystal display, or an EL display, and which displays electronic data such as the processing status of the operating system and application software.

[0060] The control unit 20 displays the operation and status of the user terminal 2 through the display unit 241.

[0061] The operation unit 242 is an interface for operating the user terminal 2, and is a part that receives commands from the user.

[0062] The display unit 241 and the operation unit 242 may be composed of a display panel made up of a liquid crystal panel or the like, and a touch panel such as a capacitive type that is placed on top of the display panel and detects the position touched by a finger.

[0063] <Server 3 schematic configuration> Next, the schematic configuration of the server 3 will be described with reference to FIG. FIG. 4 is a block diagram showing a schematic configuration of the server 3 shown in FIG.

[0064] As shown in FIG. 4, the server 3 includes a control unit 30, a storage unit 31, an image processing unit 32, a communication unit 33, a display unit , an operation unit 35, and a VNC client .

[0065] Each component of the server 3 will be described below.

[0066] The control unit 30 controls the server 3 in an integrated manner, and is composed of at least one CPU, at least one RAM, at least one ROM, various interface circuits, and the like.

[0067] The storage unit 31 is an element or storage medium that stores information, control programs, and the like required to realize various functions of the server 3. For example, a semiconductor element such as a RAM or a ROM, a hard disk, a flash storage unit, an SSD, or other storage medium may be used.

[0068] The image processing unit 32 is a part that performs processing such as enlarging or reducing the image displayed on the display unit 34 based on a command from the operation unit 35 so as to be suitable for output.

[0069] The communication unit 33 is a part that communicates with the digital multifunction peripheral 1, the user terminal 2, etc. via the network, and transmits and receives job commands such as printing, document image data, etc.

[0070] The display unit 34 has a display panel made up of a liquid crystal panel or the like, and is a part that displays various information. The display unit 34 is a display device such as a monitor or line display, which is configured with, for example, a CRT display, a liquid crystal display, or an EL display, and which displays electronic data such as the processing status of the operating system and application software.

[0071] The control unit 30 displays the operation and status of the server 3 through the display unit .

[0072] The operation unit 35 is an interface for operating the server 3 and is a part that receives commands from the administrative user of the server 3 .

[0073] The VNC client 36 is a client related to the VNC (Virtual Network Computing) service. The VNC client 36 may be configured by installing a predetermined application.

[0074] <Problems with conventional image forming systems> FIG. 5 is an explanatory diagram showing a problem with remote control of the digital multifunction peripheral 1 by the user terminal 2 in the conventional image forming system 100. In FIG.

[0075] Conventionally, a firewall or the like may prevent direct communication with the digital multifunction peripheral 1 in the local system 200. In such a case, the user terminal 2A cannot directly access the digital multifunction peripheral 1. However, as shown in Figure 5, by accessing the server 3, which is an intermediary device for the digital multifunction peripheral 1, via the cloud network 6, it becomes possible to remotely operate the digital multifunction peripheral 1.

[0076] However, building and operating such an environment is costly, and when such an environment is built using a pay-per-use cloud service, users are charged only for the amount of communication they use.

[0077] <Flow of remote control processing of the digital multifunction peripheral 1 according to the first embodiment of the present disclosure> Next, the flow of the remote control process of the digital multifunction peripheral 1 according to the first embodiment of the present disclosure will be described with reference to FIGS.

[0078] FIG. 6 is a flowchart showing an example of the flow of a remote control process of the digital multifunction peripheral 1 shown in FIG.

[0079] In step S1 of FIG. 6, the cloud network 6 determines whether or not a remote control request to the digital multifunction peripheral 1 has been received from the user terminal 2 (step S1).

[0080] When a remote control request to the digital multifunction peripheral 1 is received from the user terminal 2 (if the judgment in step S1 is Yes), in step S2, the cloud network 6 identifies the server 3, which is an intermediary device that manages the digital multifunction peripheral 1, via the communication unit 15 (step S2).

[0081] Next, in step S3, the cloud network 6 requests the server 3 identified in step S2 to wait for a specific communication (step S3). Furthermore, the cloud network 6 redirects the address of the server 3 and specific communication (information) for accessing the server 3 to the user terminal 2 that sent the remote control request. Examples of such specific communication (information) include using a specific signature or accessing a specific port number.

[0082] Next, in step S4, the control unit 30 of the server 3 determines whether the communication unit 33 has received a specific communication (step S4).

[0083] If the communication unit 33 receives the specific communication (if the determination in step S4 is Yes), in step S5, the control unit 30 accepts direct access to the server 3 from the user terminal 2 that sent the specific communication (step S5).

[0084] On the other hand, if the communication unit 33 does not receive the specific communication due to a firewall or the like of the local system 200 (if the judgment in step S4 is No), in step S6, the control unit 20 of the user terminal 2 that sent the specific communication causes the communication unit 23 to access the server 3 via the cloud network 6 (step S6).

[0085] After the process of step S5 or step S6, in step S7, the user terminal 2 starts remote control of the digital multifunction peripheral 1 (step S7).

[0086] Example 1 FIG. 7 is an explanatory diagram showing an example of a process when the digital multifunction peripheral 1 in the local system 200 shown in FIG. 1 is remotely operated from a user terminal 2A outside the local system 200. In FIG.

[0087] In the example of FIG. 7, a digital multifunction peripheral 1 and a server 3 serving as an intermediary device for the digital multifunction peripheral 1 are provided in an office network as a local system 200. On the other hand, a user terminal 2A and a cloud network 6 are provided outside the office network. Assume that a connection between the server 3 and the cloud network 6 has been established.

[0088] The cloud network 6 determines whether a remote control request to the digital multifunction peripheral 1 has been received from the user terminal 2A.

[0089] The cloud network 6 identifies the server 3, which is an intermediary device that manages the digital multifunction peripheral 1, and requests the server 3 to wait for specific communication (information). Furthermore, the cloud network 6 redirects the address of the server 3 and specific communication (information) for accessing the server 3 to the user terminal 2A.

[0090] Next, the server 3 determines whether or not it has received a specific communication (information) from the user terminal 2A. In the example of Figure 7, it is assumed that the server 3 has not received the specific communication (information) from the user terminal 2A due to a firewall in the office network.

[0091] In this case, since communication from the user terminal 2A to the server 3 is not possible, the user terminal 2A makes a remote control request to the digital multifunction peripheral 1 via the cloud network 6 by relay.

[0092] Then, when a connection between the user terminal 2A and the cloud network 6 is established and a relay connection to the server 3 via the cloud network 6 is established, remote control of the digital multifunction peripheral 1 from the user terminal 2A begins.

[0093] Example 2 FIG. 8 is an explanatory diagram showing an example of a process when the digital multifunction peripheral 1 in the local system 200 shown in FIG. 1 is remotely operated from the user terminal 2B in the local system 200. In FIG.

[0094] In the example of FIG. 8, a user terminal 2A, a digital multifunction peripheral 1, and a server 3 serving as an intermediary device for the digital multifunction peripheral 1 are provided in an office network as a local system 200. On the other hand, a cloud network 6 is provided outside the office network. Assume that a connection between the server 3 and the cloud network 6 has been established.

[0095] The cloud network 6 determines whether or not a remote control request to the digital multifunction peripheral 1 has been received from the user terminal 2B.

[0096] The cloud network 6 identifies the server 3, which is an intermediary device that manages the digital multifunction peripheral 1, and requests the server 3 to wait for specific communication (information). Furthermore, the cloud network 6 redirects the address of the server 3 and specific communication (information) for accessing the server 3 to the user terminal 2B.

[0097] Next, the server 3 determines whether or not it has received a specific communication (information) from the user terminal 2 B. In the example of Fig. 8, it is assumed that the server 3 has received a specific communication (information) from the user terminal 2 B.

[0098] In this case, assuming that communication from the user terminal 2B to the server 3 is possible, the user terminal 2B sends a remote control request to the digital multifunction peripheral 1 directly via the server 3, without going through the cloud network 6.

[0099] Then, when a connection between the user terminal 2B and the server 3 is established, remote control of the digital multifunction peripheral 1 from the user terminal 2B begins.

[0100] FIG. 9 is an explanatory diagram showing an example of a configuration for remotely controlling the digital multifunction peripheral 1 by the user terminal 2 in the image forming system 100 shown in FIG.

[0101] As shown in Figure 9, user terminal 2A accesses server 3, which is an intermediary device for digital multifunction peripheral 1, via cloud network 6, while user terminal 2B can remotely control digital multifunction peripheral 1 directly via server 3 without going through cloud network 6.

[0102] FIG. 10 is an explanatory diagram showing an example of a remote operation request screen displayed on the display unit 241 of the user terminal 2 shown in FIG.

[0103] As shown in FIG. 10, the user can make a remote operation request by pressing the "Remote Operation" button displayed on the display unit 241.

[0104] FIG. 11 is an explanatory diagram showing an example of a remote operation screen of the digital multifunction peripheral 1 via the cloud network 6, which is displayed on the display unit 241 of the user terminal 2 shown in FIG.

[0105] As shown in FIG. 11, when the digital multifunction peripheral 1 is remotely operated via the cloud network 6, the address bar displays the URL of the Internet environment (for example, "example.com").

[0106] FIG. 12 is an explanatory diagram showing an example of a remote operation screen of the digital multifunction peripheral 1 when not via the cloud network 6, which is displayed on the display unit 241 of the user terminal 2 shown in FIG.

[0107] As shown in FIG. 12, when remotely operating the digital multifunction peripheral 1 via the cloud network 6, the address bar displays the URL of the private network (for example, "example.internal," "192.168.0.3," etc.).

[0108] Example 3 FIG. 13 is an explanatory diagram showing another example of the process when the digital multifunction peripheral 1 in the local system 200 shown in FIG. 1 is remotely operated from the user terminal 2B outside the local system 200. In FIG.

[0109] In the example of FIG. 13, a digital multifunction peripheral 1 and a server 3 serving as an intermediary device for the digital multifunction peripheral 1 are provided in an office network as a local system 200. On the other hand, a user terminal 2A and a cloud network 6 are provided outside the office network. Assume that a connection between the server 3 and the cloud network 6 has been established.

[0110] Furthermore, it is assumed that an external terminal that happens to have the same IP address as server 3 is provided outside the office network.

[0111] The cloud network 6 determines whether a remote control request to the digital multifunction peripheral 1 has been received from the user terminal 2A.

[0112] The cloud network 6 identifies the server 3, which is an intermediary device that manages the digital multifunction peripheral 1, and requests the server 3 to wait for specific communication (information). Furthermore, the cloud network 6 redirects the address of the server 3 and specific communication (information) for accessing the server 3 to the user terminal 2A.

[0113] Here, there may be a case where a specific communication (information) from the user terminal 2A is received by an external terminal that happens to have the same IP address as the server 3. To avoid such problems, when communication is made with the IP address of server 3, it is determined that the other party is the intended party, for example, by checking whether or not predetermined information matches.

[0114] The server 3 sets an end point for connection confirmation with predetermined information based on an instruction from the device management device. By doing this, when a specific communication (information) is received from an external terminal that happens to have the same IP address as the server 3, it becomes possible to determine that this is an unintended response.

[0115] As a result, the user terminal 2A determines that communication with the server 3 is not possible, and sends a remote control request to the digital multifunction peripheral 1 via the cloud network 6 as a relay.

[0116] Then, when a connection between the user terminal 2A and the cloud network 6 is established and a relay connection to the server 3 via the cloud network 6 is established, remote control of the digital multifunction peripheral 1 from the user terminal 2A begins.

[0117] In this way, when remotely operating the digital multifunction printer 1 from the user terminal 2, an image forming system 100 can be realized that can establish communication with the digital multifunction printer 1 more efficiently than before by selecting a connection via an appropriate route depending on the communication conditions.

[0118] Preferred aspects of the present disclosure include any combination of the above-described aspects. In addition to the above-described embodiments, various modifications may be made to this disclosure. These modifications should not be interpreted as not belonging to the scope of this disclosure. This disclosure should include all modifications within the scope of the claims and their equivalents. [Explanation of symbols]

[0119] 1: Digital multifunction peripheral, 2, 2A, 2B: User terminal, 3: Server, 4: Local network, 5: Internet, 6: Cloud network, 10, 20, 30: Control unit, 11: Image data acquisition unit, 12: Image forming unit, 13, 21, 31: Storage unit, 14, 22, 32: Image processing unit, 15, 23, 33: Communication unit, 16: VNC server, 17, 24: Operation panel, 34, 171, 241: Display unit, 35, 172, 242: Operation unit, 36: VNC client, 100: Image forming system, 200: Local system

Claims

1. a communication unit that communicates with external devices via a network; A terminal device including a control unit that controls the communication unit, A terminal device characterized in that, when attempting to remotely control an external device, if direct communication is possible with the address of the device or an intermediary device that mediates the device, the control unit establishes communication with the device or the intermediary device and remotely controls the device, and on the other hand, if direct communication is not possible with the address of the device or the intermediary device, the control unit establishes communication with the device using a predetermined external system that relays remote control with the device or the intermediary device and remotely controls the device.

2. the device is provided within a predetermined local network and communicates with the communication unit via the intermediary device; The terminal device described in claim 1, wherein when the control unit attempts to remotely control the device, if direct communication is possible with the address of the intermediary device, it establishes communication with the device via the intermediary device and remotely controls the device, while if direct communication is not possible with the address of the intermediary device, it uses the external system to establish communication with the device via the intermediary device and remotely controls the device.

3. the external system includes a device management device that communicates with the intermediate device via a firewall; the control unit, when attempting to remotely control the device, causes the communication unit to obtain connection information for establishing a connection with the intermediate device within the local network from the device management device; A terminal device as described in claim 2, wherein if direct communication with the address of the intermediary device is possible based on the connection information, communication with the device is established via the intermediary device and the device is remotely controlled, while if direct communication is not possible based on the connection information, communication with the device is established via the intermediary device using the external system and the device is remotely controlled.

4. 4. The terminal device according to claim 3, wherein the connection information includes information for determining whether the address of the intermediate device is an intended party when the communication unit communicates with the address of the intermediate device.

5. The terminal device according to claim 3, wherein when the communication unit establishes communication with the device via the intermediary device, the control unit transmits information related to the operation of the device to the intermediary device to remotely control the device, and when the communication unit establishes communication with the device via the intermediary device using the external system, the control unit transmits information related to the operation of the device to the device management device to remotely control the device.

6. A communication method for a terminal device that communicates with an external device via a network, comprising: A communication method for a terminal device, characterized in that when attempting to remotely control an external device, if direct communication is possible with the address of the device or an intermediary device that mediates the device, communication with the device or the intermediary device is established and the device is remotely controlled, and if direct communication is not possible with the address of the device or the intermediary device, communication with the device is established using a predetermined external system that relays remote control with the device or the intermediary device, and the device is remotely controlled.

7. A communication control program executed by a processor of a terminal device that communicates with an external device via a network, A communication control program for a terminal device characterized in that, when attempting to remotely control an external device, if direct communication is possible with the address of the device or an intermediary device that mediates the device, communication with the device or the intermediary device is established and the device is remotely controlled, and if direct communication is not possible with the address of the device or the intermediary device, communication with the device is established using a predetermined external system that relays remote control with the device or the intermediary device, and the device is remotely controlled.

8. A communication system comprising devices and terminal devices communicably connected via a network, A communication system characterized in that, when the terminal device attempts to remotely control the device, if direct communication is possible with the address of the device or an intermediary device that mediates the device, the terminal device establishes communication with the device or the intermediary device and remotely controls the device, and on the other hand, if direct communication is not possible with the address of the device or the intermediary device, the terminal device establishes communication with the device using a predetermined external system that relays remote operation with the device or the intermediary device and remotely controls the device.

Images