COMMUNICATION SYSTEM, COMMUNICATION METHOD, AND COMMUNICATION PROGRAM

Abstract

A work terminal (10) notifies a remote terminal (20) of a linking display ID for a local UI component, which is a UI component corresponding to a UI component displayed on a host device and which is to be displayed on the remote terminal (20). The remote terminal (20) then displays the local UI component associated with the linking display ID received from the work terminal (10). Then when input information is entered into the displayed local UI component, the remote terminal (20) transmits the input information to the work terminal (10). The work terminal (10) then reflects the input information in the UI component corresponding to the local UI component.

Description

[Technical field]

[0001] The present invention relates to a communication system, a communication method, and a communication program. [Background technology]

[0002] Conventionally, UI extension technology has been proposed as a technology that realizes the productivity factory of operators by overlaying function extensions such as text input boxes and input checks on the web screen without modifying the system. In addition, work is sometimes performed in a remote environment where a remote terminal such as a home is remotely connected to a work terminal in the company. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-072872 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional UI extension technology had the problem that it was not possible to easily improve work efficiency without degrading operability, even in a remote environment. For example, when operating in a remote environment (remote terminal → work terminal), in addition to the conventional processing delay, there are also effects of the network, such as communication delays and packet loss. This can lead to selections that are different from the intended operation or incorrect input of characters, resulting in degraded operability and reduced work efficiency. Furthermore, to resolve this, it was necessary to modify the remote desktop application and create a function to accumulate text information and send it all at once.

[0005] The present invention has been made in consideration of the above, and aims to provide a communication system, a communication method, and a communication program that can easily improve business efficiency without reducing operability in a remote environment. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the communication system of the present invention is a communication system having a work terminal and a remote terminal connected to the work terminal, wherein the work terminal has a notification unit that notifies the remote terminal of a first identifier of a local UI widget displayed on the remote terminal, which is a UI widget corresponding to a UI widget displayed on the work terminal itself, and a reflection unit that, when input information is received from the remote terminal, reflects the input information in the UI widget corresponding to the local UI widget, and the remote terminal has a display control unit that displays a local UI widget corresponding to the first identifier of the local UI widget received from the work terminal, and a transmission unit that, when input information is input to the local UI widget displayed by the display control unit, transmits the input information to the work terminal. Effect of the Invention

[0007] According to the present invention, it is possible to easily improve work efficiency in a remote environment without deteriorating operability. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a communication system according to this embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating the configuration of the operation terminal of the present embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of information stored in the associated ID storage unit. [Figure 4] FIG. 4 is a block diagram illustrating a configuration of a remote terminal according to the present embodiment. [Diagram 5] FIG. 5 is a diagram for explaining an overview of the processing of the operation terminal and the remote terminal in the communication system. [Figure 6] FIG. 6 is a diagram for explaining an overview of the processing of the operation terminal and the remote terminal in the communication system. [Figure 7] FIG. 7 is a diagram illustrating the problems associated with the conventional technology. [Figure 8] FIG. 8 is a diagram illustrating the problem in the conventional technology. [Figure 9] FIG. 9 is a diagram illustrating the effect of the communication system according to the present embodiment. [Figure 10] FIG. 10 is a diagram illustrating the effect of the communication system according to the present embodiment. [Figure 11] FIG. 11 is a sequence diagram showing an example of a processing flow of the communication system according to the present embodiment. [Figure 12] FIG. 12 is a sequence diagram showing an example of a processing flow of a communication system according to another embodiment. [Figure 13] FIG. 13 is a sequence diagram showing an example of a processing flow of a communication system according to another embodiment. [Figure 14] FIG. 14 is a sequence diagram showing an example of a processing flow of a communication system according to another embodiment. [Figure 15] FIG. 15 is a diagram illustrating a computer that executes a program. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of a communication system, a communication method, and a communication program according to the present application will be described in detail with reference to the drawings. Note that the communication system, the communication method, and the communication program according to the present application are not limited to the embodiments.

[0010] [Communication system configuration] Fig. 1 is a block diagram showing an example of the configuration of a communication system according to the present embodiment. Note that the configuration shown in Fig. 1 is merely an example, and the specific configuration is not particularly limited.

[0011] 1, the communication system of the present embodiment includes a work terminal 10 and a remote terminal 20, which are connected via a network 30. For example, the communication system is a remote environment in which a remote terminal 20, such as a home terminal, can remotely connect to the work terminal 10 in a company to perform a task.

[0012] The work terminal 10 and the remote terminal 20 may be, for example, a desktop PC, a notebook PC, a tablet PC, a smartphone, or other terminal, and may be any type of information processing device.

[0013] The remote terminal 20 operates a function of transmitting input information from input devices such as a user's mouse and keyboard to the work terminal 10 and displaying on the screen the screen display information received from the work terminal 10. This function is generally realized as an application in the user terminal, and is displayed as a window like other applications in the remote terminal 20. Note that the screen display information received from the work terminal 10 may be the entire virtual desktop on the work terminal 10 side, or may be in units of windows within the virtual desktop.

[0014] In the communication system of the present embodiment, the work terminal 10 notifies the remote terminal 20 of the association ID of a local UI widget that corresponds to a UI widget displayed on the work terminal 10 and is displayed on the remote terminal 20. Then, the remote terminal 20 displays the local UI widget that corresponds to the association ID of the local UI widget received from the work terminal 10.

[0015] Next, when input information is input to the displayed local UI widget, the remote terminal 20 transmits the input information to the work terminal 10. Then, the work terminal 10 reflects the input information in a UI widget corresponding to the local UI widget.

[0016] That is, in the communication system of the present embodiment, for example, a local UI component displayed on the remote terminal 20 side is linked to a UI component displayed on the connected work terminal 10, and input information input to the local UI component on the remote terminal 20 side is transmitted to the work terminal that is the transmission link destination and reflected. This allows the operator to work in the communication system without feeling the above-mentioned decrease in operability due to the reflection network environment, thereby making it possible to suppress a decrease in work efficiency.

[0017] [Work terminal configuration] Fig. 2 is a block diagram illustrating the configuration of a work terminal of this embodiment. As illustrated in Fig. 2, the work terminal 10 of this embodiment is realized by a general-purpose computer such as a personal computer, and has a communication processing unit 11, an input unit 12, an output unit 13, a control unit 14, and a storage unit 15.

[0018] The communication processing unit 11 is realized by a NIC (Network Interface Card) or the like, and controls communication between an external device and the control unit 14 via a telecommunication line such as a LAN (Local Area Network) or the Internet. For example, the communication processing unit 11 controls communication between a remote terminal 20 and the control unit 14.

[0019] The input unit 12 is realized by using input devices such as a keyboard and a mouse, and inputs various instruction information such as a command to start processing to the control unit 14 in response to an input operation by an operator. The output unit 13 is realized by a display device such as a liquid crystal display.

[0020] The storage unit 15 stores data and programs necessary for various processes by the control unit 14, and has an associated ID storage unit 15a, a received ID storage unit 15b, and an input information storage unit 15c. For example, the storage unit 15 is a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.

[0021] The associated ID storage unit 15a associates and stores a local UI widget displayed on the remote terminal 20 with a UI widget displayed on the connected work terminal 10, in association with the associated ID. For example, as illustrated in Fig. 3, the associated ID storage unit 15a associates and stores an associated ID, an ID of a UI widget displayed on the connected work terminal 10, and an ID of a local UI widget displayed on the remote terminal 20. Fig. 3 is a diagram illustrating an example of information stored in the associated ID storage unit.

[0022] The received ID storage unit 15b stores the received ID assigned to the connection information received from the remote terminal 20. The input information storage unit 15c stores the input information received from the remote terminal 20.

[0023] The control unit 14 has an internal memory for storing programs that define various processing procedures and required data, and executes various processes using these. For example, the control unit 14 has a notification unit 14a and a reflection unit 14b. Here, the control unit 14 is an electronic circuit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0024] The notification unit 14a notifies the remote terminal 20 of an association ID of a local UI widget that corresponds to a UI widget displayed on the local device and is displayed on the remote terminal 20. For example, when displaying a UI widget on the output unit 13, the notification unit 14a acquires an association ID linked to a local UI widget that corresponds to the UI widget from the association ID storage unit 15a. Then, the notification unit 14a notifies the remote terminal 20 of screen information that includes the acquired association ID and a code (e.g., a QR code (registered trademark)) indicating coordinate information indicating coordinates at which the local UI widget is to be displayed on the remote terminal 20.

[0025] When the reflection unit 14b receives input information from the remote terminal 20, the reflection unit 14b reflects the input information in a UI widget corresponding to a local UI widget. For example, the reflection unit 14b receives an association ID together with the input information from the remote terminal 20, identifies a UI widget corresponding to the association ID, and reflects the input information in the identified UI widget.

[0026] Furthermore, when the reflection unit 14b receives a reception ID together with the input information, it determines whether the reception ID is consecutive with the previously received reception ID, and if not, it requests retransmission from the remote terminal 20. Furthermore, when the reflection unit 14b receives a reception ID together with the input information, it determines whether the reception ID is a duplicate of the previously received reception ID, and if they are a duplicate, it reflects the received input information or discards the received input information.

[0027] [Remote terminal configuration] Fig. 4 is a block diagram illustrating the configuration of a remote terminal of this embodiment. As illustrated in Fig. 4, the remote terminal 20 of this embodiment is realized by a general-purpose computer such as a personal computer, and has a communication processing unit 21, an input unit 22, an output unit 23, a control unit 24, and a storage unit 25.

[0028] The communication processing unit 21 is realized by a NIC (Network Interface Card) or the like, and controls communication between an external device and the control unit 24 via an electric communication line such as a LAN (Local Area Network) or the Internet. For example, the communication processing unit 21 controls communication between the work terminal 10 and the control unit 24.

[0029] The input unit 22 is realized by using input devices such as a keyboard and a mouse, and inputs various instruction information such as a command to start processing to the control unit 24 in response to an input operation by an operator. The output unit 23 is realized by a display device such as a liquid crystal display.

[0030] The storage unit 25 stores data and programs necessary for various processes by the control unit 24, and includes an associated ID storage unit 25a and an input information storage unit 25b. For example, the storage unit 25 is a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.

[0031] The associated ID storage unit 25a associates and stores a local UI widget displayed on the remote terminal 20 with a UI widget displayed on the connected work terminal 10, in association with the associated ID. The input information storage unit 25b stores input information input to the local UI widget.

[0032] The control unit 24 has an internal memory for storing programs that define various processing procedures and required data, and executes various processes using these. For example, the control unit 24 has a display control unit 24a and a transmission unit 24b. Here, the control unit 24 is an electronic circuit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0033] The display control unit 24a displays a local UI widget corresponding to the association ID of the local UI widget received from the work terminal 10. For example, when the display control unit 24a receives screen information from the work terminal, including a code (e.g., a QR code) indicating an association ID corresponding to the local UI widget to be displayed and coordinate information for displaying the local UI widget, the display control unit 24a displays a screen based on the screen information. Then, the display control unit 24a acquires the code from the displayed screen by image recognition, and acquires the association ID and coordinate information indicated by the code. Next, the display control unit 24a searches the association ID storage unit 25a for a local UI widget corresponding to the acquired association ID, and overlays the searched local ID widget at the coordinate position of the remote desktop screen indicated by the coordinate information. Note that the display control unit 24a may analyze the resolution of the displayed code, and enlarge or reduce the local UI widget according to the resolution before displaying it.

[0034] When input information is input to a local UI component displayed by the display control unit 24a, the transmission unit 24b transmits the input information to the work terminal 10. For example, when input information is input to a local UI component, the transmission unit 24b may store the input information in the input information storage unit 25b, and when the input information is accumulated in the input information storage unit 25b to a predetermined threshold or more, the transmission unit 24b may transmit the input information stored in the input information storage unit 25b to the work terminal 10.

[0035] Furthermore, the transmission unit 24b assigns a predetermined consecutive reception ID to the input information of the local UI component, and transmits the reception ID together with the input information to the work terminal 10. Furthermore, when there is no predetermined response from the work terminal 10, the transmission unit 24b stores the input information in the input information storage unit 25b, and when there is a predetermined response from the work terminal 10, the transmission unit 24b transmits the input information stored in the input information storage unit 25b to the work terminal 10.

[0036] In this manner, in the communication system, the local UI component on the remote terminal 20 side and the UI component on the working terminal 10 are linked using an association ID. Then, to check whether the transmission from the remote terminal 20 was successful, a transmission ID is assigned to the transmission information, and the remote terminal 20 and the working terminal 10 check the transmission and reception history. Furthermore, the remote terminal 20 may resend the information if there is a missing number in the transmission ID.

[0037] Also, the input information input to the remote terminal 20 may be stored for an arbitrary period of time and output all at once. This makes it possible to reduce the load on the network in the communication system compared to sending each time. Also, the remote terminal 20 may observe, for example, a situation in which packets are lost due to a deterioration in signal quality, and when the loss rate is equal to or exceeds an arbitrary rate, the remote terminal may send the output information multiple times to improve the rate of arrival at the operating terminal.

[0038] Here, an overview of the processing of the work terminal 10 and the remote terminal 20 in the communication system will be described with reference to Fig. 5 and Fig. 6. Fig. 5 and Fig. 6 are diagrams for explaining an overview of the processing of the work terminal and the remote terminal in the communication system. As illustrated in Fig. 5(1), when displaying a UI widget, the notification unit 14a of the work terminal 10 acquires an association ID (in the examples of Figs. 5 and 6, described as an association display ID) associated with a local UI widget corresponding to the UI widget from the association ID storage unit 15a. Then, the notification unit 14a notifies the remote terminal 20 of screen information including a QR code indicating the acquired association ID and coordinate information indicating the coordinates at which the local UI widget is to be displayed on the remote terminal 20.

[0039] Then, as illustrated in (2) of FIG. 5, when the display control unit 24a of the remote terminal 20 receives screen information from the work terminal, the display control unit 24a displays a screen based on the screen information, when the display control unit 24a receives screen information including a code (e.g., a QR code) indicating an association ID corresponding to a local UI component to be displayed and coordinate information for displaying the local UI component. The display control unit 24a then acquires the code from the displayed screen by image recognition, and acquires the association ID and coordinate information indicated by the code. Next, the display control unit 24a searches for a local UI component corresponding to the acquired association ID from the association ID storage unit 25a (described as internal storage (or DB) in the example of FIG. 5).

[0040] 6(3), the display control unit 24a overlays the searched local ID part at the coordinate position of the remote desktop screen indicated by the coordinate information. After that, when input information is input to the local UI part displayed by the display control unit 24a, the transmission unit 24b transmits the input information to the work terminal 10.

[0041] Then, as illustrated in (4) of FIG. 6, the reflection unit 14b of the working terminal 10 receives the association ID together with the input information from the remote terminal 20, identifies a UI widget corresponding to the association ID, and reflects the input information in the identified UI widget.

[0042] Here, the conventional problem will be described with reference to FIG. 7 and FIG. 8. FIG. 7 and FIG. 8 are diagrams for explaining the conventional problem. As illustrated in FIG. 7, conventionally, the remote terminal side transmits input information one by one, and the work terminal side reflects the input information one by one. In this case, if delay or packet loss occurs due to the influence of the network environment, it causes erroneous input. Therefore, as illustrated in FIG. 8, even if a user inputs characters at a remote terminal, input errors and correction errors occur repeatedly due to the influence of the network. In other words, for example, when a user inputs text at a remote terminal, there was a conventional problem that the user could not input characters as he or she wanted due to the influence of delay or packet loss on the network, and the work efficiency decreased.

[0043] Next, the effect of the communication system according to the present embodiment will be described with reference to FIG. 9 and FIG. 10. FIG. 9 and FIG. 10 are diagrams for explaining the effect of the communication system according to the present embodiment. As shown in FIG. 9, in the communication system according to the present embodiment, the local UI widget "A" of the remote terminal 20 and the UI widget "B" of the working terminal 10 are independent, but are linked to each other by a linking ID. Therefore, even if a delay or packet loss occurs, it is possible to prevent the occurrence of an erroneous input. That is, as exemplified in FIG. 10, the remote terminal 20 inputs to a local UI widget, which is a UI widget displayed only on the remote terminal 20, so that it is possible to avoid mistakes caused by the network without modifying the remote desktop application, and as a result, it is possible to suppress a decrease in work efficiency.

[0044] [Communication system processing procedure] Next, an example of a processing procedure of processing executed by the work terminal 10 and the remote terminal 20 in the communication system will be described with reference to Fig. 11. Fig. 11 is a sequence diagram showing an example of a processing flow of the communication system according to the present embodiment.

[0045] 11, the remote terminal 20 determines whether an associated ID (referred to as an associated display ID in FIG. 11) is present in the associated ID storage unit 25a (referred to as DB in FIG. 11) (step S101). As a result, if the associated ID is not present in the associated ID storage unit 25a (step S101: No), the remote terminal 20 outputs an error (step S102) and ends the process.

[0046] If the associated ID is stored in the associated ID storage unit 25a (Yes at step S101), the remote terminal 20 performs a transmission / reception test (step S103). The working terminal 10 receives the link test from the remote terminal 20 (step S104) and transmits a link success response to the remote terminal 20 (step S105).

[0047] Then, the remote terminal 20 checks the bidirectional communication link (step S106), and if the bidirectional communication link cannot be confirmed (step S106 No), the process returns to step S103. If the bidirectional communication link can be confirmed (step S106 Yes), the remote terminal 20 displays a local UI component corresponding to the associated ID of the local UI component received from the work terminal 10, acquires a code from the displayed screen by image recognition, acquires the associated ID indicated by the code, and determines whether the acquired associated ID is in the associated ID storage unit 25a (step S107). As a result, if the acquired associated ID is not in the associated ID storage unit 25a (step S107 No), the remote terminal 20 returns to the process of step S101.

[0048] Furthermore, if the acquired associated ID is in the associated ID storage unit 25a (Yes in step S107), the remote terminal 20 determines whether the associated ID can be acquired from the associated ID storage unit 25a (step S108). If the remote terminal 20 is unable to acquire the associated ID from the associated ID storage unit 25a (No in step S108), it outputs an error (step S109) and ends the process.

[0049] Furthermore, if the remote terminal 20 can acquire the associated ID from the associated ID storage unit 25a (Yes in step S108), it starts displaying the UI widget of the corresponding ID (step S110). That is, the remote terminal 20 displays the local UI widget corresponding to the associated ID in an overlay manner. Then, the remote terminal 20 determines whether there is an input judgment to the local UI widget (step S111), and if there is no input judgment (No in step S111), returns to step S101. Furthermore, if there is an input judgment (Yes in step S111), the remote terminal 20 assigns the reception ID to the input information (step S112), stores it in the input information storage unit 25b (described as the information accumulation unit in FIG. 11) (step S113), and transmits the input information and the reception ID to the work terminal 10 (step S114).

[0050] The work terminal 10 then receives text information as input information (step S115) and determines whether the received information includes a reception ID (step S116). If there is no reception ID (step S116: No), the work terminal 10 discards the received information (step S117) and ends the process. If there is a reception ID (step S116: Yes), the work terminal 10 records the reception ID in the reception ID storage unit 15b (step S118) and determines whether the same reception ID has been received multiple times (step S119).

[0051] As a result, if the same reception ID is received twice (Yes in step S119), the work terminal 10 overwrites the received information with new information (step S120). Note that, if the same reception ID is received twice, the work terminal 10 may discard the received information. If the same reception ID is not received twice (No in step S119), the work terminal 10 determines whether the reception IDs are consecutive (step S121). As a result, if the reception IDs are consecutive (Yes in step S121), the work terminal 10 returns a response of reception completion information to the remote terminal 20 (step S122), and displays the input information in the UI widget corresponding to the associated ID (step S123). In other words, the work terminal 10 reflects the input information in the UI widget.

[0052] Furthermore, if the received IDs are not consecutive (step S121, No), the working terminal 10 determines whether or not the ID is one for which retransmission has been requested (step S124). As a result, if the ID is one for which retransmission has been requested (step S124, Yes), the working terminal 10 proceeds to the process of step S122. Furthermore, if the ID is not one for which retransmission has been requested (step S124, No), the working terminal 10 requests the remote terminal 20 to retransmit the missing received ID (missing ID) (step S125). Then, the remote terminal 20 retransmits the requested corresponding received ID and input information to the working terminal 10 (step S126), and proceeds to the process of step S115.

[0053] The remote terminal 20 also determines whether a reception completion notification has been received from the work terminal 10 (step S127), and if the reception completion notification has not been received from the work terminal 10 (step S127: No), it resends the reception ID and the input information to the work terminal 10 (step S128) and proceeds to the process of step S115. If the remote terminal 20 has received a reception completion notification from the work terminal 10 (step S127: Yes), it records the reception ID in the transmission / reception history section (not shown) (step S129), deletes the information of the corresponding ID (step S130), and returns to step S101.

[0054] Further, the flow of the process executed by the work terminal 10 and the remote terminal 20 in the communication system is not limited to this. An example of the process flow of the communication system according to another embodiment will be described below with reference to Figs. 12 to 14. Note that a description of the same process as in Fig. 11 will be omitted. Figs. 12 to 14 are sequence diagrams showing an example of the process flow of the communication system according to another embodiment.

[0055] As shown in FIG. 12, the remote terminal 20 may suppress frequent information transmission by transmitting the input information in a lump when the input amount reaches a certain amount. In the example of FIG. 12, when the remote terminal 20 determines that there is an input determination (Yes in step S111), it determines whether the information accumulation amount of the input information in the input information storage unit 25b is equal to or greater than a certain amount (step S201). As a result, when the information accumulation amount of the input information in the input information storage unit 25b is not equal to or greater than a certain amount (No in step S201), the remote terminal 20 returns to step S107. Also, when the information accumulation amount of the input information in the input information storage unit 25b is equal to or greater than a certain amount (Yes in step S201), the remote terminal 20 proceeds to step S112. That is, when the input information is accumulated in the input information storage unit 25b to a predetermined threshold or more, the remote terminal 20 transmits the input information stored in the input information storage unit 25b to the work terminal 10.

[0056] Next, as shown in Fig. 13, the remote terminal 20 may perform multiplexing in consideration of packet loss to improve the reception probability on the working terminal 10 side. In the example of Fig. 13, when the remote terminal 20 determines that the associated ID is present in the associated ID storage unit 25a (Yes in step S101), the remote terminal 20 performs a transmission / reception test N times set in advance (step S301). The working terminal 10 receives a link test from the remote terminal 20 (step S302), and transmits a response indicating that the link is successful to the remote terminal 20 (step S303).

[0057] Then, the remote terminal 20 checks the bidirectional communication link (step S304), and if the bidirectional communication link cannot be confirmed (step S304: No), the process returns to step S301. If the remote terminal 20 can confirm the bidirectional communication link (step S304: Yes), the remote terminal 20 turns on the setting for multiple transmission of the same information (step S305), accepts text input by the input unit 12, and starts the operation of displaying local UI components (step S306).

[0058] Then, the remote terminal 20 determines whether there is an input judgment to the local UI widget (step S307), and if there is no input judgment (step S307 No), returns to step S306. If there is an input judgment (step S307 Yes), the remote terminal 20 assigns a reception ID to the input information (step S308), stores it in the input information storage unit 25b (described as storage unit in FIG. 13) (step S309), and transmits the input information and the reception ID to the work terminal 10 n times (steps S310 to S312).

[0059] In this way, the remote terminal 20 can improve the reception probability on the working terminal 10 side by performing multiplex transmission taking into consideration packet loss. When the remote terminal 20 can confirm a bidirectional communication link, it determines whether the communication quality is equal to or higher than a specified value, and performs the process from step S305 onwards only if the communication quality is less than the specified value, and if the communication quality is equal to or higher than the specified value, it may not perform multiplex transmission as in the process of FIG.

[0060] Next, as shown in FIG. 14, when a continuous communication interruption occurs due to a network failure, the remote terminal 20 may store input information and resume transmission when the communication is restored. As shown in FIG. 14, when the remote terminal 20 determines that the associated ID is present in the associated ID storage unit 25a (Yes in step S101), it performs a transmission / reception test (step S401). Here, in the example of FIG. 14, it is assumed that the transmission / reception test has failed because a network failure has occurred. Then, the remote terminal 20 checks the bidirectional communication link (step S402), and if it cannot be confirmed (No in step S402), it repeats the processes of steps S401 to S402 multiple times to determine whether the communication interruption is continuous (step S403).

[0061] If the remote terminal 20 determines that communication has been interrupted continuously (Yes at step S403), it displays the local UI widget (step S404). The remote terminal 20 then determines whether a text input section is displayed as part of the displayed local UI widget (step S405). As a result, if a text input section is displayed (Yes at step S405), the remote terminal 20 determines whether there is an input determination to the local UI widget (step S406). Here, if there is no text input section displayed in step S405 (No at step S405) or there is no input determination to the local UI widget (No at step S406), it displays an error indicating a network failure (step S407).

[0062] Furthermore, when it is determined that there is an input to a local UI component (Yes at step S406), the remote terminal 20 stores the input information in the input information storage unit 25b (step S408), and returns to step S101. In this manner, when a continuous communication interruption occurs due to a network failure, the remote terminal 20 may store the input information and resume transmission when communication is restored.

[0063] [Effects of the embodiment] As described above, in the communication system according to the embodiment, the work terminal 10 notifies the remote terminal 20 of the association ID of a local UI widget that corresponds to a UI widget displayed on the work terminal 10 and is displayed on the remote terminal 20. Then, the remote terminal 20 displays a local UI widget that corresponds to the association ID of the local UI widget received from the work terminal 10. Next, when input information is input to the displayed local UI widget, the remote terminal 20 transmits the input information to the work terminal 10. Then, the work terminal 10 reflects the input information in the UI widget that corresponds to the local UI widget. Therefore, in the communication system according to the embodiment, it is possible to easily improve business efficiency in a remote environment without deteriorating operability.

[0064] In other words, by separating the screen display of input information of the local UI parts on the remote terminal 20 from the work terminal 10 and separately transmitting the input information to the UI parts of the work terminal 10, the operator can avoid display delays and input errors caused by delays and packet loss due to the network, and can easily improve work efficiency without reducing operability.

[0065] [System configuration, etc.] Each component of each device shown in the figures according to the above embodiment is a functional concept, and does not necessarily have to be physically configured as shown in the figures. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figures, and all or a part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc. Furthermore, each processing function performed by each device can be realized in whole or in any part by a CPU and a program analyzed and executed by the CPU, or can be realized as hardware using wired logic.

[0066] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, control procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified.

[0067] 〔program〕 It is also possible to create a program in which the processes executed by the work terminal 10 and the remote terminal 20 described in the above embodiment are written in a language executable by a computer. In this case, the same effects as those of the above embodiment can be obtained by having the computer execute the program. Furthermore, such a program may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read and executed by a computer to realize the same processes as those of the above embodiment.

[0068] Fig. 15 is a diagram showing a computer that executes a program. As shown in Fig. 15, a computer 1000 includes, for example, a memory 1010, a CPU 1020, a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070, and these components are connected by a bus 1080.

[0069] The memory 1010 includes a ROM (Read Only Memory) 1011 and a RAM 1012, as exemplified in FIG. 15. The ROM 1011 stores a boot program such as a BIOS (Basic Input Output System). The hard disk drive interface 1030 is connected to a hard disk drive 1090, as exemplified in FIG. 15. The disk drive interface 1040 is connected to a disk drive 1100, as exemplified in FIG. 15. For example, a removable storage medium such as a magnetic disk or an optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to, for example, a mouse 1110 and a keyboard 1120, as exemplified in FIG. 15. The video adapter 1060 is connected to, for example, a display 1130, as exemplified in FIG. 15.

[0070] 15, the hard disk drive 1090 stores, for example, an OS 1091, an application program 1092, a program module 1093, and program data 1094. That is, the above programs are stored in, for example, the hard disk drive 1090 as program modules in which instructions to be executed by the computer 1000 are written.

[0071] Furthermore, the various data described in the above embodiment are stored as program data, for example, in the memory 1010 or the hard disk drive 1090. Then, the CPU 1020 reads out the program module 1093 and the program data 1094 stored in the memory 1010 or the hard disk drive 1090 into the RAM 1012 as necessary, and executes various processing procedures.

[0072] Note that the program module 1093 and program data 1094 relating to the program are not limited to being stored in the hard disk drive 1090, and may be stored in, for example, a removable storage medium and read by the CPU 1020 via a disk drive or the like. Alternatively, the program module 1093 and program data 1094 relating to the program may be stored in another computer connected via a network (such as a local area network (LAN) or wide area network (WAN)) and read by the CPU 1020 via the network interface 1070.

[0073] Although the embodiment to which the invention made by the present inventor is applied has been described above, the present invention is not limited by the description and drawings which form a part of the disclosure of the present invention according to the present embodiment. In other words, other embodiments, examples, operation techniques, etc. made by those skilled in the art based on the present embodiment are all included in the scope of the present invention. [Explanation of symbols]

[0074] 10 Work Station 11, 21 Communication processing unit 12, 22 Input section 13, 23 Output section 14, 24 Control section 14a Notification section 14b Reflection part 15, 25 Storage section 15a, 25a Linked ID storage section 15b Received ID storage section 15c, 25b Input information storage section 24a Display control unit 14b Transmitter

Claims

1. In a communication system having a work terminal and a remote terminal connected to the work terminal, The work terminal includes: a notification unit configured to notify a remote terminal of a first identifier of a local UI component that corresponds to a UI component displayed on the local device and is displayed on the remote terminal; a reflection unit that reflects, when input information is received from the remote terminal, the input information in the UI component corresponding to the local UI component; having The remote terminal comprises: a display control unit that displays a local UI component corresponding to a first identifier of the local UI component received from the operating terminal; a transmission unit that transmits input information to the work terminal when input information is input to the local UI part displayed by the display control unit; having The communication system is characterized in that when the input information is input to the local UI component, the transmission unit stores the input information in a memory unit, and when the input information accumulates in the memory unit to a predetermined threshold or more, the transmission unit transmits the input information stored in the memory unit to the work terminal.

2. A communication system having a work terminal and a remote terminal connected to the work terminal, The work terminal includes: a notification unit configured to notify a remote terminal of a first identifier of a local UI component that corresponds to a UI component displayed on the local device and is displayed on the remote terminal; a reflection unit that reflects, when input information is received from the remote terminal, the input information in the UI component corresponding to the local UI component; having The remote terminal comprises: a display control unit that displays a local UI component corresponding to a first identifier of the local UI component received from the operating terminal; a transmission unit that transmits input information to the work terminal when input information is input to the local UI part displayed by the display control unit; having the transmission unit assigns a predetermined consecutive second identifier to the input information of the local UI component and transmits the second identifier together with the input information to the work terminal; The communication system is characterized in that, when the reflection unit receives the second identifier along with the input information, it determines whether the second identifier is consecutive to the second identifier previously received, and if the second identifier is not consecutive, it requests the remote terminal to resend.

3. The communication system according to claim 2, characterized in that the transmission unit stores the input information in a memory unit when there is no predetermined response from the work terminal, and transmits the input information stored in the memory unit to the work terminal when there is a predetermined response from the work terminal.

4. The communication system according to claim 2, characterized in that when the reflection unit receives the second identifier together with the input information, it determines whether the second identifier overlaps with a previously received second identifier, and if there is a overlap, it reflects the received input information or discards the received input information.

5. A communication method executed by a communication system having a work terminal and a remote terminal connected to the work terminal, a notification step of notifying the remote terminal of a first identifier of a local UI component displayed on the remote terminal, the local UI component corresponding to a UI component displayed on the working terminal; a display control step of the remote terminal displaying a local UI component corresponding to a first identifier of the local UI component received from the working terminal; a transmission step of the remote terminal transmitting input information to the working terminal when input information is input to the local UI part displayed by the display control step; a reflecting step of reflecting the input information in the UI component corresponding to the local UI component in the working terminal; Including, The communication method is characterized in that the transmission process, when the input information is input to the local UI component, stores the input information in a memory unit, and, when the input information accumulated in the memory unit is equal to or greater than a predetermined threshold, transmits the input information stored in the memory unit to the work terminal.

6. A communication method executed by a communication system having a work terminal and a remote terminal connected to the work terminal, a notification step of notifying the remote terminal of a first identifier of a local UI component displayed on the remote terminal, the local UI component corresponding to a UI component displayed on the working terminal; a display control step of the remote terminal displaying a local UI component corresponding to a first identifier of the local UI component received from the working terminal; a transmission step of the remote terminal transmitting input information to the working terminal when input information is input to the local UI part displayed by the display control step; a reflecting step of reflecting the input information in the UI component corresponding to the local UI component in the working terminal; Including, the transmitting step includes adding a predetermined consecutive second identifier to the input information in the local UI component, and transmitting the second identifier together with the input information to the work terminal; The reflection process is characterized in that, when the second identifier is received along with the input information, it is determined whether the second identifier is consecutive with the second identifier previously received, and if the second identifier is not consecutive, a retransmission is requested to the remote terminal.

7. A communication program for causing a computer to execute a communication method, Computers as work terminals a notification step of notifying a remote terminal of a first identifier of a local UI part displayed on the remote terminal, the local UI part corresponding to a UI part displayed on the local device; a reflection step of reflecting the input information in the UI component corresponding to the local UI component when the input information is received from the remote terminal; Run the command, A computer as a remote terminal connected to the work terminal, a display control step of displaying a local UI component corresponding to a first identifier of the local UI component received from the operating terminal; a transmission step of transmitting the input information to the work terminal when the input information is input to the local UI part displayed by the display control step; Run the command, The transmission step is characterized in that, when the input information is input to the local UI component, the input information is stored in a memory unit, and when the input information accumulates in the memory unit to a predetermined threshold or more, the input information stored in the memory unit is transmitted to the work terminal.

8. A communication program for causing a computer to execute a communication method, comprising: Computers as work terminals a notification step of notifying a remote terminal of a first identifier of a local UI part displayed on the remote terminal, the local UI part corresponding to a UI part displayed on the local device; a reflection step of reflecting the input information in the UI component corresponding to the local UI component when the input information is received from the remote terminal; Run the command, A computer as a remote terminal connected to the work terminal, a display control step of displaying a local UI component corresponding to a first identifier of the local UI component received from the operating terminal; a transmission step of transmitting the input information to the work terminal when the input information is input to the local UI part displayed by the display control step; Run the command, the transmitting step includes adding a predetermined consecutive second identifier to the input information in the local UI component, and transmitting the second identifier together with the input information to the work terminal; The reflection step is characterized in that, when the second identifier is received along with the input information, it is determined whether the second identifier is consecutive with the second identifier previously received, and if they are not consecutive, a retransmission is requested to the remote terminal.

Images