Communication support system, communication support method, and program

Abstract

To provide a communication support system and a program which can support communication among users in a facility and a remote location.SOLUTION: On a remote terminal which intercommunicates with a communication terminal provided in the facility, the following screens are displayed: a facility state display screen which displays terminal information corresponding to the communication terminal and the position information which identifies a position of the communication terminal in the facility; a facility state list screen which displays user identification information in superposition with a real time video of a selected communication terminal which specifies a user; and a chat screen which intercommunicates with the communication terminal using one, two or more of characters, voices and videos.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a communication support system, a communication support method, and a program, and more particularly, to a communication support system, a communication support method, and a program capable of supporting communication between users between a facility and a remote location.

Background Art

[0002] As a technology for supporting communication with a remote location by an information system, for example, the video conference system of Patent Document 1 is known. These video conference systems are configured such that a plurality of terminals each including a microphone, a monitor, and a speaker are connected via a network, and video captured by the camera of each terminal and audio collected by the microphone are mutually communicated with other terminals, thereby enabling real-time communication with a remote location.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Recently, the working styles of employees and the like in companies have been changing, and they are not limited to the conventional way of gathering at a single location for work or meetings. Instead, work styles such as working at a remote base, a remote office, or employees working from home have become common.

[0005] In the face of such changes in work styles, in the conventional video conference system, it is impossible to grasp what kind of work the other party is doing until the video conference starts. Therefore, there is a problem that it is difficult to conduct consultations and communications that are not based on regular meetings, for example.

[0006] In view of the aforementioned problems, the present invention aims to provide a communication support system, a communication support method, and a program that can support communication between users between a facility and a remote location. [Means for solving the problem]

[0007] The present invention, which aims to solve the aforementioned problems, is a communication support system that supports communication between users in a facility and a remote location, comprising: one or more communication terminals installed in the facility and equipped with a facility imaging device that captures images of the facility at the location where it is installed; and a remote terminal used by the user in the remote location, wherein the remote terminal has a screen processing unit that displays a predetermined screen in an output unit configured integrally with or separately from the remote terminal, the screen processing unit displays a facility status display screen for displaying terminal information corresponding to the one or more communication terminals and location information that identifies the location of the communication terminals within the facility, and when the user in the remote location selects the terminal information or location information displayed on the facility status display screen, the system displays a detailed facility status screen including the images captured by the selected communication terminal, and displays a chat screen for mutual communication with the selected communication terminal using one or more of text, voice, and video. The screen processing unit, in the facility status display screen and / or the facility status details screen, superimposes user identification information that identifies a user onto the real-time video if the real-time video captured by the communication terminal includes a user within the facility. It is characterized by the following.

[0008] The communication support system according to the present invention, which was made with the aim of solving the aforementioned problems, A communication support system that assists communication between users in a facility and in a remote location, comprising: one or more communication terminals installed in the facility and equipped with a facility imaging device that captures images of the facility at the installed location; and a remote terminal used by the user in the remote location, wherein the remote terminal has a screen processing unit that displays a predetermined screen in an output unit configured integrally with or separately from the remote terminal, the screen processing unit displays a facility status display screen for displaying terminal information corresponding to the one or more communication terminals and location information that identifies the location of the communication terminals within the facility; when the user in the remote location selects the terminal information or location information displayed on the facility status display screen, the system displays a detailed facility status screen including the images captured by the selected communication terminal, and displays a chat screen for mutual communication with the selected communication terminal using one or more of the following: text, voice, and video.The location information further includes a map of the facility and a first icon indicating the location of each of the one or more communication terminals superimposed on the map, and when the user in the remote location selects the first icon, the screen processing unit displays the real-time video captured by the communication terminal indicated by the selected first icon as the facility status details screen on the output unit. Furthermore, the screen processing unit is characterized by superimposing a second icon indicating the location of users within the facility onto the map of the facility displayed on the facility status display screen.

[0009] In the communication support system according to the present invention, The communication terminal has a facility-side input unit for inputting at least one of the characters, voice, and video, and a facility-side output unit for outputting at least one of the characters, voice, and video. The remote terminal has a remote terminal-side input unit for inputting at least one of the characters, voice, and video, and a remote terminal-side output unit for outputting at least one of the characters, voice, and video, and further comprises a first communication processing unit that causes the remote terminal-side output unit to output at least one of the characters, voice, and video input to the facility-side input unit, and a second communication processing unit that causes the facility-side output unit to output at least one of the characters, voice, and video input to the remote terminal-side input unit. You may do so.

[0010] The communication support method according to the present invention, which was made with the aim of solving the aforementioned problems, A communication support method that uses a computer to support communication between users in a facility and a remote location, comprising the steps of: displaying a facility status display screen on the display device of a remote terminal used by a remote user, which displays terminal information corresponding to one or more communication terminals located in the facility, and location information identifying the location of the communication terminals within the facility; displaying a detailed facility status screen on the display device of the remote terminal, which includes video footage captured by the selected communication terminal, when the remote user selects the terminal information or location information displayed on the facility status display screen; displaying a chat screen on the display device of the remote terminal for mutual communication with the selected communication terminal using one or more of text, voice, and video; and, if a user within the facility is included in the real-time video footage captured by the communication terminal on the facility status display screen and / or the detailed facility status screen, displaying user identification information to identify the user superimposed on the real-time video footage. It is characterized by having the following features.

[0011] The communication support method according to the present invention, which was made with the aim of solving the aforementioned problems, A communication support method that uses a computer to support communication between users in a facility and a remote location, comprising the steps of: displaying a facility status display screen on a display device of a remote terminal used by a remote user, which displays terminal information corresponding to one or more communication terminals located within the facility, and location information identifying the location of the communication terminals within the facility; and, when the remote user selects the terminal information or location information displayed on the facility status display screen, displaying a detailed facility status screen on the display device of the remote terminal, which includes the video captured by the selected communication terminal; and the selected communication The system includes the step of displaying a chat screen on the display device of the remote terminal for mutual communication with the communication terminal using one or more of the following: text, voice, and video; the location information further includes a map of the facility and a first icon indicating the location of each of the one or more communication terminals superimposed on the map; the system further superimposes a second icon indicating the location of a user within the facility on the map of the facility displayed on the facility status display screen; and when the user at the remote location selects the first icon, the system displays the real-time video captured by the communication terminal indicated by the selected first icon on the facility status details screen. It is characterized by the following. [Effects of the Invention]

[0012] According to the configuration of the present invention, users of remote terminals can understand the work and other actions of users within the facility by viewing the facility status display screen and the facility status details screen. This makes it possible to support communication between users between the facility and remote locations. [Brief explanation of the drawing]

[0013] [Figure 1] This figure shows the overall configuration of a communication support system according to one example of this embodiment. [Figure 2] This is a perspective view showing the appearance of a communication terminal in one example of the embodiment. [Figure 3] This figure shows the configuration of the facility status display screen in one example of the same embodiment. [Figure 4]It is a diagram showing the configuration of a facility status details screen in an example of the same embodiment. [Figure 5] It is a diagram showing the configuration of a chat start confirmation screen in an example of the same embodiment. [Figure 6] It is a diagram showing the configuration of a chat screen in an example of the same embodiment. [Figure 7] It is a diagram showing the configuration of a communication terminal screen in an example of the same embodiment.

Embodiments for Carrying Out the Invention

[0014] A communication support system 100 is communicably connected via a network 500 between a communication terminal 300 installed in a facility 200 and a remote terminal 400 used by a user in a remote location.

[0015] The facility 200 is a place where users gather to work. In an example of this embodiment, an office is assumed as the facility 200 and the following description will be given. However, the facility 200 may be, for example, a factory or a specific section.

[0016] The communication terminal 300 is a terminal that is arranged in the facility 200 and communicates with a remote terminal 400 described later. Note that the number of communication terminals 300 arranged in the facility 200 may be arbitrarily selected. One communication terminal 300 may be arranged for one facility 200, or two or more communication terminals 300 may be arranged in the facility 200.

[0017] FIG. 2 is a perspective view showing the appearance of the communication terminal 300 in an example of this embodiment. As shown in FIG. 2, the communication terminal 300, as a hardware configuration, is a terminal provided with a display device 312, a voice input device 313, a voice output device 314, and a photographing device 315 in a frame 311.

[0018] The frame 311 is a structure for installing the display device 312 to the imaging device 315. The frame 311 in an example of the present embodiment is composed of a frame main body portion 311a having a rectangular frame shape and an imaging device holding portion 311b for holding the imaging device 315 described later. Note that well-known members may be selected for the members used in the frame 311. For example, a metal material may be used, or a synthetic resin material may be used.

[0019] The display device 312 displays characters and / or images by a facility-side output unit 322 described later. The display device 312 in an example of the present embodiment is a display provided within the frame of the frame main body portion 311a.

[0020] The voice input device 313 collects voices within the facility at the location where the communication terminal 300 is installed. The voice input device 313 in an example of the present embodiment is a microphone provided on the lower end side of the display device 312, and the voice collected by the voice input device 313 is input to the facility-side input unit 321.

[0021] The voice output device 314 outputs voices by a facility-side output unit 322 described later. In an example of the present embodiment, the voice output device 314 is configured by a speaker provided on the upper end side of the display device 311.

[0022] The imaging device 315 captures real-time images within the facility at the location where the communication terminal 300 is installed. In an example of the present embodiment, the imaging device 315 is configured by a camera provided in the imaging device holding portion 311.

[0023] Furthermore, the communication terminal 300 includes, as a function, a facility-side input unit 321, a facility-side output unit 322, and a first communication processing unit 330. The above functions of the communication terminal 300 are provided by software, and a program pre-stored in the HDD (Hard Disk Drive) or other auxiliary storage device of a computer with the aforementioned hardware configuration is loaded into memory and executed by the CPU (Central Processing Unit), thereby enabling the computer to function as the communication terminal 300.

[0024] The facility-side input unit 321 receives input from at least one of the following: text, audio, or video. In one example of this embodiment, the communication terminal 300 is equipped with an audio input device 313 and a camera 315. The audio collected by the audio input device 313 and the real-time video captured by the camera 315 are input to the facility-side input unit 321. It also accepts text input from any terminal (not shown) within the facility. In this example of this embodiment, the communication terminal 300 is configured to accept text input from other terminals, but the communication terminal 300 may also be configured to receive text input directly by being equipped with a keyboard or a touchpad with character recognition functionality.

[0025] The facility-side output unit 322 outputs at least one of text, audio, or video. In one example of this embodiment, the communication terminal 300 is equipped with a display device 312 and an audio output device 314, with text and video being output to the display device 312 and audio being output to the audio output device 314.

[0026] The first communication processing unit 330 transmits at least one of the inputs (text, voice, or video) received by the aforementioned facility-side input unit 321 to the remote terminal 400, which will be described later, and has the remote terminal-side output unit 432 of the remote terminal 400 output it.

[0027] The remote terminal 400 is a terminal used by a user in a remote location. In one example of this embodiment, the remote terminal 400 has a hardware configuration comprising a display device 411, an audio input device 412, an audio output device 413, a camera 414, and a character input device 415. The remote terminal 400 may be configured using, for example, a smartphone, a tablet computer, a laptop computer, or a stationary personal computer. Furthermore, the hardware configuration of the remote terminal 400 may be an integrated device, i.e., housed in a single enclosure, or it may be configured from multiple devices, with some components, such as the display device 411, being separate devices from the main unit.

[0028] The display device 411 displays a predetermined screen using a screen processing unit 421 (described later), and also displays characters and / or images using a remote terminal output unit 432 (described later). In this example, the display device 411 is a display provided by the remote terminal 400.

[0029] The voice input device 412 collects sound from the surrounding area of ​​the remote terminal 400. In this example, the voice input device 412 is a microphone provided by the remote terminal 400, and the sound collected by the voice input device 412 is input to the remote terminal side input unit 431.

[0030] The audio output device 413 outputs audio via the remote terminal output unit 432, which will be described later. In this example, the audio output device 413 is the speaker provided by the remote terminal 400.

[0031] The imaging device 414 captures real-time video of the user using the remote terminal 400. In this example, the imaging device 414 is a camera installed in the remote terminal 400.

[0032] The character input device 415 is a device that inputs character information through user operation. In one example of this embodiment, the character input device 415 is the keyboard provided on the remote terminal 400.

[0033] Furthermore, the remote terminal 400 in this embodiment includes, as a function, a screen processing unit 421, a remote terminal side input unit 431, a remote terminal side output unit 432, and a second communication processing unit 440. The above functions of the remote terminal 400 are implemented by software, similar to the communication terminal 300. Of the above functions, one or both of the screen processing unit 421 and the second communication processing unit 440 do not necessarily need to be built within the remote terminal 400, but may be built within a device connected to the remote terminal 400 in a manner that enables communication over a network. As mentioned above, a well-known computer may be used as the remote terminal 400, and the computer functions as the remote terminal 400 by loading a program pre-stored in the computer's HDD or other auxiliary storage device into memory and executing it with the CPU.

[0034] The screen processing unit 421 causes an output unit, which is integrated with or separate from the remote terminal 400, to display a predetermined screen. In one example of this embodiment, the output unit is the remote terminal output unit 432, which will be described later. The screen processing unit 432 controls the screen displayed on the display device 411 and outputs characters and / or images output from the remote terminal output unit 432, which will be described later, to a predetermined position on the screen.

[0035] The remote terminal input unit 431 receives at least one of the following: text, video, or video. In one example of this embodiment, the remote terminal 400 is equipped with a text input device 415, a voice input device 412, and a camera 414. The text entered by the text input device 415, the audio collected by the voice input device 412, and the real-time video captured by the camera 414 are input to the remote terminal input unit 431.

[0036] The remote terminal output unit 432 outputs at least one of the following: text, audio, or video. In one example of this embodiment, the remote terminal 400 is equipped with a display device 411 and an audio output device 413, with text and video being output to the display device 411 and audio being output to the audio output device 413.

[0037] The second communication processing unit 440 transmits at least one of the inputs (text, voice, or video) received by the remote terminal input unit 431 to the aforementioned communication terminal 300, causing the facility-side output unit 322 of the communication terminal 300 to output the result.

[0038] In one example of this embodiment, the communication terminal 300 and the remote terminal 400 are connected to communicate via a network 500. The network 500 may be a wide area network such as the Internet, a Local Area Network (LAN), or a Virtual Private Network (VPN) built using a wide area network. The network 500 may be configured by arbitrarily selecting any well-known network technology.

[0039] Furthermore, in this embodiment, the communication terminal 300 is configured to include a facility-side input unit 321, a facility-side output unit 322, and a first communication processing unit 330, while the remote terminal 400 is configured to include a remote terminal-side input unit 431, a remote terminal-side output unit 432, and a second communication processing unit 440. However, some or all of the above configurations may be handled by terminals or server devices other than the communication terminal 300 and the remote terminal 400. For example, the communication support system 100 may be further configured to include a communication support server, which can perform the functions of the first communication processing unit 330 and the second communication processing unit 440. In this case, the functions performed by the communication support server may be configured as, for example, a cloud service.

[0040] The above describes the configuration of the communication support system 100 in one example of this embodiment.

[0041] Next, we will describe communication support using the communication support system 100 in an example of this embodiment.

[0042] Figure 3 is a diagram showing the configuration of the facility status display screen W100, which is displayed on the display device 411 by the screen processing unit 421 of the remote terminal 400 in an example of this embodiment. As shown in Figure 3, the facility status display screen W100 in an example of this embodiment consists of a facility video area W110 and a map area W120.

[0043] The facility video area W110 is an area that displays a list of thumbnails of real-time video captured by communication terminals 300 installed in the facility 200. In one example of this embodiment, the name W111 and the thumbnail video W112 are displayed for each communication terminal 300.

[0044] Furthermore, in one example of this embodiment, if the thumbnail video W112 includes a user within the facility 200, that is, if the user is visible in the thumbnail-generated real-time video, the user's name W113 is superimposed on the thumbnail image W112 as user identification information to identify that user.

[0045] Map area W120 is the area that displays a map of facility 200. In one example of this embodiment, map area W120 displays a map of the facility W121, overlaid with a communication terminal icon W122 indicating the location of the communication terminal 300, and a user icon W123 indicating the location of users within facility 200.

[0046] On the facility status display screen W100, when a user operates the remote terminal 400 and selects either a thumbnail image W112 displayed in the list, or a communication terminal icon W122 superimposed on the map W121, the screen processing unit 421 of the remote terminal 400 displays the facility status details screen on the display device 411.

[0047] Figure 4 shows the configuration of the facility status details screen W200 in an example of this embodiment. As shown in Figure 4, the facility status details screen W200 in an example of this embodiment includes a real-time video W210 and a chat start button W220.

[0048] The real-time video W210 is real-time video captured by a communication terminal 300 selected by the user on the aforementioned facility status display screen W100. In this example, if the real-time video W210 includes a user within the facility 200, that is, if a user within the facility 200 is visible in the real-time video, the user's name W211 is superimposed as user identification information to identify that user.

[0049] The chat start button W220 is a button that initiates a chat, that is, two-way communication using at least text, voice, or video, between the remote terminal 400 and the selected communication terminal 300. When a user operates the remote terminal 400 and presses the chat start button W220, the remote terminal 400 displays a chat start confirmation screen on the display device 411 via the screen processing unit 421.

[0050] Figure 5 shows the configuration of a chat start confirmation screen W300 in an example of this embodiment. As shown in Figure 5, the chat start confirmation screen W300 includes a real-time video W310, an audio switching button W321, a video switching button W322, and a chat start confirmation button W323.

[0051] Real-time video W310 is real-time video captured by the communication terminal W300 used for chatting. Similar to the thumbnail W112 on the facility status display screen W100 and the real-time video W210 on the facility status details screen W200, the real-time video W310 on the chat start confirmation screen W300 also displays the name W311 as user identification information to identify users within facility 200 if such users are included in the real-time video.

[0052] The audio switching button W321 is a button that starts or stops sound collection by the audio input device 412 of the remote terminal 400, and the video switching button W322 is a button that starts or stops shooting by the shooting device 414 of the remote terminal 400.

[0053] The chat confirmation start button W323 is a button that initiates chat, that is, mutual communication using at least text, voice, or video, with the communication terminal 300.

[0054] In the aforementioned chat start confirmation screen W300, when the chat start confirmation button W323 is pressed, the screen processing unit 421 of the remote terminal 400 displays the chat screen W400 on the display device 411. Figure 6 is a diagram showing the configuration of the chat screen W400 in an example of this embodiment. As shown in Figure 6, the chat screen W400 includes a facility-side real-time video W410, a remote terminal-side real-time video W420, a text message W430, an audio switching button W441, a video switching button W442, a screen sharing button W443, and a chat stop button W444.

[0055] The facility-side real-time video W410 is real-time video captured by the communication terminal 300, which chats with the remote terminal 400. In one example of this embodiment, the facility-side real-time video W410 is captured by the camera 315 of the communication terminal 300 and input to the facility-side input unit 321, and the first communication processing unit 330 outputs it to the display device 411 via the remote terminal-side output unit 432 of the remote terminal 400.

[0056] In the chat screen W400, the facility's real-time video W410, similar to the thumbnail image W112 in the facility status display screen W100, the real-time video W210 in the facility status details screen W200, and the real-time video W310 in the chat start confirmation screen W300, will have the user's name W411 superimposed as user identification information to identify the user if the real-time video includes a user within facility 200.

[0057] The remote terminal video W420 is real-time video captured by the remote terminal 400. In one example of this embodiment, the remote terminal real-time video W420 is captured by the camera 414 of the remote terminal 400 and input to the remote terminal input unit W431. The second communication processing unit 440 transmits it to the communication terminal 300, which is the chat partner, and outputs it as the remote terminal real-time video W420 by the remote terminal output unit 432.

[0058] Text message W430 displays character information exchanged between the remote terminal 400 and the communication terminal 300. When character information is input to the remote terminal side input unit 431 of the remote terminal 300, the second communication processing unit 440 transmits it to the communication terminal 300, and the remote terminal side output unit 432 outputs it as the transmitted message W431 in text message W430. Also, when character information is input to the facility side input unit 321 of the communication terminal 300, the first communication processing unit 330 causes the remote terminal side output unit 432 to output it as the received message W432.

[0059] The audio switching button W441 is a button that starts or stops sound collection by the audio input device 412 of the remote terminal 400, and the video switching button W442 is a button that starts or stops shooting by the shooting device 414 of the remote terminal 400.

[0060] The screen sharing button W443 is a button that shares the screen displayed on the display device 411 of the remote terminal 400 with the communication terminal 300. When the screen sharing button W443 is pressed, the second communication processing unit 440 outputs the content displayed on the display device 411 of the remote terminal 400 to the display device 311 via the facility-side output unit 432 of the communication terminal 300.

[0061] The chat stop button W444 is a button that stops the chat. When the chat stop button W444 is pressed, the chat is stopped, and the screen processing unit 421 transitions the screen to the facility status display screen W100.

[0062] Figure 7 shows the configuration of the communication terminal screen W500 in an example of this embodiment. The facility status display screen W100, the facility status details screen W200, the chat start confirmation screen W300, and the chat screen W400 are screens displayed on the remote terminal 400, while the communication terminal screen W500 is displayed on the display device 312 of the communication terminal 300, as shown in Figure 5. In this example of this embodiment, the communication terminal screen W500 displays a background image W510 and a remote user icon W520.

[0063] The remote user icon W520 is an icon that indicates the user of a remote terminal 400 that is communicating with the communication terminal 300. In one example of this embodiment, the user's facial photograph is used as the remote user icon W520. When the communication terminal 300 is not chatting with any of the remote terminals 400, only the background image W510 is displayed on the communication terminal screen W500, and the remote user icon W520 is not displayed. In another example of this embodiment, one communication terminal 300 is configured to communicate with two or more remote terminals 400, and when chatting with two or more remote terminals 400, the remote user icon W520 representing the user of each remote terminal 400 is displayed for all of the remote terminals 400 that are chatting.

[0064] This concludes the description of one example of this embodiment. However, the embodiments of the present invention are not limited to this. For example, in this example of the embodiment, the real-time video output to the facility status display screen W100 and other screens is configured to display the name of the user as user identification information to identify the user within the facility. However, instead of the name, an account name of any system used within the facility 200 may be used as user identification information.

[0065] Furthermore, in this embodiment, the remote terminal 400 is equipped with a screen processing unit 421, which controls the display, transitions, and other functions of each screen of the remote terminal 400. However, the functions of the screen processing unit 421 may be configured to be performed by the communication terminal 300, or a separate server device may be provided, and the functions may be performed by the server device. In this case, a program that performs the steps of displaying the facility status display screen W100 on the display device 411 of the remote terminal 400, displaying the facility status details screen W200 on the display device 411 of the remote terminal 400, displaying the chat start confirmation screen W300 on the display device 411 of the remote terminal 400, and displaying the chat screen W400 on the display device 411 of the remote terminal 400 may be pre-stored in the HDD or other secondary storage device of the server device. The program may then be loaded into the memory of the server device and executed by the CPU to control the display, transitions, and other functions of the screens of the remote terminal 400. Furthermore, in one example of this embodiment, the transition from the facility status details screen W200 to the chat screen W400 is configured to go through the chat start confirmation screen W300. However, the confirmation screen may be omitted, and the transition from the facility status details screen W200 to the chat screen W400 may be configured to go directly.

[0066] Other specific configurations are not limited to this embodiment, and various modifications are possible without departing from the spirit of the present invention.

[0067] In the facility status display screen, the information included in the thumbnail image does not necessarily have to be real-time video; it may be a fixed image, shape, or text. Also, if the facility status display screen includes terminal information that allows the communication terminal to be identified (e.g., a shape, text), then a thumbnail image is not necessarily required. Furthermore, the map area 120 is not necessarily required in the facility status display screen; it may be configured to display a fixed image, shape, or text as location information that identifies the location of each communication terminal within the facility. In these cases, by selecting any of the terminal information or location information included in the facility status display screen, a detailed facility status screen including the video captured by the selected communication terminal may be displayed, and a chat screen for mutual communication with the selected communication terminal using one or more of text, voice, and video may be displayed. [Explanation of symbols]

[0068] 100 Communication Support Systems 200 facilities 300 communication terminals 311 frames 312 Display device 313 Voice input device 314 Audio output device 315 Imaging device 321 Facility-side input section 322 Facility-side output section 330 First Communication Processing Unit 400 remote terminals 411 Display device 412 Voice input device 413 Audio output device 414 Imaging device 415 Character Input Device 421 Screen Processing Unit 431 Remote terminal side input section 432 Remote terminal output section 440 Second Communication Processing Unit 500 Networks

Claims

1. A communication support system that assists communication between users within a facility and in remote locations, One or more communication terminals are provided within the facility and equipped with a facility imaging device that captures images of the facility at the location where it is provided. The remote terminal used by the user in the remote location, Equipped with, The remote terminal has a screen processing unit that displays a predetermined screen in an output unit which is integrated with or separate from the remote terminal. The aforementioned screen processing unit A facility status display screen is displayed for displaying terminal information corresponding to one or more communication terminals and location information that identifies the location of the communication terminal within the facility; when the user in the remote location selects the terminal information or location information displayed on the facility status display screen, a detailed facility status screen is displayed, including the video captured by the selected communication terminal. A chat screen is displayed for mutual communication with the selected communication terminal using one or more of the following: text, voice, and video. The screen processing unit, in the facility status display screen and / or the facility status details screen, superimposes user identification information that identifies the user onto the real-time video if the real-time video captured by the communication terminal includes a user within the facility. Communication support system.

2. A communication support system that assists communication between users within a facility and in remote locations, One or more communication terminals are provided within the facility and equipped with a facility imaging device that captures images of the facility at the location where it is provided. The remote terminal used by the user in the remote location, Equipped with, The remote terminal has a screen processing unit that displays a predetermined screen in an output unit which is integrated with or separate from the remote terminal. The aforementioned screen processing unit A facility status display screen is displayed for displaying terminal information corresponding to one or more communication terminals and location information that identifies the location of the communication terminal within the facility; when the user in the remote location selects the terminal information or location information displayed on the facility status display screen, a detailed facility status screen is displayed, including the video captured by the selected communication terminal. A chat screen is displayed for mutual communication with the selected communication terminal using one or more of the following: text, voice, and video. The location information further includes a map of the facility and a first icon superimposed on the map indicating the location of each of the one or more communication terminals. When the user in the remote location selects the first icon, the screen processing unit causes the real-time video captured by the communication terminal indicated by the selected first icon to be displayed on the output unit as the facility status details screen. The screen processing unit, in the facility status display screen, further superimposes a second icon indicating the location of users within the facility onto the map of the facility displayed on the facility status display screen. Communication support system.

3. The communication terminal has a facility-side input unit for inputting at least one of the characters, the voice, and the video, and a facility-side output unit for outputting at least one of the characters, the voice, and the video. The remote terminal has a remote terminal-side input unit for inputting at least one of the characters, the voice, and the video, and a remote terminal-side output unit for outputting at least one of the characters, the voice, and the video. A first communication processing unit that causes at least one of the characters, voice, and video input to the facility-side input unit to be output at the remote terminal-side output unit, A second communication processing unit causes the facility output unit to output at least one of the characters, voice, and video input to the remote terminal input unit, Furthermore, A communication support system according to claim 1 or 2.

4. A communication support method that uses computers to support communication between users within a facility and in remote locations, The steps include: displaying a facility status display screen on a remote terminal used by a remote user, which displays terminal information corresponding to one or more communication terminals located within the facility, and location information identifying the location of the communication terminals within the facility; When the user in the remote location selects the terminal information or location information displayed on the facility status display screen, the step of displaying a detailed facility status screen, including video captured by the selected communication terminal, on the display device of the remote terminal, The steps include: displaying a chat screen on the remote terminal's display device for mutual communication with the selected communication terminal using one or more of text, voice, and video; and, if the real-time video captured by the communication terminal on the facility status display screen and / or facility status details screen includes users within the facility, displaying user identification information to identify such users superimposed on the real-time video; A communication support method that includes the following features.

5. A communication support method that uses computers to support communication between users within a facility and in remote locations, The steps include: displaying a facility status display screen on a remote terminal used by a remote user, which displays terminal information corresponding to one or more communication terminals located within the facility, and location information identifying the location of the communication terminals within the facility; When the user in the remote location selects the terminal information or location information displayed on the facility status display screen, the step of displaying a detailed facility status screen, including video captured by the selected communication terminal, on the display device of the remote terminal, The steps include: displaying a chat screen on the display device of the remote terminal for mutual communication with the selected communication terminal using one or more of text, voice, and video; Equipped with, The location information further includes a map of the facility and a first icon superimposed on the map indicating the location of each of the one or more communication terminals. On the map of the facility displayed on the facility status display screen, a second icon indicating the location of users within the facility is superimposed. When the user in the remote location selects the first icon, the real-time video captured by the communication terminal indicated by the selected first icon is displayed on the facility status details screen. Communication support methods.

6. A program that causes a computer to function as a communication terminal according to claim 1 or 2.

7. A program that causes a computer to function as a remote terminal as described in claim 1 or 2.

8. A program that causes a computer to execute the communication support method described in claim 4 or 5.

Images