Intercom system

Abstract

In order to respond to a call from a virtual space, the responding party needed to activate that virtual space and constantly monitor for calls. Furthermore, responses could only be made from within the virtual space. [Solution] By having the main intercom unit in the real world respond to calls from the virtual space, constant monitoring is eliminated. Furthermore, since the main intercom unit also responds to calls from intercom slave units installed in the real space using the same communication protocol, calls from both the virtual and real spaces can be handled by a single main intercom unit.

Description

Technical Field

[0001] The present invention relates to an intercom master unit connected to a general-purpose network such as a LAN, integrating a voice chat function in a virtual space such as a metaverse, and particularly realizing interaction with the virtual space without being aware of the virtual space in a real-world intercom master unit.

Background Art

[0002] In the conventional chat function in a virtual space, it is necessary for both parties of the callers to log in to the virtual space simultaneously. Therefore, even in a state of waiting for a response like an intercom, the user always has to continue logging in and waiting for a voice chat call. For this purpose, a dedicated communication terminal such as a smartphone is required, and it is necessary to continuously monitor the incoming voice chat. As a reverse idea, there is a prior art proposal to send incoming calls of an intercom or a telephone onto a virtual space.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the measure of Patent Document 1, it is premised that a response is made on the virtual space. For a response, the user needs to start the virtual space from a personal computer and constantly monitor incoming calls. For example, when the frequency of incoming calls from the virtual space is low in a company or the like, there are problems such as too much man-hours for waiting, and it is impossible to confirm when a user wants to feign absence due to the user's movements.

Means for Solving the Problems

[0005] To solve the above problems, the invention of claim 1 comprises a virtual calling device such as an image or icon of an intercom sub-unit provided in a virtual space such as a metaverse space, and an intercom master unit installed in a building in the real world and connectable to a general-purpose network, characterized in that a call sound is emitted on the intercom master unit after a call is made from the virtual calling device, and two-way communication is possible when the intercom master unit answers after the call. With this configuration, when waiting to respond to a call from a virtual call device in the virtual space, only the intercom master unit needs to be installed in the real space, eliminating the need to log in or perform other access actions to the virtual space, thus improving convenience.

[0006] The invention of claim 2 is characterized in that the intercom master unit is equipped with an intercom slave unit that has calling and communication functions to the intercom master unit which is installed at the entrance of a building in the real world and connected to a general-purpose network. With this configuration, the intercom master unit can respond to calls from intercom slave units in the real world using the same procedure as calls from the virtual calling device. This eliminates the need to install a dedicated terminal for the virtual space, increasing versatility and eliminating the need for dedicated installation space for the virtual space.

[0007] The invention of claim 3 is characterized in that, after a call sound is emitted by operating the virtual call button of the virtual call device, the intercom master unit emits an audio signal input from the virtual space and displays a video signal input from the virtual space before the intercom master unit responds, and does not emit any audio from the intercom master unit into the virtual space. This configuration allows users to see the caller's image and voice before responding, which, unlike virtual chat, allows them to pretend they are not home, thus improving convenience for the responder.

[0008] The invention of claim 4 is characterized in that the virtual calling device connects and registers with intercom master units of multiple buildings in the real world. With this configuration, multiple intercom master units can be called from a virtual call device.

[0009] The invention of claim 5 is characterized in that the virtual call device has one virtual call button and can simultaneously call multiple intercom master units of connected buildings by operation from a virtual space (metaverse space). With this configuration, the virtual call device can simultaneously call multiple intercom master units in the real world with a single call button, allowing anyone available from among the intercom master units located in different places to answer.

[0010] The invention of claim 6 is characterized in that the virtual call device has a plurality of virtual call buttons, and by operation from a virtual space (metaverse space), it calls one or more intercom master units from among a plurality of building intercom master units that have been registered for connection, corresponding to the button that was operated. With this configuration, the virtual call device has multiple call buttons, allowing a single virtual call device to call multiple intercom master units in the real world, depending on the purpose. [Effects of the Invention]

[0011] According to the present invention, convenience is improved because, regardless of whether the connected intercom is installed in the real world or in a virtual world, the same intercom master unit can be used to respond with the same operation. [Brief explanation of the drawing]

[0012] [Figure 1] This is a configuration diagram showing the configuration of a single intercom master unit and an intercom slave unit in the real world, and a virtual calling device in the virtual world, in the intercom system of the present invention. [Figure 2] This is a block diagram showing the specific configuration of a single intercom master unit and an intercom slave unit in real space, and a virtual calling device in virtual space, in the intercom system of the present invention. [Figure 3]This is a configuration diagram showing the configuration of a virtual call device in the intercom system of the present invention, which comprises multiple intercom master units and intercom slave units in the real world, and one call button in the virtual world. [Figure 4] This is a configuration diagram showing the configuration of a virtual call device in the intercom system of the present invention, which includes multiple intercom master units and intercom slave units in the real world, and multiple call buttons in the virtual world. [Modes for carrying out the invention]

[0013] The following describes a best embodiment of the intercom system of the present invention with reference to the drawings. Figure 1 is a diagram of the configuration of the intercom system of the present invention, which comprises an intercom sub-unit 1 installed outside the dwelling in the real world, which allows visitors to call and communicate with residents who are inside the dwelling, and an intercom master unit 2 installed inside the dwelling, which allows residents who respond to calls from visitors to communicate. The intercom sub-unit 1 and the intercom master unit 2 are connected by general-purpose networks L1 and L2, respectively, such as LAN cables, and communicate using general-purpose VoIP protocols such as SIP. Furthermore, in a virtual space such as the metaverse, there is a virtual calling device 3 that mimics the shape of an intercom handset. The virtual transmission unit, which is the audio and video communication interface of the virtual calling device 3, is connected to the intercom master unit 2 via a general-purpose network L3 so that communication is possible, and the master unit's IP address is registered so that communication can be performed using a general-purpose VoIP protocol similar to that in the real world.

[0014] Figure 2 is a block diagram of the intercom system of the present invention. In Figure 2, the intercom sub-unit 1 consists of a transmission unit 11 that transmits voice and image communication between the general-purpose network L1 and each component circuit of the intercom sub-unit 1, a speaker 12 that emits sound from the intercom master unit 2, a microphone 13 that collects sound to the intercom master unit 2 and transmits it via the transmission unit 11, a camera 14 that captures video for the intercom master unit 2 and transmits it via the transmission unit 11, a call button 15 for calling the intercom master unit 2, and a CPU 16 that performs control within the intercom sub-unit 1, such as converting the operation of the call button into a call signal.

[0015] The intercom master unit 2 consists of a transmission unit 21 that transmits voice and image communication between the general-purpose network L2 and each component circuit of the intercom master unit 2, a speaker 22 that emits call sounds and conversation voices from the intercom slave unit 1 and virtual call device 3 (hereinafter referred to as "slave unit, etc."), a microphone 23 that collects voices from the slave unit, etc. and transmits them via the transmission unit 21, a display 24 that displays video from the slave unit, etc. transmitted via the transmission unit 21, an answer button 25 for responding to calls from the slave unit, etc., and a CPU 26 that performs control within the intercom master unit 2, such as converting the operation of the answer button into an answer signal. The virtual call device 3 in the virtual space consists of a virtual transmission unit 31 that transmits voice and image communication between the general-purpose network L3 and each virtual component circuit of the intercom master unit 2, a virtual speaker 32 that emits sound from the intercom master unit 2, a virtual microphone 33 that collects sound for the intercom master unit 2 and transmits it via the virtual transmission unit 31, a virtual camera 34 that captures video for the intercom master unit 2 and transmits it via the virtual transmission unit 31, and a virtual call button 35 for calling the intercom master unit 2. Regarding the virtual speaker 32 in the virtual space, by emitting the voice from the intercom main unit 2 in the virtual space, the voice can be transmitted to the person near the virtual calling device 3 in the virtual space. Also, regarding the virtual camera 34 and virtual microphone 33 in the virtual space, for accessing the virtual space within the virtual space, image capturing and sound collection of the real space are performed using a microphone and camera of a smartphone or the like (not shown), and in addition to transmitting the image and voice to the intercom main unit 2, it is also possible to transmit artificial sounds such as an avatar image in the virtual space and a synthesized voice created within the virtual space.

[0016] In such a configuration, as a first embodiment, the operations between the real spaces and the operation from the virtual space to the real space will be described. First, the operation between the real spaces will be described. In FIGS. 1 and 2, when a visitor operates the call button 15 of the intercom sub-unit 1 installed in the real space, a call signal is transmitted to the intercom main unit 2 via the transmission unit 11 and the general-purpose networks L1 and L2. Also, simultaneously, with the intercom sub-unit 1 camera 14 and microphone 13 activated, the voice signal collected by the microphone 13 and the video signal captured by the camera 14 are transmitted to the intercom main unit 2 via the same path as the call signal. The CPU 26 of the intercom main unit 2 uses the call signal received from the intercom sub-unit 1 via the transmission unit 21 as a trigger to sound a call tone from the speaker 22, and then emits the voice signal collected by the microphone 13 from the speaker 22 and displays the video signal captured by the camera 14 on the display 24. Also, a person near the intercom main unit 2 who notices the call tone checks the voice from the speaker 22 and the video displayed on the display 24 before responding, and when determining that they should respond, presses the response button 25, thereby activating the microphone 23 of the intercom main unit 2 and the speaker 12 of the intercom sub-unit 1, enabling mutual communication between the intercom main unit 2 and the intercom sub-unit 1. Note that if it is determined that there is no need to respond, one can use the "not at home" function by not performing any operation. In the "not at home" state, since the microphone 23 of the intercom main unit 2 is inactive, the voice from the intercom main unit 2 is not sounded to the intercom sub-unit 1.

[0017] Next, we will explain the transition from virtual space to real space. In Figure 1, the virtual call device 3, installed in a virtual space such as the metaverse, has an appearance reminiscent of an intercom handset, and is equipped with icons for a virtual microphone 33, a virtual camera 34, and a virtual call button 35. When a person accessing the virtual space (hereinafter referred to as "accessor") touches the icon for the virtual call button 35, the virtual call device 3 activates the microphone and camera of a terminal device (hereinafter referred to as "accessor terminal"), such as a personal computer or tablet (not shown), that the accessor is operating. In Figure 2, the virtual call device 3 transmits a call signal to the intercom master unit 2 via the virtual transmission unit 31 and general-purpose networks L3 and L2 when the virtual call button 35 is operated. In addition, the virtual call device 3 also inputs the audio picked up by the microphone of the active access terminal as an audio signal to the virtual microphone 33, and the video captured by the camera of the access terminal as a video signal to the virtual camera 34, and transmits the audio and video signals input to the virtual microphone 33 and virtual camera 34 to the intercom master unit 2 via the same path as the call signal. As mentioned above, the audio signal uses the general-purpose VOIP protocol, so there is no need to perform protocol conversion when sending the audio signal from the virtual space to the real space. The CPU 26 of the intercom master unit 2 establishes a network connection with the virtual calling device 3 triggered by the calling signal from the virtual calling device 3 received via the transmission unit 21. After sounding the calling tone from the speaker 22, it emits the voice signal from the virtual microphone 33 from the speaker 22 and displays the video signal captured by the virtual camera 34 on the display 24. At this point, the microphone 23 of the intercom master unit 2 is inoperative. Also, a person near the intercom master unit 2 who notices the calling tone can confirm the voice from the speaker 22 and the video displayed on the display 24 before responding, and only when determining that a response should be made, presses the response button 25, thereby activating the microphone 23 of the intercom master unit 2 and the virtual speaker 32 of the virtual calling device 3. The voice signal from the virtual speaker 32 is emitted by an output device such as a speaker or headphones (not shown) of the accessor's terminal, enabling two-way communication between the intercom master unit 2 and the virtual calling device 3. Of course, when determining that a response should not be made, one can use the excuse of being out as in the real space, and since the microphone 23 of the intercom master unit 2 is inoperative in the case of being out, the voice from the intercom master unit 2 is not sounded in the virtual space.

[0018] As described above, from the perspective of the intercom master unit 2, one can enter a call with the same response operation without being aware of whether the calling party is the intercom slave unit 1 in the real space or the virtual calling device 3 in the virtual space, eliminating the need for a login operation specific to the virtual space. Also, in the case of a call from the virtual space, since the accessor's terminal can be located anywhere in the world, before the microphone 23 of the intercom master unit 2 becomes active upon response, it is more important to pre-check the video of the calling person and whether one can speak the language for communication than in the real space, but with this configuration, pre-checking can be easily implemented. For example, if only people who can speak Japanese are near the intercom master unit 2, and the voice signal input from the virtual microphone 33 is in a foreign language, one can use the excuse of being out.

[0019] For example, if the intercom master unit 2 is installed in a school classroom, the classroom can be called from the virtual call device 3, which is a doorphone in the metaverse, allowing students in the classroom to notice the call. Until a response is given, only the audio and video input to the virtual call device 3 in the metaverse are unilaterally transmitted to the intercom master unit 2, so if no one shows interest, they can pretend not to be home by ignoring the call. If someone is interested, they can use the response button 25 to talk to the person in the metaverse using the intercom master unit 2, and depending on the situation, they can even directly participate in the metaverse using a computer or other device outside the system. Furthermore, if a company installs a virtual call device 3 in the metaverse and a person in the metaverse wants to speak with a representative of that company, operating the virtual call button 35 on the virtual call device 3 will cause a ringing sound to occur on the intercom master unit 2 installed within the company, even if the company does not have the metaverse activated. By operating the answer button 25, the person can then communicate with the person in the metaverse. This intercom is also connected to the actual company entrance, so even if a visitor at the company entrance operates the intercom sub-unit 1, the same intercom master unit 2 will respond.

[0020] Next, as a modification of the first embodiment, a second embodiment in which multiple intercom master units are installed will be described using Figure 3. Figure 3 is a diagram of a modified configuration of the intercom system described in Figure 1 of the present invention. It includes an intercom sub-unit 1 installed outside the dwelling in the real world, which allows visitors to call and communicate with residents inside the dwelling. There are also multiple intercom master units 2a, 2b, etc., installed inside the dwelling, which allow residents to communicate with visitors who respond to their calls. Similar to the first embodiment, it also includes a virtual call device 3 in a virtual space. The intercom sub-unit 1 and the intercom master units 2a, 2b, etc. are connected by general-purpose networks L1, L2a, L2b, etc., such as LAN cables, and communicate using general-purpose VoIP protocols such as SIP. The multiple intercom master units 2a, 2b, etc. do not need to be installed in close proximity to each other; as long as they are connected by a general-purpose network, they can be installed in extremely distant locations, for example, with intercom master unit 2a in Japan and intercom master unit 2b in Europe. The internal configuration of each intercom master unit 2a, 2b, etc. is equivalent to that of intercom master unit 2 in Figure 1. Furthermore, the virtual call device 3 is connected to the intercom master units 2a, 2b, etc. via a general-purpose network L3, similar to Figures 1 and 2, and the IP addresses of each master unit are registered so that it can be connected using the general-purpose VoIP protocol.

[0021] In this configuration, the following will explain the interaction between real-world spaces. First, in Figure 3, when a visitor operates the call button 15 of the intercom sub-unit 1 installed in the real world, a call signal is transmitted to the intercom master units 2a, 2b, ... via the transmission unit 11 and the general-purpose networks L1 and L2a, L2b, .... At the same time, the camera 14 and microphone 13 of the intercom sub-unit 1 are activated, and the audio signal picked up by the microphone 13 and the video signal captured by the camera 14 are transmitted to the intercom master units 2a, 2b, ... via the same path as the call signal. The subsequent operation of the intercom master units 2a, 2b, ... is the same as in the first embodiment, but all intercom master units 2a, 2b, ... perform the same operations as in the first embodiment, such as ringing a call tone. Furthermore, any person near one of the intercom master units 2a, 2b, etc., who notices the ringing tone, can check the audio from speaker 22 and the image displayed on display 24 before answering. Only if they decide to answer, they can, for example, press the answer button 25 on intercom master unit 2a, which activates the microphone 23 on intercom master unit 2a and the speaker 12 on intercom sub-unit 1, enabling two-way communication between intercom master unit 2a and intercom sub-unit 1. At this time, intercom master unit 2b detects the answer from intercom master unit 2a and disables its speaker 22 and display 24. Furthermore, if it is determined that there is no need to respond, the action of pretending to be absent by doing nothing is the same as in the first embodiment.

[0022] Next, we will explain the transition from virtual space to real space. In Figure 3, when an accessor touches the icon of the virtual call button 35, the virtual call device 3 activates the microphone and camera of the accessor terminal, as in the first embodiment, and transmits call signals to the intercom master units 2a, 2b, ... via the virtual transmission unit 31 and the general-purpose network L3 and L2a, L2b, ..., respectively. At the same time, it inputs the audio picked up by the microphone of the activated accessor terminal as an audio signal to the virtual microphone 33, and the video captured by the camera of the accessor terminal as a video signal to the virtual camera 34. The audio and video signals input to the virtual microphone 33 and virtual camera 34 are then transmitted to the intercom master units 2a, 2b, ..., respectively, via the same path as the call signal. As mentioned above, the audio signal uses the general-purpose VOIP protocol, so there is no need to perform protocol conversion when sending the audio signal from the virtual space to the real space. The subsequent operation of the intercom master units 2a, 2b, ... is the same as the operation between real spaces in the second embodiment, and a call can be initiated with the same response operation without being aware of whether the calling party is the intercom slave unit 1 in the real space or the virtual call device 3 in the virtual space.

[0023] Next, as a further modification of the second embodiment, a third embodiment in which multiple intercom master units are installed and multiple virtual call buttons are installed on the virtual call device will be described with reference to Figure 4. Figure 4 shows a configuration diagram of another modified example of the intercom system of the present invention, in which the real-world intercom sub-unit 1 and intercom master units 2a, 2b, ... are the same as those in Figure 3. Unlike Figure 3, the virtual call device 3a in the virtual space has a first virtual call button 35a for calling the first intercom master unit 2a and a second virtual call button 35b for calling the second intercom master unit 2b. The other configurations are the same as in Figure 3. The block diagram is also the same as the virtual call device 3 in Figure 2, except that there are two virtual call buttons.

[0024] In this configuration, the operation between real spaces is the same as in the second embodiment, so we will omit the explanation and instead explain the operation from the virtual space to the real space. In Figure 4, the first virtual call button 35a and the second virtual call button 35b are programmed to call the first intercom master unit 2a and the second intercom master unit 2b, respectively. The first virtual call button 35a and the second virtual call button 35b have identification means that can identify the call destination. Because this identification means exists in a virtual space, it is possible to have identification means in many ways compared to the real space, such as displaying text on the virtual call device 3a, providing voice guidance explaining the call destination when either virtual call button is selected, or displaying a popup with an illustration. In Figure 4, when an accessor touches the icon of the first virtual call button 35a from among multiple virtual call buttons, the virtual call device 3a activates the microphone and camera of the accessor terminal, as in the first embodiment, and transmits a call signal to the intercom master unit 2a via the virtual transmission unit 31, general-purpose networks L3 and L2a, and inputs the audio picked up by the microphone of the activated accessor terminal as an audio signal to the virtual microphone 33, and inputs the video captured by the camera of the accessor terminal as a video signal to the virtual camera 34. The audio and video signals input to the virtual microphone 33 and virtual camera 34 are then transmitted to the intercom master unit 2a via the same path as the call signal. As mentioned above, the audio signal uses the general-purpose VOIP protocol, so there is no need to perform protocol conversion when sending the audio signal from the virtual space to the real space. The subsequent operation of the intercom master unit 2a is the same as in the first embodiment, and the user can enter into a conversation with the same response operation without being aware of whether the caller is the intercom slave unit 1 in the real world or the virtual calling device 3 in the virtual world. Furthermore, for intercom master units 2b, ... other than the intercom master unit 2a, since no call signal is transmitted from the virtual calling device 3a in the first place, no ringing sound or other similar effects occur. Furthermore, if it is determined that there is no need to respond, the action of pretending to be absent without taking any action is the same as in the first and second embodiments. [Industrial applicability]

[0025] As described above, the virtual camera 34 and virtual microphone 33 in the virtual space can capture images and collect sounds from the real world using a microphone and camera of a smartphone or similar device (not shown) used to access the virtual space, and transmit the images and sounds to the intercom master unit 2. In addition, they can also transmit avatar images and artificial sounds such as synthesized voices created within the virtual space. Furthermore, in this system, the virtual call device 3 is directly connected to the intercom master unit via a general-purpose network. However, the system does not use the general-purpose VoIP protocol for communication between virtual units within the virtual space, and only uses the general-purpose VoIP protocol when communicating with the intercom master unit. The same effect is achieved even if a protocol conversion device is present within the virtual space. [Explanation of Symbols]

[0026] 1. Intercom handset 2, 2a, 2b... Intercom master unit 3, 3a Virtual Paging Device L1, L2, L2a, L2b, L3 General-Purpose Network 35, 35a, 35b Virtual Call Buttons

Claims

1. An intercom system comprising a virtual calling device located in a virtual space such as a metaverse space, which mimics the design of an intercom handset using images and icons, and an intercom master unit installed in a building in the real world and connectable to a general-purpose network, wherein when a call is made from the virtual calling device, a ringing sound is emitted from the intercom master unit, and two-way communication is possible when the intercom master unit answers after the call.

2. The intercom system according to claim 1, characterized in that it includes an intercom sub-unit that has calling and communication functions using the same communication protocol as the virtual call device, to which the intercom master unit is installed at the entrance of a building in the real world and connected via a general-purpose network.

3. The intercom system according to claim 1 or 2, characterized in that, after a call sound is emitted when the virtual call button of the virtual call device is operated, the intercom master unit emits an audio signal input from the virtual space and displays a video signal input from the virtual space before the intercom master unit responds, and does not emit any audio from the intercom master unit into the virtual space.

4. The intercom system according to claim 1 or 2, characterized in that the virtual calling device is connected to and registered with a plurality of intercom master units in the real space.

5. The intercom system according to claim 4, characterized in that the virtual calling device has one virtual calling button and can simultaneously call multiple intercom master units of connected buildings by operation from the virtual space.

6. The intercom system according to claim 4, characterized in that the virtual calling device has a plurality of virtual calling buttons, and calls one or more intercom master units from among a plurality of intercom master units of multiple buildings that have been registered for connection by operation from the virtual space, corresponding to the button that was operated.

Images