Methods, devices, electronic equipment and storage media for voice communication

Abstract

This application discloses a method, apparatus, electronic device, and storage medium for voice intercom. The method establishes a bidirectional transmission and reception management relationship between a first gateway and a first device through a preset bidirectional transmission and reception protocol. The first device is a front-end user device that has already established a one-way reception management relationship with a second gateway. The intercom function can be realized with only one negotiation. The negotiation time is short and the response speed is fast, which improves the user experience and meets user needs. After the bidirectional transmission and reception management relationship is established, the reception and transmission of media stream information can be completed through a single link, without the need to maintain two links, thus saving resources.

Description

Technical Field

[0001] This application belongs to the field of voice intercom technology, and particularly relates to a voice intercom method, apparatus, electronic device and storage medium. Background Technology

[0002] With the rapid development of society and the economy, video surveillance, as an important means in the security field, is playing an increasingly important role, and its application in important industries such as public security and finance has been continuously expanding in recent years. The national standard "Technical Requirements for Information Transmission, Exchange and Control of Public Security Video Surveillance Network System" (hereinafter referred to as GB / T 28181-2016) specifies the functional requirements of video surveillance systems. GB / T 28181-2016 details the implementation process of the one-to-one voice intercom function between the central user and the front-end user, which requires the combination of the following two independent processes:

[0003] 1) Through the real-time audio and video on-demand function, the central user receives real-time audio and video media streams sent by the front-end user equipment. See section 9.2 of the national standard specification.

[0004] 2) Through the voice broadcasting function, the central user sends real-time audio media streams to the front-end user equipment. See section 9.12.1 of the national standard specification.

[0005] Among them, the real-time audio and video on-demand process and the voice broadcast process each involve multiple signaling exchanges to complete the operation and media negotiation.

[0006] However, since the national standard GB / T 28181 does not specify the multi-party intercom process, existing technologies typically combine multiple one-to-one intercoms to achieve multi-party intercom. When implementing multi-party intercom by overlaying one-to-one intercoms, two separate processes are required for each front-end user: real-time audio / video playback and voice broadcasting. This necessitates two media negotiations to enable intercom, each involving multiple signaling interactions and waiting periods, resulting in a lengthy overall process. This hinders the rapid provision of multi-party intercom functionality, leading to a poor user experience. Furthermore, the two separate media negotiations require maintaining two separate media stream transmission links, resulting in significant resource consumption.

[0007] Therefore, the problem with existing technologies is that existing methods for implementing multi-party voice communication based on the GB28181 protocol are time-consuming and resource-intensive. Summary of the Invention

[0008] This application provides a voice intercom method, device, electronic device, and storage medium, which solves the problems of long negotiation time and high resource consumption in existing methods for implementing multi-party voice intercom based on the GB28181 protocol.

[0009] In a first aspect, embodiments of this application provide a voice intercom method applied to a first gateway, comprising:

[0010] When the central user equipment sends a multi-party intercom request to the first gateway, the multi-party intercom request is received. The multi-party intercom request is a request for multi-party intercom between the central user equipment and multiple front-end devices. The front-end devices include the first device that has established a one-way reception management relationship with the second gateway. The one-way reception management relationship is generated based on a preset one-way reception protocol.

[0011] In response to a multi-party intercom request, when the front-end device is the first device, the communication information between the second gateway and the first device is obtained. The communication information includes the identification information of the second gateway, the identification information of the first device, and the communication format information.

[0012] Based on communication information and a preset bidirectional transmission and reception protocol, a bidirectional transmission and reception management relationship is established between the first gateway and the first device;

[0013] Upon receiving media information from the central user equipment, the media information is sent to the first device that has a bidirectional transmission and reception management relationship with the first gateway.

[0014] In some possible implementations, the front-end device includes a second device, and a one-way receive management relationship has been established between the second device and the first gateway; the method also includes:

[0015] In response to a multi-party intercom request, when the front-end device is the second device, a one-way transmission management relationship is established between the first gateway and the second device based on a preset one-way transmission protocol, thereby obtaining a two-way transmit / receive management relationship between the first gateway and the second device; or

[0016] In response to multi-party intercom requests, when the front-end device is the second device, a bidirectional transmission and reception management relationship is established between the first gateway and the second device based on a preset bidirectional transmission and reception protocol;

[0017] Upon receiving media information from the central user equipment, the system sends media information to the first device that has a bidirectional transmission and reception management relationship with the first gateway, including:

[0018] Upon receiving media information from the central user equipment, the media information is sent to the first and second devices that have a bidirectional transmission and reception management relationship with the first gateway.

[0019] In some possible implementations, the bidirectional transceiver protocol includes an invitation protocol and an invitation protocol. The invitation protocol is stored in the first gateway and the second gateway, and the invitation protocol is stored in the front-end device. Based on communication information and a preset bidirectional transceiver protocol, a bidirectional transceiver management relationship is established between the first gateway and the first device, including:

[0020] Based on communication information and invitation protocols, an invitation message is sent to the first device;

[0021] The system receives information about the response result returned by the first device, wherein the response result information is generated by the first device based on the invitation information and the invitation protocol.

[0022] If the response is in agreement, a transmit / receive management relationship is generated between the first gateway and the first device.

[0023] In some possible implementations, the invitation information includes send and receive flags, and the response result information includes send and receive flags.

[0024] In some possible implementations, the method also includes:

[0025] Upon receiving media information sent by the target front-end device, the media information is sent to the central user device and other front-end devices, wherein the target front-end device is a front-end device that has a bidirectional send-receive management relationship with the first gateway.

[0026] In some possible implementations, a one-way receive protocol is a protocol in which the gateway requests to receive media information sent by the front-end device; a one-way send protocol is a protocol in which the gateway requests to send media information to the front-end device; and a two-way send / receive protocol is a protocol in which the gateway requests to send media information to the front-end device.

[0027] Secondly, embodiments of this application also provide a voice intercom device, applied to a first gateway, comprising:

[0028] The receiving module is used to receive a multi-party intercom request when the central user equipment sends a multi-party intercom request to the first gateway. The multi-party intercom request is a request for multi-party intercom between the central user equipment and multiple front-end devices. The front-end devices include the first device that has established a one-way receiving management relationship with the second gateway. The one-way receiving management relationship is generated based on a preset one-way receiving protocol.

[0029] The acquisition module is used to respond to a multi-party intercom request and, when the front-end device is the first device, acquire the communication information between the second gateway and the first device. The communication information includes the identification information of the second gateway, the identification information of the first device, and the communication format information.

[0030] The module is used to establish a bidirectional transmission and reception management relationship between the first gateway and the first device based on communication information and a preset bidirectional transmission and reception protocol.

[0031] The sending module is used to send media information to the first device that has a bidirectional transmission and reception management relationship with the first gateway when it receives media information sent by the central user equipment.

[0032] In some possible implementations, the front-end device includes a second device, which has established a one-way receive management relationship with the first gateway; the device also includes:

[0033] The module also responds to multi-party intercom requests. When the front-end device is a second device, it establishes a one-way transmission management relationship between the first gateway and the second device based on a preset one-way transmission protocol, thereby obtaining a two-way transmit / receive management relationship between the first gateway and the second device; or

[0034] The module is also used to respond to multi-party intercom requests and, when the front-end device is the second device, to establish a bidirectional transmission and reception management relationship between the first gateway and the second device based on a preset bidirectional transmission and reception protocol.

[0035] The sending module is used to send media information to a first device that has a bidirectional transmission and reception management relationship with the first gateway upon receiving media information sent by the central user equipment, including:

[0036] The sending unit is used to send media information to a first device and a second device that have a bidirectional transmission and reception management relationship with the first gateway when it receives media information sent by the central user equipment.

[0037] In some possible implementations, the bidirectional transceiver protocol includes an invitation protocol and an invitation protocol. The invitation protocol is stored in the first gateway and the second gateway, and the invitation protocol is stored in the front-end device. The establishment module is used to establish a bidirectional transceiver management relationship between the first gateway and the first device based on communication information and a preset bidirectional transceiver protocol, including:

[0038] The sending unit is used to send invitation information to the first device based on communication information and an invitation protocol;

[0039] The receiving unit is used to receive information about the response result returned by the first device, wherein the information about the response result is generated by the first device based on the invitation information and the invitation protocol;

[0040] The generation unit is used to generate the transmit / receive management relationship between the first gateway and the first device if the response result is in agreement.

[0041] In some possible implementations, the invitation information includes send and receive flags, and the response result information includes send and receive flags.

[0042] In some possible implementations, the device also includes:

[0043] The sending module is also used to send media information to the central user equipment and other front-end devices when it receives media information sent by the target front-end device, wherein the target front-end device is a front-end device that has a bidirectional send-receive management relationship with the first gateway.

[0044] In some possible implementations, a one-way receive protocol is a protocol in which the gateway requests to receive media information sent by the front-end device; a one-way send protocol is a protocol in which the gateway requests to send media information to the front-end device; and a two-way send / receive protocol is a protocol in which the gateway requests to send media information to the front-end device.

[0045] Thirdly, embodiments of this application also provide an electronic device, which includes a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, it implements the voice communication method in the first aspect, or any possible implementation of the first aspect.

[0046] Fourthly, embodiments of this application also provide a computer storage medium storing computer program instructions, which, when executed by a processor, implement the voice communication method in the first aspect or any possible implementation of the first aspect.

[0047] Fifthly, embodiments of this application provide a computer program product in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform the voice communication method of the first aspect or any possible implementation thereof.

[0048] The voice intercom method, apparatus, electronic device, and storage medium of this application embodiment, when a central user equipment sends a multi-party intercom request to a first gateway, the first gateway receives the multi-party intercom request. The multi-party intercom request is a request for multi-party intercom between the central user equipment and multiple front-end devices. The front-end devices may include a first device that has established a one-way receive management relationship with a second gateway. This one-way receive management relationship can be generated based on a preset one-way receive protocol. Then, in response to the multi-party intercom request, if the front-end device is the first device, the first gateway obtains the communication information between the second gateway and the first device. This communication information may include the identification information of the second gateway, the identification information of the first device, and communication format information. Then, based on the communication information and a preset two-way transmit / receive protocol, a two-way transmit / receive management relationship can be established between the first gateway and the first device. Subsequently, when receiving media information sent by the central user equipment, the gateway can send the media information to the first device that has a two-way transmit / receive management relationship with the first gateway. Through a pre-defined bidirectional transmit / receive protocol, a bidirectional transmit / receive management relationship can be established between the first gateway and the first device in one go. The first device is a front-end user device that has already established a one-way receive management relationship with the second gateway. Only one negotiation is needed to realize the intercom function. The negotiation time is short and the response speed is fast, which improves the user experience and meets user needs. After the bidirectional transmit / receive management relationship is established, the reception and transmission of media stream information can be completed through a single link, without the need to maintain two links, thus saving resources. Attached Figure Description

[0049] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0050] Figure 1 This is a flowchart illustrating the existing technology for implementing one-to-one communication based on the GB28181 protocol;

[0051] Figure 2 This is a schematic diagram of a method for implementing one-to-many intercom based on the GB28181 protocol in existing technology;

[0052] Figure 3 This is a schematic flowchart of a voice intercom method provided in an embodiment of this application;

[0053] Figure 4 This is a schematic diagram of the structure of a voice intercom system provided in an embodiment of this application;

[0054] Figure 5 This is a schematic diagram of the structure of a national standard gateway provided in an embodiment of this application;

[0055] Figure 6 This is a schematic flowchart of a voice intercom method provided in an embodiment of this application;

[0056] Figure 7 This is a schematic diagram of a bidirectional transceiver protocol provided in an embodiment of this application;

[0057] Figure 8 This is a schematic diagram of a voice intercom result provided in an embodiment of this application;

[0058] Figure 9 This is a schematic diagram of a voice intercom device provided in an embodiment of this application;

[0059] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0060] The features and exemplary embodiments of various aspects of this application will be described in detail below. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain this application and not to limit it. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples.

[0061] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes said element.

[0062] As described in the background section, GB / T 28181-2016 details the implementation process of a one-to-one voice intercom function between a central user and a front-end user, which requires a combination of the following two independent processes:

[0063] 1) Through the real-time audio and video on-demand function, the central user receives real-time audio and video media streams sent by the front-end user equipment. See section 9.2 of the national standard specification.

[0064] 2) Through the voice broadcasting function, the central user sends real-time audio media streams to the front-end user equipment. See section 9.12.1 of the national standard specification.

[0065] Among them, the real-time audio and video on-demand process and the voice broadcast process each involve multiple signaling exchanges to complete the operation and media negotiation.

[0066] However, since the national standard GB / T 28181 does not specify the multi-party intercom process, existing technologies typically combine multiple one-to-one intercoms to achieve multi-party intercom. Implementing multi-party intercom by overlaying one-to-one intercoms requires two separate processes for each front-end user: real-time audio / video playback and voice broadcasting. This necessitates two media negotiations to enable intercom, each involving multiple signaling interactions and waiting periods, resulting in a lengthy overall process. This hinders the rapid provision of multi-party intercom functionality, leading to a poor user experience. Furthermore, the two separate media negotiations require maintaining two separate media stream transmission links, resulting in significant resource consumption. Therefore, existing methods for implementing multi-party voice intercom based on the GB28181 protocol suffer from long negotiation times and high resource consumption.

[0067] It should be noted that the central user equipment can receive media streams, such as voice and video, from the front-end user equipment through the gateway based on the real-time audio and video on-demand function of the GB28181 protocol.

[0068] It should also be noted that the real-time audio and video on-demand function refers to the gateway establishing a one-way reception management relationship with the front-end user devices through a one-way reception protocol. For example, gateway_1 establishes a one-way reception management relationship with front-end user devices_1 and_2 through a one-way reception protocol, and gateway_2 establishes a one-way reception management relationship with front-end user devices_3 and_4 through a one-way reception protocol. In this case, gateway_1 is responsible for unidirectionally sending the media streams of front-end user devices_1 and_2 to the central user device, and gateway_2 is responsible for sending the media streams of front-end user devices_3 and_4 to the central user device. Furthermore, since gateway_1 has not established a one-way reception management relationship with front-end user devices_3 and_4, gateway_1 does not have the authority to forward the media streams of front-end user devices_3 and_4 to the central user device. At the same time, gateway_1 and gateway_2 also do not have the authority to send the media stream of the central user device to the front-end user devices.

[0069] The following is in conjunction with the appendix Figure 1 and attached Figure 2 This paper introduces the specific process of voice intercom based on the GB28181 protocol in the existing technology.

[0070] First, we will introduce the specific process of one-to-one communication based on the GB28181 protocol in the existing technology.

[0071] like Figure 1 As shown, in actual business scenarios, the real-time audio and video on-demand process has been completed before one-to-one voice communication. That is, the gateway and the front-end user have established a one-way receiving and management relationship. Then, it is only necessary to complete the voice broadcast function during the communication to realize one-to-one voice communication.

[0072] Specifically, in Figure 1 In the first stage, the national standard gateway and the front-end user complete the real-time audio and video on-demand process. The central user device can send a viewing request to the national standard gateway, which returns a viewing response. The central user can then watch the media stream from the front-end user. At this point, the central user device can only receive media information from the front-end user device, but cannot send media information to it; that is, a one-way receive management relationship has been established between the national standard gateway and the front-end user. When the central user device wants to send media information to the front-end user device, i.e., wants to have a one-to-one conversation, the central user device needs to send a conversation request. After the national standard gateway and the front-end user complete the voice broadcast process, the national standard gateway returns a conversation response to the central user device. Then, the central user can send the media stream to the front-end user device; that is, a one-way send management relationship has been established between the national standard gateway and the front-end user. Thus, the central user can communicate with the front-end user about the media stream through two separate links. The entire one-to-one voice conversation implementation process requires two negotiations: one to establish a one-way receive management relationship and one to establish a one-way send management relationship. Maintaining two links during voice conversations wastes time and resources.

[0073] It should be noted that, due to the large amount of actual SIP signaling, Figure 1 The specific SIP signaling process for each step has been omitted. For details, please refer to the signaling flow of real-time audio and video on-demand and voice broadcasting in the national standard specifications.

[0074] Next, we will introduce the specific process of one-to-many intercom based on the GB28181 protocol in the existing technology.

[0075] like Figure 2 As shown, since the GB28181 national standard does not specify the process for multi-party intercom scenarios, existing technologies usually combine multiple one-to-one intercoms into a single unit.

[0076] Specifically, in Figure 2In this approach, multi-party multi-talk is achieved by overlaying one-to-one intercoms. This requires two separate processes for each front-end user: real-time audio / video playback and voice broadcasting. Each front-end user needs to perform two media negotiations: establishing a one-way receive management relationship and a one-way transmit management relationship. Since each media negotiation involves multiple signaling interactions and waiting periods, adding a new front-end user is time-consuming, and each front-end user needs to maintain two links, resulting in high resource consumption. Therefore, existing methods for implementing multi-party voice intercom based on the GB28181 protocol suffer from long negotiation times and high resource consumption.

[0077] Based on this, embodiments of this application provide a method, apparatus, electronic device, and storage medium for voice intercom, which can be applied to multi-party intercom scenarios based on the GB28181 protocol. This can solve the problem of long negotiation time in existing multi-party voice intercom methods based on the GB28181 protocol.

[0078] The following is in conjunction with the appendix Figure 3 The voice intercom method provided in the embodiments of this application will be described in detail.

[0079] Figure 3 This is a schematic diagram of a voice intercom method provided in an embodiment of this application, applied to a first gateway, such as... Figure 3 As shown, the method may include S110-S140.

[0080] S110, when the central user equipment sends a multi-party intercom request to the first gateway, the multi-party intercom request is received. The multi-party intercom request is a request for multi-party intercom between the central user equipment and multiple front-end devices. The front-end devices include the first device that has established a one-way reception management relationship with the second gateway. The one-way reception management relationship is generated based on a preset one-way reception protocol.

[0081] The first gateway refers to the gateway that receives multi-party intercom request information sent by the central user equipment.

[0082] A multi-party communication request refers to a request for multi-party communication between a central user device and multiple front-end user devices. In other words, the central user device can receive media streams from multiple front-end user devices and can also send media streams to multiple front-end user devices.

[0083] A second gateway refers to a gateway that has not received a multi-party intercom request from the central user equipment, but which is connected to a front-end user equipment that the central user equipment wants to conduct multi-party intercom.

[0084] A one-way reception protocol refers to a protocol by which a gateway requests to receive media information sent by a front-end device. For example, it could be the GB28181 protocol that enables real-time video and audio on-demand playback. A one-way reception management relationship can be generated based on a preset one-way reception protocol.

[0085] Specifically, step S110 can be understood as follows: when the central user equipment sends a multi-party intercom request to the first gateway, the first gateway receives the multi-party intercom request. The multi-party intercom request is a request from the central user equipment to conduct multi-party intercom with multiple front-end devices. These front-end devices may include devices that have established a one-way receive management relationship with the second gateway; these devices can be referred to as the first device. The one-way receive management relationship is generated based on a preset one-way receive protocol. In other words, when the first gateway receives the multi-party intercom request from the central user equipment, there may be front-end user devices not managed by the first gateway, i.e., the first device managed by the second gateway. At this time, no one-way receive relationship or one-way send relationship is established between the first gateway and the first device. That is, the central user equipment can only receive the media stream from the first device through the second gateway; the central user equipment cannot receive or send media streams to the first device through the first gateway.

[0086] In some embodiments, a one-way receiving protocol is a protocol for a gateway to request to receive media information sent by a front-end device; a one-way sending protocol is a protocol for a gateway to request to send media information to a front-end device; and a two-way sending and receiving protocol is a protocol for a gateway to request and send media information to each other with a front-end device.

[0087] Specifically, a one-way receive protocol can be a protocol for a gateway to request the one-way reception of media information sent by a front-end device. For example, it could be the GB28181 protocol for implementing real-time audio / video on-demand functionality. Based on this protocol, a one-way receive management relationship can be established between the gateway and the front-end device, thus enabling real-time audio / video on-demand functionality. A one-way send protocol can be a protocol for a gateway to request the one-way send of media information to a front-end device. For example, it could be the GB28181 protocol for implementing voice broadcasting functionality. Based on this protocol, a one-way send management relationship can be established between the gateway and the front-end device, thus enabling voice broadcasting functionality. A two-way transmit / receive protocol can be a protocol for a gateway to request the mutual transmission of media information between itself and the front-end device. For example, if there is no one-way receive management relationship or one-way send management relationship between gateway_1 and front-end user equipment_3 or front-end user equipment_4, a two-way transmit / receive protocol can be used to establish both a one-way transmit / receive management relationship between gateway_1 and front-end user equipment_3, and also between gateway_1 and front-end user equipment_4. Therefore, if the central user equipment wants to establish a bidirectional transmit / receive management relationship with the front-end user equipment, using the traditional GB28181 protocol, the gateway and the front-end user equipment need to negotiate the protocol twice. A one-way receive management relationship needs to be established through a one-way receive protocol, and a one-way transmit management relationship also needs to be established through a one-way transmit protocol. Maintaining the one-way receive management relationship and the one-way transmit management relationship requires two independent links. The negotiation is time-consuming and resource-intensive. However, by using a bidirectional transmit / receive protocol, the front-end user equipment that was originally connected to other gateways can establish a bidirectional transmit / receive management relationship with them through a single negotiation. Only one link needs to be maintained, the negotiation time is short, and resources are saved.

[0088] S120, in response to a multi-party intercom request, if the front-end device is the first device, obtains the communication information between the second gateway and the first device, wherein the communication information includes the identification information of the second gateway, the identification information of the first device, and the communication format information.

[0089] Specifically, step S120 can be understood as follows: in response to a multi-party intercom request, if the front-end device is a first device managed by the second gateway, the first gateway obtains the communication information between the second gateway and the first device. The communication information may include the identification information of the second gateway, the identification information of the first device, and the communication format information, for use by the first gateway and the first device to conduct communication negotiation.

[0090] S130 establishes a bidirectional transmission and reception management relationship between the first gateway and the first device based on communication information and a preset bidirectional transmission and reception protocol.

[0091] Specifically, step S130 can be understood as follows: after obtaining communication information from the second gateway, a bidirectional transmission and reception management relationship between the first gateway and the first device can be established based on the communication information and the preset bidirectional transmission and reception protocol.

[0092] In some embodiments, the bidirectional transceiver protocol includes an invitation protocol and an invitation protocol, wherein the invitation protocol is stored in a first gateway and a second gateway, and the invitation protocol is stored in a front-end device; based on communication information and a preset bidirectional transceiver protocol, a bidirectional transceiver management relationship is established between the first gateway and the first device, including:

[0093] Based on communication information and invitation protocols, an invitation message is sent to the first device;

[0094] The system receives information about the response result returned by the first device, wherein the response result information is generated by the first device based on the invitation information and the invitation protocol.

[0095] If the response is in agreement, a transmit / receive management relationship is generated between the first gateway and the first device.

[0096] Specifically, the bidirectional transceiver protocol can include an invitation protocol and an invitation protocol. The invitation protocol can be programmed into the gateway device, and the invitation protocol can be programmed into the front-end user device. Step S130 establishes a bidirectional transceiver management relationship between the first gateway and the first device based on the communication information and the preset bidirectional transceiver protocol. This can include: based on the communication information and the invitation protocol, the first gateway can send invitation information to the first device, and then the first gateway can receive the response result information returned by the first device. The response result information can be generated by the first device based on the invitation information and the invitation protocol. Then, if the response result is in agreement, a transceiver management relationship can be generated between the first gateway and the first device. Thus, by maintaining a single link, the first gateway and the first device can achieve the sending and receiving of video streams, thereby realizing multi-party intercom between the central user device and multiple first devices.

[0097] In some embodiments, the invitation information may include send / receive flag information, and the response result information may include send / receive flag information.

[0098] Send and receive flag information, such as sendrecv flag information. When the front-end user equipment receives the sendrecv flag information sent by the first gateway, it can know that the first gateway wants to establish a bidirectional send and receive management relationship. At this time, the front-end user equipment can return the sendrecv flag information and the OK message to the first gateway, indicating that it agrees to establish a bidirectional send and receive management relationship with the first gateway.

[0099] Specifically, the first gateway can send an invitation message to the first device, which may include transmit / receive flag information. The first gateway can then receive a response from the first device, which may also include transmit / receive flag information. Based on this transmit / receive flag information, a two-way transmit / receive management relationship can be established through a single negotiation, saving negotiation time and enabling faster fulfillment of multi-party intercom requests from central users, thus meeting user needs.

[0100] S140: Upon receiving media information sent by the central user equipment, the media information is sent to the first device that has a bidirectional transmission and reception management relationship with the first gateway.

[0101] Specifically, step S140 can be understood as follows: when the first gateway receives media information sent by the central user equipment, it can send media information to the first device that has a bidirectional transmission and reception management relationship with the first gateway.

[0102] In some embodiments, the front-end device includes a second device, and the second device has established a one-way receive management relationship with the first gateway; the method further includes:

[0103] In response to a multi-party intercom request, when the front-end device is the second device, a one-way transmission management relationship is established between the first gateway and the second device based on a preset one-way transmission protocol, thereby obtaining a two-way transmit / receive management relationship between the first gateway and the second device; or

[0104] In response to multi-party intercom requests, when the front-end device is the second device, a bidirectional transmission and reception management relationship is established between the first gateway and the second device based on a preset bidirectional transmission and reception protocol;

[0105] Upon receiving media information from the central user equipment, the system sends media information to the first device that has a bidirectional transmission and reception management relationship with the first gateway, including:

[0106] Upon receiving media information from the central user equipment, the media information is sent to the first and second devices that have a bidirectional transmission and reception management relationship with the first gateway.

[0107] The second device refers to a front-end user device that has established a one-way reception management relationship with the first gateway through a one-way reception protocol. This front-end user device can be called the second device.

[0108] Specifically, the front-end user equipment for which the central user equipment wants to conduct multi-party intercom may include a second device that has established a one-way receive management relationship with the first gateway. The method further includes: in response to a multi-party intercom request, when the front-end device is the second device, method one can be used to establish a one-way send management relationship between the first gateway and the second device based on a preset one-way send protocol, thereby obtaining a bidirectional send-receive management relationship between the first gateway and the second device; or method two can be used to establish a bidirectional send-receive management relationship between the first gateway and the second device based on a preset bidirectional send-receive protocol. Upon receiving media information sent by the central user equipment, sending media information to the first device with a bidirectional send-receive management relationship with the first gateway may include: upon receiving media information sent by the central user equipment, sending media information to both the first device and the second device with a bidirectional send-receive management relationship with the first gateway. In other words, since the first gateway has already established a one-way receive management relationship with the second device based on the GB28181 protocol, it can negotiate with the second device once based on the GB28181 protocol to establish a one-way send management relationship. In this way, a two-way send and receive management relationship can be realized through two links. Alternatively, it can directly negotiate with the second device once based on the two-way send and receive protocol to establish a new two-way send and receive management relationship to replace the original one-way receive management relationship. A two-way send and receive management relationship can be realized through one link, which is more flexible.

[0109] In the voice intercom method of this application embodiment, when the central user equipment sends a multi-party intercom request to the first gateway, the first gateway receives the multi-party intercom request. The multi-party intercom request is a request for multi-party intercom between the central user equipment and multiple front-end devices. The front-end devices may include a first device that has established a one-way receive management relationship with the second gateway. The one-way receive management relationship can be generated based on a preset one-way receive protocol. Then, in response to the multi-party intercom request, if the front-end device is the first device, the first gateway obtains the communication information between the second gateway and the first device. The communication information may include the identification information of the second gateway, the identification information of the first device, and the communication format information. Then, based on the communication information and the preset two-way transmit and receive protocol, a two-way transmit and receive management relationship can be established between the first gateway and the first device. Then, when receiving media information sent by the central user equipment, the first gateway can send the media information to the first device that has a two-way transmit and receive management relationship with the first gateway. Through a pre-defined bidirectional transmit / receive protocol, a bidirectional transmit / receive management relationship can be established between the first gateway and the first device in one go. The first device is a front-end user device that has already established a one-way receive management relationship with the second gateway. Only one negotiation is needed to realize the intercom function. The negotiation time is short and the response speed is fast, which improves the user experience and meets user needs. After the bidirectional transmit / receive management relationship is established, the reception and transmission of media stream information can be completed through a single link, without the need to maintain two links, thus saving resources.

[0110] In some embodiments, the voice intercom method further includes:

[0111] Upon receiving media information sent by the target front-end device, the media information is sent to the central user device and other front-end devices, wherein the target front-end device is a front-end device that has a bidirectional send-receive management relationship with the first gateway.

[0112] The target front-end device refers to the front-end device that has a bidirectional transmit / receive management relationship with the first gateway. For example, it can be the first device that has established a bidirectional transmit / receive management relationship with the first gateway based on a bidirectional transmit / receive protocol, or it can be the second device that has established a bidirectional transmit / receive management relationship with the first gateway based on a one-way receive protocol and a one-way send protocol, or it can be the second device that has established a bidirectional transmit / receive management relationship with the first gateway based on a bidirectional transmit / receive protocol.

[0113] Specifically, when the first gateway receives media information sent by the target front-end device, it can send media information to the central user device and other front-end devices. In other words, after the first gateway establishes a bidirectional transmission and reception management relationship with the first and second devices, since all media stream information is aggregated within a single gateway, the first gateway can not only realize one-to-many intercom between the central user device and the front-end user devices, but also intercom between the front-end devices themselves, i.e., multi-party intercom between the central user device, the first device, and the second device. The voice intercom method provided in this application embodiment allows all user media streams to be aggregated to the same national standard gateway, ensuring that each party can be heard by the others, and each party can hear the intercom of any other party. Furthermore, no media stream transmission is required between national standard gateways, resulting in less internal resource consumption and lower bandwidth usage.

[0114] In one example, the internal structure of each national standard gateway can be as follows: Figure 4 As shown, a national standard gateway may include a national standard gateway signaling module and a national standard gateway media module. These two modules can be deployed together or separately, and this application embodiment does not impose any limitations. Different national standard gateways may be deployed in different clusters, different data centers, or different regions.

[0115] In another example, such as Figure 5 As shown, front-end user 1, front-end user 2, and front-end user 3 belong to national standard gateway 1, national standard gateway 2, and national standard gateway 3, respectively, and their respective national standard gateways handle audio and video live streaming, video-on-demand, and recording operations. In other words, front-end user 1, front-end user 2, and front-end user 3 have established one-way receiving and management relationships with national standard gateway 1, national standard gateway 2, and national standard gateway 3, respectively. (See [reference needed]). Figure 6 The central user can watch or record the media streams of the front-end user, but the central user cannot send media streams to the front-end user.

[0116] The specific process for implementing multi-party intercom functionality using the national standard gateway 1 is as follows: Figure 6 As shown:

[0117] 1) Front-end user 1, front-end user 2, and front-end user 3 have established a one-way receiving management relationship with national standard gateway 1, national standard gateway 2, and national standard gateway 3 respectively. That is, national standard gateway 1, national standard gateway 2, and national standard gateway 3 can receive the media streams of front-end user 1, front-end user 2, and front-end user 3 respectively through the real-time audio and video on-demand process.

[0118] 2) When the central user equipment sends a multi-party intercom request to the national standard gateway 1, the national standard gateway 1 can add the front-end user 1 to the multi-party intercom through the voice broadcast process, or add the front-end user 1 to the multi-party intercom through the bidirectional transceiver protocol, thus establishing a bidirectional transceiver management relationship between the national standard gateway 1 and the front-end user 1.

[0119] National Standard Gateway 1 requests communication information from National Standard Gateway 2, such as the identification information of National Standard Gateway 2, the identification information of Front-end User 2, and the historical communication format information between National Standard Gateway 2 and Front-end User 2. In other words, National Standard Gateway 1 requests communication between the central user and Front-end User 2. National Standard Gateway 2 returns communication information to National Standard Gateway 1. National Standard Gateway 1 adds Front-end User 2 to the multi-party multi-talk through re-INVITE media negotiation. Re-INVITE media negotiation is a bidirectional transmit / receive protocol. This establishes a bidirectional transmit / receive management relationship between National Standard Gateway 1 and Front-end User 1.

[0120] The process of establishing the bidirectional send-receive management relationship between the national standard gateway 1 and the front-end user 3 is the same as the process of establishing the bidirectional send-receive management relationship between the national standard gateway 1 and the front-end user 2.

[0121] 3) The national standard gateway 1 sends a multi-party intercom response message to the central user.

[0122] It should be noted that the signaling operations related to the real-time audio / video on-demand process and voice broadcast process involved in this procedure are performed in accordance with the GB28181 protocol. Messages between GB28181 Gateway 1, GB28181 Gateway 2, and GB28181 Gateway 3 are internally defined private messages. These messages may include header information such as From, To, and Call-ID of the current SIP call with the user.

[0123] In another example, communication information may include: 1) User communication information: user signaling IP, signaling port, signaling port type including source and destination; 2) User call information: all-ID, From, To, etc.; 3) User media information: media IP, media port, media port type, media stream information including source and destination, etc.

[0124] In one example, the specific process of the bidirectional send / receive protocol is as follows: Figure 7 As shown, the GB / T gateway 1 may include a "GB / T gateway signaling module" and a "GB / T gateway media module". The process of establishing a bidirectional transmission and reception management relationship between GB / T gateway 1 and front-end user 2 based on a bidirectional transmission and reception protocol is as follows:

[0125] 1) The "GB Gateway Signaling Module" sends an INVITE message to the "GB Gateway Media Module" to request media resources;

[0126] 2) The "GB Gateway Media Module" responds to the "GB Gateway Signaling Module" with a 200 OK message, carrying the media SDP;

[0127] 3) The "national standard gateway signaling module" sends a re-INVITE message, i.e. an invitation message, to the front-end user 2. The invitation message includes a media SDP, which carries bidirectional transmit and receive flag information, such as the sendrecv flag information.

[0128] 4) Front-end user 2 responds to the "national standard gateway signaling module" with a 200 OK message, carrying the user SDP, which carries bidirectional send and receive flag information, such as sendrecv flag information;

[0129] 5) The "GB Gateway Signaling Module" sends an ACK response message to the "GB Gateway Media Module," carrying the user's SDP;

[0130] 6) The "National Standard Gateway Signaling Module" sends an ACK response message to the front-end user.

[0131] Based on a bidirectional transmit / receive protocol, bidirectional transmit / receive management relationships were established between GB1 gateway 1 and front-end user 2, and between GB1 gateway 1 and front-end user 3, such as... Figure 8 As shown, the national standard gateway 1 has added front-end user 1, front-end user 2, and front-end user 3 to the multi-party intercom. During multi-party intercom, there is no need to transmit media streams between gateways, which can get rid of the constraints of national standard gateway 2 and national standard gateway 3. Multi-party intercom between the central user, front-end user 1, front-end user 2, and front-end user 3 can be completed through a single national standard gateway, namely national standard gateway 1.

[0132] It should be noted that in this process, the re-INVITE message between the national standard gateway signaling and front-end user 2 is implemented according to the SIP protocol. The required From, To, and Call-ID header information is carried in the response message of the national standard gateway 2 to which front-end user 2 belongs. (See [link to relevant documentation]). Figure 6 The communication information returned by the national standard gateway 2 to the national standard gateway 1.

[0133] It should also be noted that all SDP information involved in this process carries a sendrecv description, indicating bidirectional transmission and reception. This process uses a re-INVITE invitation message, allowing the national standard gateway 1 to add front-end user 2, who is not affiliated with the national standard gateway 1, to the multi-party intercom. Only one media negotiation is required between the gateway and front-end user 2, saving time. Only one media channel needs to be maintained, and media stream transmission between gateways is not required during multi-party intercom, resulting in lower bandwidth consumption and conserving internal resources.

[0134] Figure 9 This application provides a voice intercom device, applied to a first gateway, such as... Figure 9As shown, the device 900 may include a receiving module 910, an acquisition module 920, an establishment module 930, and a sending module 940:

[0135] The receiving module 910 is used to receive a multi-party intercom request when the central user equipment sends a multi-party intercom request to the first gateway. The multi-party intercom request is a request for multi-party intercom between the central user equipment and multiple front-end devices. The front-end devices include the first device that has established a one-way receiving management relationship with the second gateway. The one-way receiving management relationship is generated based on a preset one-way receiving protocol.

[0136] The acquisition module 920 is used to respond to a multi-party intercom request and, when the front-end device is the first device, acquire the communication information between the second gateway and the first device. The communication information includes the identification information of the second gateway, the identification information of the first device, and the communication format information.

[0137] Module 930 is used to establish a bidirectional transmission and reception management relationship between the first gateway and the first device based on communication information and a preset bidirectional transmission and reception protocol;

[0138] The sending module 940 is used to send media information to the first device that has a bidirectional transmission and reception management relationship with the first gateway when it receives media information sent by the central user equipment.

[0139] The voice intercom device provided in this application embodiment, when a central user equipment sends a multi-party intercom request to a first gateway, the first gateway receives the multi-party intercom request. The multi-party intercom request is a request for multi-party intercom between the central user equipment and multiple front-end devices. The front-end devices may include a first device that has established a one-way receive management relationship with a second gateway. This one-way receive management relationship can be generated based on a preset one-way receive protocol. Then, in response to the multi-party intercom request, if the front-end device is the first device, the first gateway obtains the communication information between the second gateway and the first device. This communication information may include the identification information of the second gateway, the identification information of the first device, and communication format information. Then, based on the communication information and a preset two-way transmit and receive protocol, a two-way transmit and receive management relationship can be established between the first gateway and the first device. Then, when receiving media information sent by the central user equipment, the first gateway can send the media information to the first device that has a two-way transmit and receive management relationship with the first gateway. Through a pre-defined bidirectional transmit / receive protocol, a bidirectional transmit / receive management relationship can be established between the first gateway and the first device in one go. The first device is a front-end user device that has already established a one-way receive management relationship with the second gateway. Only one negotiation is needed to realize the intercom function. The negotiation time is short and the response speed is fast, which improves the user experience and meets user needs. After the bidirectional transmit / receive management relationship is established, the reception and transmission of media stream information can be completed through a single link, without the need to maintain two links, thus saving resources.

[0140] In some embodiments, the front-end device includes a second device, and the second device has established a one-way reception management relationship with the first gateway; the device may further include:

[0141] The module also responds to multi-party intercom requests. When the front-end device is a second device, it establishes a one-way transmission management relationship between the first gateway and the second device based on a preset one-way transmission protocol, thereby obtaining a two-way transmit / receive management relationship between the first gateway and the second device; or

[0142] The module is also used to respond to multi-party intercom requests and, when the front-end device is the second device, to establish a bidirectional transmission and reception management relationship between the first gateway and the second device based on a preset bidirectional transmission and reception protocol.

[0143] The sending module is used to send media information to a first device that has a bidirectional transmission and reception management relationship with the first gateway upon receiving media information sent by the central user equipment, including:

[0144] The sending unit is used to send media information to a first device and a second device that have a bidirectional transmission and reception management relationship with the first gateway when it receives media information sent by the central user equipment.

[0145] In some embodiments, the bidirectional transceiver protocol includes an invitation protocol and an invitation protocol, wherein the invitation protocol is stored in the first gateway and the second gateway, and the invitation protocol is stored in the front-end device; the establishment module is used to establish a bidirectional transceiver management relationship between the first gateway and the first device based on communication information and a preset bidirectional transceiver protocol, and may include:

[0146] The sending unit is used to send invitation information to the first device based on communication information and an invitation protocol;

[0147] The receiving unit is used to receive information about the response result returned by the first device, wherein the information about the response result is generated by the first device based on the invitation information and the invitation protocol;

[0148] The generation unit is used to generate the transmit / receive management relationship between the first gateway and the first device if the response result is in agreement.

[0149] In some embodiments, the invitation information includes send / receive flag information, and the response result information may include send / receive flag information.

[0150] In some embodiments, the device may further include:

[0151] The sending module is also used to send media information to the central user equipment and other front-end devices when it receives media information sent by the target front-end device, wherein the target front-end device is a front-end device that has a bidirectional send-receive management relationship with the first gateway.

[0152] In some embodiments, a one-way receiving protocol is a protocol for a gateway to request to receive media information sent by a front-end device; a one-way sending protocol is a protocol for a gateway to request to send media information to a front-end device; and a two-way sending and receiving protocol is a protocol for a gateway to request and send media information to each other with a front-end device.

[0153] The various modules in the voice intercom device provided in this application embodiment can achieve... Figures 3 to 8 The functions of each step of the provided voice intercom method and the corresponding technical effects are described briefly and will not be elaborated here.

[0154] Figure 10 A schematic diagram of the hardware structure of the voice intercom device provided in an embodiment of this application is shown.

[0155] The voice intercom device may include a processor 1001 and a memory 1002 storing computer program instructions.

[0156] Specifically, the processor 1001 may include a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.

[0157] Memory 1002 may include mass storage for data or instructions. For example, and not limitingly, memory 1002 may include a hard disk drive (HDD), floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where suitable, memory 1002 may include removable or non-removable (or fixed) media. Where suitable, memory 1002 may be internal or external to a voice intercom device. In a particular embodiment, memory 1002 is a non-volatile solid-state memory.

[0158] Memory may include read-only memory (ROM), random access memory (RAM), disk storage media devices, optical storage media devices, flash memory devices, and electrical, optical, or other physical / tangible memory storage devices. Therefore, typically, memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to one aspect of this disclosure.

[0159] The processor 1001 reads and executes computer program instructions stored in the memory 1002 to implement any of the voice intercom methods in the above embodiments.

[0160] In one example, the voice intercom device may further include a communication interface 1003 and a bus 1004. Wherein, for example... Figure 10 As shown, the processor 1001, memory 1002, and communication interface 1003 are connected through bus 1004 and complete communication with each other.

[0161] The communication interface 1003 is mainly used to realize communication between various modules, devices, units and / or equipment in the embodiments of this application.

[0162] Bus 1004 includes hardware, software, or both, that couples components of a voice intercom device together. For example, and not limitingly, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Linear Predictive Coding (LPC) bus, a memory bus, a MicroChannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (Peripheral Component Interconnect-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VESA Local Bus, VLB) bus, or other suitable buses, or a combination of two or more of these. Where appropriate, bus 1004 may include one or more buses. Although specific buses are described and illustrated in the embodiments of this application, this application considers any suitable bus or interconnection.

[0163] This device can execute the voice intercom method in the embodiments of this application based on the various units / components in the voice intercom device, thereby achieving a combination Figures 3 to 8 Describes the method for creating database table partitions.

[0164] Furthermore, in conjunction with the voice intercom methods in the above embodiments, this application embodiment can provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when these computer program instructions are executed by a processor, they implement any of the voice intercom methods in the above embodiments.

[0165] This application also provides a computer program product, wherein the instructions in the computer program product, when executed by the processor of an electronic device, cause the electronic device to perform various processes implementing any of the above-described voice intercom method embodiments.

[0166] It should be clarified that this application is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of this application is not limited to the specific steps described and shown. Those skilled in the art can make various changes, modifications, and additions, or change the order of steps, after understanding the spirit of this application.

[0167] The functional blocks shown in the above-described block diagram can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of this application are programs or code segments used to perform the required tasks. Programs or code segments can be stored on a machine-readable medium or transmitted over a transmission medium or communication link via data signals carried on a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, read-only memory (ROM), flash memory, erasable read-only memory (EROM), floppy disks, compact disc read-only memory (CD-ROM), optical disks, hard disks, fiber optic media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.

[0168] It should also be noted that the exemplary embodiments mentioned in this application describe methods or systems based on a series of steps or apparatus. However, this application is not limited to the order of the above steps; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0169] The aspects of this disclosure have been described above with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block in the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that these instructions, executable via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions / actions specified in one or more blocks of the flowchart illustrations and / or block diagrams. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field-programmable logic circuit. It is also understood that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can also be implemented by special-purpose hardware performing the specified functions or actions, or can be implemented by a combination of special-purpose hardware and computer instructions.

[0170] The above are merely specific embodiments of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.

Claims

1. A method for voice communication, characterized in that, Applied to the first gateway, including: When the central user equipment sends a multi-party intercom request to the first gateway, the multi-party intercom request is received. The multi-party intercom request is a request for multi-party intercom between the central user equipment and multiple front-end devices. The front-end devices include a first device that has established a one-way reception management relationship with the second gateway. The one-way reception management relationship is generated based on a preset one-way reception protocol. In response to the multi-party intercom request, if the front-end device is the first device, the communication information between the second gateway and the first device is obtained, wherein the communication information includes the identification information of the second gateway, the identification information of the first device, and the communication format information; Based on the communication information and the preset bidirectional transceiver protocol, a bidirectional transceiver management relationship is established between the first gateway and the first device; Upon receiving media information sent by the central user equipment, the media information is sent to the first device that has the bidirectional transmission and reception management relationship with the first gateway.

2. The method according to claim 1, characterized in that, The front-end device includes a second device, and the second device has established the one-way receiving management relationship with the first gateway; The method further includes: In response to the multi-party intercom request, when the front-end device is the second device, a one-way transmission management relationship is established between the first gateway and the second device based on a preset one-way transmission protocol, thereby obtaining a two-way transmit / receive management relationship between the first gateway and the second device; or In response to the multi-party intercom request, if the front-end device is the second device, a bidirectional transceiver management relationship is established between the first gateway and the second device based on the preset bidirectional transceiver protocol; Upon receiving media information sent by the central user equipment, sending the media information to the first device that has the bidirectional transceiver management relationship with the first gateway includes: Upon receiving media information sent by the central user equipment, the media information is sent to the first device and the second device that have the bidirectional transmission and reception management relationship with the first gateway.

3. The method according to claim 1, characterized in that, The bidirectional transceiver protocol includes an invitation protocol and an invitation protocol. The invitation protocol is stored in the first gateway and the second gateway, and the invitation protocol is stored in the front-end device. The step of establishing a bidirectional transmission and reception management relationship between the first gateway and the first device based on the communication information and a preset bidirectional transmission and reception protocol includes: Based on the communication information and the invitation protocol, an invitation message is sent to the first device; The system receives information about the response result returned by the first device, wherein the information about the response result is generated by the first device based on the invitation information and the invitation protocol; If the response result is in agreement, the transmit / receive management relationship between the first gateway and the first device is generated.

4. The method according to claim 3, characterized in that, The invitation information includes send / receive flag information, and the response result information includes the send / receive flag information.

5. The method according to any one of claims 1 to 4, characterized in that, Also includes: Upon receiving media information sent by the target front-end device, the media information is sent to the central user device and other front-end devices, wherein the target front-end device is a front-end device that has the bidirectional transmit / receive management relationship with the first gateway.

6. The method according to any one of claims 1 to 4, characterized in that, The one-way receiving protocol is a protocol for the gateway to request to receive media information sent by the front-end device; the one-way sending protocol is a protocol for the gateway to request to send media information to the front-end device; the two-way sending and receiving protocol is a protocol for the gateway to request and send media information to each other with the front-end device.

7. A voice intercom device, characterized in that, Applied to the first gateway, including: The receiving module is used to receive the multi-party intercom request when the central user equipment sends a multi-party intercom request to the first gateway. The multi-party intercom request is a request for multi-party intercom between the central user equipment and multiple front-end devices. The front-end devices include a first device that has established a one-way receiving management relationship with the second gateway. The one-way receiving management relationship is generated based on a preset one-way receiving protocol. The acquisition module is used to respond to the multi-party intercom request and, when the front-end device is the first device, acquire communication information between the second gateway and the first device, wherein the communication information includes the identification information of the second gateway, the identification information of the first device, and communication format information; The module is used to establish a bidirectional transmission and reception management relationship between the first gateway and the first device based on the communication information and a preset bidirectional transmission and reception protocol. The sending module is configured to send the media information to the first device that has the bidirectional transmission and reception management relationship with the first gateway when it receives the media information sent by the central user equipment.

8. The apparatus according to claim 7, characterized in that, The front-end device includes a second device, and the second device has established the one-way reception management relationship with the first gateway; the device further includes: The module is also configured to, in response to the multi-party intercom request, establish a one-way transmission management relationship between the first gateway and the second device based on a preset one-way transmission protocol, when the front-end device is the second device, thereby obtaining a two-way transmit / receive management relationship between the first gateway and the second device; or The module is also used to respond to the multi-party intercom request and, when the front-end device is the second device, establish a bidirectional transmission and reception management relationship between the first gateway and the second device based on the preset bidirectional transmission and reception protocol. The sending module is configured to, upon receiving media information sent by the central user equipment, send the media information to the first device that has the bidirectional transceiver management relationship with the first gateway, including: The sending unit is configured to send the media information to the first device and the second device, which have the bidirectional transceiver management relationship with the first gateway, upon receiving the media information sent by the central user equipment.

9. An electronic device, characterized in that, The electronic device includes: a processor and a memory storing computer program instructions; the processor, when executing the computer program instructions, implements the voice intercom method as described in any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer program instructions that, when executed by a processor, implement the voice intercom method as described in any one of claims 1 to 6.

Images