Conference monitoring method, conference system and conference monitoring device

Abstract

An embodiment of the present application provides a conference monitoring method, a conference system, and a conference monitoring device. The method is applied to any streaming media gateway in the conference system. The conference system also includes an access gateway and multiple conference terminals; any streaming media gateway is connected to at least one conference terminal, and all streaming media gateways are connected to the access gateway. The method includes: after receiving first visual network conference data triggered by a target conference terminal in a conference service, sending the first visual network conference data to other conference terminals in the conference service and the access gateway in the conference system respectively, so that the access gateway converts the first visual network conference data into first monitoring network conference data, and sends the first monitoring network conference data to the first monitoring terminal; wherein the target conference terminal is the terminal that the first monitoring terminal needs to monitor, or the target conference terminal is the terminal in the conference service that the first monitoring terminal needs to access.

Description

Technical Field

[0001] The present application relates to the field of conference technology, and in particular to a conference monitoring method, a conference system, and a conference monitoring device. Background Art

[0002] With the development of technology, video conferencing has been widely used in various fields. Through video conferencing, participants can hear the sounds from other venues, see the images, movements, and expressions of participants in other venues, and even send electronic presentations, making participants feel as if they are actually there. In some video conferencing, it is necessary to connect a monitoring terminal to monitor the conference terminals or to import monitoring data into the meeting.

[0003] In the related art, the monitoring terminal is added to the conference by connecting the monitoring terminal to a conference terminal participating in the conference.

[0004] However, the conference terminal connected to the monitoring terminal cannot transmit conference data when transmitting the monitoring data of the monitoring terminal, and the above solution requires that the monitoring terminal and the conference terminal are fully interoperable. Summary of the Invention

[0005] Embodiments of the present application provide a conference monitoring method, a conference system, and a conference monitoring device for monitoring conference terminals without affecting the conference.

[0006] In a first aspect, an embodiment of the present application provides a first conference monitoring method, which is applied to any streaming media gateway in a conference system, wherein the conference system also includes an access gateway and multiple conference terminals; wherein any streaming media gateway is connected to at least one conference terminal, and all streaming media gateways are connected to the access gateway, and the method includes:

[0007] After receiving the first visual network conference data triggered by the target conference terminal in the conference service, the first visual network conference data is sent to other conference terminals in the conference service and the access gateway in the conference system, so that the access gateway converts the first visual network conference data into first monitoring network conference data, and sends the first monitoring network conference data to the first monitoring terminal;

[0008] The target conference terminal is a terminal that the first monitoring terminal needs to monitor, or the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access.

[0009] The above scheme diverts the first visual network conference data triggered by the target conference terminal through the streaming media gateway (sent to other conference terminals in the conference service and the access gateway in the conference system respectively), reducing the network upload pressure of the conference terminal; and then converts the first visual network conference data into first monitoring network conference data that can be received by the first monitoring terminal through the access gateway, and sends the first monitoring network conference data to the first monitoring terminal, avoiding the situation where the first monitoring terminal cannot receive the conference data due to network isolation, and monitoring the conference terminal without affecting the meeting.

[0010] In some optional implementations, the method further comprises:

[0011] After receiving the second visual network monitoring data sent by the access gateway, the second visual network monitoring data is sent to the conference terminal that needs to access the second monitoring terminal; wherein, the second visual network monitoring data is obtained by the access gateway converting the second monitoring network monitoring data after receiving the second monitoring network monitoring data sent by the second monitoring terminal, and the second monitoring terminal is the monitoring terminal that the conference terminal needs to access.

[0012] The above scheme converts the monitoring data of the second monitoring network into second visual network monitoring data that can be received by the conference terminal through the access gateway, and sends the second visual network monitoring data to the streaming media gateway corresponding to the conference terminal that needs to access the second monitoring terminal; then, after receiving the second visual network monitoring data that can be received by the conference terminal, the streaming media gateway sends the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal, avoiding the situation where the conference terminal that needs to access the second monitoring terminal cannot receive the monitoring data due to network isolation, and connecting the monitoring terminal to the conference terminal without affecting the meeting.

[0013] In some optional implementations, if the target conference terminal participates in multiple conference services, sending the first video network conference data to other conference terminals in the conference service and the access gateway in the conference system respectively includes:

[0014] For any conference service participated in by the target conference terminal, sending the first video network conference data corresponding to the conference service to other conference terminals in the conference service; and

[0015] All first video network conference data triggered by the target conference terminal are sent to the access gateway.

[0016] In the above scheme, when the target conference terminal participates in multiple conference services, it determines which conference service the first visual network conference data triggered by it corresponds to, and then sends the first visual network conference data to other conference terminals in the corresponding conference service, thereby decoupling the visual network conference data triggered by the conference terminal from the conference service, thereby not affecting other conference services participated in by the target conference terminal. Therefore, the conference terminal can participate in multiple conference services.

[0017] In some optional implementations, if the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access, the method further includes:

[0018] After receiving the third visual network monitoring data sent by the access gateway, the third visual network monitoring data is sent to the target conference terminal; wherein, the third visual network monitoring data is obtained by the access gateway converting the third monitoring network monitoring data after receiving the third monitoring network monitoring data sent by the first monitoring terminal.

[0019] The above scheme converts the monitoring data of the third monitoring network into third visual network monitoring data that can be received by the conference terminal through the access gateway, and sends the third visual network monitoring data to the streaming media gateway corresponding to the conference terminal in the conference service that needs to be accessed; then, after receiving the third visual network monitoring data that can be received by the conference terminal, the streaming media gateway sends the third visual network monitoring data to the conference terminal in the conference service that needs to be accessed, avoiding the situation where the conference terminal in the conference service that needs to be accessed cannot receive the monitoring data due to network isolation, and connecting the monitoring terminal to the conference service without affecting the meeting.

[0020] In a second aspect, an embodiment of the present application provides a second conference monitoring method, which is applied to an access gateway in a conference system, wherein the conference system also includes at least one streaming gateway and multiple conference terminals; wherein any streaming gateway is connected to at least one conference terminal, and all streaming gateways are connected to the access gateway, and the method includes:

[0021] After receiving the first video network conference data sent by the streaming gateway, converting the first video network conference data into first monitoring network conference data;

[0022] The first monitoring network conference data is sent to the first monitoring terminal; wherein the first visual network conference data is triggered by a target conference terminal in a conference service; the target conference terminal is a terminal that the first monitoring terminal needs to monitor, or the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access.

[0023] In some optional implementations, the method further comprises:

[0024] After receiving the second monitoring network monitoring data sent by the second monitoring terminal, converting the second monitoring network monitoring data into the second visual network monitoring data; wherein the second monitoring terminal is the monitoring terminal that the conference terminal needs to access;

[0025] The second visual network monitoring data is sent to the streaming gateway corresponding to the conference terminal that needs to access the second monitoring terminal, so that the streaming gateway sends the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal.

[0026] In some optional implementations, if the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access, the method further includes:

[0027] After receiving the monitoring data of the third monitoring network sent by the first monitoring terminal, converting the monitoring data of the third monitoring network into monitoring data of the third visual network;

[0028] The third visual network monitoring data is sent to the streaming gateway corresponding to the target conference terminal, so that the streaming gateway sends the third visual network monitoring data to the target conference terminal.

[0029] In a third aspect, an embodiment of the present application provides a conference system, comprising at least one streaming gateway, an access gateway, and a plurality of conference terminals; wherein any streaming gateway is connected to at least one conference terminal, and all streaming gateways are connected to the access gateway;

[0030] Any streaming media gateway, configured to, after receiving first video network conference data triggered by a target conference terminal in a conference service, send the first video network conference data to other conference terminals in the conference service and an access gateway in the conference system;

[0031] The access gateway is configured to, after receiving the first video network conference data sent by the streaming gateway, convert the first video network conference data into first monitoring network conference data, and send the first monitoring network conference data to the first monitoring terminal;

[0032] The target conference terminal is a terminal that the first monitoring terminal needs to monitor, or the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access.

[0033] In some optional implementations, the access gateway is further configured to, after receiving the second monitoring network monitoring data sent by the second monitoring terminal, convert the second monitoring network monitoring data into second visual network monitoring data, and send the second visual network monitoring data to the streaming media gateway corresponding to the conference terminal that needs to access the second monitoring terminal; wherein the second monitoring terminal is the monitoring terminal that the conference terminal needs to access;

[0034] The streaming media gateway is further configured to send the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal after receiving the second visual network monitoring data sent by the access gateway.

[0035] In some optional implementations, if the target conference terminal participates in multiple conference services, the streaming gateway is specifically configured to:

[0036] For any conference service participated in by the target conference terminal, sending the first video network conference data corresponding to the conference service to other conference terminals in the conference service; and

[0037] All first video network conference data triggered by the target conference terminal are sent to the access gateway.

[0038] In some optional implementations, if the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access, the access gateway is further configured to, after receiving the monitoring data of the third monitoring network sent by the first monitoring terminal, convert the monitoring data of the third monitoring network into monitoring data of a third visual network, and send the monitoring data of the third visual network to the streaming media gateway corresponding to the target conference terminal;

[0039] The streaming media gateway is further configured to send the third visual network monitoring data to the target conference terminal after receiving the third visual network monitoring data sent by the access gateway.

[0040] In a fourth aspect, an embodiment of the present application provides a first conference monitoring device, which is applied to any streaming media gateway in a conference system, wherein the conference system also includes an access gateway and multiple conference terminals; wherein any streaming media gateway is connected to at least one conference terminal, and all streaming media gateways are connected to the access gateway, and the device includes:

[0041] A first transceiver module is configured to, after receiving first visual network conference data triggered by a target conference terminal in a conference service, send the first visual network conference data to other conference terminals in the conference service and an access gateway in the conference system, so that the access gateway converts the first visual network conference data into first monitoring network conference data and sends the first monitoring network conference data to the first monitoring terminal;

[0042] The target conference terminal is a terminal that the first monitoring terminal needs to monitor, or the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access.

[0043] In a fifth aspect, an embodiment of the present application provides a second conference monitoring device, which is applied to an access gateway in a conference system, wherein the conference system also includes at least one streaming media gateway and multiple conference terminals; wherein any streaming media gateway is connected to at least one conference terminal, and all streaming media gateways are connected to the access gateway, and the device includes:

[0044] A conversion module, configured to convert the first visual network conference data into first monitoring network conference data after receiving the first visual network conference data sent by the streaming media gateway;

[0045] The second transceiver module is used to send the first monitoring network conference data to the first monitoring terminal; wherein, the first visual network conference data is triggered by the target conference terminal in the conference service; the target conference terminal is the terminal that the first monitoring terminal needs to monitor, or the target conference terminal is the terminal in the conference service that the first monitoring terminal needs to access.

[0046] In a sixth aspect, an embodiment of the present application provides a streaming media gateway comprising at least one processor and at least one memory, wherein the memory stores a computer program, and when the program is executed by the processor, the processor executes any conference monitoring method described in the first aspect above.

[0047] In the seventh aspect, an embodiment of the present application provides an access gateway comprising at least one processor and at least one memory, wherein the memory stores a computer program, and when the program is executed by the processor, the processor executes any conference monitoring method described in the second aspect above.

[0048] In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium storing a computer program executable by a processor. When the program runs on the processor, the processor executes the conference monitoring method described in any one of the first or second aspects above. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0050] Figure 1Schematic diagram of application scenarios provided by embodiments of the present application;

[0051] Figure 2 An interactive flow chart of the first conference monitoring method provided in an embodiment of the present application;

[0052] Figure 3 An interactive flow chart of the second conference monitoring method provided in an embodiment of the present application;

[0053] Figure 4 An interactive flow chart of the third conference monitoring method provided in an embodiment of the present application;

[0054] Figure 5 An interactive flow chart of the fourth conference monitoring method provided in an embodiment of the present application;

[0055] Figure 6 A flowchart of a conference monitoring method provided in an embodiment of the present application;

[0056] Figure 7 A schematic diagram of the structure of a first conference monitoring device provided in an embodiment of the present application;

[0057] Figure 8 A schematic diagram of the structure of a second conference monitoring device provided in an embodiment of the present application;

[0058] Figure 9 A schematic diagram of the structure of the streaming media gateway provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] To make the objectives, technical solutions, and advantages of this application more clear, this application will be further described in detail below with reference to the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of this application.

[0060] The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature specified as "first" or "second" may explicitly or implicitly include one or more of such features. Throughout this application, unless otherwise specified, "plurality" means two or more.

[0061] In the description of this application, it should be noted that, unless otherwise specified or limited, the term "connection" should be understood in a broad sense. For example, it can mean direct connection, indirect connection through an intermediate medium, or internal communication between two devices. Those skilled in the art will understand the specific meaning of the above terms in this application based on specific circumstances.

[0062] In some video conferences, it is necessary to access a monitoring terminal to monitor the conference terminal or introduce monitoring data into the conference.

[0063] In the related art, the monitoring terminal is added to the conference by connecting the monitoring terminal to a conference terminal participating in the conference.

[0064] However, the conference terminal connected to the monitoring terminal cannot transmit conference data when transmitting the monitoring data of the monitoring terminal, and the above solution requires that the monitoring terminal and the conference terminal are fully interoperable.

[0065] In view of this, the embodiments of the present application provide a conference monitoring method, a conference system, and a conference monitoring device, which are used to monitor conference terminals without affecting the conference. Figure 1 As shown, the conference system includes at least one streaming gateway, an access gateway and multiple conference terminals ( Figure 1 Taking 3 conference terminals and 3 streaming gateways as an example, more or fewer conference terminals and streaming gateways can be set in actual applications); any streaming gateway is connected to at least one conference terminal ( Figure 1 Taking the one-to-one correspondence between conference terminals and streaming gateways as an example, in actual applications, multiple conference terminals can be connected to the same streaming gateway), and all streaming gateways are connected to the access gateway; the access gateway and the monitoring terminal can directly or indirectly exchange data, that is, the access gateway can directly send data to the monitoring terminal; or, refer to Figure 1 As shown, the access gateway sends data to the monitoring terminal through the monitoring platform. In this way, only one network link between the access gateway and the monitoring platform needs to be connected, thereby increasing network security.

[0066] The method is applied to any streaming media gateway in a conference system, including: after receiving the first visual network conference data triggered by the target conference terminal in the conference service, sending the first visual network conference data to other conference terminals in the conference service and the access gateway in the conference system respectively, so that the access gateway converts the first visual network conference data into first monitoring network conference data, and sends the first monitoring network conference data to the first monitoring terminal; wherein, the target conference terminal is the terminal that the first monitoring terminal needs to monitor, or the target conference terminal is the terminal in the conference service that the first monitoring terminal needs to access.

[0067] The following will be combined with the accompanying drawings and specific embodiments to explain in detail the technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0068] Figure 2 The interactive flow chart of the first conference monitoring method provided in the embodiment of the present application is as follows: Figure 2 As shown, the following steps are included:

[0069] Step S201: After receiving the first video network conference data triggered by the target conference terminal in the conference service, the streaming gateway sends the first video network conference data to other conference terminals in the conference service and the access gateway in the conference system.

[0070] In this embodiment, when the first monitoring terminal needs to monitor a specific conference terminal, it needs to obtain the conference data of the conference terminal; when the first monitoring terminal needs to access a conference service, it needs to obtain the conference data of all conference terminals in the conference service. Therefore, the target conference terminal is the terminal that the first monitoring terminal needs to monitor, or the terminal in the conference service that the first monitoring terminal needs to access.

[0071] During implementation, the first monitoring device needs to obtain conference data of the target conference terminal. If the conference terminal directly diverts the conference data, the network upload pressure of the conference terminal will increase.

[0072] Based on this, this embodiment is provided with a streaming media gateway for diverting the visual network conference data triggered by the conference terminal, and diverts the first visual network conference data triggered by the target conference terminal (sent to other conference terminals in the conference service and the access gateway in the conference system respectively), reducing the network upload pressure of the conference terminal.

[0073] Step S202: After receiving the first video network conference data sent by the streaming media gateway, the access gateway converts the first video network conference data into first monitoring network conference data, and sends the first monitoring network conference data to the first monitoring terminal.

[0074] Because the conferencing terminals use a video network, while the monitoring terminals use a monitoring network, the monitoring and video networks are isolated from each other, preventing direct communication. Specifically, the signaling used by the video network and the monitoring network differs. The video network uses H323 or Session Initiation Protocol (SIP), while the monitoring network uses RTSP, Onvif, or GB28181. The transmission methods and codecs may also differ.

[0075] Based on this, this embodiment also provides an access gateway for performing data format conversion.

[0076] The access gateway converts the first video network conference data into first monitoring network conference data that can be received by the first monitoring terminal, and sends the first monitoring network conference data to the first monitoring terminal.

[0077] Exemplarily, the access gateway converts the format of the first visual network conference data according to the network protocol, transmission mode and encoding and decoding mode between the access gateway and the first monitoring terminal to obtain the first monitoring network conference data.

[0078] The above scheme diverts the first visual network conference data triggered by the target conference terminal through the streaming media gateway (sent to other conference terminals in the conference service and the access gateway in the conference system respectively), reducing the network upload pressure of the conference terminal; and then converts the first visual network conference data into first monitoring network conference data that can be received by the first monitoring terminal through the access gateway, and sends the first monitoring network conference data to the first monitoring terminal, avoiding the situation where the first monitoring terminal cannot receive the conference data due to network isolation, and monitoring the conference terminal without affecting the meeting.

[0079] Figure 3 The interactive flow chart of the second conference monitoring method provided in the embodiment of the present application is as follows: Figure 3 As shown, the following steps are included:

[0080] Step S301: After receiving the second monitoring network monitoring data sent by the second monitoring terminal, the access gateway converts the second monitoring network monitoring data into second visual network monitoring data, and sends the second visual network monitoring data to the streaming gateway corresponding to the conference terminal that needs to access the second monitoring terminal.

[0081] The second monitoring terminal is a monitoring terminal that the conference terminal needs to access.

[0082] During implementation, the second monitoring terminal needs to access a specific conference terminal, which then needs to obtain the monitoring data from the second monitoring terminal. Because the conference terminal utilizes a visual network, and the monitoring terminal utilizes a monitoring network, there is network isolation between the monitoring network and the visual network, preventing direct communication. Therefore, this embodiment uses an access gateway to convert the monitoring data from the second monitoring network into second visual network monitoring data that can be received by the conference terminal, and then sends the second visual network monitoring data to the streaming media gateway corresponding to the conference terminal that needs to access the second monitoring terminal.

[0083] Exemplarily, the access gateway converts the format of the second monitoring network monitoring data according to the network protocol, transmission mode and encoding and decoding mode between the access gateway and the streaming media gateway to obtain the second visual network monitoring data.

[0084] Step S302: After receiving the second visual network monitoring data sent by the access gateway, the streaming gateway sends the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal.

[0085] After receiving the second visual network monitoring data that can be received by the conference terminal, the streaming gateway can send the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal.

[0086] The above scheme converts the monitoring data of the second monitoring network into second visual network monitoring data that can be received by the conference terminal through the access gateway, and sends the second visual network monitoring data to the streaming media gateway corresponding to the conference terminal that needs to access the second monitoring terminal; then, after receiving the second visual network monitoring data that can be received by the conference terminal, the streaming media gateway sends the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal, avoiding the situation where the conference terminal that needs to access the second monitoring terminal cannot receive the monitoring data due to network isolation, and connecting the monitoring terminal to the conference terminal without affecting the meeting.

[0087] For the case where the target conference terminal participates in multiple conference services, the embodiment of the present application provides an interactive flow chart of a third conference monitoring method, such as Figure 4 As shown, the following steps are included:

[0088] Step S401: After receiving the first visual network conference data triggered by the target conference terminal in the conference service, the streaming media gateway sends the first visual network conference data corresponding to any conference service participated in by the target conference terminal to other conference terminals in the conference service; and sends all first visual network conference data triggered by the target conference terminal to the access gateway.

[0089] In this embodiment, the visual network conference data triggered by the conference terminal is decoupled from the conference service, so the conference terminal can participate in multiple conference services.

[0090] For example, when the target conference terminal participates in multiple conference services, it first determines which conference service the first visual network conference data triggered by it corresponds to, and then sends the first visual network conference data to other conference terminals in the corresponding conference service, so as not to affect other conference services participated by the target conference terminal.

[0091] Step S402: After receiving the first video network conference data sent by the streaming media gateway, the access gateway converts the first video network conference data into first monitoring network conference data, and sends the first monitoring network conference data to the first monitoring terminal.

[0092] The specific implementation of step S402 can refer to the above embodiment and will not be repeated here.

[0093] In the above scheme, when the target conference terminal participates in multiple conference services, it determines which conference service the first visual network conference data triggered by it corresponds to, and then sends the first visual network conference data to other conference terminals in the corresponding conference service, thereby decoupling the visual network conference data triggered by the conference terminal from the conference service, thereby not affecting other conference services participated in by the target conference terminal. Therefore, the conference terminal can participate in multiple conference services.

[0094] For the case where the target conference terminal is a terminal in the conference service that the first monitoring terminal needs to access, the embodiment of the present application provides an interactive flow chart of a fourth conference monitoring method, such as Figure 5 As shown, the following steps are included:

[0095] Step S501: After receiving the third monitoring network monitoring data sent by the first monitoring terminal, the access gateway converts the third monitoring network monitoring data into third visual network monitoring data, and sends the third visual network monitoring data to the streaming gateway corresponding to the target conference terminal.

[0096] In this embodiment, when a first monitoring terminal needs to access a conference service, not only does the first monitoring terminal need to obtain conference data from all conference terminals in the conference service, but the conference terminals in the conference service also need to obtain monitoring data from the first monitoring terminal. Because the conference terminals utilize a visual network and the monitoring terminals utilize a monitoring network, there is network isolation between the monitoring network and the visual network, preventing direct communication. Therefore, in this embodiment, the access gateway converts the monitoring data from the third monitoring network into third visual network monitoring data that can be received by the conference terminal, and then sends the third visual network monitoring data to the streaming media gateway corresponding to the conference terminal in the conference service that requires access.

[0097] Step S502: After receiving the third visual network monitoring data sent by the access gateway, the streaming gateway sends the third visual network monitoring data to the target conference terminal.

[0098] After receiving the third-party visual network monitoring data that can be received by the conference terminal, the streaming media gateway can send the third-party visual network monitoring data to the conference terminal in the conference service that needs to be accessed.

[0099] The above scheme converts the monitoring data of the third monitoring network into third visual network monitoring data that can be received by the conference terminal through the access gateway, and sends the third visual network monitoring data to the streaming media gateway corresponding to the conference terminal in the conference service that needs to be accessed; then, after receiving the third visual network monitoring data that can be received by the conference terminal, the streaming media gateway sends the third visual network monitoring data to the conference terminal in the conference service that needs to be accessed, avoiding the situation where the conference terminal in the conference service that needs to be accessed cannot receive the monitoring data due to network isolation, and connecting the monitoring terminal to the conference service without affecting the meeting.

[0100] In the embodiment of the present application, the conference monitoring method performed by the streaming gateway includes the following steps:

[0101] After receiving the first visual network conference data triggered by the target conference terminal in the conference service, the first visual network conference data is sent to other conference terminals in the conference service and the access gateway in the conference system, so that the access gateway converts the first visual network conference data into first monitoring network conference data, and sends the first monitoring network conference data to the first monitoring terminal;

[0102] The target conference terminal is a terminal that the first monitoring terminal needs to monitor, or the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access.

[0103] In some optional implementations, the method further comprises:

[0104] After receiving the second visual network monitoring data sent by the access gateway, the second visual network monitoring data is sent to the conference terminal that needs to access the second monitoring terminal; wherein, the second visual network monitoring data is obtained by the access gateway converting the second monitoring network monitoring data after receiving the second monitoring network monitoring data sent by the second monitoring terminal, and the second monitoring terminal is the monitoring terminal that the conference terminal needs to access.

[0105] In some optional implementations, if the target conference terminal participates in multiple conference services, sending the first video network conference data to other conference terminals in the conference service and the access gateway in the conference system respectively includes:

[0106] For any conference service participated in by the target conference terminal, sending the first video network conference data corresponding to the conference service to other conference terminals in the conference service; and

[0107] All first video network conference data triggered by the target conference terminal are sent to the access gateway.

[0108] In some optional implementations, if the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access, the method further includes:

[0109] After receiving the third visual network monitoring data sent by the access gateway, the third visual network monitoring data is sent to the target conference terminal; wherein, the third visual network monitoring data is obtained by the access gateway converting the third monitoring network monitoring data after receiving the third monitoring network monitoring data sent by the first monitoring terminal.

[0110] In the embodiment of the present application, the conference monitoring method performed by the access gateway is referred to Figure 6 As shown, the following steps are included:

[0111] Step S601: after receiving the first video network conference data sent by the streaming gateway, convert the first video network conference data into first monitoring network conference data;

[0112] Step S602: Send the first monitoring network conference data to the first monitoring terminal; wherein, the first visual network conference data is triggered by the target conference terminal in the conference service; the target conference terminal is the terminal that the first monitoring terminal needs to monitor, or the target conference terminal is the terminal in the conference service that the first monitoring terminal needs to access.

[0113] In some optional implementations, the method further comprises:

[0114] After receiving the second monitoring network monitoring data sent by the second monitoring terminal, converting the second monitoring network monitoring data into the second visual network monitoring data; wherein the second monitoring terminal is the monitoring terminal that the conference terminal needs to access;

[0115] The second visual network monitoring data is sent to the streaming gateway corresponding to the conference terminal that needs to access the second monitoring terminal, so that the streaming gateway sends the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal.

[0116] In some optional implementations, if the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access, the method further includes:

[0117] After receiving the monitoring data of the third monitoring network sent by the first monitoring terminal, converting the monitoring data of the third monitoring network into monitoring data of the third visual network;

[0118] The third visual network monitoring data is sent to the streaming gateway corresponding to the target conference terminal, so that the streaming gateway sends the third visual network monitoring data to the target conference terminal.

[0119] The method executed by the streaming gateway and the method executed by the access gateway can refer to the implementation of the above-mentioned interaction method, and the repeated parts will not be repeated.

[0120] like Figure 7 As shown, based on the same inventive concept as the conference monitoring method performed by the streaming gateway, the embodiment of the present application provides a first conference monitoring device 700, which is applied to the streaming gateway, and the device includes:

[0121] The first transceiver module 701 is configured to, after receiving first visual network conference data triggered by a target conference terminal in a conference service, send the first visual network conference data to other conference terminals in the conference service and an access gateway in the conference system, so that the access gateway converts the first visual network conference data into first monitoring network conference data and sends the first monitoring network conference data to the first monitoring terminal;

[0122] The target conference terminal is a terminal that the first monitoring terminal needs to monitor, or the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access.

[0123] In some optional implementations, the first transceiver module 701 is further configured to:

[0124] After receiving the second visual network monitoring data sent by the access gateway, the second visual network monitoring data is sent to the conference terminal that needs to access the second monitoring terminal; wherein, the second visual network monitoring data is obtained by the access gateway converting the second monitoring network monitoring data after receiving the second monitoring network monitoring data sent by the second monitoring terminal, and the second monitoring terminal is the monitoring terminal that the conference terminal needs to access.

[0125] In some optional implementations, if the target conference terminal participates in multiple conference services, the first transceiver module 701 is specifically configured to:

[0126] For any conference service participated in by the target conference terminal, sending the first video network conference data corresponding to the conference service to other conference terminals in the conference service; and

[0127] All first video network conference data triggered by the target conference terminal are sent to the access gateway.

[0128] In some optional implementations, if the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access, the first transceiver module 701 is further configured to:

[0129] After receiving the third visual network monitoring data sent by the access gateway, the third visual network monitoring data is sent to the target conference terminal; wherein, the third visual network monitoring data is obtained by the access gateway converting the third monitoring network monitoring data after receiving the third monitoring network monitoring data sent by the first monitoring terminal.

[0130] like Figure 8 As shown, based on the same inventive concept as the conference monitoring method performed by the access gateway, the embodiment of the present application provides a second conference monitoring device 800, which is applied to the access gateway and includes:

[0131] The conversion module 801 is configured to convert the first video network conference data into first monitoring network conference data after receiving the first video network conference data sent by the streaming gateway;

[0132] The second transceiver module 802 is used to send the first monitoring network conference data to the first monitoring terminal; wherein, the first visual network conference data is triggered by the target conference terminal in the conference service; the target conference terminal is the terminal that the first monitoring terminal needs to monitor, or the target conference terminal is the terminal in the conference service that the first monitoring terminal needs to access.

[0133] In some optional implementations, the conversion module 801 is further configured to:

[0134] After receiving the second monitoring network monitoring data sent by the second monitoring terminal, converting the second monitoring network monitoring data into the second visual network monitoring data; wherein the second monitoring terminal is the monitoring terminal that the conference terminal needs to access;

[0135] The second transceiver module 802 is further configured to:

[0136] The second visual network monitoring data is sent to the streaming gateway corresponding to the conference terminal that needs to access the second monitoring terminal, so that the streaming gateway sends the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal.

[0137] In some optional implementations, if the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access, the conversion module 801 is further configured to:

[0138] After receiving the monitoring data of the third monitoring network sent by the first monitoring terminal, converting the monitoring data of the third monitoring network into monitoring data of the third visual network;

[0139] The second transceiver module 802 is further configured to:

[0140] The third visual network monitoring data is sent to the streaming gateway corresponding to the target conference terminal, so that the streaming gateway sends the third visual network monitoring data to the target conference terminal.

[0141] Figures 7 and 8 The specific implementation of the embodiment can refer to the implementation of the above-mentioned interaction method, and the repeated parts will be omitted.

[0142] Based on the same technical concept, the embodiment of the present application also provides a streaming gateway 900, such as Figure 9 As shown, it includes at least one processor 901 and a memory 902 connected to the at least one processor. The specific connection medium between the processor 901 and the memory 902 is not limited in the embodiment of the present application. Figure 9 For example, the processor 901 and the memory 902 are connected via a bus 903. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 9 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0143] Among them, the processor 901 is the control center of the streaming media gateway, which can use various interfaces and lines to connect various parts of the streaming media gateway, and realize data processing by running or executing instructions stored in the memory 902 and calling data stored in the memory 902. Optionally, the processor 901 may include one or more processing units. The processor 901 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes the issuance of instructions. It is understandable that the above-mentioned modem processor may not be integrated into the processor 901. In some embodiments, the processor 901 and the memory 902 can be implemented on the same chip. In some embodiments, they can also be implemented separately on independent chips.

[0144] The processor 901 can be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit (ASIC), a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiment of the conference monitoring method can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor.

[0145] The memory 902 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 902 may include at least one type of storage medium, such as a flash memory, a hard disk, a multimedia card, a card-type memory, a random access memory (Random Access Memory, RAM), a static random access memory (Static Random Access Memory, SRAM), a programmable read-only memory (Programmable Read Only Memory, PROM), a read-only memory (Read Only Memory, ROM), an electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), a magnetic memory, a disk, an optical disk, etc. The memory 902 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 902 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.

[0146] In an embodiment of the present application, the memory 902 stores a computer program. When the program is executed by the processor 901, the processor 901 executes the steps of the corresponding method of the above-mentioned streaming media gateway.

[0147] Based on the same technical concept, an embodiment of the present application also provides an access gateway, comprising at least one processor and at least one memory, wherein the memory stores a computer program, and when the program is executed by the processor, the processor executes the steps of the above-mentioned access gateway corresponding method.

[0148] Based on the same technical concept, an embodiment of the present application also provides a computer-readable storage medium, which stores a computer program executable by a processor. When the program runs on the processor, the processor executes the steps of the above-mentioned conference monitoring method.

[0149] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0150] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0151] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0152] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0153] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present application.

[0154] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A conference monitoring method, characterized in that: Applied to any streaming media gateway in a conference system, the conference system also includes an access gateway and multiple conference terminals; wherein any streaming media gateway is connected to at least one conference terminal, and all streaming media gateways are connected to the access gateway, the method comprising: After receiving the first visual network conference data triggered by the target conference terminal in the conference service, the first visual network conference data is sent to other conference terminals in the conference service and the access gateway in the conference system, so that the access gateway converts the first visual network conference data into first monitoring network conference data, and sends the first monitoring network conference data to the first monitoring terminal; The target conference terminal is a terminal that the first monitoring terminal needs to monitor; the target conference terminal and the other conference terminals use a visual network, and the first monitoring terminal uses a monitoring network; If the target conference terminal participates in multiple conference services, the first video network conference data is sent to other conference terminals in the conference service and an access gateway in the conference system respectively, including: For any conference service participated in by the target conference terminal, sending the first video network conference data corresponding to the conference service to other conference terminals in the conference service; and Sending all first video network conference data triggered by the target conference terminal to the access gateway; The method further comprises: After receiving the second visual network monitoring data sent by the access gateway, the second visual network monitoring data is sent to the conference terminal that needs to access the second monitoring terminal; wherein, the second visual network monitoring data is obtained by the access gateway converting the second monitoring network monitoring data after receiving the second monitoring network monitoring data sent by the second monitoring terminal, and the second monitoring terminal is the monitoring terminal that the conference terminal needs to access.

2. The method according to claim 1, characterized in that If the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access, the method further includes: After receiving the third visual network monitoring data sent by the access gateway, the third visual network monitoring data is sent to the target conference terminal; wherein, the third visual network monitoring data is obtained by the access gateway converting the third monitoring network monitoring data after receiving the third monitoring network monitoring data sent by the first monitoring terminal.

3. A conference monitoring method, characterized in that: An access gateway applied to a conference system, the conference system further comprising at least one streaming gateway and a plurality of conference terminals; wherein any streaming gateway is connected to at least one conference terminal, and all streaming gateways are connected to the access gateway, the method comprising: After receiving the first video network conference data sent by the streaming gateway, converting the first video network conference data into first monitoring network conference data; Sending the first monitoring network conference data to the first monitoring terminal; wherein the first visual network conference data is triggered by a target conference terminal in the conference service; the target conference terminal is the terminal that the first monitoring terminal needs to monitor; the target conference terminal and other conference terminals use the visual network, and the first monitoring terminal uses the monitoring network; Among them, if the target conference terminal participates in multiple conference services, the streaming gateway sends to the access gateway all the first visual network conference data triggered by the target conference terminal; the streaming gateway sends to other conference terminals in any conference service the first visual network conference data corresponding to the conference service triggered by the target conference terminal; The method further comprises: After receiving the second monitoring network monitoring data sent by the second monitoring terminal, converting the second monitoring network monitoring data into the second visual network monitoring data; wherein the second monitoring terminal is the monitoring terminal that the conference terminal needs to access; The second visual network monitoring data is sent to the streaming gateway corresponding to the conference terminal that needs to access the second monitoring terminal, so that the streaming gateway sends the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal.

4. The method according to claim 3, characterized in that If the target conference terminal is a terminal in a conference service that the first monitoring terminal needs to access, the method further includes: After receiving the monitoring data of the third monitoring network sent by the first monitoring terminal, converting the monitoring data of the third monitoring network into monitoring data of the third visual network; The third visual network monitoring data is sent to the streaming gateway corresponding to the target conference terminal, so that the streaming gateway sends the third visual network monitoring data to the target conference terminal.

5. A conference system, characterized in that: The conference system includes at least one streaming gateway, an access gateway, and multiple conference terminals; wherein any streaming gateway is connected to at least one conference terminal, and all streaming gateways are connected to the access gateway; Any streaming media gateway, configured to, after receiving first video network conference data triggered by a target conference terminal in a conference service, send the first video network conference data to other conference terminals in the conference service and an access gateway in the conference system; The access gateway is configured to, after receiving the first video network conference data sent by the streaming gateway, convert the first video network conference data into first monitoring network conference data, and send the first monitoring network conference data to the first monitoring terminal; The target conference terminal is a terminal that the first monitoring terminal needs to monitor; the target conference terminal and the other conference terminals use a visual network, and the first monitoring terminal uses a monitoring network; If the target conference terminal participates in multiple conference services, the streaming gateway is specifically configured to: For any conference service participated in by the target conference terminal, sending the first video network conference data corresponding to the conference service to other conference terminals in the conference service; and Sending all first video network conference data triggered by the target conference terminal to the access gateway; The access gateway is further configured to, after receiving the second monitoring network monitoring data sent by the second monitoring terminal, convert the second monitoring network monitoring data into second visual network monitoring data, and send the second visual network monitoring data to the streaming media gateway corresponding to the conference terminal that needs to access the second monitoring terminal; wherein the second monitoring terminal is the monitoring terminal that the conference terminal needs to access; The streaming media gateway is further configured to send the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal after receiving the second visual network monitoring data sent by the access gateway.

6. A conference monitoring device, characterized in that: Applicable to any streaming media gateway in a conference system, the conference system also including an access gateway and multiple conference terminals; wherein any streaming media gateway is connected to at least one conference terminal, and all streaming media gateways are connected to the access gateway, the device comprising: A first transceiver module is configured to, after receiving first visual network conference data triggered by a target conference terminal in a conference service, send the first visual network conference data to other conference terminals in the conference service and an access gateway in the conference system, so that the access gateway converts the first visual network conference data into first monitoring network conference data and sends the first monitoring network conference data to the first monitoring terminal; The target conference terminal is a terminal that the first monitoring terminal needs to monitor; the target conference terminal and the other conference terminals use a visual network, and the first monitoring terminal uses a monitoring network; If the target conference terminal participates in multiple conference services, the first transceiver module is specifically configured to: For any conference service participated in by the target conference terminal, sending the first video network conference data corresponding to the conference service to other conference terminals in the conference service; and Sending all first video network conference data triggered by the target conference terminal to the access gateway; The first transceiver module is further configured to: After receiving the second visual network monitoring data sent by the access gateway, the second visual network monitoring data is sent to the conference terminal that needs to access the second monitoring terminal; wherein, the second visual network monitoring data is obtained by the access gateway converting the second monitoring network monitoring data after receiving the second monitoring network monitoring data sent by the second monitoring terminal, and the second monitoring terminal is the monitoring terminal that the conference terminal needs to access.

7. A conference monitoring device, characterized in that: An access gateway used in a conference system, the conference system also including at least one streaming gateway and multiple conference terminals; wherein any streaming gateway is connected to at least one conference terminal, and all streaming gateways are connected to the access gateway, the device comprising: A conversion module, configured to convert the first visual network conference data into first monitoring network conference data after receiving the first visual network conference data sent by the streaming media gateway; A second transceiver module is configured to transmit the first monitoring network conference data to the first monitoring terminal; wherein the first visual network conference data is triggered by a target conference terminal in the conference service; the target conference terminal is a terminal that the first monitoring terminal needs to monitor; the target conference terminal and other conference terminals use the visual network, and the first monitoring terminal uses the monitoring network; Among them, if the target conference terminal participates in multiple conference services, the streaming gateway sends to the access gateway all the first visual network conference data triggered by the target conference terminal; the streaming gateway sends to other conference terminals in any conference service the first visual network conference data corresponding to the conference service triggered by the target conference terminal; The conversion module is also used for: After receiving the second monitoring network monitoring data sent by the second monitoring terminal, converting the second monitoring network monitoring data into the second visual network monitoring data; wherein the second monitoring terminal is the monitoring terminal that the conference terminal needs to access; The second transceiver module is further configured to: The second visual network monitoring data is sent to the streaming gateway corresponding to the conference terminal that needs to access the second monitoring terminal, so that the streaming gateway sends the second visual network monitoring data to the conference terminal that needs to access the second monitoring terminal.

Images