A membership method, device, electronic device and storage medium

Abstract

An embodiment of the present invention provides a joining method, device, equipment and storage medium, which are applied to a coordination server, wherein the coordination server is registered to a first visual network, and the coordination server is also connected to a video conferencing platform located on the Internet; the method comprises: when receiving a joining call signaling sent by the video conferencing platform, parsing a visual network number from the joining call signaling, wherein the visual network number is the number of the called visual network terminal; determining the network type corresponding to the visual network number, and the joining call mode corresponding to the network type; based on the joining call mode, establishing a communication connection between the video conferencing platform and the visual network terminal, so that the video conferencing platform associates the visual network terminal with a preset video conferencing service.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a method and device for joining a meeting, an electronic device and a storage medium. Background Art

[0002] The visual network adopts the world's most advanced VisionVera real-time HD video exchange technology, realizing real-time transmission of HD video across the entire network that is currently impossible with the Internet. It integrates dozens of video, voice, image, text, communication, data and other services such as HD video conferencing, video surveillance, remote training, intelligent monitoring and analysis, emergency command, video calls, live broadcasts, TV mails, information releases, etc. into one system platform, and realizes real-time interconnection of HD quality video communications through a variety of terminal devices.

[0003] In the related technologies, video conferencing services in the visual network need to rely on the same visual network environment, that is, all devices in the same visual network can conduct video conferencing. However, with the continuous promotion of video conferencing, it is often necessary to conduct video conferencing in multiple networks with different environmental conditions. However, due to the different protocols used by devices in different network environments or the inability of different networks to communicate, it is impossible to realize the linkage of video conferencing in multiple different networks, and the customer experience is not high. Summary of the invention

[0004] In view of the above problems, the embodiments of the present invention provide a method, device, electronic device and storage medium for joining a meeting, so as to overcome the above problems or at least partially solve the above problems.

[0005] In a first aspect of an embodiment of the present invention, a method for joining a conference is disclosed, which is applied to a coordination server, wherein the coordination server is registered with a first video network and is also connected to a video conferencing platform located on the Internet; the method comprises:

[0006] When receiving the joining call signaling sent by the video conferencing platform, parsing the joining call signaling to obtain a video network number, where the video network number is the number of the called video network terminal;

[0007] Determine the network type corresponding to the video network number and the conference call mode corresponding to the network type;

[0008] Based on the conference call mode, a communication connection is established between the video conferencing platform and the visual networking terminal, so that the video conferencing platform associates the visual networking terminal with a preset video conferencing service.

[0009] Optionally, determining a network type corresponding to the video network number and a conference call mode corresponding to the network type includes:

[0010] When the visual network number is not a number registered in the first visual network, determining that the network type is an external visual network type, and determining that the joining call mode is a cross-network joining call mode;

[0011] When the visual network number is a number registered in the first visual network, the network type is determined to be a local visual network type, and the joining call mode is determined to be an intra-network joining call mode.

[0012] Optionally, establishing a communication connection between the video conferencing platform and the video networking terminal based on the conference call mode includes:

[0013] When the joining call mode is the cross-network joining call mode, based on the joining call signaling, sending the cross-network call signaling to the second visual network registered with the visual network number, so that the visual network terminal obtains the cross-network call signaling;

[0014] Receiving a visual network reply signaling returned by the visual network terminal in response to the cross-network call signaling, and converting the visual network reply signaling into an Internet reply signaling;

[0015] The Internet reply signaling is sent to the video conferencing platform to establish a communication connection between the video conferencing platform and the visual networking terminal, so that the video conferencing platform associates the visual networking terminal with the preset video conferencing service.

[0016] Optionally, the coordination server is further connected to a bridging server, and the sending of the cross-network call signaling to the second visual network registered with the visual network number based on the conference call signaling includes:

[0017] Sending the inter-network call signaling to the bridging server, so that the bridging server sends the inter-network call signaling to the visual network terminal through the second visual network registered with the visual network number;

[0018] The receiving of a visual network reply signaling returned by the visual network terminal in response to the cross-network call signaling includes:

[0019] A visual networking reply signaling returned by the bridging server is received, wherein the visual networking reply signaling is sent by the visual networking terminal to the bridging server.

[0020] Optionally, parsing the video network number from the conference call signaling includes:

[0021] Determining a call protocol for encapsulating the conference call signaling;

[0022] According to the call protocol, the conference call signaling is parsed to obtain the video network number;

[0023] The converting the visual network reply signaling into an Internet reply signaling comprises:

[0024] The visual network reply signaling is subjected to protocol conversion to obtain an Internet reply signaling that complies with the call protocol.

[0025] Optionally, after the step of establishing a communication connection between the video conferencing platform and the video networking terminal based on the conference call mode, the method further includes at least one of the following:

[0026] Receiving multimedia data of a participant sent by the video conferencing platform, converting the multimedia data of the participant into first multimedia data, and sending the first multimedia data to the visual networking terminal; wherein the first multimedia data is data adapted to the visual networking terminal;

[0027] Receive the second multimedia data sent by the visual networking terminal, convert the second multimedia data into third multimedia data, and send the third multimedia data to the video conferencing platform; wherein the third multimedia data is data adapted to the video conferencing platform.

[0028] A second aspect of an embodiment of the present invention discloses a method for joining a conference, which is applied to a video conferencing platform on the Internet, wherein the video conferencing platform is also connected to a coordination server, and the coordination server is registered to a first video network, wherein the method comprises:

[0029] Generate a joining call signaling according to the received joining invitation operation, wherein the joining call signaling includes a video network number;

[0030] Sending the conference call signaling to the coordination server, so that the coordination server determines the conference call mode corresponding to the network type according to the network type corresponding to the visual network number, and establishes a communication connection between the video conferencing platform and the visual network terminal based on the conference call mode;

[0031] Based on the communication connection, the visual networking terminal is associated with a preset video conferencing service.

[0032] Optionally, the preset video service object is further associated with a plurality of conference participating terminals, and the method further includes at least one of the following:

[0033] Receiving multimedia data sent by each of the plurality of conference participating terminals, and obtaining the conference participating party multimedia data after mixing the multimedia data, and sending the conference participating party multimedia data to the coordination server, so that the coordination server converts the conference participating party multimedia data into first multimedia data, and sends the first multimedia data to the visual network terminal;

[0034] Receive the third multimedia data sent by the coordination server, and send the third multimedia data to the multiple participating terminals respectively; wherein the third multimedia data is obtained by the coordination server after performing protocol conversion on the received second multimedia data, and the second multimedia data is generated and sent by the visual network terminal.

[0035] According to a third aspect of an embodiment of the present invention, there is provided a conference joining device, which is applied to a coordination server, wherein the coordination server is registered to a first video network, and the coordination server is also connected to a video conferencing platform located on the Internet; the device comprises:

[0036] A parsing module, configured to parse the video network number from the conference call signaling when receiving the conference call signaling sent by the video conferencing platform;

[0037] A network type determination module, used to determine the network type corresponding to the video network number and the conference call mode corresponding to the network type;

[0038] A calling module is used to establish a communication connection between the video conferencing platform and the visual networking terminal based on the conference call mode, so that the video conferencing platform associates the visual networking terminal with a preset video conferencing service.

[0039] A fourth aspect of an embodiment of the present invention provides a conference joining device, which is applied to a video conferencing platform on the Internet, wherein the video conferencing platform is also connected to a coordination server, and the coordination server is registered to a first video network, wherein the device comprises:

[0040] A signaling generation module, configured to generate a conference call signaling according to the received conference invitation operation, wherein the conference call signaling includes a video network number;

[0041] A signaling sending module, used for sending the conference call signaling to the coordination server, so that the coordination server determines the conference call mode corresponding to the network type according to the network type corresponding to the visual network number, and establishes a communication connection between the video conferencing platform and the visual network terminal based on the conference call mode;

[0042] A conference association module is used to associate the visual networking terminal with a preset video conference service based on the communication connection.

[0043] The embodiment of the present invention further discloses an electronic device, including:

[0044] One or more processors; and one or more machine-readable media having instructions stored thereon, which, when executed by the one or more processors, enable the device to execute the joining method as described in the first aspect or the second aspect of the embodiment of the present invention.

[0045] The embodiment of the present invention further discloses a computer-readable storage medium, wherein the computer program stored in the storage medium enables a processor to execute the membership joining method as described in the first aspect or the second aspect of the embodiment of the present invention.

[0046] The embodiments of the present invention include the following advantages:

[0047] In an embodiment of the present invention, the coordination server parses the joining call signaling sent by the video conferencing platform and proposes a video network number, and can determine the network type corresponding to the video network number, and start the corresponding joining call mode according to the network type, and then can complete the communication connection between the video network terminal and the video conferencing platform based on the joining call mode, so that the video network terminal can successfully join the video conference.

[0048] In the embodiments of the present invention, since the coordination server can start the corresponding conference call mode for different network types to realize the communication connection between the visual network terminal and the video conferencing platform, the visual network terminal in the network of different types from the coordination server can join the video conference managed by the video conferencing platform on the Internet, so that the devices located in different networks can be linked to conduct video conferencing, which expands the application scope of visual network video conferencing and optimizes the customer experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0050] Figure 1 It is a networking schematic diagram of a visual network of the present invention;

[0051] Figure 2 It is a schematic diagram of the hardware structure of a node server of the present invention;

[0052] Figure 3It is a schematic diagram of the hardware structure of an access switch of the present invention;

[0053] Figure 4 It is a hardware structure diagram of an Ethernet protocol conversion gateway of the present invention;

[0054] Figure 5 It is a communication architecture diagram of a method for joining a conference according to an embodiment of the present invention;

[0055] Figure 6 is a flowchart of the steps of a method for joining a membership according to an embodiment of the present invention;

[0056] Figure 7 is another communication architecture diagram of a method for joining a meeting according to an embodiment of the present invention;

[0057] Figure 8 is a flowchart of steps of another method for joining a membership according to an embodiment of the present invention;

[0058] Fig. 9 It is a complete flow chart of a method for joining a membership according to an embodiment of the present invention;

[0059] Fig.10 It is a structural schematic diagram of an embodiment of a member joining device according to an embodiment of the present invention;

[0060] Fig.11 This is a structural diagram of another embodiment of a member joining device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0061] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0062] The visual Internet is an important milestone in the development of the Internet. It is a real-time network that can realize real-time transmission of high-definition video and push many Internet applications towards high-definition video and high-definition face-to-face communication.

[0063] The visual network adopts real-time high-definition video exchange technology. It can integrate the required services such as high-definition video conferencing, video monitoring, intelligent monitoring analysis, emergency command, digital radio and television, delayed TV, online teaching, live broadcast, VOD on demand, TV mail, personalized recording (PVR), intranet (self-operated) channels, intelligent video broadcast control, information release and dozens of other video, voice, picture, text, communication, data and other services on a single system platform, and realize high-definition quality video playback through TV or computer.

[0064] In order to enable those skilled in the art to better understand the embodiments of the present invention, the visual network is introduced as follows:

[0065] Some of the technologies used in the visual Internet of Things are as follows:

[0066] Network Technology

[0067] The network technology innovation of Visual Networking improves the traditional Ethernet to cope with the huge potential first video traffic on the network. Different from simple network packet switching (Packet Switching) or network circuit switching (Circuit Switching), Visual Networking technology uses Packet Switching to meet the streaming needs. Visual Networking technology has the flexibility, simplicity and low price of packet switching, and the quality and security guarantee of circuit switching, realizing the seamless connection of the whole network switching virtual circuit and data format.

[0068] Switching Technology

[0069] Visual networking uses the two advantages of Ethernet: asynchronism and packet switching. It eliminates Ethernet defects under the premise of full compatibility, and has seamless end-to-end connection across the entire network, directly connects to user terminals, and directly carries IP data packets. User data does not require any format conversion within the entire network. Visual networking is a more advanced form of Ethernet and a real-time switching platform that can achieve large-scale real-time transmission of high-definition video across the entire network, which is currently unattainable on the Internet, and pushes many network video applications towards high definition and unification.

[0070] Server Technology

[0071] The server technology on the visual network and unified video platform is different from the traditional server. Its streaming media transmission is based on connection-oriented. Its data processing capability is independent of traffic and communication time. A single network layer can include signaling and data transmission. For voice and video services, the complexity of streaming media processing on the visual network and unified video platform is much simpler than data processing, and its efficiency is more than 100 times higher than that of traditional servers.

[0072] Storage Technology

[0073] The ultra-high-speed storage technology of the unified video platform adopts the most advanced real-time operating system to adapt to the media content with ultra-large capacity and ultra-large flow, mapping the program information in the server command to the specific hard disk space. The media content no longer passes through the server, but is directly delivered to the user terminal in an instant. The user generally waits for less than 0.2 seconds. The optimized sector distribution greatly reduces the mechanical movement of the hard disk head seeking, and the resource consumption accounts for only 20% of the same level of IP Internet, but it generates 3 times more concurrent traffic than the traditional hard disk array, and the overall efficiency is improved by more than 10 times.

[0074] Network Security Technology

[0075] The structural design of the visual network completely eradicates the network security issues that plague the Internet through separate licensing for each service and complete isolation of equipment and user data. Generally, anti-virus programs and firewalls are not required, and attacks by hackers and viruses are eliminated, providing users with a structurally worry-free and secure network.

[0076] Service Innovation Technology

[0077] The unified video platform integrates services and transmission. Whether it is a single user, a private network user or a network, it is just an automatic connection. User terminals, set-top boxes or PCs are directly connected to the unified video platform to obtain rich and colorful multimedia video services in various forms. The unified video platform uses a "recipe-style" table configuration mode to replace traditional complex application programming. Complex applications can be implemented with very little code, realizing "unlimited" new business innovation.

[0078] The networking of the visual network is as follows:

[0079] Visual networking is a centrally controlled network structure. The network can be a tree network, star network, ring network, etc., but on this basis, there needs to be a centralized control node in the network to control the entire network.

[0080] like Figure 1 As shown in the figure, the visual network is divided into two parts: access network and metropolitan area network.

[0081] The equipment in the access network can be divided into three categories: node server, access switch, and terminal (including various set-top boxes, encoding boards, storage, etc.). The node server is connected to the access switch, and the access switch can be connected to multiple terminals and can be connected to Ethernet.

[0082] The node server is a node in the access network that performs centralized control functions and can control access switches and terminals. The node server can be directly connected to the access switch or directly connected to the terminal.

[0083] Similarly, the devices in the metropolitan area network can also be divided into three categories: metropolitan area servers, node switches, and node servers. The metropolitan area servers are connected to the node switches, and the node switches can be connected to multiple node servers.

[0084] The node server is a node server of the access network part, that is, the node server belongs to both the access network part and the metropolitan area network part.

[0085] The metropolitan area server is a node with centralized control function in the metropolitan area network, which can control the node switch and node server. The metropolitan area server can be directly connected to the node switch or the node server.

[0086] It can be seen from this that the entire visual network is a hierarchical and centrally controlled network structure, and the network controlled by the node server and the metropolitan area server can be various structures such as tree, star, and ring.

[0087] Figuratively speaking, the access network part can form a unified video platform (the part in the dotted circle), and multiple unified video platforms can form a visual network; each unified video platform can be interconnected through the metropolitan area and wide area visual networks.

[0088] Visual networking equipment classification

[0089] 1.1 The devices in the visual network of the embodiment of the present invention can be mainly divided into three categories: servers, switches (including Ethernet protocol conversion gateways), terminals (including various set-top boxes, encoding boards, storage devices, etc.). The visual network as a whole can be divided into a metropolitan area network (or a national network, a global network, etc.) and an access network.

[0090] 1.2 The equipment in the access network can be mainly divided into three categories: node server, access switch (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, encoding boards, storage, etc.).

[0091] The specific hardware structure of each access network device is as follows:

[0092] Node server:

[0093] like Figure 2 As shown, it mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

[0094] Among them, the packets coming from the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of checking the address table 205 on the incoming packets, thereby obtaining the packet's guidance information; and according to the packet's guidance information, the packet is stored in the queue of the corresponding packet buffer 206; if the queue of the packet buffer 206 is close to full, it is discarded; the switching engine module 202 polls all packet buffer queues, and forwards if the following conditions are met: 1) the port sending buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements the control of the hard disk, including the initialization, reading and writing of the hard disk; the CPU module 203 is mainly responsible for the protocol processing between the access switch and the terminal (not shown in the figure), the configuration of the address table 205 (including the downstream protocol packet address table, the upstream protocol packet address table, and the data packet address table), and the configuration of the disk array module 204.

[0095] Access switch:

[0096] like Figure 3 As shown, it mainly includes a network interface module (a downlink network interface module 301, an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

[0097] Among them, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the destination address (DA), source address (SA), data packet type and packet length of the packet meet the requirements. If they meet the requirements, the corresponding stream identifier (stream-id) is allocated and enters the switching engine module 303, otherwise it is discarded; the packet (downlink data) coming from the uplink network interface module 302 enters the switching engine module 303; the data packet coming from the CPU module 304 enters the switching engine module 303; the switching engine module 303 processes the incoming packet The address table 306 is looked up to obtain the packet's guidance information; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in combination with the stream identifier (stream-id); if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downstream network interface to the upstream network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the packet's guidance information; if the queue of the packet buffer 307 is nearly full, it is discarded.

[0098] The switching engine module 303 polls all packet buffer queues, which may include two situations:

[0099] If the queue is from the downlink network interface to the uplink network interface, it is forwarded if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero; 3) a token generated by the bit rate control module is obtained;

[0100] If the queue is not going from the downstream network interface to the upstream network interface, it is forwarded if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

[0101] The code rate control module 308 is configured by the CPU module 304 to generate tokens for all packet buffer queues from the downstream network interface to the upstream network interface within a programmable interval to control the code rate of the upstream forwarding.

[0102] The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306 , and configuration of the bit rate control module 308 .

[0103] Ethernet protocol conversion gateway:

[0104] like Figure 4 As shown, it mainly includes a network interface module (a downlink network interface module 401, an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a bit rate control module 408, an address table 406, a packet buffer 407 and a MAC adding module 409, and a MAC deleting module 410.

[0105] The data packet from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the Ethernet MAC DA, Ethernet MAC SA, Ethernet length or frame type, visual network destination address DA, visual network source address SA, visual network data packet type and packet length of the data packet meet the requirements, and if they meet the requirements, a corresponding stream identifier (stream-id) is assigned; then, the MAC deletion module 410 subtracts the MAC DA, MAC SA, length or frame type (2 bytes) and enters the corresponding receiving buffer, otherwise it is discarded;

[0106] The downlink network interface module 401 detects the sending buffer of the port. If there is a packet, it obtains the Ethernet MAC DA of the corresponding terminal based on the visual network destination address DA of the packet, adds the Ethernet MAC DA of the terminal, the MACSA of the Ethernet protocol conversion gateway, and the Ethernet length or frame type, and sends it.

[0107] The functions of other modules in the Ethernet protocol conversion gateway are similar to those of the access switch.

[0108] terminal:

[0109] It mainly includes network interface module, business processing module and CPU module; for example, the set-top box mainly includes network interface module, audio and video encoding and decoding engine module, CPU module; the encoding board mainly includes network interface module, audio and video encoding engine module, CPU module; the memory mainly includes network interface module, CPU module and disk array module.

[0110] 1.3 The equipment in the metropolitan area network can be divided into two categories: node server, node switch, and metropolitan area server. Among them, the node switch mainly includes network interface module, switching engine module and CPU module; the metropolitan area server mainly includes network interface module, switching engine module and CPU module.

[0111] 2. Definition of Visual Network Data Packet

[0112] 2.1 Access Network Data Packet Definition

[0113] The data packet of the access network mainly includes the following parts: destination address (DA), source address (SA), reserved bytes, payload (PDU), and CRC.

[0114] As shown in the following table, the data packet of the access network mainly includes the following parts:

[0115] DA S Reserved Payload CRC

[0116] in:

[0117] The destination address (DA) consists of 8 bytes. The first byte indicates the type of data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), with a maximum of 256 possibilities. The second to sixth bytes are the metropolitan area network address, and the seventh and eighth bytes are the access network address.

[0118] The source address (SA) is also composed of 8 bytes and has the same definition as the destination address (DA).

[0119] The reserved bytes consist of 2 bytes;

[0120] The payload part has different lengths depending on the type of datagram. If it is a protocol packet, it is 64 bytes. If it is a single multicast data packet, it is 32+1024=1056 bytes. Of course, it is not limited to the above two types.

[0121] CRC consists of 4 bytes and its calculation method follows the standard Ethernet CRC algorithm.

[0122] 2.2 Definition of Metropolitan Area Network Data Packet

[0123] The topology of the metropolitan area network is a graph. There may be two or more connections between two devices, that is, there may be more than two connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metropolitan area network address of a metropolitan area network device is unique. In order to accurately describe the connection relationship between metropolitan area network devices, a parameter: a label is introduced in the embodiment of the present invention to uniquely describe a metropolitan area network device.

[0124] The definition of labels in this manual is similar to the definition of labels in MPLS (Multi-Protocol Label Switch). Assuming that there are two connections between device A and device B, there are two labels for the data packet from device A to device B, and there are two labels for the data packet from device B to device A. Labels are divided into input labels and output labels. Assuming that the label of the data packet entering device A (input label) is 0x0000, the label of the data packet when leaving device A (output label) may become 0x0001. The access process of the metropolitan area network is a centralized access process, which means that the address allocation and label allocation of the metropolitan area network are dominated by the metropolitan area server, and the node switch and node server are only passively executed. This is different from the label allocation of MPLS, which is the result of mutual negotiation between the switch and the server.

[0125] As shown in the following table, the data packets of the metropolitan area network mainly include the following parts:

[0126] DA S Reserved Label Payload CRC

[0127] That is, destination address (DA), source address (SA), reserved byte (Reserved), label, payload (PDU), CRC. The label format can refer to the following definition: the label is 32 bits, of which the upper 16 bits are reserved and only the lower 16 bits are used. It is located between the reserved bytes and payload of the data packet.

[0128] In the related art, when a video conferencing platform is used to invite a video network terminal to join the meeting, the video network virtual terminal virtualized by the co-conversion server and the invited video network terminal are both in a network environment organized by a core server. In this case, the co-conversion server can directly perform protocol conversion to realize the video network terminal's invitation function. However, with the expansion of video conferencing services, the video network terminal invited to join the meeting is often not in the same video network environment as the co-conversion server. Different video networks are independent of each other and cannot communicate. In this case, the video conferencing platform cannot successfully call the video network terminal.

[0129] In view of this, based on the characteristics of the above-mentioned visual network, the core concept of the present invention is proposed, that is, to use the coordination server to make conference calls for visual network terminals in networks of different network types, and adopt corresponding call modes to achieve that in video conferences, the video conferencing platform can invite visual network terminals in different visual networks to participate in the video conference through the coordination server, thereby realizing video conferencing linkage of devices in different networks.

[0130] refer to Figure 5 , which shows a communication architecture diagram of a method for joining a conference according to an embodiment of the present invention, such as Figure 5 As shown, a video conferencing platform is deployed on the Internet, which is communicated with a coordination server, and the coordination server is registered in a first visual network A; wherein, the coordination server can also communicate with multiple visual networks B that are different from the first visual network A (the three visual networks B shown in the figure are different from each other), and multiple visual network terminals can be deployed in each visual network B.

[0131] The difference between the first visual network A and the visual network B may mean that: the first visual network A is a 64-bit visual network, and the visual network B is a 16-bit visual network. Alternatively, the first visual network A is a 16-bit visual network, and the visual network B is a 64-bit visual network. Alternatively, in one case, the first visual network A and different visual networks B belong to different scopes, for example, the first visual network A is a visual network in a certain region A, and the visual network B is a visual network in another region B.

[0132] In this embodiment, after the coordination server is registered with the first visual network A, it can obtain a visual network virtual terminal number, and the coordination server can use the visual network virtual terminal number to join the first visual network A to communicate with the devices in the first visual network A. In practice, the coordination server can also be registered with the Internet at the same time, obtain an IP address from the Internet, and use the IP address to communicate with the devices in the Internet, for example, the IP address can be used to communicate with the video conferencing platform.

[0133] In this embodiment, the video conferencing platform refers to a microprocessor MCU used for data processing and forwarding in video communication services on the Internet, which may be configured with multiple ports, each of which may correspond to a video stream in a video conference.

[0134] Combination Figure 5 The communication architecture shown in the figure, the joining method of this embodiment is described in detail from the coordination server side and the video conferencing platform side respectively.

[0135] Reference Figure 6 As shown, a flowchart of a method for joining a conference in this embodiment implemented by the coordination server side is shown, which may specifically include the following steps:

[0136] Step S601: when receiving a call joining signaling sent by the video conferencing platform, parsing the video network number from the call joining signaling.

[0137] In this embodiment, the video conferencing platform can manage flow control in the video conference, that is, a video conference is established by the video conferencing platform, and the video conferencing platform can invite some devices to participate in the video conference, where the devices participating in the video conference can include devices on the Internet and devices in the visual network.

[0138] Specifically, when the video conferencing platform invites a device in the visual network to join a video conference, it needs to go through the invitation relay server. In this case, the relay server can receive the call signaling sent by the video conferencing platform. The call signaling is encapsulated by the Internet protocol and can be used in the video conference to reversely call the visual network terminal in the visual network to invite the visual network terminal to join the video conference.

[0139] In specific implementation, the joining call signaling may carry the video network number of the called video network terminal. In practical applications, a video network terminal may have a unique video network number. For example, a video network terminal registers to Figure 5 In the visual network B shown, the core server in the visual network B allocates a visual network number to the visual network terminal. The visual network number can be a unique number among all the multiple visual networks B, so that the visual network terminal can join the registered visual network B through this visual network number.

[0140] Specifically, since the cooperative transfer server needs to call the video network terminal in the video network based on the joining call signaling, and the joining call signaling is an Internet protocol and cannot directly communicate with the video network terminal in the video network, the cooperative transfer server can parse the joining call signaling to parse out the video network number it carries, and make subsequent calls based on the video network number.

[0141] In this embodiment, different call protocols can be configured on the video conferencing platform according to the requirements. For example, the H.323 protocol or the SIP protocol, or both protocols can be configured in the video conferencing platform. Specifically, one of the call protocols can be selected to encapsulate the conference call signaling. Among them, the Session Initiation Protocol SIP protocol is used to establish and disconnect the media session, and the H.323 protocol is used to specify which protocol is used to provide media services.

[0142] In a specific implementation, the coordination server may parse the video network number from the conference call signaling through the following steps.

[0143] Step S6011: Determine the call protocol for encapsulating the conference call signaling.

[0144] Step S6012: According to the call protocol, the conference call signaling is parsed to obtain the video network number.

[0145] In a specific implementation, multiple parsing modules can be pre-configured in the coordination server, and each parsing module can correspond to a call protocol. For example, a parsing module corresponding to the H.323 protocol and a parsing module corresponding to the SIP protocol can be configured. Then, after determining the call protocol encapsulating the conference call signaling, the coordination server can parse the conference call signaling through the parsing module corresponding to the call protocol, and then obtain the video network number.

[0146] Step S602: Determine the network type corresponding to the video network number and the conference call mode corresponding to the network type.

[0147] In this embodiment, since the visual network number is registered in the visual network, when registering, the visual network terminals in different visual networks all have unique visual network numbers, so the network type of the registered visual network can be determined according to the visual network number. The network type may refer to the type of network relationship between the registered visual network and the first visual network, for example, the network relationship type may be a local domain type or an external domain type. Among them, the local domain type may mean that the first visual network and the registered visual network are the same visual network, and the external domain type may mean that the first visual network and the registered visual network are two different visual networks.

[0148] After the network type is determined, a corresponding conference call mode may be determined according to the network type. The conference call mode may refer to an operation mode in which the coordination server calls the video network terminal to join the conference.

[0149] In a specific implementation, the network type and the conference call mode may be determined according to the following steps:

[0150] Step S6021: When the visual network number is not a number registered in the first visual network, determine that the network type is an external domain visual network type, and determine that the joining call mode is a cross-network joining call mode.

[0151] Step S6022: When the visual network number is a number registered in the first visual network, determine that the network type is a local visual network type, and determine that the joining call mode is an intra-network joining call mode.

[0152] In this embodiment, since the cooperative conversion server is registered in the first visual network, when parsing the visual network number, it can query from the first visual network where it is located whether the visual network number is a number registered in the first visual network.

[0153] In one implementation, the coordination server may pre-store a correspondence table of all registered visual network numbers and visual network terminals in the first visual network, and then query the correspondence table to see whether the resolved visual network number is in the correspondence table. If not, it indicates that the visual network number is not a number registered in the first visual network, and step S6021 may be executed. If yes, it indicates that the visual network number is a number registered in the first visual network, and step S6022 may be executed.

[0154] In another implementation, in order to distinguish the visual network to which the visual network number is registered, a prefix number may be added to the visual network number, and the prefix number may uniquely identify the registered visual network. For example, if the visual network number is 91-10010, then 91 is the prefix number. In this case, it may be determined whether the number is registered in the first visual network based on the prefix number.

[0155] Step S603: Based on the conference call mode, a communication connection is established between the video conferencing platform and the visual networking terminal, so that the video conferencing platform associates the visual networking terminal with a preset video conferencing service.

[0156] In this embodiment, the coordination server can call the video network terminal to join the meeting based on the determined joining call mode. Specifically, calling the video network terminal to join the meeting means that after establishing a communication connection between the video conferencing platform and the video network terminal, the video conferencing platform associates the video network terminal with the preset video conferencing service. Among them, establishing a communication connection between the video conferencing platform and the video network terminal can mean that the coordination server successfully conducts communication transfer between the video conferencing platform and the video network terminal.

[0157] In specific implementation, if the network type indicates that the first visual network and the visual network registered by the visual network terminal are different visual networks, the coordination server can execute a cross-network conference call mode to call the visual network terminal in another visual network to join the conference.

[0158] If the network type indicates that the first visual network and the visual network terminal registered are the same visual network, the coordination server can execute the in-network call mode to call the visual network terminal in another visual network to join the meeting. In this case, the coordination server can directly communicate with the core server in the first visual network to send the command of joining the visual network to the visual network terminal, so that the visual network terminal can join the video conference.

[0159] In practice, after a communication connection is established between the video networking terminal and the video conferencing platform, conference data can be exchanged between the video conferencing platform and the video networking terminal through the communication connection.

[0160] In this embodiment, the preset video conferencing service may refer to the video conferencing service that the visual networking terminal wants to participate in. Associating the visual networking terminal with the preset video conferencing service may mean: the video conferencing platform allocates a port to the visual networking terminal, and the port can be pre-configured for video stream transmission in the preset video conferencing service, thereby realizing the invitation of the visual networking terminal to the video conference.

[0161] In the embodiments of the present invention, since the coordination server can start the corresponding conference call mode for different network types to realize the communication connection between the visual network terminal and the video conferencing platform, the visual network terminal in the different type of network from the coordination server can join the video conference managed by the video conferencing platform in the Internet, so that the devices located in different networks can be linked to conduct video conferencing, which expands the application scope of visual network video conferencing and optimizes the customer experience.

[0162] In a specific implementation, how the coordination server establishes a communication connection between the video conferencing platform and the video network terminal in the cross-network conference call mode is described, which may specifically include the following steps:

[0163] Step S6031: When the joining call mode is the cross-network joining call mode, based on the joining call signaling, sending cross-network call signaling to the second visual network registered with the visual network number, so that the visual network terminal obtains the cross-network call signaling.

[0164] In this mode, the cooperative server can generate an inter-network call signaling including the visual network number to transmit the inter-network call signaling across the visual network. In a specific implementation, when it is determined that the visual network number is not a number registered in the first visual network, the cooperative server can also determine the second visual network to which the visual network number is registered based on the parsed visual network number. In this case, the cooperative server can also store a correspondence table of all registered visual network numbers and visual network terminals in multiple different visual networks, and then determine the second visual network to which the visual network number is registered in multiple correspondence tables.

[0165] like Figure 5 As shown, the cooperative server can send cross-network call signaling to the core server in the second visual network to realize the transmission of cross-network call signaling from the first visual network to the second visual network. The core server in the second visual network can then forward the cross-network call signaling to the visual network terminal so that the visual network terminal obtains the cross-network call signaling.

[0166] In a specific implementation of this embodiment, the coordination server may further include a visual networking module, and the visual networking module may be used to generate a cross-network call signaling based on the conference call signaling, which may specifically include the following steps:

[0167] Step S1: Generate an inter-module communication message including the visual network number.

[0168] In practice, after parsing the visual network number, the coordination server can construct an inter-module communication message call.execute for YATE inter-module communication, and then send the inter-module communication message to the message queue of the YATE communication mechanism.

[0169] Step S2: Send the inter-module communication message to the preset visual networking module.

[0170] In practice, the visual networking module in the cooperative server can pre-subscribe to the inter-module communication message, and the visual networking module can capture the inter-module communication message in the YATE message queue. In this way, the cooperative server can send the inter-module communication message to the visual networking module.

[0171] Step S3: extracting the visual network number from the inter-module communication message through the visual network module, and generating cross-network call signaling that complies with the visual network protocol.

[0172] Among them, after receiving the inter-module communication message, the visual network module will extract the visual network number carried in the inter-module communication message, and then encapsulate the visual network number in the call signaling of the visual network message to obtain the cross-network call signaling.

[0173] Step S6032: Receive the visual network reply signaling returned by the visual network terminal in response to the cross-network call signaling, and convert the visual network reply signaling into an Internet reply signaling.

[0174] In this embodiment, the cooperative conversion server can receive the visual network reply signaling sent by the visual network terminal from the second visual network. Since the visual network reply signaling is encapsulated using the visual network protocol, the cooperative conversion server can convert the visual network reply signaling into an Internet reply signaling.

[0175] Specifically, the cooperative server can search for Internet content corresponding to the content of the visual network reply signaling according to the content of the visual network reply signaling and the preset content correspondence relationship. The Internet content is content that is consistent with the content meaning of the visual network reply signaling, and then encapsulates the Internet content using the Internet protocol to obtain the Internet reply signaling.

[0176] For example, the content of the visual network reply signal is "8e01", which means agreement to join the membership. The Internet content corresponding to "8e01" is "8F85", which also means agreement to join the membership. Then the Internet reply signal is the signal of "8F85".

[0177] In one implementation, since the coordination server may include multiple parsing modules and visual networking modules, the visual networking reply signaling may be converted into Internet reply signaling through the parsing module that parses the conference call signaling.

[0178] For example, if the conference call signaling is a signaling of the H.323 protocol, the conference call signaling is parsed by the parsing module corresponding to the H.323 protocol. At the same time, the video network reply signaling can also be converted into an Internet reply signaling that complies with the H.323 protocol by the parsing module corresponding to the H.323 protocol.

[0179] Step S6033: Send the Internet reply signaling to the video conferencing platform to establish a communication connection between the video conferencing platform and the visual networking terminal, so that the video conferencing platform associates the visual networking terminal with the preset video conferencing service.

[0180] In this embodiment, after the coordination server sends the Internet reply signaling to the video conferencing platform, a communication connection is established between the video conferencing platform and the visual network terminal, so that the video conferencing platform can associate the visual network terminal with the preset video conferencing service and can return the Internet reply confirmation signaling to the coordination server. After receiving the Internet reply confirmation signaling, it can be determined that the visual network terminal has joined the video conference managed by the video conferencing platform.

[0181] refer to Figure 7 , which shows a communication architecture diagram of a method for joining a conference according to another embodiment of the present invention, such as Figure 7 As shown, a video conferencing platform is deployed on the Internet, and the video conferencing platform is connected to the coordination server, and the coordination server is registered in the first visual network A. Among them, the coordination server can also be connected to the bridge server, and the bridge server can be connected to the core servers in multiple different visual networks B at the same time, so that the bridge server and multiple core servers constitute multiple visual networks B different from the first visual network A.

[0182] from Figure 7 It can be seen that the bridging server plays a communication bridging role between the first visual network A and multiple visual networks B, and the cooperative server can realize cross-network communication with multiple different visual networks B through the communication connection with the bridging server.

[0183] Therefore, combined with Figure 7 In the communication architecture shown in FIG. 1 , the coordination server can complete the cross-network call of the visual network terminal via the bridge server in the cross-network conference call mode. The following describes how to establish a communication connection between the video conferencing platform and the visual network terminal in this case, which may include the following steps:

[0184] Step S6031': When the joining call mode is the cross-network joining call mode, based on the joining call signaling, the cross-network call signaling is sent to the bridging server, so that the bridging server sends the cross-network call signaling to the video network terminal through the second video network registered with the video network number.

[0185] In this embodiment, when the coordination server determines that the visual network number is not a number registered in the first visual network, it can send cross-network call signaling to the bridging server, and the bridging server calls the visual network terminal located in the second visual network according to the parsed visual network number.

[0186] Among them, a designated field in the cross-network call signaling may include the number of the bridging server, and the designated field may indicate that the cross-network call signaling needs to be sent to the corresponding bridging server to implement a cross-network invitation to a video network terminal to participate in a video conference.

[0187] Step S6032': receiving the visual networking reply signaling returned by the bridging server, wherein the visual networking reply signaling is sent by the visual networking terminal to the bridging server.

[0188] Step S6033': Send the Internet reply signaling to the video conferencing platform to establish a communication connection between the video conferencing platform and the visual networking terminal, so that the video conferencing platform associates the visual networking terminal with the preset video conferencing service.

[0189] The following describes how the coordination server forwards conference data between the visual networking terminal and the video conferencing platform. Specifically, in a feasible implementation, the coordination server may execute the following steps S604 and S605, or only execute one of the steps S604 and S605, to achieve data forwarding:

[0190] Step S604: receiving the multimedia data of the participants sent by the video conferencing platform, converting the multimedia data of the participants into first multimedia data, and sending the first multimedia data to the visual network terminal.

[0191] Among them, the first multimedia data is data adapted to the visual networking terminal.

[0192] In this embodiment, the coordination server can receive the multimedia data of the participants sent by the video conferencing platform through the Internet communication protocol. In practice, the protocol for encapsulating the multimedia data of the participants may include a transport layer protocol, a network layer protocol and an application layer protocol.

[0193] In this embodiment, the network layer protocol of the multimedia data of the participants can be converted from the Internet protocol to the visual network protocol. At the same time, in order to facilitate the identification of multimedia data in both the Internet and the visual network, the encoding protocol of the multimedia data of the participants can also be converted. The encoding protocol can refer to a protocol used to characterize the encoding type of multimedia data. For example, in the Internet, the G711 protocol characterizes that the multimedia data is audio data, and the H.264 protocol characterizes that the multimedia data is video data.

[0194] In this embodiment, the multimedia data of the participants sent by the video conferencing platform may be audio data in the G711 format, which is an audio coding method developed by the International Telecommunication Union (ITU-T), also known as ITU-T G.711. The coordination server may convert the multimedia data of the participants into the first multimedia data, which may be audio data of the 2001 protocol, wherein the 2001 protocol is a protocol for encapsulating audio data in the visual network, and is used to facilitate the visual network terminal to identify the multimedia data as audio data through the 2001 protocol.

[0195] Alternatively, the multimedia data of the participants sent by the video conferencing platform may be video data of the H.264 encoding protocol, and the first multimedia data may be video data of the 2002 protocol, wherein the 2002 protocol is a protocol used to encapsulate audio data in the visual network.

[0196] In practice, the multimedia data of the participants may be data obtained by mixing the multimedia data (audio data or video data) sent by each participant in a preset video conferencing service on the video conferencing platform.

[0197] Step S605: Receive the second multimedia data sent by the visual networking terminal, convert the second multimedia data into third multimedia data, and send the third multimedia data to the video conferencing platform.

[0198] The third multimedia data is data compatible with the video conferencing platform.

[0199] Based on the above step S604, in this embodiment, the second multimedia data may be audio data or video data collected by the visual network terminal, wherein the protocol for encapsulating the multimedia data of the participants may include a transport layer protocol, a network layer protocol and an application layer protocol.

[0200] In specific implementation, the coordination server can convert the network layer protocol of the second multimedia data from the visual networking protocol to the new Internet protocol, and can convert the encoding protocol of the second multimedia data into an encoding protocol that can be recognized by the video conferencing platform.

[0201] For example, if the second multimedia data is audio data of 2001 protocol, the second multimedia data can be converted into audio data of G711 coding protocol. Alternatively, if the second multimedia data is video data of 2002 protocol, the second multimedia data can be converted into video data of H.264 coding protocol.

[0202] In one implementation, when the video networking terminal needs to exit the video conference, the video conference platform may send a conference end signaling to the coordination server, and the process of the video networking terminal exiting the video conference may be as follows:

[0203] First, the coordination server can send a cross-network conference end signaling to the visual network terminal in the second visual network based on the conference end signaling, and the visual network terminal returns the visual network conference end signaling in response to the cross-network conference end signaling.

[0204] Next, the coordination server converts the video network conference end signaling into an Internet conference end signaling, and sends the Internet conference end signaling to the video conferencing platform, so that the video conferencing platform cancels the association between the video network terminal and the preset video conferencing business object, thereby causing the video network terminal to exit the video conference.

[0205] In this embodiment, since the cooperative conversion server can make cross-network calls between different visual networks, visual network terminals that are not in the same visual network as the cooperative conversion server can join the video conference managed by the video conferencing platform on the Internet, thereby realizing the linkage of video conferencing between devices located in different networks, expanding the application scope of visual network video conferencing, and optimizing customer experience.

[0206] based on Figure 5 or Figure 7 The communication architecture diagram shown in the figure explains the conference joining method of this embodiment from the perspective of the video conferencing platform.

[0207] Reference Figure 8 As shown, a flowchart of a method for joining a conference in this embodiment implemented by a video conferencing platform is shown, which may specifically include the following steps:

[0208] Step S801: Generate a conference call signaling according to the received conference invitation operation.

[0209] The conference call signaling includes the video network number.

[0210] In this embodiment, the invitation operation may refer to the operation of inputting a call address in the address bar provided by the video conferencing platform, wherein the call address may be in the form of: video network number@co-transfer server IP address, for example, 00100@10.1.54.252. Then the video conferencing platform may send a call signaling for joining the conference to the co-transfer server according to the input call address. The co-transfer server IP address refers to the IP address used by the co-transfer server on the Internet.

[0211] Step S802: Send the conference call signaling to the coordination server, so that the coordination server determines the conference call mode corresponding to the network type according to the network type corresponding to the visual network number, and establishes a communication connection between the video conferencing platform and the visual network terminal based on the conference call mode.

[0212] In this embodiment, the conference call signaling may be sent to the coordination server. The process of the coordination server responding to the conference call signaling may refer to the above steps S601 to S603, which will not be described in detail here.

[0213] Step S803: Based on the communication connection, the visual networking terminal is associated with a preset video conferencing service.

[0214] Among them, after the coordination server successfully calls the visual network terminal, the visual network terminal can be associated with the preset video conferencing service based on the successfully established communication connection. In the specific implementation, as described in the above steps S6031 to S6033, the video conferencing platform can associate the visual network terminal with the preset video conferencing service when receiving the Internet reply signaling sent by the coordination server. Among them, the Internet reply signaling is generated by the coordination server after performing protocol conversion on the received visual network reply signaling, and the visual network reply signaling is generated by the visual network terminal in response to the cross-network call signaling.

[0215] In this embodiment, the video conferencing platform can manage multiple video conferencing services at the same time, and the preset video conferencing service associated with the visual network terminal can refer to: a video conferencing service that is pre-designated among multiple video conferencing services, and the designated video conferencing service is the video conferencing service that the visual network terminal wants to participate in.

[0216] In a specific implementation, the video conferencing platform can allocate multiple ports for each video conferencing service, and associating the visual networking terminal to the preset video conferencing service can mean: allocating a port to the visual networking terminal from multiple ports allocated to the preset video conferencing service, and the port can be pre-configured for video stream transmission in the preset video conferencing service, thereby realizing the invitation of the visual networking terminal to the video conference.

[0217] In one embodiment, the preset video conference service is also associated with multiple participating terminals, that is, multiple participating terminals participate in the preset video conference service. The multiple participating terminals may all be terminals in the Internet, or may include some terminals in the first visual network and some terminals in the Internet.

[0218] The video conference platform may also perform at least one of the following steps S805 and S806 in the flow control of the video conference:

[0219] Step S805: Obtain the multimedia data of the participants, and send the multimedia data of the participants to the coordination server, so that the coordination server converts the multimedia data of the participants into first multimedia data, and sends the first multimedia data to the visual network terminal.

[0220] Specifically, the process of the cooperative conversion server converting the multimedia data of the participant into the first multimedia data can refer to the process of the above-mentioned step S705, which will not be repeated here.

[0221] In step S805, since the preset video service object is associated with multiple participating terminals, it is a video conference with multiple participants. In this case, the video conference platform can obtain the multimedia data of the participating parties through the following steps:

[0222] The multimedia data sent by each of the plurality of conference participating terminals are received, and each of the multimedia data is mixed to obtain the conference participating party multimedia data.

[0223] In this embodiment, the video conferencing platform may mix the received multimedia data sent by the multiple participating terminals, that is, mix the multiple channels of multimedia data into one channel of participating party multimedia data.

[0224] In a specific implementation, the multimedia data sent by the multiple participating terminals can be video data or audio data, so the video conferencing platform can mix the audio data sent by the multiple participating terminals into one channel of audio data, and use the mixed one channel of audio data as the multimedia data of the participating party. Alternatively, the video conferencing platform can mix the video data sent by the multiple participating terminals to obtain one channel of video data, and use the mixed one channel of video data as the multimedia data of the participating party.

[0225] Step S806: receiving the third multimedia data sent by the coordination server, and sending the third multimedia data to the multiple conference participating terminals respectively.

[0226] The third multimedia data is obtained by the cooperation server after performing protocol conversion on the received second multimedia data, and the second multimedia data is generated and sent by the visual network terminal.

[0227] In practice, the video conferencing platform can send the third multimedia data separately to multiple participating terminals, or, when receiving the third multimedia data and multimedia data sent by other participating terminals at the same time, the third multimedia data can be mixed with the multimedia data sent by other participating terminals into one multimedia data channel and sent to the multiple participating terminals.

[0228] Among them, the third multimedia data can be audio data or video data. The type of multimedia data sent by other participating terminals is the same as the third multimedia data, that is, the third multimedia data is audio data, then the multimedia data sent by other participating terminals is mixed with the third multimedia data.

[0229] In this embodiment, since the video conferencing platform can invite visual network terminals in different visual networks to participate in the video conference, it can achieve the linkage of video conferencing for devices located in different networks, expand the application scope of visual network video conferencing, and optimize the customer experience.

[0230] Reference Fig. 9 As shown, Fig. 9 Shown in Figure 7 In the communication architecture provided, a complete process diagram of inviting a video network terminal to join the meeting through a cross-network call joining mode is provided, wherein Huawei MCU is a video conferencing platform, the video network STB terminal is a video network terminal (also known as an Aurora terminal), the H323 coordination server is the coordination server of this application, the video network server is the core server of this application, the video network server is a bridge server, and Huawei MCU adopts the H323 call protocol. The following processes are included completely:

[0231] (1) Use Huawei MCU as the Internet terminal participating in the video conference, and the Aurora terminal as the video network terminal in the conference. First, configure the H323 coordination server to allow the virtual terminal to access the network normally. At the same time, the bridge server also needs to configure the virtual terminal, start it and wait for it to access the network.

[0232] (2) Configure 00100@10.1.54.252 as the call address in the MCU address bar of the call initiator. After the call starts, the MCU sends a callsetup signaling to the virtual terminal generated by the XMCU coordination server.

[0233] (3) At this time, XMCU determines that 00100 is a number in the external video network, and starts the cross-network call mode. The virtual terminal of XMCU first sends an 8F85 signaling to the bridge server. The signaling contains the destination number of the called terminal. The virtual terminal of the bridge server converts this 8F85 into a call signaling 8e01 ​​of the video network protocol.

[0234] (4) The virtual terminal of the bridge server sends the 8e01 ​​signaling to the core server, and the core server converts 8e01 ​​into 8e02 and sends it to the Aurora terminal.

[0235] (5) After receiving 8e02, the Aurora terminal replies 8e01 ​​to the core server. The core server converts this 8e01 ​​reply into 8e02 reply and sends it to the virtual terminal of the bridge server.

[0236] (6) After receiving this reply, the virtual terminal of the bridge server converts the signaling into the 8F85 signaling reply of the visual networking protocol and sends it to the virtual terminal coordinated by the XMCU, and then converts the signaling into the connect signaling of the H323 protocol and sends it to the Huawei MCU.

[0237] (7) After receiving the connect signal, Huawei's MCU replies with an ACK signal to indicate that it has learned that the Aurora terminal has joined the meeting normally.

[0238] (8) At this time, Huawei MCU starts to send h264 video stream and G711 audio stream to XMCU for coordination. The coordination server encapsulates the two video streams into 2002 and 2001 media streams respectively and sends them to the Aurora terminal. At the same time, it decapsulates the 2001 and 2002 media streams sent by the Aurora terminal into G711 and h264 and sends them to Huawei MCU.

[0239] (9) When the meeting needs to be ended, Huawei MCU sends a releaseComplete signal to the virtual terminal generated by the XMCU coordination server, and the virtual terminal converts the signal into the hang-up signal 8F85 of the video networking protocol.

[0240] (10) And send 8F85 signaling to the bridge server, which includes the destination terminal number of the terminal that is hung up. The virtual terminal of the bridge server converts this 8F85 into a hang-up signaling 8e01 ​​of the visual networking protocol.

[0241] (11) The virtual terminal of the bridge server sends the 8e01 ​​signaling to the core server, and the core server converts 8e01 ​​into 8e02 and sends it to the Aurora terminal.

[0242] (12) After receiving 8e02, the Aurora terminal replies 8e01 ​​to the core server. The core server converts this 8e01 ​​reply into 8e02 reply and sends it to the virtual terminal of the bridge server.

[0243] (13) After receiving this reply, the virtual terminal of the bridge server converts the signaling into the 8F85 signaling reply of the visual networking protocol and sends it to the virtual terminal coordinated by XMCU, and then converts the signaling into the ReleaseComplete signaling of the H323 protocol and sends it to the Huawei MCU. In this way, the MCU hangs up the visual networking terminal that needs to withdraw.

[0244] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0245] refer to Fig.10 , shows a structural block diagram of a joining device, which is applied to a coordination server, the coordination server is registered with a first visual network, and the coordination server is also connected to a video conferencing platform located on the Internet; the device may include the following modules:

[0246] The parsing module 1001 is used to parse the video network number from the conference call signaling when receiving the conference call signaling sent by the video conferencing platform;

[0247] The network type determination module 1002 is used to determine the network type corresponding to the video network number and the conference call mode corresponding to the network type;

[0248] The calling module 1003 is used to establish a communication connection between the video conferencing platform and the visual networking terminal based on the conference call mode, so that the video conferencing platform associates the visual networking terminal with a preset video conferencing service.

[0249] Optionally, the network type determination module 1002 may specifically include the following units:

[0250] A first unit is used to determine that the network type is an external domain visual network type and determine that the joining call mode is a cross-network joining call mode when the visual network number is not a number registered in the first visual network;

[0251] The second unit is used to determine that the network type is a local domain visual network type and the joining call mode is an intra-network joining call mode when the visual network number is a number registered in the first visual network.

[0252] Optionally, the calling module 1003 may specifically include the following units:

[0253] A signaling forwarding unit, configured to, when the conference call mode is the cross-network conference call mode, send the cross-network call signaling to the second visual network registered with the visual network number based on the conference call signaling, so that the visual network terminal corresponding to the visual network number obtains the cross-network call signaling;

[0254] A signaling receiving unit, configured to convert the visual network reply signaling returned by the visual network terminal to the cross-network call signaling into an Internet reply signaling;

[0255] The signaling sending unit is used to send the Internet reply signaling to the video conferencing platform so that the video conferencing platform associates the visual network terminal with the preset video conferencing service.

[0256] Optionally, the parsing module may specifically include the following units:

[0257] A protocol determination unit, used to determine a call protocol for encapsulating the conference call signaling;

[0258] A number parsing unit, used to parse the conference call signaling according to the call protocol to obtain the video network number;

[0259] The signaling receiving unit includes a signaling conversion unit, which is used to perform protocol conversion on the visual network reply signaling to obtain an Internet reply signaling that complies with the call protocol.

[0260] Optionally, the signaling forwarding unit may specifically include the following units:

[0261] A communication message generating unit, used for generating an inter-module communication message including the visual network number;

[0262] A first sending unit, used to send the inter-module communication message to a preset visual networking module;

[0263] A generating unit, configured to extract the visual networking number from the inter-module communication message through the visual networking module, and generate a cross-network call signaling that complies with the visual networking protocol;

[0264] The second sending unit is used to send the inter-network call signaling to the second visual network registered with the visual network number.

[0265] Optionally, the signaling forwarding module unit can be specifically used to send the inter-network call signaling to the bridging server, so that the bridging server sends the inter-network call signaling to the visual network terminal through the second visual network registered with the visual network number;

[0266] The signaling receiving unit may be specifically configured to receive a visual networking reply signaling returned by the bridging server, wherein the visual networking reply signaling is sent by the visual networking terminal to the bridging server.

[0267] Optionally, the device further comprises at least the following modules:

[0268] The first data forwarding unit may be used to receive the multimedia data of the participants sent by the video conferencing platform, convert the multimedia data of the participants into first multimedia data, and send the first multimedia data to the visual networking terminal; wherein the first multimedia data is data adapted to the visual networking terminal;

[0269] The second data forwarding unit can be used to receive the second multimedia data sent by the visual networking terminal, convert the second multimedia data into third multimedia data, and send the third multimedia data to the video conferencing platform; wherein the third multimedia data is data adapted to the video conferencing platform.

[0270] Reference Fig.11 As shown, a structural block diagram of another joining device is shown, which is applied to the video conferencing platform side in the Internet. The video conferencing platform is also connected to the coordination server, and the coordination server is registered to the first video network. The device may specifically include the following modules:

[0271] The signaling generation module 1101 is used to generate a conference call signaling according to the received conference invitation operation, wherein the conference call signaling includes a video network number;

[0272] The signaling sending module 1102 is used to send the conference call signaling to the coordination server, so that the coordination server determines the conference call mode corresponding to the network type according to the network type corresponding to the visual network number, and establishes a communication connection between the video conferencing platform and the visual network terminal based on the conference call mode;

[0273] The conference association module 1103 is used to associate the video networking terminal with a preset video conference service based on the communication connection.

[0274] Optionally, the preset video service object is further associated with a plurality of conference participating terminals, and the device may further include at least one of the following:

[0275] A third forwarding unit is used to obtain the multimedia data of the participant, and send the multimedia data of the participant to the coordination server, so that the coordination server converts the multimedia data of the participant into first multimedia data, and sends the first multimedia data to the visual network terminal;

[0276] The fourth forwarding unit is used to receive the third multimedia data sent by the coordination server, and send the third multimedia data to the multiple participating terminals respectively; wherein the third multimedia data is obtained by the coordination server after performing protocol conversion on the received second multimedia data, and the second multimedia data is generated and sent by the visual network terminal.

[0277] Optionally, the third forwarding unit may specifically include the following units:

[0278] The screen mixing unit is specifically used to receive the multimedia data sent by each of the multiple participating terminals, and obtain the multimedia data of the participating party after mixing each of the multimedia data.

[0279] As for the embodiment of the membership device, since it is basically similar to the embodiment of the membership method, the description is relatively simple, and the relevant parts can be referred to the partial description of the embodiment of the membership method.

[0280] An embodiment of the present invention further provides an electronic device, including:

[0281] One or more processors; and one or more machine-readable media having instructions stored thereon, which, when executed by the one or more processors, enable the device to execute the membership method as described in the embodiment of the present invention.

[0282] The embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program that enables a processor to execute the method for joining a conference as described in the embodiment of the present invention.

[0283] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0284] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0285] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0286] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0287] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0288] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0289] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0290] The above is a detailed introduction to a membership method, device, electronic device and readable storage medium provided by the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A membership method, characterized in that: Applied to a co-conversion server, the co-conversion server is registered to a first visual network, and the co-conversion server is also connected to a video conferencing platform located on the Internet; the method described includes: When receiving the joining call signaling sent by the video conferencing platform, parsing the joining call signaling to obtain a video network number, where the video network number is the number of the called video network terminal; Determine the network type corresponding to the video network number and the conference call mode corresponding to the network type; Based on the conference call mode, establishing a communication connection between the video conferencing platform and the visual networking terminal, so that the video conferencing platform associates the visual networking terminal with a preset video conferencing service; The establishing of a communication connection between the video conferencing platform and the video networking terminal based on the conference call mode includes: When the joining call mode is the cross-network joining call mode, based on the joining call signaling, sending the cross-network call signaling to the second visual network registered with the visual network number, so that the visual network terminal obtains the cross-network call signaling; Receiving a visual network reply signaling returned by the visual network terminal in response to the cross-network call signaling, and converting the visual network reply signaling into an Internet reply signaling; The Internet reply signaling is sent to the video conferencing platform to establish a communication connection between the video conferencing platform and the visual networking terminal, so that the video conferencing platform associates the visual networking terminal with the preset video conferencing service.

2. The method according to claim 1, characterized in that Determining the network type corresponding to the video network number and the conference call mode corresponding to the network type includes: When the visual network number is not a number registered in the first visual network, determining that the network type is an external visual network type, and determining that the joining call mode is a cross-network joining call mode; When the visual network number is a number registered in the first visual network, the network type is determined to be a local visual network type, and the joining call mode is determined to be an intra-network joining call mode.

3. The method according to claim 1, characterized in that The coordination server is also connected to a bridging server, and based on the conference call signaling, sending a cross-network call signaling to a second visual network registered with the visual network number includes: Sending the inter-network call signaling to the bridging server, so that the bridging server sends the inter-network call signaling to the visual network terminal through the second visual network registered with the visual network number; The receiving of a visual network reply signaling returned by the visual network terminal in response to the cross-network call signaling includes: A visual networking reply signaling returned by the bridging server is received, wherein the visual networking reply signaling is sent by the visual networking terminal to the bridging server.

4. The method according to claim 1, characterized in that: The step of parsing the video network number from the conference call signaling includes: Determining a call protocol for encapsulating the conference call signaling; According to the call protocol, the conference call signaling is parsed to obtain the video network number; The converting the visual network reply signaling into an Internet reply signaling comprises: The visual network reply signaling is subjected to protocol conversion to obtain an Internet reply signaling that complies with the call protocol.

5. The method according to any one of claims 1 to 4, characterized in that: After the step of establishing a communication connection between the video conferencing platform and the video networking terminal based on the conference call mode, the method further includes at least one of the following: Receiving multimedia data of a participant sent by the video conferencing platform, converting the multimedia data of the participant into first multimedia data, and sending the first multimedia data to the visual networking terminal; wherein the first multimedia data is data adapted to the visual networking terminal; Receive the second multimedia data sent by the visual networking terminal, convert the second multimedia data into third multimedia data, and send the third multimedia data to the video conferencing platform; wherein the third multimedia data is data adapted to the video conferencing platform.

6. A method for joining a membership, characterized in that: Applied to the video conferencing platform side in the Internet, the video conferencing platform is also connected to a coordination server, and the coordination server is registered to the first visual network, and the method includes: Generate a joining call signaling according to the received joining invitation operation, wherein the joining call signaling includes a video network number; Sending the conference call signaling to the coordination server, so that the coordination server determines the conference call mode corresponding to the network type according to the network type corresponding to the visual network number, and establishes a communication connection between the video conferencing platform and the visual network terminal based on the conference call mode; Based on the communication connection, associating the video networking terminal with a preset video conferencing service; The coordination server is used to send cross-network call signaling to the second visual network registered with the visual network number based on the conference call signaling when the conference call mode is the cross-network conference call mode, so that the visual network terminal obtains the cross-network call signaling; receives the visual network reply signaling returned by the visual network terminal in response to the cross-network call signaling, and converts the visual network reply signaling into an Internet reply signaling; sends the Internet reply signaling to the video conferencing platform to establish a communication connection between the video conferencing platform and the visual network terminal, so that the video conferencing platform associates the visual network terminal with the preset video conferencing service.

7. The method according to claim 6, characterized in that The preset video service object is also associated with a plurality of conference participating terminals, and the method further includes at least one of the following: Receiving multimedia data sent by each of the plurality of conference participating terminals, mixing the multimedia data to obtain conference participating party multimedia data, sending the conference participating party multimedia data to the coordination server, so that the coordination server converts the conference participating party multimedia data into first multimedia data, and sends the first multimedia data to the visual network terminal; Receive the third multimedia data sent by the coordination server, and send the third multimedia data to the multiple participating terminals respectively; wherein the third multimedia data is obtained by the coordination server after performing protocol conversion on the received second multimedia data, and the second multimedia data is generated and sent by the visual network terminal.

8. A membership device, characterized in that: Applied to a coordination server, the coordination server is registered to a first visual network, and the coordination server is also connected to a video conferencing platform located on the Internet; the device comprises: A parsing module, configured to parse the video network number from the conference call signaling when receiving the conference call signaling sent by the video conferencing platform; A network type determination module, used to determine the network type corresponding to the video network number and the conference call mode corresponding to the network type; A calling module, used for establishing a communication connection between the video conferencing platform and the visual networking terminal based on the conference call mode, so that the video conferencing platform associates the visual networking terminal with a preset video conferencing service; The calling module comprises: A signaling forwarding unit, configured to, when the conference call mode is the cross-network conference call mode, send the cross-network call signaling to the second visual network registered with the visual network number based on the conference call signaling, so that the visual network terminal corresponding to the visual network number obtains the cross-network call signaling; A signaling receiving unit, configured to convert the visual network reply signaling returned by the visual network terminal to the cross-network call signaling into an Internet reply signaling; The signaling sending unit is used to send the Internet reply signaling to the video conferencing platform so that the video conferencing platform associates the visual network terminal with the preset video conferencing service.

9. A membership device, characterized in that: Applied to the video conferencing platform side in the Internet, the video conferencing platform is also connected to the coordination server, and the coordination server is registered to the first visual network. The device includes: A signaling generation module, configured to generate a conference call signaling according to the received conference invitation operation, wherein the conference call signaling includes a video network number; A signaling sending module, used to send the conference call signaling to the coordination server, so that the coordination server determines the conference call mode corresponding to the network type according to the network type corresponding to the visual network number, and establishes a communication connection between the video conferencing platform and the visual network terminal based on the conference call mode; A conference association module, used to associate the video networking terminal with a preset video conference service based on the communication connection; The coordination server is used to send cross-network call signaling to the second visual network registered with the visual network number based on the conference call signaling when the conference call mode is the cross-network conference call mode, so that the visual network terminal obtains the cross-network call signaling; receives the visual network reply signaling returned by the visual network terminal in response to the cross-network call signaling, and converts the visual network reply signaling into an Internet reply signaling; sends the Internet reply signaling to the video conferencing platform to establish a communication connection between the video conferencing platform and the visual network terminal, so that the video conferencing platform associates the visual network terminal with the preset video conferencing service.

10. An electronic device, characterized in that: include: one or more processors; and One or more machine-readable media having instructions stored thereon, when executed by the one or more processors, cause the device to execute the membership joining method as described in any one of claims 1-5 or any one of claims 6-7.

11. A computer-readable storage medium, characterized in that: The computer program stored therein enables the processor to execute the membership joining method as described in any one of claims 1-5 or any one of claims 6-7.

Images