A cascaded video conference cross-domain round-robin method, device and electronic equipment

Abstract

The application discloses a kind of cascaded video conference cross-domain round tour method, device and electronic equipment, wherein, first target network side equipment receives the round tour video stream request of second target network side equipment sent carrying video stream list, first target network side equipment will the intersection of video stream list and the video stream request list corresponding to first target network side equipment as target video stream list, to make second target network side equipment acquire target video stream according to target video stream list, and according to multi-picture round tour layout is displayed on corresponding terminal, since first target network side equipment obtains target video stream based on the intersection of the video stream list and the video stream request list, to realize the on-demand uplink of video stream, save the bandwidth cost between superior and subordinate, reduce media stream acquisition calculation cost, to realize the demand of cross-domain multi-picture round tour in multi-level cascaded conference.

Description

Technical Field

[0001] This invention relates to the field of communication technology, and in particular to a method, apparatus and electronic device for cross-domain polling in cascaded video conferencing. Background Technology

[0002] A video conferencing system refers to a system that enables two or more individuals or groups in different locations to exchange audio, video, and file data through transmission lines and multimedia equipment, achieving real-time and interactive communication for remote meetings. A video conferencing system typically includes various participating devices such as a Multipoint Control Unit (MCU) (i.e., a video conferencing server), software terminals, hardware terminals, and recording servers. Terminals capture images and audio, encode them, and send them to the MCU. The MCU then, according to meeting requirements, may or may not merge the images sent from multiple terminals, and may or may not mix the audio before sending it to each participating terminal, thereby enabling audio and video calls for multiple participants.

[0003] In some video conferencing application scenarios, the conferencing system usually needs to be deployed and managed hierarchically and with different authority according to the region or organizational structure. That is, each level of unit deploys, maintains and uses its own video conferencing system. At the same time, the conferencing systems of each level of unit can be cascaded across domains based on a tree network to hold cross-domain multi-level cascaded meetings.

[0004] Existing technologies have enabled multi-channel cascading cross-domain conferencing systems, allowing for the exchange of multiple main video streams between upper-level and lower-level conferencing systems. Based on this, users have raised the requirement for cross-domain multi-screen rotation in cascading conferencing. However, due to the structural limitations of tree networks, network interconnection can only be achieved between directly subordinate upper and lower levels. In other words, lower-level terminals cannot upload video streams to the upper level for rotation as needed. Therefore, how to achieve the requirement for cross-domain multi-screen rotation in cascading conferencing has become an urgent problem to be solved. Summary of the Invention

[0005] This invention provides a method, apparatus, and electronic device for cross-domain polling in cascaded video conferencing, which solves the problem that existing technologies cannot perform cross-domain multi-screen polling in multi-level cascaded conferences in tree networks.

[0006] In a first aspect, embodiments of the present invention provide a cross-domain polling method for cascaded video conferencing, applied to a tree-structured cascaded video conferencing system, the method comprising: The first target network device receives a first round video stream request carrying a list of video streams sent by the second target network device; The first target network-side device uses the intersection of the video stream list and the video stream request list corresponding to the first target network-side device as the target video stream list, so that the second target network-side device can obtain the target video stream according to the target video stream list and display it on the corresponding terminal according to the multi-screen rotation layout; Wherein, the first target network-side device is a subordinate network-side device directly under the second target network-side device, the video stream list is a list of terminal video streams acquired on demand when the second target network-side device performs periodic multi-screen rotation, and the video stream request list is a list of video streams corresponding to all directly subordinate and subordinate terminals belonging to the first target network-side device that enter the multi-screen rotation layout of the second target network-side device.

[0007] The cascading video conferencing cross-domain polling method provided in this embodiment of the invention involves a first target network device receiving a first polling video stream request carrying a video stream list from a second target network device. The first target network device uses the intersection of the video stream list and the video stream request list corresponding to the first target network device as a target video stream list. Based on this, it obtains a target video stream and sends it to the second target network device, enabling the second target network device to display it on the corresponding terminal according to a multi-screen polling layout. The video stream list is the list of terminal video streams obtained on demand by the second target network device during periodic multi-screen polling. The video stream request list is the list of video streams corresponding to all direct and subordinate terminals belonging to the first target network device that enter the multi-screen polling layout of the second target network device. The first target network device uses the intersection of the video stream list and the video stream request list corresponding to the first target network device as the target video stream list and obtains the target video stream based on the target video stream list. Since the target video stream list is the intersection of the video stream list carried in the polling video stream request and the video stream request list corresponding to the first target network device, the number of target video streams that the first target network device needs to acquire is reduced by performing the intersection operation of the video stream list and the video stream request list. This saves the computational overhead of the central processing unit for identification and judgment during video stream forwarding, and simplifies the signaling service logic in this cascaded video conference, ensuring the reliability of the signaling service in the video conferencing system. Furthermore, since the second target network device only needs to acquire the target video stream from the first target network device on demand each time according to the multi-screen polling layout and the conference system's organizational structure, rather than acquiring all the video streams from the first target network device, network bandwidth between upper and lower level target network devices is saved. Moreover, the requirement for cross-domain multi-screen polling in multi-level cascaded conferences is met, thereby improving the performance of the video conferencing system.

[0008] In one possible implementation, before the first target network-side device receives the first round-robin video stream request carrying a list of video streams sent by the second target network-side device, the method further includes: After receiving the request to create a conference, the first target network-side device creates a first home simulation terminal and a first away simulation terminal corresponding to the third target network-side device; The first target network device configures a corresponding video stream request list for the third target network device based on the participant list, multi-screen rotation layout, and conference system organizational structure carried in the conference creation request; The first target network-side device sends the create conference request to the third target network-side device, so that the third target network-side device creates a local conference according to the create conference request; The first away simulation terminal is used to obtain the target video stream from the third target network side device according to the target video stream list of the third target network side device, and the first home simulation terminal is used to send the video stream obtained by the first away simulation terminal to the media service of the first target network side device. The third target network side device is a directly subordinate network side device of the first target network side device.

[0009] In this embodiment of the invention, after receiving a meeting creation request, the first target network-side device creates a meeting at its own level and configures a third target network-side device, which is its directly subordinate network-side device, with an away simulation terminal for obtaining target video streams from the third target network-side device according to the target video stream list of the third target network-side device, and a home simulation terminal for sending the video streams obtained by the first away simulation terminal to the media service of the first target network-side device. In addition, based on the participant list, multi-screen rotation layout and meeting system organizational structure carried in the meeting creation request, the device configures a corresponding video stream request list for the third target network-side device and sends a meeting creation request to the third target network-side device. Because the first target network device generates a pair of first home simulation terminals and first away simulation terminals in its cascading gateway service, wherein the first away simulation terminal belongs to the third target network device and is added to the participant list corresponding to the third target network device, and the first home simulation terminal belongs to the first target network device and is added to the participant list corresponding to the first target network device, the first target network device can obtain video streams from the third target network device through the first home simulation terminal and the first away simulation terminal, making the upload of video streams in the video conferencing system more stable.

[0010] In one possible implementation, after the first target network-side device receives a polling video stream request carrying a video stream list from the second target network-side device, before the first target network-side device uses the intersection of the video stream list and the video stream request list corresponding to the first target network-side device as the target video stream list, the method further includes: The first target network-side device determines the third target network-side device based on the list of participants and the organizational structure of the conference system; The first target network-side device uses the conference number of the third target network-side device as the target conference number; The first target network-side device sends the polling video stream request to the third target network-side device according to the target conference number.

[0011] In this embodiment of the invention, the first target network-side device determines its directly subordinate network-side device, namely the third target network-side device, based on the participant list and the conference system's organizational structure. The first target network-side device uses the conference number of the third target network-side device as the target conference number and sends a polling video stream request to the network-side device corresponding to the target conference number. Because the first target network-side device accurately determines its directly subordinate network-side device based on the participant list and the conference system's organizational structure, it can precisely send a polling video stream request carrying a video stream list to its directly subordinate network-side device. This allows the directly subordinate network-side device to upload video streams to the first target network-side device as needed based on the target video stream list, saving network bandwidth between the upper and lower level network-side devices and improving the efficiency of the video conferencing system.

[0012] Secondly, embodiments of the present invention also provide a cross-domain polling method for cascaded video conferencing, applied to a tree-network cascaded video conferencing system, the method comprising: After the second target network device reaches the polling cycle, it sends a polling video stream request to the first target network device, so that the first target network device can determine the target video stream list based on the video stream list carried in the polling video stream request and the video stream request list corresponding to the first target network device. The second target network-side device obtains the target video stream according to the target video stream list and displays it on the corresponding terminal according to the multi-screen rotation layout; Wherein, the first target network-side device is a subordinate network-side device directly under the second target network-side device, the video stream list is a list of terminal video streams acquired on demand when the second target network-side device performs periodic multi-screen rotation, and the video stream request list is a list of video streams corresponding to all directly subordinate and subordinate terminals belonging to the first target network-side device that enter the multi-screen rotation layout of the second target network-side device.

[0013] In one possible implementation, the method further includes: The second target network-side device receives a request to create a conference; The second target network-side device configures a second home-field simulation terminal and a second away-field simulation terminal for the first target network-side device; The second target network device configures a corresponding video stream request list for the first target network device based on the participant list, multi-screen rotation layout, and conference system organizational structure carried in the conference creation request; The second target network device sends the create meeting request to the first target network device, so that the first target network device creates a local meeting according to the create meeting request.

[0014] In one possible implementation, the second target network-side device obtains the target video stream according to the target video stream list, including: The second target network-side device obtains the target video stream from the first target network-side device through the second away simulation terminal according to the target video stream list; The second target network-side device sends the target video stream of the first target network-side device obtained by the second away simulation terminal to the media service of the second target network-side device through the second home simulation terminal.

[0015] Thirdly, embodiments of the present invention also provide a cascaded video conferencing cross-domain polling device, comprising: The first receiving module is used to receive a first round-robin video stream request carrying a list of video streams sent by the second target network-side device; The determination module is used to take the intersection of the video stream list and the video stream request list corresponding to the first target network side device as the target video stream list, so that the second target network side device can obtain the target video stream according to the target video stream list and display it on the corresponding terminal according to the multi-screen rotation layout; Wherein, the first target network-side device is a subordinate network-side device directly under the second target network-side device, the video stream list is a list of terminal video streams acquired on demand when the second target network-side device performs periodic multi-screen rotation, and the video stream request list is a list of video streams corresponding to all directly subordinate and subordinate terminals belonging to the first target network-side device that enter the multi-screen rotation layout of the second target network-side device.

[0016] Fourthly, embodiments of the present invention also provide a cascaded video conferencing cross-domain polling device, comprising: The second receiving module is used to send a polling video stream request to the first target network device after the polling cycle is reached, so that the first target network device can determine the target video stream list according to the video stream list carried in the polling video stream request and the video stream request list corresponding to the first target network device. The third receiving module is used to obtain the target video stream according to the target video stream list and display it on the corresponding terminal according to the multi-screen rotation layout; Wherein, the first target network-side device is a subordinate network-side device directly under the second target network-side device, the video stream list is a list of terminal video streams acquired on demand when the second target network-side device performs periodic multi-screen rotation, and the video stream request list is a list of video streams corresponding to all directly subordinate and subordinate terminals belonging to the first target network-side device that enter the multi-screen rotation layout of the second target network-side device.

[0017] Fifthly, embodiments of the present invention also provide an electronic device, including a processor; a memory for storing processor-executable instructions; wherein the processor executes the executable instructions to implement the steps of the cascaded video conferencing cross-domain polling method described in any one of the first or second aspects.

[0018] In a sixth aspect, embodiments of the present invention also provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of any of the cascaded video conferencing cross-domain polling methods described in the first or second aspect.

[0019] The technical effects that may be achieved by the cascaded video conferencing cross-domain rotation device disclosed in the third aspect, the cascaded video conferencing cross-domain rotation device disclosed in the fourth aspect, the electronic device disclosed in the fifth aspect, and the computer-readable storage medium disclosed in the sixth aspect are described above in the description of the technical effects that may be achieved by the various possible solutions in the first aspect or the second aspect or the second aspect, and will not be repeated here. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 A schematic diagram of the structure of a network-side device in a video conferencing system provided in an embodiment of the present invention; Figure 2This is a schematic diagram of the structure of a cascaded video conferencing system provided in an embodiment of the present invention; Figure 3 A schematic diagram of the structure of a video conferencing system cascading gateway service provided in an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of a video conferencing system embodiment provided by the present invention; Figure 5 This is a schematic diagram of a multi-screen layout provided in an embodiment of the present invention; Figure 6 A schematic diagram of the structure of a video conferencing system control service provided in an embodiment of the present invention; Figure 7 A schematic diagram of the signaling service structure of a video conferencing system embodiment provided by this invention; Figure 8 This is a schematic diagram of the structure of a cascading gateway service in a video conferencing system embodiment provided by the present invention; Figure 9 This is a schematic diagram of the structure of a cascaded video conferencing cross-domain polling device provided in an embodiment of the present invention; Figure 10 This is a schematic diagram of another cascaded video conferencing cross-domain polling device provided in an embodiment of the present invention; Figure 11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention; Figure 12 A flowchart of a cross-domain polling method for cascaded video conferencing provided in an embodiment of the present invention; Figure 13 A flowchart of another cascaded video conferencing cross-domain polling method provided in an embodiment of the present invention. Detailed Implementation

[0022] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this invention, and not all of them. Based on the embodiments of this invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this invention.

[0023] The application scenarios described in the embodiments of this invention are for the purpose of more clearly illustrating the technical solutions of the embodiments of this invention, and do not constitute a limitation on the technical solutions provided by the embodiments of this invention. Those skilled in the art will understand that with the emergence of new application scenarios, the technical solutions provided by the embodiments of this invention are also applicable to similar technical problems. In the description of this invention, unless otherwise stated, "multiple" means two or more.

[0024] The following explanations of some terms used in the embodiments of the present invention are provided to facilitate understanding by those skilled in the art.

[0025] (1) Video conferencing system, such as Figure 1 As shown, the participating devices include an MCU 11 and various terminals 12. The MCU 11 is also known as the video conferencing server, which is the network-side device in this embodiment of the invention. The MCU 11 includes a web browser 111, a conferencing control service 112, a signaling service 113, a media service 114, and a cascading gateway service 115. The web browser 111 is communicatively connected to the conferencing control service 112, which is also communicatively connected to the signaling service 113. The signaling service 113 is communicatively connected to the media service 114. The cascading gateway service 115 is communicatively connected to both the signaling service 113 and the media service 114. The terminals 12 are communicatively connected to both the signaling service 113 and the media service 114. The terminals 12 can include n terminals, where n is a positive integer. In the aforementioned video conferencing system, terminal 12 captures images and sounds, encodes them, and sends them to MCU 11. MCU 11 then merges or does not merge the images sent by multiple terminals 12, and mixes or does not mix the sounds, according to the meeting requirements, and then sends them to each participating terminal, thereby enabling audio and video calls among multiple participants.

[0026] (2) Multi-screen layout refers to a video screen that includes multiple display areas, and each display area is used to display the screen of a participating terminal. In other words, multi-screen layout includes the size and position of multiple display areas divided in the video screen, as well as the screen of the participating terminal corresponding to each display area.

[0027] like Figure 2 As shown, this is an embodiment of the present invention providing a multi-level cascaded video conferencing system. The cascaded video conferencing system includes a multi-level video conferencing system, a top-level video conferencing system 21, a second-level video conferencing system 22, ..., an n-level video conferencing system 2n, where n is greater than or equal to 2. Each level of the video conferencing system includes network-side devices and terminals.

[0028] The first target network-side device in this embodiment of the invention can be Figure 2 The network-side devices for other conferencing systems besides the top-level video conferencing system, and the second target network-side devices can be... Figure 2 Network-side equipment for video conferencing systems other than the final-level video conferencing system.

[0029] for example, Figure 2In this context, if the network-side device corresponding to the top-level video conferencing system is the second target network-side device, then the first target network-side device can be either the network-side device corresponding to the second-level video conferencing system 1 or the network-side device corresponding to the second-level video conferencing system 2. Similarly, if the network-side device corresponding to the second-level video conferencing system 1 is the second target network-side device, then the first target network-side device can be either the network-side device corresponding to the third-level video conferencing system 1 or the network-side device corresponding to the third-level video conferencing system 2. In other words, the network-side device corresponding to the second-level video conferencing system 1 is a directly subordinate network-side device of the network-side device corresponding to the top-level video conferencing system, and the network-side device corresponding to the third-level video conferencing system 1 is a directly subordinate network-side device of the network-side device corresponding to the second-level video conferencing system 1, but not a directly subordinate network-side device of the network-side device corresponding to the top-level video conferencing system.

[0030] Figure 2 The multi-level cascaded video conferencing system shown is a tree-structured network video conferencing system. The cross-domain polling method for cascaded video conferencing provided in this embodiment of the invention is applied to the tree-structured network cascaded video conferencing system.

[0031] This invention provides a cross-domain polling method for video conferencing, applied to a tree-structured cascaded video conferencing system, wherein: The first target network-side device is configured to receive a first round-robin video stream request carrying a video stream list sent by the second target network-side device; and to take the intersection of the video stream list and the video stream request list corresponding to the first target network-side device as the target video stream list, so that the second target network-side device can obtain the target video stream according to the target video stream list and display it on the corresponding terminal according to the multi-screen round-robin layout.

[0032] The second target network-side device is used to send a polling video stream request to the first target network-side device after the polling cycle is reached, so that the first target network-side device can determine the target video stream list based on the video stream list carried in the polling video stream request and the video stream request list corresponding to the first target network-side device; obtain the target video stream according to the target video stream list, and display it on the corresponding terminal according to the multi-screen polling layout.

[0033] Wherein, the first target network-side device is a directly subordinate network-side device of the second target network-side device, the video stream list is a list of terminal video streams acquired on demand when the second target network-side device performs periodic multi-screen rotation, and the video stream request list is a list of video streams corresponding to all directly subordinate and subordinate terminals belonging to the first target network-side device that enter the multi-screen rotation layout of the second target network-side device.

[0034] In this embodiment of the invention, after the second target network-side device reaches its polling cycle, it sends a polling video stream request to the first target network-side device. The first target network-side device receives the polling video stream request carrying a video stream list from the second target network-side device, takes the intersection of the video stream list and the video stream request list corresponding to the first target network-side device as the target video stream list, and obtains the target video stream based on this. The target video stream is then sent to the second target network-side device. After receiving the target video stream, the second target network-side device displays it on the corresponding terminal according to the multi-screen polling layout. Here, the video stream list is the terminal video stream list that the second target network-side device obtains on demand when performing periodic multi-screen polling, and the video stream request list is the video stream list corresponding to all direct and subordinate terminals belonging to the first target network-side device that enter the multi-screen polling layout of the second target network-side device. The first target network-side device takes the intersection of the video stream list and the video stream request list corresponding to the first target network-side device as the target video stream list, and obtains the target video stream according to the target video stream list. Since the target video stream list is the intersection of the video stream list carried in the polling video stream request and the video stream request list corresponding to the first target network device, the number of target video streams that the first target network device needs to acquire is reduced by performing the intersection operation of the video stream list and the video stream request list. This saves the computational overhead of the central processing unit for identification and judgment during video stream forwarding, and simplifies the signaling service logic in this cascaded video conference, ensuring the reliability of the signaling service in the video conferencing system. Furthermore, since the second target network device only needs to acquire the target video stream from the first target network device on demand each time according to the multi-screen polling layout and the conference system's organizational structure, rather than acquiring all the video streams from the first target network device, network bandwidth between upper and lower level target network devices is saved. Moreover, the requirement for cross-domain multi-screen polling in multi-level cascaded conferences is met, thereby improving the performance of the video conferencing system.

[0035] In specific implementation, the second target network-side device can be the network-side device corresponding to the top-level video conferencing system, or it can be the network-side device corresponding to other video conferencing systems. If the second target network-side device is the network-side device corresponding to the top-level video conferencing system, then the polling video stream request received by the second target network-side device is a polling video stream request triggered by the user. If the second target network-side device is another video conferencing system, then the polling video stream request is a polling video stream request sent by the superior network-side device of the second target network-side device, and the polling video stream request carries a list of video streams.

[0036] For example, the second target network-side device is Figure 2If the network-side device corresponding to the secondary video conferencing system 1 is the network-side device of the top-level video conferencing system, then the polling video stream request received by the second target network-side device is the polling video stream request sent by the network-side device corresponding to the top-level video conferencing system.

[0037] In specific implementation, before the second target network-side device sends a polling video stream request to the first target network-side device, it also sends a conference creation request to the first target network-side device. After receiving the conference creation request, the first target network-side device creates a first home simulation terminal and a first away simulation terminal corresponding to the third target network-side device. Based on the participant list, multi-screen polling layout, and conference system organizational structure carried in the conference creation request, the first target network-side device configures a corresponding video stream request list for the third target network-side device. The first target network-side device sends a conference creation request to the third target network-side device so that the third target network-side device can create its own conference according to the conference creation request. Among them, the first away simulation terminal is used to obtain the target video stream from the third target network-side device according to the target video stream list of the third target network-side device, and the first home simulation terminal is used to send the video stream obtained by the first away simulation terminal to the media service of the first target network-side device. The third target network-side device is a directly subordinate network-side device of the first target network-side device.

[0038] For example, after receiving a meeting creation request from the network side device corresponding to the top-level video conferencing system, the network side device corresponding to the second-level video conferencing system 1 creates a home simulation terminal and a away simulation terminal corresponding to the network side device corresponding to the third-level video conferencing system 1, and creates a home simulation terminal and a away simulation terminal corresponding to the network side device corresponding to the third-level video conferencing system 2.

[0039] In this embodiment of the invention, after receiving a meeting creation request, the first target network-side device creates a meeting at its own level and configures a third target network-side device (its directly subordinate network-side device) with an away simulation terminal for acquiring the video stream corresponding to the third target network-side device and a home simulation terminal for sending the video stream acquired by the first away simulation terminal to the media service of the first target network-side device. Based on the participant list, multi-screen rotation layout, and meeting system organizational structure carried in the meeting creation request, the device configures a corresponding video stream request list for the third target network-side device and sends a meeting creation request to the third target network-side device. Because the first target network device generates a pair of first home simulation terminals and first away simulation terminals in its cascading gateway service, wherein the first away simulation terminal belongs to the third target network device and is added to the participant list corresponding to the third target network device, and the first home simulation terminal belongs to the first target network device and is added to the participant list corresponding to the first target network device, the first target network device can obtain video streams from the third target network device through the first home simulation terminal and the first away simulation terminal, making the upload of video streams in the video conferencing system more stable.

[0040] In specific implementation, after the first target network device receives the polling video stream request carrying the video stream list sent by the second target network device, before the first target network device uses the intersection of the video stream list and the video stream request list corresponding to the first target network device as the target video stream list, the process further includes: the first target network device determining the third target network device based on the participant list and the conference system organizational structure; the first target network device using the conference number of the third target network device as the target conference number; and the first target network device sending the polling video stream request to the third target network device based on the target conference number.

[0041] In this embodiment of the invention, the first target network-side device determines its directly subordinate network-side device, namely the third target network-side device, based on the participant list and the conference system's organizational structure. The first target network-side device uses the conference number of the third target network-side device as the target conference number and sends a polling video stream request to the network-side device corresponding to the target conference number. Because the first target network-side device accurately determines its directly subordinate network-side device based on the participant list and the conference system's organizational structure, it can precisely send a polling video stream request carrying a video stream list to its directly subordinate network-side device. This allows the directly subordinate network-side device to upload video streams to the first target network-side device as needed based on the target video stream list, saving network bandwidth between the upper and lower level network-side devices and improving the efficiency of the video conferencing system.

[0042] In specific implementation, the first target network side device obtains the target video stream according to the target video stream list, including: the first away simulation terminal obtains the target video stream from the third target network side device according to the target video stream list of the third target network side device; the first target network side device sends the target video stream obtained by the first away simulation terminal to the media service of the first target network side device through the first home simulation terminal.

[0043] In this embodiment of the invention, the first away simulation terminal obtains the target video stream from the third target network side device according to the target video stream list of the third target network side device. The first target network side device then sends the target video stream obtained by the first away simulation terminal to the media service of the first target network side device through the first home simulation terminal. Since the target video stream list is the intersection of the video stream list carried in the polling video stream request and the video stream request list corresponding to the first target network side device, the number of target video streams that the first away simulation terminal needs to obtain from the third target network side device is reduced by performing the intersection operation of the video stream list and the video stream request list. This saves the computational overhead of the central processing unit (CPU) for identification and judgment during video stream forwarding, and simplifies the logic of the signaling service in the cascaded video conference, ensuring the reliability of the signaling service in the video conferencing system.

[0044] In practice, the second target network device receives a meeting creation request and configures a second home simulation terminal and a second away simulation terminal for the first target network device. Based on the participant list, multi-screen rotation layout, and meeting system organizational structure carried in the meeting creation request, the second target network device configures a corresponding video stream request list for the first target network device. The second target network device sends a meeting creation request to the first target network device so that the first target network device can create a meeting at this level based on the meeting creation request.

[0045] In this embodiment of the invention, the second target network-side device creates a local conference and configures a second away-field simulation terminal for the first target network-side device to acquire the video stream corresponding to the first target network-side device, and a second home-field simulation terminal for sending the video stream acquired by the second away-field simulation terminal to the media service of the second network-side device. Based on the participant list, multi-screen rotation layout, and conference system organizational structure carried in the conference creation request, it configures a corresponding video stream request list for its directly subordinate network-side devices and sends a conference creation request to the first target network-side device. Since the second target network-side device generates a pair of second home-field simulation terminals and second away-field simulation terminals in its cascading gateway service, where the second away-field simulation terminal belongs to the first target network-side device and is added to the participant list corresponding to the first target network-side device, and the second home-field simulation terminal belongs to the second target network-side device and is added to the participant list corresponding to the second target network-side device, the second target network-side device can acquire the video stream from the first target network-side device through the second home-field simulation terminal and the second away-field simulation terminal, making the video stream upload in the video conferencing system more stable.

[0046] In practice, the second away simulation terminal obtains the target video stream from the first target network device according to the target video stream list; the second target network device sends the target video stream obtained by the second away simulation terminal from the first target network device to the media service of the second target network device through the second home simulation terminal.

[0047] The following is combined Figure 1 and Figure 2 The cross-domain polling method for cascaded video conferencing provided in the embodiments of the present invention will be described in detail.

[0048] After receiving a meeting creation request, the meeting control service 112 of the second target network device creates a meeting at its current level. This meeting creation request includes information such as the list of participants at this level and a multi-screen rotating layout. It should be noted that if the second target network device is the network device corresponding to the top-level meeting system, the meeting control service 112 in the second target network device receives the meeting creation request from the web browser 111, i.e., the user-triggered meeting creation request. If the second target network device is not the network device corresponding to the top-level meeting system, the meeting control service 112 in the second target network device receives the meeting creation request sent from the superior network device of the second target network device. After the meeting is created, the meeting control service 112 of the second target network device iterates through the list of participants at its current level. If no lower-level participant terminals are involved, the meeting control service ends. If lower-level participant terminals are involved, the service configures a home simulation terminal 1151 and an away simulation terminal 1152 for its directly subordinate network devices according to the organizational structure of the participants in the list of participants at this level. Figure 3 As shown, the host simulation terminal 1151 is added to the participant list of the superior network device; the guest simulation terminal 1152 is configured with the privateLayoutSSRCs video stream request list, where the privateLayoutSSRCs video stream request list is a static list, which is the video stream list of all direct and subordinate terminals belonging to the subordinate network device that enter the multi-screen rotation layout of the superior network device; irrelevant participant terminals are removed, and a meeting creation request is sent to the meeting control service 112 of its direct subordinate network device; the meeting control service is terminated.

[0049] For example, in Figure 2 In the cascaded video conferencing system shown, the network-side device corresponding to the top-level video conferencing system is designated as the second target network-side device, and the network-side device corresponding to the second-level video conferencing system 1 is designated as the first target network-side device. The meeting control service 112 of the top-level video conferencing system's network-side device creates the meeting at this level after receiving a meeting creation request from the web browser 111. It configures a home simulation terminal 1151 and a guest simulation terminal 1152 for the second-level video conferencing system's network-side device, adds the home simulation terminal 1151 to the participant list of the top-level video conferencing system's network-side device, and configures a privateLayoutSSRCs video stream request list for the guest simulation terminal 1152. It removes irrelevant participants, adds the guest simulation terminal 1152 to the participant list of the second-level video conferencing system's network-side device, initiates a meeting creation request to the meeting control service 112 of the second-level video conferencing system's network-side device, and terminates the meeting control service of the top-level video conferencing system's network-side device.

[0050] After receiving a meeting creation request from the meeting control service 112 of the second target network device, the meeting control service 112 of the first target network device creates a meeting at this level. The meeting creation request includes a list of participants at this level and information such as a multi-screen rotating layout. After the meeting is created, the meeting control service 112 of the first target network device iterates through the list of participants at this level. If no lower-level participant terminals are involved, the meeting control service ends. If lower-level participant terminals are involved, the service configures a home simulation terminal 1151 and an away simulation terminal 1152 for its directly subordinate network devices based on the organizational structure of the participants in the list. Figure 3As shown, the host simulation terminal 1151 is added to the participant list of this level; the guest simulation terminal 1152 is configured with the privateLayoutSSRCs video stream request list, where the privateLayoutSSRCs video stream request list is a static list that contains all video streams that enter the multi-screen rotating layout under the organization subtree of the guest simulation terminal 1152 belonging to the lower-level network side device; irrelevant participant terminals are removed, the guest simulation terminal 1152 is added to the participant list of its directly subordinate network side device, a meeting creation request is sent to the meeting control service 112 of the directly subordinate network side device; and the meeting control service is terminated.

[0051] For example, in Figure 2 In the cascaded video conferencing system shown, after receiving a meeting creation request from the network control service 112 of the network side device corresponding to the second-level video conferencing system 1, the meeting control service 112 creates a meeting at this level. It configures a home simulation terminal 1151 and a guest simulation terminal 1152 for the directly subordinate network side devices of the second-level video conferencing system 1, i.e., it configures a home simulation terminal A1 and a guest simulation terminal B1 for the third-level video conferencing system 1, and a home simulation terminal A2 and a guest simulation terminal B2 for the third-level video conferencing system 2. It also adds home simulation terminals A1 and A2 to the participant list corresponding to the second-level video conferencing system 1, and configures the guest simulation terminal B2 as well. Configure privateLayoutSSRCsA for terminal B1 and privateLayoutSSRCsB for the guest simulation terminal B2; remove irrelevant participant terminals from the current participant list, add guest simulation terminal B1 to the current participant list corresponding to Level 3 video conferencing system 1, and add guest simulation terminal B2 to the current participant list corresponding to Level 3 video conferencing system 2; initiate a meeting creation request to the directly subordinate network side devices of Level 2 video conferencing system 1, namely the meeting control service 112 of Level 3 video conferencing system 1 and the meeting control service 112 of Level 3 video conferencing system 23, and terminate the meeting control service of Level 2 video conferencing system 1.

[0052] After the second target network device sends a conference creation request to the first target network device, it sends a SwitchCycleSSRCs first round video stream request to the first target network device. The signaling service 113 of the first target network device receives the SwitchCycleSSRCs first round video stream request carrying a video stream list sent by the signaling service 113 of the second target network device. The SwitchCycleSSRCs first round video stream request is a dynamic list. The signaling service 113 of the first target network device iterates through the corresponding lower-level network devices of the first target network device. The list of participants is determined, identifying the master simulation terminal 1151 for each subordinate network-side device, and determining the conference number, signaling service address, and port of each subordinate network-side device. The signaling service 113 of the first target network-side device uses the subordinate network-side device signaling service address and port of each master simulation terminal 1151 to send a SwitchCycleSSRCs first round video stream request to the signaling service 113 of its directly subordinate network devices. This SwitchCycleSSRCs first round video stream request includes a video stream list and the subordinate conference number. The first target network-side device... The signaling service 113 determines the guest simulation terminal 1152 corresponding to the lower-level network-side device and obtains its privateLayoutSSRCs video stream request list; the signaling service 113 of the first target network-side device traverses the video stream list in the first round of SwitchCycleSSRCs video stream requests, and at the same time traverses the privateLayoutSSRCs video stream request list of the guest simulation terminal 1152 corresponding to the lower-level network-side device, obtains the intersection of the two lists, and generates the ssrcsToMS target video stream list; the signaling service 113 of the first target network-side device uses the above-mentioned s The srcsToMS target video stream list initiates a SetPrivateLayoutSSRC video stream switching request to the guest simulation terminal 1152, causing it to request the video streams in the list to obtain the target video stream; the signaling service 113 of the first target network side device receives the RequestVideoSSRCs video stream request signaling from the guest simulation terminal 1152, and sends a RequestStreams video stream forwarding request to the media service 114 corresponding to the lower-level network side device, requesting to update the privateLayoutSSRCs video stream request list of the guest simulation terminal 1152;The signaling service 113 of the first target network device stores the ssrcsToMS target video stream list. If the ssrcsToMS target video stream list generated by the next SwitchCycleSSRCs round-robin video stream request remains unchanged, it does not need to send a RequestStreams video stream forwarding request to the local media service 114; that is, it does not need to request an update to the privateLayoutSSRCs video stream request list of the guest simulation terminal 1152. When the signaling service 113 of the first target network device adds the guest simulation terminal 1152 to the local participant list, it determines whether the local meeting is round-robin. If not, it sends the privateLayoutSSRCs video stream request list to the guest simulation terminal 1152 corresponding to the lower-level network device.

[0053] In specific implementation, the away simulation terminal 1152 acquires the video stream from the lower-level network side device terminal 12 of the first target network side device. The first target network side device uses the home simulation terminal 1151 to send the video stream acquired by the away simulation terminal 1152 to the media service of the first target network side device. It receives the RequestStreams video stream request from the signaling service 113 of the lower-level network side device, updates its own stored privateLayoutSSRCs video stream request list, and uses the away simulation terminal 1152 to send the acquired video stream to the second target network side device through the cascading gateway service 115.

[0054] For example, in Figure 2In the cascaded video conferencing system shown, the network-side device corresponding to the third-level video conferencing system 1 in the third-level video conferencing system 23 serves as the first target network-side device, the network-side device corresponding to the second-level video conferencing system 1 in the second-level video conferencing system 22 serves as the second target network-side device, and the network-side device corresponding to the fourth-level video conferencing system 1 in the fourth-level video conferencing system 24 serves as the third target network-side device. Furthermore, the second-level video conferencing system 1 configures a home simulation terminal A1 and a away simulation terminal B1 for the third-level video conferencing system 1, and the third-level video conferencing system 1 configures a home simulation terminal A2 and a away simulation terminal B2 for the fourth-level video conferencing system 1. The network-side device corresponding to the Level 4 video conferencing system 1 obtains the video stream from its own terminal 12 through the guest simulation terminal B2. The guest simulation terminal B2 copies the obtained video stream to the master simulation terminal A2 of the Level 3 video conferencing system 1. The master simulation terminal A2 sends the video stream from the guest simulation terminal B2 to the media service 114 of the Level 3 video conferencing system 1. The network-side device corresponding to the Level 3 video conferencing system 1 obtains the video stream from its own terminal 12 through the guest simulation terminal B1. The guest simulation terminal B1 copies the obtained video stream to the master simulation terminal A1 of the Level 2 video conferencing system 1. The master simulation terminal A1 sends the video stream from the guest simulation terminal B1 to the media service 114 of the Level 2 video conferencing system 1. The system receives RequestStreams video stream requests from the signaling service 113 of the network-side device corresponding to the Level 3 video conferencing system 1 and updates its own stored privateLayoutSSRCs video stream request list.

[0055] In specific implementation, the media service 114 of the second target network side device is used to receive video streams from the local terminal 12, and the main analog terminal 1151 of the second target network side device is used to receive video streams from the first target network side device; it provides an interface for setting a multi-screen rotation layout to the signaling service 113 of the upper-level network side device of the second target network side device, and performs multi-screen video stream fusion according to the multi-screen rotation layout; when the set rotation cycle is reached, it initiates a RequestStreams video stream request to the signaling service 113 according to the multi-screen rotation layout. The requested video stream list is a combination of the current rotation video stream list and the next rotation video stream list, wherein the RequestStreams video stream request is a dynamic list; when the next round of video stream switching time arrives, the screen switching is triggered, switching from the current round of video screen to the next round of video screen, and the switching is triggered separately for each layout cell.

[0056] For example, in Figure 2In the cascaded video conferencing system shown, the network-side device corresponding to the top-level video conferencing system is used as the second target network-side device, and the network-side device corresponding to the second-level video conferencing system 1 is used as the first target network-side device. The media service 114 of the network-side device corresponding to the second-level video conferencing system 1 is used to receive the video stream from the local terminal 12. The main analog terminal 1151 of the network-side device corresponding to the second-level video conferencing system 1 receives the video stream from the network-side device corresponding to the top-level video conferencing system. The system provides an interface for setting a multi-screen rotation layout to the signaling service 113 of the network-side device corresponding to the top-level video conferencing system, and performs multi-screen video stream fusion according to the multi-screen rotation layout. When the set rotation cycle is reached, a RequestStreams video stream request is initiated to the signaling service 113 according to the multi-screen rotation layout. That is, when the time for switching the next round of video streams arrives, the screen switching is triggered, switching from the current round of video screen to the next round of video screen. The switching is triggered separately for each layout cell.

[0057] In specific implementation, the signaling service 113 of the second target network device is used to receive RequestStreams video stream requests initiated by the media service 114 of the upper-level network device during multi-screen polling; it iterates through the list of participants corresponding to the upper-level network device of the second target network device, determines the master simulation terminal 1151 of each lower-level network device, and clarifies the conference number, signaling service address and port of each lower-level network device; using the lower-level network device signaling service address and port of each master simulation terminal 1151, it sends SwitchCycleSSRCs polling video stream requests to the signaling service 113 of its directly subordinate lower-level network device, which includes the video stream list and lower-level conference number in the RequestStreams video stream request.

[0058] The multi-level cascading cross-domain polling method provided in this embodiment of the invention allows the upper-level network-side device to receive video streams sent by all lower-level network-side devices as needed, based on a multi-screen polling layout. All lower-level network-side devices include directly subordinate lower-level network-side devices as well as non-directly subordinate lower-level network-side devices.

[0059] For example, such as Figure 2 As shown, Level 2 video conferencing system 1 is a directly subordinate network-side device of the top-level video conferencing system, Level 3 video conferencing system 1 is a non-directly subordinate network-side device of the top-level video conferencing system, and similarly, Level 4 video conferencing system 1 is also a non-directly subordinate network-side device of the top-level video conferencing system.

[0060] To better understand the present invention, specific embodiments are described below.

[0061] A provincial-level conference system can convene a province-wide video conference. The structure of this cascading video conference is as follows: Figure 4 As shown, the provincial video conferencing system, the municipal video conferencing system 1, and the municipal video conferencing system 2 can all be used as the second target network-side devices, while the municipal video conferencing system 1, the municipal video conferencing system 2, the county video conferencing system 1, the county video conferencing system 2, the county video conferencing system 3, and the county video conferencing system 4 can all be used as the first target network-side devices.

[0062] Figure 4 The system shown includes seven terminals: terminal 1 corresponding to the provincial video conferencing system (which can act as the chairperson), terminal 2 corresponding to the municipal video conferencing system 1, terminal 3 corresponding to the municipal video conferencing system 2, terminal 4 corresponding to the county-level video conferencing system 1, terminal 5 corresponding to the county-level video conferencing system 2, terminal 6 corresponding to the county-level video conferencing system 3, and terminal 7 corresponding to the county-level video conferencing system 4. In this embodiment, the multi-screen layout is set to two screens, with the left side filled with (municipal-level 1 terminal 2, county-level 1 terminal 4, county-level 2 terminal 5) and the right side filled with (municipal-level 2 terminal 3, county-level 3 terminal 6, county-level 4 terminal 7). Figure 5 As shown, the polling cycle is set to 10 seconds.

[0063] like Figure 6 The diagram shows the structure of the meeting control service in a provincial-level video conferencing system. The meeting control service 112 of the provincial-level video conferencing system receives a meeting creation request from the local web browser 111 and creates the local meeting. The meeting creation request includes a complete list of participants for the province-wide video conference and a multi-screen rotating layout. The complete list of participants for the province-wide video conference is as follows: Provincial Terminal 1, City Terminal 1, City Terminal 2, County Terminal 3, County Terminal 1, County Terminal 2, County Terminal 5, County Terminal 3, and County Terminal 4. The multi-screen rotating layout is a two-screen layout.

[0064] The provincial video conferencing system's meeting control service 112 traverses the complete participant list of all provincial-level video conferencing systems. Based on the organizational structure of the participants, it configures a home simulation terminal 1151 and a away simulation terminal 1152 for its directly subordinate network-side devices. Specifically, it generates a first home simulation terminal 11511 and a first away simulation terminal 11521 for the municipal video conferencing system 1, and a second home simulation terminal 11512 and a second away simulation terminal 11522 for the municipal video conferencing system 2. Figure 8As shown, the first home-site simulation terminal 11511 and the second home-site simulation terminal 11512 are added to the participant list of the provincial video conferencing system. The participant list of the meeting after the addition is as follows: Provincial terminal 1, Municipal terminal 1, Municipal terminal 2, County terminal 1, County terminal 2, County terminal 5, County terminal 3, County terminal 4, First home-site simulation terminal 11511, and Second home-site simulation terminal 11512.

[0065] The provincial video conferencing system's meeting control service 112 configures a privateLayoutSSRCs video stream request list for the first away simulation terminal 11521 and the second away simulation terminal 11522. Specifically, the privateLayoutSSRCs video stream request list of the first away simulation terminal 11521 includes the video streams of city-level terminal 1 2, county-level terminal 1 4, and county-level terminal 2 5, while the privateLayoutSSRCs video stream request list of the second away simulation terminal 11522 includes the video streams of city-level terminal 2 3, county-level terminal 3 6, and county-level terminal 4 7, as shown in Table 1.

[0066]

[0067] Table 1

[0068] Remove irrelevant participants, add the corresponding guest simulation terminals to the participant list of the lower-level video conferencing system, and initiate a meeting creation request to the meeting control service 112 of the municipal video conferencing system 1 and the municipal video conferencing system 2. That is, in the meeting creation request initiated to the meeting control service 112 of the municipal video conferencing system 1, the first participant list includes: municipal terminal 1 2, county terminal 1 4, county terminal 2 5, and the first guest simulation terminal 11521; in the meeting creation request initiated to the meeting control service 112 of the municipal video conferencing system 2, the second participant list includes: municipal terminal 2 3, county terminal 3 6, county terminal 4 7, and the second guest simulation terminal 11522.

[0069] The media service 114 of the provincial video conferencing system receives video streams from provincial terminal 1, and receives video streams from lower-level network-side device terminals through the first main analog terminal 11511 and the second main analog terminal 11512. Specifically, the first main analog terminal 11511 receives video streams from city-level terminal 2, county-level terminal 4 and county-level terminal 5, and the second main analog terminal 11512 receives video streams from city-level terminal 3, county-level terminal 6 and county-level terminal 7. The media service 114 of the provincial video conferencing system provides the signaling service 113 at the same level with an interface for setting up a multi-screen rotation layout, and performs multi-screen video stream fusion according to the multi-screen rotation layout; When the media service 114 of the provincial video conferencing system reaches the preset polling cycle, such as 10 seconds, it initiates a RequestStreams video stream request to the signaling service 113 according to the multi-screen polling layout. The requested video stream list is the combination of the video stream list of the current polling cycle and the video stream list of the next polling cycle. For example, when the first 10-second polling cycle arrives, the requested video stream list is the video stream of city-level terminal 2, the video stream of city-level terminal 3, the video stream of county-level terminal 4, and the video stream of county-level terminal 6. When the second 10-second polling cycle arrives, the requested video stream list is the video stream of county-level terminal 4, the video stream of county-level terminal 6, the video stream of county-level terminal 5, and the video stream of county-level terminal 7. The media service 114 of the provincial video conferencing system triggers a screen switch when the next video stream switching time arrives, switching from the current video stream to the next one. This switch is triggered individually for each layout cell. For example, if the current time is 0 seconds and the current video stream is from city-level terminal 2 (terminal 1) and city-level terminal 3 (terminal 2), then when the next video stream switching time arrives (i.e., the current time is 10 seconds), the video stream will switch to the video stream from county-level terminal 4 (terminal 1) and county-level terminal 6 (terminal 3).

[0070] like Figure 7 The diagram shows the structure of the signaling service in a provincial-level video conferencing system. The signaling service 113 of the provincial-level video conferencing system receives a RequestStreams video stream request from the media service 114 of the provincial-level video conferencing system during multi-screen rotation. The signaling service 113 of the provincial video conferencing system traverses the complete participant list for all provincial-level video conferences: Identify the third main venue simulation terminal 11513 and the fourth main venue simulation terminal 11514 of the municipal video conferencing system 1, and the fifth main venue simulation terminal 11515 and the sixth main venue simulation terminal 11516 of the municipal video conferencing system 2, and determine the conference number, signaling service address and port of the above conferences; The provincial video conferencing system sends SwitchCycleSSRCs polling video stream requests (dynamic list) to municipal video conferencing systems 1 and 2 via signaling service 113. Municipal video conferencing system 1 sends SwitchCycleSSRCs polling video stream requests to county-level video conferencing systems 1 and 2 via signaling service 113. Municipal video conferencing system 2 sends SwitchCycleSSRCs polling video stream requests to county-level video conferencing systems 3 and 4 via signaling service 113, thus achieving a hierarchical recursive transmission of SwitchCycleSSRCs polling video stream requests. As shown in Table 2, the parameters of the SwitchCycleSSRCs polling video stream request include the video stream list in RequestStreams and the lower-level conference number.

[0071]

[0072] Table 2

[0073] The meeting control service 112 of the municipal video conferencing system 1 receives a meeting creation request sent from the meeting control service 112 of the provincial video conferencing system and creates a meeting at this level; the meeting creation request includes information such as the first participant list and the multi-screen rotation layout; The meeting control service 112 of the municipal video conferencing system 1 traverses the first participant list and, based on the organizational structure of the participants' distribution, generates a third home simulation terminal 11513 and a third away simulation terminal 11523 for the county-level video conferencing system 1, and a fourth home simulation terminal 11514 and a fourth away simulation terminal 11524 for the county-level video conferencing system 2. Figure 8 As shown, the third home-site simulation terminal 11513 and the fourth home-site simulation terminal 11514 are added to the participant list of the municipal video conferencing system 1. After the addition, the participant list of this level meeting is: municipal 1 terminal 2, county 1 terminal 4, county 2 terminal 5, third home-site simulation terminal 11513, and fourth home-site simulation terminal 11514. The meeting control service 112 of the municipal video conferencing system 1 configures the privateLayoutSSRCs video stream request list for the third away simulation terminal 11523 and the fourth away simulation terminal 11524. That is, the privateLayoutSSRCs video stream request list of the third away simulation terminal 11523 includes the video stream of county-level terminal 4, and the privateLayoutSSRCs video stream request list of the fourth away simulation terminal 11524 includes the video stream of county-level terminal 5, as shown in Table 1. Remove irrelevant participants, add the corresponding guest simulation terminals to the participant list of the lower-level video conferencing system, and then send a meeting creation request to the meeting control service 112 of county-level video conferencing system 1 and county-level video conferencing system 2. That is, in the meeting creation request sent to the meeting control service 112 of county-level video conferencing system 1, the third participant list includes: county-level 1 terminal 4 and third guest simulation terminal 11523; in the meeting creation request sent to the meeting control service 112 of county-level video conferencing system 2, the fourth participant list includes: county-level 2 terminal 5 and fourth guest simulation terminal 11524.

[0074] The media service 114 of the municipal video conferencing system 1 receives video streams from municipal terminal 2, obtains video streams from county terminal 4 obtained by the third home simulation terminal 11513 and the third away simulation terminal 11523, and obtains video streams from county terminal 5 obtained by the fourth home simulation terminal 11514 and the fourth away simulation terminal 11524. The media service 114 of the municipal video conferencing system 1 receives the RequestStreams video stream request from the signaling service 113, updates the privateLayoutSSRCs video stream request list of the municipal terminal 2, and uses the first away simulation terminal 11521 to forward the video streams of the municipal terminal 2, county terminal 3 and county terminal 4 to the cascading gateway service 115 of the provincial video conferencing system.

[0075] The signaling service 113 of the municipal video conferencing system 1 receives SwitchCycleSSRCs polling video stream requests from the signaling service 113 of the provincial video conferencing system and iterates through the first participant list; Determine the meeting number, signaling service address, and port of county-level video conferencing system 1 and county-level video conferencing system 2; The municipal video conferencing system 1 sends a SwitchCycleSSRCs polling video stream request to the county-level video conferencing system 1 and the county-level video conferencing system 2 through signaling service 113. As shown in Table 2, the parameters of the SwitchCycleSSRCs polling video stream request include the video stream list and the lower-level conference number. The signaling service 113 of the municipal video conferencing system 1 identifies the first away simulation terminal 11521 and obtains its privateLayoutSSRCs video stream request list; The signaling service 113 of the municipal video conferencing system 1 traverses the video stream list in the first round of video stream requests in SwitchCycleSSRCs, and at the same time traverses the video stream request list in the privateLayoutSSRCs of the first away simulation terminal 11521. The intersection of the two lists is taken to generate the target video stream list ssrcsToMS, as shown in Table 3. The signaling service 113 of the municipal video conferencing system 1 uses the above-mentioned ssrcsToMS target video stream list to initiate a SetPrivateLayoutSSRC video stream switching request to the first away simulation terminal 11521, so that it requests the video stream of the ssrcsToMS target video stream list; The signaling service 113 of the municipal video conferencing system 1 receives the RequestVideoSSRCs video stream request signaling from the first away simulation terminal 11521 and sends the RequestStreams video stream request to the media service 114 of the municipal conferencing system 1, updating the video stream request list of the first away simulation terminal 11521. Save the list of target video streams in ssrcsToMS; When the first away simulation terminal 11521 joins the meeting, the signaling service 113 determines whether the municipal video conferencing system 1 is polling. Since the municipal video conferencing system 1 is polling, the original privateLayoutSSRCs video stream request list will not be sent to the third away simulation terminal 11523 and the fourth away simulation terminal 11524.

[0076] The meeting control service 112 of the municipal video conferencing system 2 receives a meeting creation request sent from the meeting control service 112 of the provincial video conferencing system and creates a meeting at this level; the meeting creation request includes information such as a list of second participants and a multi-screen rotation layout; The meeting control service 112 of the city-level video conferencing system 2 iterates through the second participant list and, based on the organizational structure of the participants' distribution, generates a fifth home simulation terminal 11515 and a fifth away simulation terminal 11525 for the county-level video conferencing system 3, and a sixth home simulation terminal 11516 and a sixth away simulation terminal 11526 for the county-level video conferencing system 4. Figure 8 As shown, the fifth main venue simulation terminal 11515 and the sixth main venue simulation terminal 11516 are added to the list of participants in this level of meeting. The list of participants in this level of meeting after the addition is as follows: city level 2 terminal 3, county level 3 terminal 6, county level 4 terminal 7, fifth main venue simulation terminal 11515, and sixth main venue simulation terminal 11516. The meeting control service 112 of the municipal video conferencing system 2 configures the privateLayoutSSRCs video stream request list for the fifth away simulation terminal 11525 and the sixth away simulation terminal 11526. That is, the privateLayoutSSRCs video stream request list of the fifth away simulation terminal 11525 includes the video stream of the county-level 3 terminal 6, and the privateLayoutSSRCs video stream request list of the sixth away simulation terminal 11526 includes the video stream of the county-level 4 terminal 7, as shown in Table 1. Remove irrelevant participants, add the corresponding guest simulation terminals to the participant list of the lower-level video conferencing system, and initiate a meeting creation request to the meeting control service 112 of county-level video conferencing system 3 and county-level video conferencing system 4. That is, in the meeting creation request initiated to the meeting control service 112 of county-level video conferencing system 3, the fifth participant list includes: county-level 3 terminal 6 and fifth guest simulation terminal 11525; in the meeting creation request initiated to the meeting control service 112 of county-level video conferencing system 4, the sixth participant list includes: county-level 4 terminal 7 and sixth guest simulation terminal 11526.

[0077] The media service 114 of the municipal video conferencing system 2 receives video streams from municipal terminal 3, obtains video streams from county-level terminal 6 obtained by the fifth home simulation terminal 11515 and the fifth away simulation terminal 11525, and obtains video streams from county-level terminal 7 obtained by the sixth home simulation terminal 11516 and the sixth away simulation terminal 11526. The media service 114 of the municipal video conferencing system 2 receives the RequestStreams video stream request from the signaling service 113, updates the privateLayoutSSRCs video stream request list of the municipal terminal 2 3, and forwards the video streams of the municipal terminal 2 3, county terminal 3 6 and county terminal 4 7 to the cascading gateway service 115 of the provincial video conferencing system through the second away simulation terminal 11522.

[0078] The signaling service 113 of the municipal video conferencing system 2 receives the SwitchCycleSSRCs polling video stream request from the signaling service 113 of the provincial video conferencing system 11 and iterates through the second participant list. The fifth master simulation terminal 11515 of county-level video conferencing system 3 and the sixth master simulation terminal 11516 of county-level video conferencing system 4 are determined, and the conference number, signaling service address and port of county-level video conferencing system 3 and county-level video conferencing system 4 are determined. The municipal video conferencing system 2 sends SwitchCycleSSRCs round-robin video stream requests to the county-level video conferencing system 3 and the county-level video conferencing system 4 through signaling service 113. As shown in Table 2, the parameters of the first round-robin video stream request of SwitchCycleSSRCs include the video stream list and the lower-level conference number in the second round-robin video stream request of SwitchCycleSSRCs. The signaling service 113 of the municipal video conferencing system 2 identifies the second away simulation terminal 11522 and obtains its privateLayoutSSRCs video stream request list; The signaling service 113 of the municipal video conferencing system 2 traverses the video stream list in the first round of SwitchCycleSSRCs video stream request and at the same time traverses the privateLayoutSSRCs video stream request list of the second away simulation terminal 11522. The intersection of the two lists is taken to generate the ssrcsToMS target video stream list, as shown in Table 3. The signaling service 113 of the municipal video conferencing system 2 uses the above-mentioned ssrcsToMS target video stream list to initiate a SetPrivateLayoutSSRC video stream switching request to the second away simulation terminal 11522, so that it requests the video stream of the ssrcsToMS target video stream list; The signaling service 113 of the municipal video conferencing system 2 receives the RequestVideoSSRCs video stream request signaling from the second away simulation terminal 11522, and sends the RequestStreams video stream request to the media service 114 of the municipal conferencing system 2, updating the video stream request list of the second away simulation terminal 11522. Save the list of target video streams in ssrcsToMS; When the second away simulation terminal 11522 joins the meeting, the signaling service 113 determines whether the municipal video conferencing system 2 is polling. Since the municipal video conferencing system 2 is polling, the original privateLayoutSSRCs video stream request list will not be sent to the fifth away simulation terminal 11525 and the sixth away simulation terminal 11526.

[0079] The meeting control service 112 of the county-level video conferencing system 1 receives a meeting creation request sent from the meeting control service 112 of the city-level video conferencing system 1 and creates a meeting at this level; the meeting creation request includes information such as a list of third-party participants and a multi-screen rotation layout; The county-level video conferencing system 1's meeting control service 112 iterates through the third participant list. If no lower-level participant terminals are involved, the creation process ends.

[0080] The media service 114 of the county-level conference system 1 receives video streams from the county-level terminal 4; The media service 114 of the county-level conferencing system 1 receives the RequestStreams video stream request from the signaling service 113, updates the privateLayoutSSRCs video stream request list of the county-level terminal 4, and forwards the video stream of the county-level terminal 4 to the cascading gateway service 115 of the city-level video conferencing system 1 through the third away simulation terminal 11523.

[0081] The signaling service 113 of the county-level video conferencing system 1 receives the SwitchCycleSSRCs polling video stream request from the signaling service 113 of the city-level video conferencing system 1, traverses the third participant list, and ends the traversal if there is no lower-level video conferencing system. The signaling service 113 of the county-level video conferencing system 1 identifies the third away simulation terminal 11523 and obtains its privateLayoutSSRCs video stream request list, as shown in Table 1. The signaling service 113 of the county-level video conferencing system 1 traverses the video stream list in the SwitchCycleSSRCs polling video stream request and at the same time traverses the privateLayoutSSRCs video stream request list of the third away field simulation terminal 11523. The intersection of the two lists is taken to generate the ssrcsToMS target video stream list, as shown in Table 3. The signaling service 113 of the county-level video conferencing system 1 initiates a SetPrivateLayoutSSRC video stream switching request to the third away simulation terminal 11523 through the aforementioned ssrcsToMS target video stream list, so that it requests the video streams in the ssrcsToMS target video stream list; Save the list of target video streams in ssrcsToMS; When the third away simulation terminal 11523 joins the meeting, the signaling service 113 determines whether the county-level video conferencing system 1 is polling. Since the city and county-level video conferencing system 1 is not polling, the signaling service ends.

[0082] The meeting control service 112 of the county-level video conferencing system 2 receives a meeting creation request from the meeting control service 112 of the city-level video conferencing system 1 and creates a meeting at this level; the meeting creation request includes information such as a list of fourth participants and a multi-screen rotation layout; The county-level video conferencing system 2's meeting control service 112 traverses the fourth participant list. If it does not involve lower-level participant terminals, the creation process ends.

[0083] The media service 114 of the county-level conference system 2 receives video streams from the county-level terminal 5; The media service 114 of the county-level conferencing system 2 receives the RequestStreams video stream request from the signaling service 113, updates the privateLayoutSSRCs video stream request list of the county-level 2 terminal 5, and forwards the video stream of the county-level 2 terminal 5 to the cascading gateway service 115 of the city-level video conferencing system 1 through the fourth away field simulation terminal 11524.

[0084] The signaling service 113 of the county-level video conferencing system 2 receives the SwitchCycleSSRCs polling video stream request from the signaling service 113 of the city-level video conferencing system 1, traverses the fourth participant list, and ends the traversal if there is no lower-level video conferencing system. The signaling service 113 of the county-level video conferencing system 2 identifies the fourth away simulation terminal 11524 and obtains its privateLayoutSSRCs video stream request list, as shown in Table 1. The signaling service 113 of the county-level video conferencing system 2 traverses the video stream list in the SwitchCycleSSRCss polling video stream request and at the same time traverses the privateLayoutSSRCs video stream request list of the fourth away simulation terminal 11524. The intersection of the two lists is taken to generate the ssrcsToMS target video stream list, as shown in Table 3. The signaling service 113 of the county-level video conferencing system 2 initiates a SetPrivateLayoutSSRC video stream switching request to the fourth away simulation terminal 11524 through the aforementioned ssrcsToMS target video stream list, so that it requests the video streams in the ssrcsToMS target video stream list; Save the list of target video streams in ssrcsToMS; When the fourth away simulation terminal 11524 joins the meeting, the signaling service 113 determines whether the county-level video conferencing system 2 is polling. Since the county-level video conferencing system 2 is not polling, the signaling service ends.

[0085] The meeting control service 112 of the county-level video conferencing system 3 receives a meeting creation request sent from the meeting control service 112 of the city-level video conferencing system 2 and creates a meeting at this level; the meeting creation request includes information such as the fifth participant list and multi-screen rotation layout; The county-level video conferencing system 3's meeting control service 112 traverses the fifth participant list. If no lower-level participant terminals are involved, the creation process ends.

[0086] The media service 114 of the county-level conference system 3 receives video streams from the county-level terminal 6; The media service 114 of the county-level conferencing system 3 receives the RequestStreams video stream request from the signaling service 113, updates the privateLayoutSSRCs video stream request list of the county-level terminal 6, and forwards the video stream of the county-level terminal 6 to the cascading gateway service 115 of the city-level video conferencing system 2 through the fifth away simulation terminal 11525.

[0087] The signaling service 113 of the county-level video conferencing system 3 receives the SwitchCycleSSRCs polling video stream request from the signaling service 113 of the city-level video conferencing system 3, traverses the fifth participant list, and ends the traversal if there is no lower-level video conferencing. The signaling service 113 of the county-level video conferencing system 3 identifies the fifth away simulation terminal 11525 and obtains its privateLayoutSSRCs video stream request list, as shown in Table 1; The signaling service 113 of the county-level video conferencing system 3 traverses the video stream list in the SwitchCycleSSRCs polling video stream request and at the same time traverses the privateLayoutSSRCs video stream request list of the fifth away simulation terminal 11525. The intersection of the two lists is taken to generate the ssrcsToMS target video stream list, as shown in Table 3. The signaling service 113 of the county-level video conferencing system 3 initiates a SetPrivateLayoutSSRC video stream switching request to the fifth away simulation terminal 11525 through the aforementioned ssrcsToMS target video stream list, so that it requests the video streams in the ssrcsToMS target video stream list; Save the list of target video streams in ssrcsToMS; When the fifth away simulation terminal 11525 joins the meeting, the signaling service 113 determines whether the county-level video conferencing system 3 is polling. Since the city and county-level video conferencing system 3 is not polling, the signaling service ends.

[0088] The meeting control service 112 of the county-level video conferencing system 4 receives a meeting creation request sent from the meeting control service 112 of the city-level video conferencing system 2 and creates a meeting at this level; the meeting creation request includes information such as the sixth participant list and multi-screen rotation layout; The county-level video conferencing system 4's meeting control service 112 traverses the sixth participant list. If no lower-level participant terminals are involved, the meeting ends.

[0089] The media service 114 of the county-level conference system 4 receives video streams from the county-level terminal 7; The media service 114 of the county-level conferencing system 4 receives the RequestStreams video stream request from the signaling service 113, updates the privateLayoutSSRCs video stream request list of the county-level terminal 7, and forwards the video stream of the county-level terminal 7 to the cascading gateway service 115 of the city-level video conferencing system 2 through the sixth away simulation terminal 11526.

[0090] The signaling service 113 of the county-level video conferencing system 4 receives the SwitchCycleSSRCs polling video stream request from the signaling service 113 of the city-level video conferencing system 2, traverses the sixth participant list, and ends the traversal if there is no lower-level video conferencing. The signaling service 113 of the county-level video conferencing system 4 identifies the sixth away simulation terminal 11526 and obtains its privateLayoutSSRCs video stream request list, as shown in Table 1. The signaling service 113 of the county-level video conferencing system 4 traverses the video stream list in the SwitchCycleSSRCs polling video stream request and at the same time traverses the privateLayoutSSRCs video stream request list of the sixth away simulation terminal 11526. The intersection of the two lists is taken to generate the ssrcsToMS target video stream list, as shown in Table 3. The signaling service 113 of the county-level video conferencing system 4 initiates a SetPrivateLayoutSSRC video stream switching request to the sixth away simulation terminal 11526 through the aforementioned ssrcsToMS target video stream list, so that it requests the video stream of the ssrcsToMS target video stream list; Save the list of target video streams in ssrcsToMS; When the sixth away simulation terminal 11526 joins the meeting, the signaling service 113 determines whether the county-level video conferencing system 4 is polling. Since the city and county-level video conferencing system 4 is not polling, the signaling service ends.

[0091]

[0092] Table 3

[0093] like Figure 9 As shown, this is a cascaded video conferencing cross-domain polling device provided in an embodiment of the present invention. The device includes: The first receiving module 901 is used to receive a polling video stream request carrying a video stream list sent by the second target network side device; The determination module 902 is used to take the intersection of the video stream list and the video stream request list corresponding to the first target network side device as the target video stream list, so that the second target network side device can obtain the target video stream according to the target video stream list and display it on the corresponding terminal according to the multi-screen rotation layout; Among them, the first target network-side device is a subordinate network-side device directly under the second target network-side device, the video stream list is a list of terminal video streams that the second target network-side device acquires on demand when performing periodic multi-screen rotation, and the video stream request list is a list of video streams corresponding to all directly subordinate and subordinate terminals belonging to the first target network-side device that enter the multi-screen rotation layout of the second target network-side device.

[0094] Optionally, before receiving the polling video stream request carrying the video stream list sent by the second target network-side device, the first receiving module 901 is further configured to: Upon receiving the request to create a meeting, a first home simulation terminal and a first away simulation terminal corresponding to the third target network-side device are created; The first target network device configures the corresponding video stream request list for the third target network device based on the participant list, multi-screen rotation layout, and conference system organizational structure carried in the conference creation request; The first target network device sends a conference creation request to the third target network device, so that the third target network device can create a conference at this level according to the conference creation request. The first away simulation terminal is used to obtain the target video stream from the third target network side device according to the target video stream list of the third target network side device. The first home simulation terminal is used to send the video stream obtained by the first away simulation terminal to the media service of the first target network side device. The third target network side device is a directly subordinate network side device of the first target network side device.

[0095] Optionally, module 902 is also used for: Based on the list of attendees and the organizational structure of the conference system, the third target network-side device was determined; The corresponding conference number of the third target network side device in the cascading conference is determined as the target conference number; A polling video stream request is sent to the third target network device based on the target conference number.

[0096] like Figure 10 As shown, this is a cascaded video conferencing cross-domain polling device provided in an embodiment of the present invention. The device includes: The second receiving module 1001 is used to send a polling video stream request to the first target network device after the polling cycle is reached, so that the first target network device can determine the target video stream list according to the video stream list carried in the first polling video stream request and the video stream request list corresponding to the first target network device. The third receiving module 1002 is used to obtain the target video stream according to the target video stream list and display it on the corresponding terminal according to the multi-screen rotation layout; Among them, the first target network-side device is a subordinate network-side device directly under the second target network-side device, the video stream list is a list of terminal video streams that the second target network-side device acquires on demand when performing periodic multi-screen rotation, and the video stream request list is a list of video streams corresponding to all directly subordinate and subordinate terminals belonging to the first target network-side device that enter the multi-screen rotation layout of the second target network-side device.

[0097] Optionally, the second receiving module 1001 is also used for: Receive a request to create a meeting; Configure a second home-field simulation terminal and a second away-field simulation terminal for the first target network-side equipment; Based on the participant list, multi-screen rotation layout, and conference system organizational structure carried in the meeting creation request, configure the corresponding video stream request list for the first target network-side device; Send a conference creation request to the first target network device so that the first target network device can create a conference at this level according to the conference creation request.

[0098] Optionally, the third receiving module 1002 is specifically used for: Obtain the target video stream from the first target network-side device based on the target video stream list; The media service of the second target network side device sends the target video stream obtained by the second home simulation terminal to the second target network side device through the second home simulation terminal.

[0099] like Figure 11 As shown, an electronic device 110 is also provided as an embodiment of the present invention. Figure 11 The electronic device 110 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0100] like Figure 11 As shown, electronic device 110 can be represented as a general-purpose computing device, such as a server. The components of electronic device 111 may include, but are not limited to: at least one processor 111, at least one memory 112 storing instructions executable by the processor 111, and a bus 113 connecting different system components (including memory 112 and processor 111), wherein processor 111 is the processor of electronic device.

[0101] The processor 111 implements any of the cascaded video conferencing cross-domain polling methods in the above embodiments by running executable instructions.

[0102] Bus 113 represents one or more of several bus structures, including a memory bus or memory controller, peripheral bus, processor, or local bus using any of the various bus structures.

[0103] The memory 112 may include a readable medium in the form of volatile memory, such as random access memory (RAM) 1121 and / or cache memory 1122, and may further include read-only memory (ROM) 1123.

[0104] The memory 112 may also include a program / utility 1125 having a set (at least one) of program modules 1124, including but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of these examples may include an implementation of a network environment.

[0105] Electronic device 110 can also communicate with one or more external devices 114 (e.g., keyboard, pointing device, etc.), and with one or more devices that enable a user to interact with electronic device 110, and / or with any device that enables electronic device 110 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 115. Furthermore, electronic device 110 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 116. Figure 11 As shown, network adapter 116 communicates with other modules of electronic device 110 via bus 113. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with electronic device 110, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0106] This invention also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of any of the above-described cascaded video conferencing cross-domain polling methods.

[0107] Based on the same inventive concept, this embodiment of the invention also provides a cross-domain polling method for cascaded video conferencing. Since the device corresponding to this method is the first target network-side device in the multi-level cascaded video conferencing system of this embodiment of the invention, and the principle of solving the problem by this method is similar to that of the device, the implementation of this method can refer to the implementation of the system, and the repeated parts will not be described again.

[0108] like Figure 12 As shown, an embodiment of the present invention provides a cross-domain polling method for cascaded video conferencing, applied to a tree-structured cascaded video conferencing system. The method includes the following steps: S1201, The first target network side device receives a polling video stream request carrying a video stream list sent by the second target network side device; S1202, the first target network side device takes the intersection of the video stream list and the video stream request list corresponding to the first target network side device as the target video stream list, so that the second target network side device can obtain the target video stream according to the target video stream list and display it on the corresponding terminal according to the multi-screen rotation layout; Among them, the first target network-side device is a subordinate network-side device directly under the second target network-side device, the video stream list is a list of terminal video streams that the second target network-side device acquires on demand when performing periodic multi-screen rotation, and the video stream request list is a list of video streams corresponding to all directly subordinate and subordinate terminals belonging to the first target network-side device that enter the multi-screen rotation layout of the second target network-side device.

[0109] Optionally, before the first target network-side device receives the first round-robin video stream request carrying the video stream list sent by the second target network-side device, it further includes: After receiving the request to create a conference, the first target network device creates a first home simulation terminal and a first away simulation terminal corresponding to the third target network device. The first target network device configures the corresponding video stream request list for the third target network device based on the participant list, multi-screen rotation layout, and conference system organizational structure carried in the conference creation request; The first target network device sends a conference creation request to the third target network device, so that the third target network device can create a conference at this level according to the conference creation request. The first away simulation terminal is used to obtain the target video stream of the third target network side device according to the target video stream list of the third target network side device, and the first home simulation terminal is used to send the video stream obtained by the first away simulation terminal to the media service of the first target network side device. The third target network side device is a directly subordinate network side device of the first target network side device.

[0110] Optionally, after the first target network device receives the polling video stream request carrying the video stream list sent by the second target network device, before the first target network device uses the intersection of the video stream list and the video stream request list corresponding to the first target network device as the target video stream list, the method further includes: The first target network-side device determines the third target network-side device based on the list of participants and the organizational structure of the conference system; The first target network device determines the target conference number as the corresponding conference number of the third target network device in the cascading conference. The first target network device sends a polling video stream request to the third target network device based on the target conference number.

[0111] Based on the same inventive concept, this embodiment of the invention also provides a cross-domain polling method for cascaded video conferencing. Since the device corresponding to this method is the second target network-side device in the multi-level cascaded video conferencing system of this embodiment of the invention, and the principle of solving the problem by this method is similar to that of the device, the implementation of this method can refer to the implementation of the system, and the repeated parts will not be described again.

[0112] like Figure 13 As shown, this embodiment of the invention also provides a cross-domain polling method for cascaded video conferencing, applied to a tree-network cascaded video conferencing system. The method includes the following steps: S1301. After the second target network side device reaches the polling cycle, it sends a first polling video stream request to the first target network side device, so that the first target network side device can determine the target video stream list according to the video stream list carried in the first polling video stream request and the video stream request list corresponding to the first target network side device. S1302. The second target network side device obtains the target video stream according to the target video stream list and displays it on the corresponding terminal according to the multi-screen rotation layout. Among them, the first target network-side device is a subordinate network-side device directly under the second target network-side device, the video stream list is a list of terminal video streams that the second target network-side device acquires on demand when performing periodic multi-screen rotation, and the video stream request list is a list of video streams corresponding to all directly subordinate and subordinate terminals belonging to the first target network-side device that enter the multi-screen rotation layout of the second target network-side device.

[0113] Optionally, the method further includes: The second target network-side device receives the request to create a conference; The second target network side device is configured with a second home field simulation terminal and a second away field simulation terminal for the first target network side device; The second target network device configures the corresponding video stream request list for the first target network device based on the participant list, multi-screen rotation layout, and conference system organizational structure carried in the conference creation request; The second target network device sends a conference creation request to the first target network device, so that the first target network device can create a conference at this level according to the conference creation request.

[0114] Optionally, the second target network-side device obtains the target video stream according to the target video stream list, including: The second target network-side device obtains the target video stream from the first target network-side device through the second away simulation terminal according to the target video stream list; The second target network side device sends the target video stream of the first target network side device obtained by the second away simulation terminal to the media service of the second target network side device through the second home simulation terminal.

[0115] The present application has been described above with reference to block diagrams and / or flowcharts illustrating methods, apparatus (systems), and / or computer program products according to embodiments of the present application. It should be understood that a block of a block diagram and / or flowchart, as well as combinations of blocks of block diagrams and / or flowcharts, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, and / or other programmable data processing means to produce a machine such that the instructions, executable via the computer processor and / or other programmable data processing means, create methods for implementing the functions / actions specified in the blocks of the block diagrams and / or flowcharts.

[0116] Accordingly, this application can also be implemented using hardware and / or software (including firmware, resident software, microcode, etc.). Furthermore, this application can take the form of a computer program product on a computer-usable or computer-readable storage medium, having computer-usable or computer-readable program code implemented in the medium for use by or in conjunction with an instruction execution system. In the context of this application, a computer-usable or computer-readable medium can be any medium that can contain, store, communicate, transmit, or deliver a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0117] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A cross-domain polling method for cascaded video conferencing, characterized in that, The method, applied to a tree-network cascaded video conferencing system, wherein the tree-network cascaded video conferencing system comprises at least three levels of video conferencing systems, includes: During the meeting creation phase, the first target network device, based on the received meeting creation request, creates corresponding first home simulation terminal and first away simulation terminal for the directly subordinate third target network device, and configures a corresponding video stream request list for the third target network device based on the participant list, multi-screen rotation layout, and meeting system organizational structure in the meeting creation request; the video stream request list is a list of static video streams corresponding to all directly subordinate and subordinate terminals belonging to the first target network device that enter the multi-screen rotation layout of the second target network device. During the polling execution phase, the first target network device receives a polling video stream request carrying a video stream list from the second target network device; the video stream list is a dynamic list generated by the second target network device according to the video streams required for the current polling cycle. The first target network-side device traverses the video stream list and the video stream request list corresponding to the first target network-side device, obtains the intersection of the video stream list and the video stream request list, and generates a target video stream list, so that the second target network-side device obtains the target video stream according to the target video stream list and displays it on the corresponding terminal according to the multi-screen rotation layout; Wherein, the first target network-side device is the network-side device corresponding to any other conferencing system other than the top-level video conferencing system, and the first target network-side device is a subordinate network-side device directly under the second target network-side device.

2. The method as described in claim 1, characterized in that, The first away simulation terminal is used to obtain the target video stream from the third target network side device according to the target video stream list of the third target network side device, and the first home simulation terminal is used to send the video stream obtained by the first away simulation terminal to the media service of the first target network side device. Before the first target network-side device receives the polling video stream request carrying the video stream list sent by the second target network-side device, it further includes: The first target network device sends the create conference request to the third target network device, so that the third target network device creates a local conference according to the create conference request.

3. The method as described in claim 2, characterized in that, After the first target network-side device receives a polling video stream request carrying a video stream list from the second target network-side device, before the first target network-side device uses the intersection of the video stream list and the video stream request list corresponding to the first target network-side device as the target video stream list, the process further includes: The first target network-side device determines the third target network-side device based on the list of participants and the organizational structure of the conference system; The first target network-side device determines the corresponding conference number of the third target network-side device in the cascading conference as the target conference number; The first target network-side device sends the polling video stream request to the third target network-side device according to the target conference number.

4. A method for cross-domain polling in cascading video conferencing, characterized in that, The method, applied to a tree-network cascaded video conferencing system, wherein the tree-network cascaded video conferencing system comprises at least three levels of video conferencing systems, includes: During the meeting creation phase, the second target network device configures a second home simulation terminal and a second away simulation terminal for the first target network device based on the received meeting creation request. It also configures a corresponding video stream request list for the first target network device based on the participant list, multi-screen rotation layout, and meeting system organizational structure carried in the meeting creation request. The video stream request list is a list of static video streams belonging to the first target network device and its direct and subordinate terminals that enter the multi-screen rotation layout of the second target network device. During the polling execution phase, after the second target network-side device reaches the polling cycle, it sends a polling video stream request to the first target network-side device. This allows the first target network-side device to traverse the video stream list carried in the polling video stream request and the video stream request list corresponding to the first target network-side device, obtain the intersection of the video stream list and the video stream request list, and generate a target video stream list. The video stream list is a dynamic list generated by the second target network-side device based on the video streams required for the current polling cycle. The second target network-side device obtains the target video stream according to the target video stream list and displays it on the corresponding terminal according to the multi-screen rotation layout; Wherein, the first target network-side device is the network-side device corresponding to any other conferencing system other than the top-level video conferencing system, and the first target network-side device is a subordinate network-side device directly under the second target network-side device.

5. The method as described in claim 4, characterized in that, Before sending a polling video stream request to the first target network device after the second target network device reaches its polling cycle, the method further includes: The second target network device sends the create meeting request to the first target network device, so that the first target network device creates a local meeting according to the create meeting request.

6. The method as described in claim 5, characterized in that, The second target network-side device obtains the target video stream according to the target video stream list, including: The second target network-side device obtains the target video stream from the first target network-side device through the second away simulation terminal according to the target video stream list; The second target network-side device sends the target video stream of the first target network-side device obtained by the second away simulation terminal to the media service of the second target network-side device through the second home simulation terminal.

7. A cascaded video conferencing cross-domain polling device, characterized in that, This is applied to a tree-structured cascaded video conferencing system, which includes at least three levels of video conferencing systems, including: The first receiving module is configured to, during the meeting creation phase, create corresponding first home simulation terminals and first away simulation terminals for the directly subordinate third target network devices based on the received meeting creation request, and configure a corresponding video stream request list for the third target network devices based on the participant list, multi-screen rotation layout, and meeting system organizational structure in the meeting creation request; the video stream request list is a static video stream list corresponding to all directly subordinate and subordinate terminals of the first target network device that enter the multi-screen rotation layout of the second target network device; during the rotation execution phase, receive a rotation video stream request carrying a video stream list sent by the second target network device; the video stream list is a dynamic list generated by the second target network device according to the video streams required for the current rotation cycle. The determination module is used to traverse the video stream list and the video stream request list corresponding to the first target network side device, obtain the intersection of the video stream list and the video stream request list, and generate a target video stream list, so that the second target network side device can obtain the target video stream according to the target video stream list and display it on the corresponding terminal according to the multi-screen rotation layout; Wherein, the first target network-side device is the network-side device corresponding to any other conferencing system other than the top-level video conferencing system, and the first target network-side device is a subordinate network-side device directly under the second target network-side device.

8. A cascaded video conferencing cross-domain polling device, characterized in that, This is applied to a tree-structured cascaded video conferencing system, which includes at least three levels of video conferencing systems, including: The second receiving module is used to, during the meeting creation phase, configure a second home simulation terminal and a second away simulation terminal for the first target network device based on the received meeting creation request, and configure a corresponding video stream request list for the first target network device based on the participant list, multi-screen rotation layout, and meeting system organizational structure carried in the meeting creation request; the video stream request list is a static video stream list corresponding to all direct and subordinate terminals belonging to the first target network device that enter the multi-screen rotation layout of the second target network device; during the rotation execution phase, after the rotation cycle is reached, a rotation video stream request is sent to the first target network device, so that the first target network device traverses the video stream list carried in the rotation video stream request and the video stream request list corresponding to the first target network device, obtains the intersection of the video stream list and the video stream request list, and generates a target video stream list; the video stream list is a dynamic list generated by the second target network device according to the video streams required for the current rotation cycle; The third receiving module is used to obtain the target video stream according to the target video stream list and display it on the corresponding terminal according to the multi-screen rotation layout; Wherein, the first target network-side device is the network-side device corresponding to any other conferencing system other than the top-level video conferencing system, and the first target network-side device is a subordinate network-side device directly under the second target network-side device.

9. An electronic device, characterized in that, Includes a processor; a memory for storing processor-executable instructions; wherein the processor implements the steps of the cascaded video conferencing cross-domain polling method according to any one of claims 1 to 3, or the steps of the cascaded video conferencing cross-domain polling method according to any one of claims 4 to 6, by executing the executable instructions.

10. A computer-readable storage medium, characterized in that, The device contains a computer program that, when executed by a processor, implements the steps of the cascading video conferencing cross-domain polling method according to any one of claims 1 to 3, or implements the steps of the cascading video conferencing cross-domain polling method according to any one of claims 4 to 6.

Images