Cross-level polling method and device for cascaded video conference and computer equipment

By determining static and dynamic configuration information in the cascading video conferencing system and generating a target video stream request list, the problem of not being able to support multiple cross-level picture patrols in cascading video conferencing is solved, and multiple cross-level picture patrols are realized The need to avoid abnormal screens on the round-trip.

CN118890429APending Publication Date: 2024-11-01ZHEJIANG HUACHUANG VISION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410881040.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-02
Publication Date
2024-11-01

AI Technical Summary

Technical Problem

The cascading video conferencing system cannot support a single conference to conduct multiple cross-level picture round patrols, resulting in multiple layouts conflicting, resulting in abnormality in the round patrols.

Method used

By determining the static configuration information of each level of conference system, including the static video stream request list and static round patrol status, according to the video stream required for each multi-screen fusion layout and the organizational attribution relationship of the conference system, the static configuration information of each level of conference system is determined, including the static video stream request list and the static round patrol status, and determine the static during the conference process. The multi-screen fusion layout of the fusion session is the target layout, and a target video stream request list is generated based on the target layout's requirements list and the real-time round patrol status, and the video stream uplink is controlled according to the static or dynamic round patrol status.

Benefits of technology

It can meet the needs of multi-channel cross-level picture round patrols in cascading video conferencing, avoid abnormalities in round patrols, and ensure the accuracy and stable upward flow of video streams.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118890429A_ABST
    Figure CN118890429A_ABST
Patent Text Reader

Abstract

The invention relates to a cross-level polling method and device for a cascade video conference and computer equipment, and the method comprises the steps: determining a static video stream request list and a static polling state corresponding to each level of conference system according to a video stream needed by each multi-image fusion layout and an organization affiliation relation of each level of conference system; in the conference proceeding process, determining a multi-picture fusion layout for starting the fusion session as a target layout; generating a target video stream request list corresponding to each stage of conference system based on the first layout demand list and the real-time polling state corresponding to each target layout; and controlling the conference system to use the static video stream request list or the target video stream request list to uplink video streams according to the static polling state corresponding to each stage of conference system. According to the method and the device, the problem that a single conference cannot be supported to carry out multi-path cross-level picture polling in the cascade video conference is solved, and the requirement of multi-path cross-level picture polling in the cascade video conference is met.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a cross-level patrol method, device and computer equipment for cascaded video conferencing. Background Art

[0002] In a cascaded video conferencing system, conference systems at all levels are cascaded across domains in a tree-like network. Traditional cascade conferencing only supports single-channel media stream exchange between upper and lower level conference systems. At this time, the lower level can only upload one main video stream to the upper level, which cannot meet complex conference requirements.

[0003] In order to solve the above problems, the existing technology sets the second target network side device to obtain the target video stream from the first target network side device on demand each time according to the multi-screen patrol layout and the conference system organizational structure, realizing the cross-domain multi-screen patrol requirements of multi-level cascade conferences. However, the above method cannot support multi-channel cross-level patrols in a single conference. In the case of multiple patrol screen layouts with different requirements in a conference, multiple layouts conflict with each other, causing abnormalities in all patrol screens.

[0004] With regard to the problem in the related art that cascaded video conferencing cannot support multi-channel cross-level screen tours in a single conference, no effective solution has been proposed yet. Summary of the invention

[0005] In this embodiment, a cross-level patrol method, apparatus and computer equipment for a cascaded video conference are provided to solve the problem in the related art that a cascaded video conference cannot support a single conference to perform multi-channel cross-level screen patrol.

[0006] In a first aspect, a cross-level patrol method for a cascaded video conference is provided in this embodiment, and the method includes:

[0007] According to the video streams required by each multi-screen fusion layout and the organizational affiliation of conference systems at all levels, the static configuration information of each level of the conference system is determined; the static configuration information includes a static video stream request list and a static patrol status corresponding to each level of the conference system;

[0008] During the conference, the multi-screen fusion layout that starts the fusion session is determined as the target layout;

[0009] Based on the first layout requirement list and the real-time patrol status corresponding to each target layout, generating a target video stream request list corresponding to each level of the conference system;

[0010] According to the static patrol state corresponding to each level of the conference system, the conference system is controlled to use the static video stream request list or the target video stream request list to upload the video stream.

[0011] In some embodiments, generating a target video stream request list corresponding to each level of the conference system based on the first layout requirement list corresponding to each target layout and the real-time patrol status includes:

[0012] Determine the dynamic patrol state corresponding to each target layout according to the real-time patrol state of each target layout;

[0013] Generate a first video stream request based on the dynamic patrol state and a first layout requirement list corresponding to each of the target layouts;

[0014] Based on the first video stream request and other currently received video stream requests, a target video stream request list corresponding to each level of the conference system is generated.

[0015] In some embodiments, generating a first video stream request based on the dynamic patrol state and a first layout requirement list corresponding to each of the target layouts includes:

[0016] Acquire a first layout requirement list corresponding to each of the target layouts; the first layout requirement list is used to record multiple video stream synchronization source identifiers required for the target layout;

[0017] De-duplicate and merge the first layout requirement lists to obtain corresponding second layout requirement lists;

[0018] Based on the second layout requirement list and the dynamic patrol status, the first video stream request is generated.

[0019] In some embodiments, generating a target video stream request list corresponding to each level of the conference system based on the first video stream request and other currently received video stream requests includes:

[0020] De-duplication and merging the dynamic video stream list in the first video stream request and the other video stream requests currently received to obtain a first video stream request list;

[0021] Based on the first video stream request list and the dynamic patrol state, generating a corresponding second video stream request;

[0022] When the conference system at each level receives the second video stream request, a target video stream request list corresponding to the conference system is generated according to the second video stream request.

[0023] In some embodiments, when the conference system at each level receives the second video stream request, generating a target video stream request list corresponding to the conference system according to the second video stream request includes:

[0024] When the conference system at each level receives the second video stream request, obtaining the dynamic patrol status in the second video stream request;

[0025] When the dynamic patrol state is patrol on, configuring a target video stream request list corresponding to the conference system according to the first video stream request list in the second video stream request;

[0026] When the dynamic patrol state is closed patrol, the target video stream request list corresponding to the conference system is set to an invalid value.

[0027] In some of the embodiments, determining the dynamic patrol state corresponding to each of the target layouts according to the real-time patrol state of each of the target layouts includes:

[0028] According to the real-time patrol status of each of the target layouts, determining whether any of the target layouts has started patrolling;

[0029] According to the judgment result, the field value corresponding to the dynamic patrol status is updated.

[0030] In some embodiments, controlling the conference system to use the static video stream request list or the target video stream request list to upload the video stream according to the static patrol state corresponding to each level of the conference system includes:

[0031] When the static patrol state corresponding to the conference system is patrol on, controlling the conference system to use the target video stream request list to upload the video stream;

[0032] When the static patrol state corresponding to the conference system is closed patrol, the conference system is controlled to use the static video stream request list to upload the video stream.

[0033] In a second aspect, a cross-level patrol device for cascade video conferencing is provided in this embodiment, and the device includes: a static module, a dynamic module, and a control module;

[0034] The static module is used to determine the static configuration information of each level of the conference system according to the video stream required by each multi-screen fusion layout and the organizational affiliation of the conference systems at each level; the static configuration information includes a static video stream request list and a static patrol status corresponding to each level of the conference system;

[0035] The dynamic module is used to determine the multi-screen fusion layout of the fusion session as the target layout during the conference;

[0036] The dynamic module is further used to generate a target video stream request list corresponding to each level of the conference system based on the first layout requirement list and the real-time patrol status corresponding to each target layout;

[0037] The control module is used to control the conference system to use the static video stream request list or the target video stream request list to upload the video stream according to the static patrol state corresponding to each level of the conference system.

[0038] According to a third aspect, a computer device is provided in this embodiment, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the cross-level patrol method for cascaded video conferencing described in the first aspect is implemented.

[0039] In a fourth aspect, a storage medium is provided in this embodiment, on which a computer program is stored, and when the program is executed by a processor, the cross-level patrol method of the cascaded video conference described in the first aspect is implemented.

[0040] Compared with the related art, the cross-level patrol method, device and computer equipment of cascaded video conferencing provided in this embodiment determine the static configuration information of each level of conference system according to the video stream required for each multi-screen fusion layout and the organizational affiliation of the conference systems at each level; the static configuration information includes the static video stream request list and static patrol status corresponding to each level of conference system; during the conference, the multi-screen fusion layout for starting the fusion session is determined as the target layout; based on the first layout requirement list and real-time patrol status corresponding to each target layout, the target video stream request list corresponding to each level of conference system is generated; further, according to the static patrol status corresponding to each level of conference system, the conference system is controlled to use the static video stream request list or the target video stream request list to upload the video stream, thereby solving the problem that the cascaded video conferencing cannot support a single conference for multi-channel cross-level screen patrol, and realizing the need for multi-channel cross-level screen patrol in the cascaded video conferencing.

[0041] Details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more readily apparent. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0043] Figure 1 It is a hardware structure block diagram of a terminal device of a cross-level patrol method of a cascaded video conference provided in an embodiment of the present application;

[0044] Figure 2 is a flow chart of a cross-level patrol method for cascaded video conferencing provided by an embodiment of the present application;

[0045] Figure 3 It is a schematic diagram of the architecture of a cascade video conferencing system provided in one embodiment of the present application;

[0046] Figure 4 This is a schematic diagram of the architecture of a conference control service for a cascaded video conferencing system provided in one embodiment of the present application;

[0047] Figure 5 This is a schematic diagram of the architecture of a signaling service of a cascaded video conferencing system provided in one embodiment of the present application;

[0048] Figure 6 It is a flow chart of a cross-level patrol method for cascaded video conferencing provided by a preferred embodiment of the present application;

[0049] Figure 7 This is a structural block diagram of a cross-level patrol device for cascaded video conferencing provided in one embodiment of the present application.

[0050] In the figure: 102, processor; 104, memory; 106, transmission device; 108, input and output device; 10, static module; 20, dynamic module; 30, control module. DETAILED DESCRIPTION

[0051] In order to more clearly understand the purpose, technical solutions and advantages of the present application, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments.

[0052] Unless otherwise defined, the technical terms or scientific terms involved in this application shall have the general meaning understood by people with ordinary skills in the technical field to which this application belongs. The words "one", "a", "a", "the", "these" and the like in this application do not represent quantitative restrictions, and they can be singular or plural. The terms "include", "comprise", "have" and any variants thereof involved in this application are intended to cover non-exclusive inclusions; for example, a process, method and system, product or device comprising a series of steps or modules (units) is not limited to the listed steps or modules (units), but may include unlisted steps or modules (units), or may include other steps or modules (units) inherent to these processes, methods, products or devices. The words "connect", "connected", "coupled" and the like involved in this application are not limited to physical or mechanical connections, but may include electrical connections, whether directly or indirectly. The "multiple" involved in this application refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, "A and / or B" can mean: A exists alone, A and B exist at the same time, and B exists alone. Usually, the character " / " indicates that the objects associated with each other are in an "or" relationship. The terms "first", "second", "third", etc. involved in this application are only used to distinguish similar objects and do not represent a specific ordering of the objects.

[0053] The method embodiment provided in this embodiment can be executed in a terminal, a computer or a similar computing device. For example, running on a terminal, Figure 1 FIG. 1 is a hardware structure block diagram of a terminal of the cross-level patrol method of the cascade video conference of this embodiment. Figure 1 As shown, the terminal may include one or more ( Figure 1 Only one is shown in the figure) processor 102 and memory 104 for storing data, wherein processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA. The above terminal may also include a transmission device 106 and an input and output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations shown.

[0054] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the cross-level patrol method of the cascade video conference in this embodiment. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0055] The transmission device 106 is used to receive or send data via a network. The above network includes a wireless network provided by the communication provider of the terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (Radio Frequency, referred to as RF) module, which is used to communicate with the Internet wirelessly.

[0056] In this embodiment, a cross-level patrol method for cascaded video conferences is provided. Figure 2 is a flow chart of the cross-level patrol method of the cascade video conference of this embodiment. Figure 2 As shown, the process includes the following steps:

[0057] Step S210, determining static configuration information of each level of conference system according to the video streams required for each multi-screen fusion layout and the organizational affiliation of each level of conference system; the static configuration information includes a static video stream request list and a static patrol status corresponding to each level of conference system;

[0058] Step S220, during the conference, determining the multi-screen fusion layout for starting the fusion session as the target layout;

[0059] Step S230, generating a target video stream request list corresponding to each level of conference system based on the first layout requirement list corresponding to each target layout and the real-time patrol status;

[0060] Step S240: According to the static patrol state corresponding to each level of conference system, the conference system is controlled to use the static video stream request list or the target video stream request list to upload the video stream.

[0061] Specifically, by using the conference control service of the conference system, according to the organizational tree structure corresponding to the current cascade conference, conference terminals at all levels are selected as needed for layout filling, so as to pre-configure various multi-screen fusion layouts. Among them, the multi-screen fusion layout includes a public multi-screen layout and a terminal custom layout. The public multi-screen layout and the terminal custom layout have different screen requirements. The public multi-screen layout is the multi-screen layout normally used in the meeting, while the terminal custom layout is usually configured by the top-level direct terminal. It can be a multi-screen layout used by monitoring management personnel, etc., and the number is not limited.

[0062] Furthermore, all the populated video stream synchronization source identifiers (Synchronous Source, SSRC) in each multi-screen fusion layout are merged. The synchronization source identifier is used to distinguish video streams from different sources. In combination with the organizational affiliation of conference systems at all levels, a corresponding static video stream request list from lower to upper level is set for the away simulation terminal of each level of conference system. Each static video stream request list contains multiple video stream SSRCs required for the on-demand uplink video stream of the current conference system. At the same time, if there is a multi-screen fusion layout with patrol turned on, add attributes to the away simulation terminal of the corresponding conference system, and set the value of its static patrol state to 1, indicating that there is a patrol in the conference; if there is no multi-screen fusion layout with patrol turned on, add attributes to the away simulation terminal of the corresponding conference system, and set the value of its static patrol state to 0, indicating that there is no patrol in the conference.

[0063] Among them, the conference systems at all levels are conferences with a hierarchical relationship. Each level of unit deploys and maintains its own conference system. At the same time, the units at all levels perform cross-domain cascading based on a tree network to achieve cross-domain multi-level cascade conferences. Based on this, according to the organizational tree structure corresponding to the current cascade conference, the organizational affiliation of the conference systems at all levels is obtained. For example, Figure 3 As shown, the subordinate conferences of the first video conference system include the second video conference system A1 and the second video conference system A2, the subordinates of the second video conference system A1 include the third video conference system A11 and the third video conference system A12, and the subordinates of the second video conference system A2 include the third video conference system A21 and the third video conference system A22. Accordingly, the conference control services of the conference systems at all levels have a superior-subordinate connection relationship, such as Figure 4 As shown, the subordinate conference control services of the first video conferencing system include conference control service B1 of the second video conferencing system and conference control service B2 of the second video conferencing system, the subordinate conference control services of the second video conferencing system B1 include conference control service B11 of the third video conferencing system and conference control service B12 of the third video conferencing system, and the subordinate conference control services of the second video conferencing system B2 include conference control service B21 of the third video conferencing system and conference control service B22 of the third video conferencing system.

[0064] It should be noted that during the conference, the corresponding fusion session can be opened for each multi-screen fusion layout by calling the encoding library interface. Using the media service of the conference system, the multi-screen fusion layout that opens the fusion session is used as the target layout, and the dynamic patrol status corresponding to each target layout is determined according to the real-time patrol status of each target layout. Based on the dynamic patrol status and the first layout requirement list corresponding to each target layout, a first video stream request is generated, and the first video stream request is sent to the signaling service of the conference system.

[0065] Afterwards, the signaling service of the conference system is used to de-duplicate and merge the dynamic video stream list in the first video stream request and other currently received video stream requests to obtain the first video stream request list. Based on the first video stream request list and the dynamic patrol status, the corresponding second video stream request is generated. Then, when each level of the conference system receives the second video stream request, the dynamic patrol status in the second video stream request is obtained. When the dynamic patrol status is on, the target video stream request list corresponding to the conference system is configured according to the first video stream request list in the second video stream request. When the dynamic patrol status is off, the target video stream request list corresponding to the conference system is set to an invalid value. Among them, other video stream requests include but are not limited to video stream requests generated by real-time operations such as roll call, everyone watching the chairman, and preview.

[0066] After the media service triggers the on-demand video stream request, the static patrol state corresponding to the conference system is determined. When the static patrol state corresponding to the conference system is on patrol, it means that the conference has configured patrol, and the conference system is controlled to use the target video stream request list to upload the video stream; when the static patrol state corresponding to the conference system is off patrol, it means that the conference is not currently configured with patrol, and the conference system is controlled to use the static video stream request list to upload the video stream.

[0067] In order to meet the complex conference requirements in the cascaded video conferencing system, the second target network side device is usually set to obtain the target video stream from the first target network side device on demand each time according to the multi-screen patrol layout and the conference system organizational structure, so as to meet the cross-domain multi-screen patrol requirements of the cascaded conference. However, the above method cannot support multi-channel cross-level patrols in a single conference. When there are multiple patrol screen layouts with different requirements in a conference, multiple layouts conflict with each other, which will cause abnormalities in all patrol screens.

[0068] Compared with the prior art, the present application determines the static configuration information of each level of conference system according to the video stream required by each multi-screen fusion layout and the organizational affiliation of each level of conference system; the static configuration information includes the static video stream request list and static patrol status corresponding to each level of conference system; during the conference, the multi-screen fusion layout that starts the fusion session is determined as the target layout; based on the first layout requirement list and real-time patrol status corresponding to each target layout, the target video stream request list corresponding to each level of conference system is generated; further, according to the static patrol status corresponding to each level of conference system, the conference system is controlled to use the static video stream request list or the target video stream request list to upload the video stream. Based on this, by predetermining the static video stream request list and static patrol status of the conference, and during the conference, according to the first layout requirement list and real-time patrol status of the multi-channel multi-screen fusion layout, a target video stream request list is formed, so that the video stream can be uploaded on demand based on the synchronization of static values ​​and dynamic values, which solves the problem that a single conference cannot support multi-channel cross-level screen patrol in cascade video conferences, and realizes that the needs of multi-channel cross-level screen patrol are met in cascade video conferences.

[0069] In some embodiments, generating a target video stream request list corresponding to each level of conference system based on the first layout requirement list corresponding to each target layout and the real-time patrol status in step S230 includes the following steps:

[0070] Step S231, determining the dynamic patrol state corresponding to each target layout according to the real-time patrol state of each target layout;

[0071] Step S232, generating a first video stream request based on the dynamic patrol state and the first layout requirement list corresponding to each target layout;

[0072] Step S233: Generate a target video stream request list corresponding to each level of conference system based on the first video stream request and other currently received video stream requests.

[0073] Specifically, a first layout requirement list corresponding to each target layout is obtained, where the first layout requirement list is used to record multiple video stream synchronization source identifiers and corresponding video stream uplink methods required for the target layout, and each first layout requirement list is de-duplicated and merged to obtain a corresponding second layout requirement list.

[0074] Further, according to the real-time patrol status of each target layout, it is determined whether any target layout in each target layout has patrol enabled. When no target layout has patrol enabled, the field value corresponding to the dynamic patrol status is updated to 0. When any target layout has patrol enabled, the field value corresponding to the dynamic patrol status is updated to 1. Based on the content of the second layout requirement list and the dynamic patrol status, a first video stream request is generated, and the first video stream request is sent to the signaling service of the conference system.

[0075] When the signaling service receives the first video stream request sent by the media service, the dynamic video stream list in the first video stream request is de-duplicated and merged with other currently received video stream requests to obtain the first video stream request list, and the corresponding second video stream request is generated based on the content and dynamic patrol status of the first video stream request list. When each level of the conference system receives the second video stream request, a target video stream request list corresponding to the conference system is generated according to the second video stream request.

[0076] Through this embodiment, the dynamic patrol status corresponding to each target layout is determined according to the real-time patrol status of each target layout, and the first video stream request is generated based on the dynamic patrol status and the first layout requirement list corresponding to each target layout. Based on the first video stream request and other video stream requests currently received, a target video stream request list corresponding to each level of conference system is generated, so as to accurately obtain dynamic patrol information during the meeting.

[0077] In some embodiments, generating a first video stream request based on the dynamic patrol state and the first layout requirement list corresponding to each target layout in step S232 includes the following steps:

[0078] Step S2321, obtaining a first layout requirement list corresponding to each target layout; the first layout requirement list is used to record multiple video stream synchronization source identifiers required for the target layout;

[0079] Step S2322, de-duplication and merge the first layout requirement lists to obtain corresponding second layout requirement lists;

[0080] Step S2323: Generate a first video stream request based on the second layout requirement list and the dynamic patrol status.

[0081] Specifically, when setting any multi-screen fusion layout, the patrol status of the layout is recorded, and the first layout requirement list of the layout is recorded. The first layout requirement list includes multiple video stream SSRCs required by the layout and the corresponding video stream uplink mode. If the layout needs to start patrol, the first layout requirement list of the layout is recorded as an empty list to facilitate on-demand requests during patrol.

[0082] By calling the encoding library interface, the corresponding fusion session is opened for each multi-screen fusion layout. If the fusion session of any terminal custom layout is closed, its patrol status and the first layout requirement list are deleted. When the encoding library processes the multi-screen fusion layout of the fusion patrol, the first layout requirement list of the corresponding layout is updated according to the unique identifier of the fusion session, and the first layout requirement lists are deduplicated and merged to obtain the corresponding second layout requirement list, so as to obtain a complete SSRC list.

[0083] Further, based on the content of the second layout requirement list and the dynamic patrol status, a first video stream request is generated, the first video stream request is a patrol on-demand uplink video stream request, and the first video stream request is sent to the signaling service of the conference system.

[0084] It should be noted that when the encoding library processes the multi-screen fusion layout of fusion patrol, each time a batch of video streams comes to its turn, it triggers an on-demand uplink callback of the patrol video stream, that is, the specific process of issuing the first video stream request mentioned above, and the callback interface includes the unique identifier of the current fusion session and the first layout requirement list of the current layout, and the unique identifier of the fusion session corresponds to the multi-screen fusion layout.

[0085] Among them, when any layout switches from a patrol layout to a non-patrol layout, an on-demand upstream callback event of the patrol video stream is triggered, that is, the first layout requirement list of the non-patrol layout and the first layout requirement list of other target layouts are de-duplicated and merged, and then a first video stream request is issued.

[0086] Through this embodiment, the first layout requirement list corresponding to each target layout is obtained, and the first layout requirement lists are deduplicated and merged to obtain the corresponding second layout requirement list to avoid request conflicts, and based on the second layout requirement list and the dynamic patrol status, an accurate first video stream request is obtained.

[0087] In some embodiments, generating a target video stream request list corresponding to each level of conference system based on the first video stream request and other currently received video stream requests in step S233 includes the following steps:

[0088] Step S2331, de-duplication and merge the dynamic video stream list in the first video stream request and other currently received video stream requests to obtain a first video stream request list;

[0089] Step S2332, based on the first video stream request list and the dynamic patrol state, generating a corresponding second video stream request;

[0090] Step S2333: When each level of conference system receives the second video stream request, a target video stream request list corresponding to the conference system is generated according to the second video stream request.

[0091] Specifically, after receiving the first video stream request sent by the media service, the dynamic video stream list in the first video stream request and other currently received video stream requests are de-duplicated and merged to obtain the first video stream request list, that is, to form a complete and dynamic cross-level video stream on-demand uplink SSRC list. Among them, the dynamic video stream list contains multiple video stream SSRCs required for each target layout and their corresponding video stream uplink modes, and other video stream requests include but are not limited to video stream requests generated by real-time operations such as roll call, all watching the chairman, and preview.

[0092] Further, based on the content of the first video stream request list and the dynamic patrol state in the first video stream request, a corresponding second video stream request is generated, and the dynamic patrol state in the first video stream request is used to indicate whether a patrol currently exists. The second video stream request is distributed to the signaling services of each subordinate conference system, and recursively transmitted to the signaling services of the subordinate and subsequent conference systems step by step.

[0093] For example, Figure 5 As shown, the signaling service C1 of the second video conferencing system and the signaling service C2 of the second video conferencing system are subordinate signaling services of the first video conferencing system, and the signaling service C11 of the third video conferencing system, the signaling service C12 of the third video conferencing system, the signaling service C21 of the third video conferencing system and the signaling service C22 of the third video conferencing system are all subordinate signaling services of the first video conferencing system.

[0094] When each subordinate conference system receives the second video stream request, the dynamic patrol status in the second video stream request is obtained. If the dynamic patrol status is patrol on, the target video stream request list corresponding to the conference system is configured according to the first video stream request list in the second video stream request; if the dynamic patrol status is patrol off, the target video stream request list corresponding to the conference system is set to an invalid value, thereby realizing the configuration of the target video stream request list.

[0095] Through this embodiment, the dynamic video stream list in the first video stream request and other currently received video stream requests are de-duplicated and merged to obtain a first video stream request list. Based on the first video stream request list and the dynamic patrol status, a corresponding second video stream request is generated. When each level of the conference system receives the second video stream request, a target video stream request list corresponding to the conference system is generated according to the second video stream request, thereby achieving accurate configuration of the target video stream request list.

[0096] In some embodiments, when each level of conference system receives the second video stream request, generating a target video stream request list corresponding to the conference system according to the second video stream request in step S2333 includes the following steps:

[0097] When each level of conference system receives the second video stream request, obtaining the dynamic patrol status in the second video stream request;

[0098] When the dynamic patrol state is patrol on, configuring a target video stream request list corresponding to the conference system according to the first video stream request list in the second video stream request;

[0099] When the dynamic patrol state is closed, the target video stream request list corresponding to the conference system is set to an invalid value.

[0100] Specifically, when each subordinate conference system receives the second video stream request, it obtains the dynamic patrol state and the first video stream request list in the second video stream request, and determines whether it is in the patrol state according to the field value of the dynamic patrol state.

[0101] Among them, when the field value of the dynamic patrol status is 1, it means that it is in patrol, and the value of the target video stream request list is updated using the first video stream request list in the second video stream request; when the field value of the dynamic patrol status is 0, it means that the patrol has stopped, and the target video stream request list is set to an invalid value.

[0102] Through this embodiment, when each level of the conference system receives a second video stream request, the dynamic patrol status in the second video stream request is obtained. When the dynamic patrol status is patrol on, the target video stream request list corresponding to the conference system is configured according to the first video stream request list in the second video stream request. When the dynamic patrol status is patrol off, the target video stream request list corresponding to the conference system is set to an invalid value. In this way, combined with the dynamic patrol status, the configuration of the target video stream request list is completed, thereby improving the accuracy of the on-demand uplink video stream during dynamic patrol.

[0103] In some embodiments, determining the dynamic patrol state corresponding to each target layout according to the real-time patrol state of each target layout in step S231 includes the following steps:

[0104] Step S2312, judging whether any target layout among the target layouts has started patrolling according to the real-time patrolling status of each target layout;

[0105] Step S2313: Update the field value corresponding to the dynamic patrol status according to the judgment result.

[0106] Specifically, determine whether any target layout in each target layout has patrol enabled. When no target layout has patrol enabled, update the field value corresponding to the dynamic patrol status to 0. When any target layout has patrol enabled, update the field value corresponding to the dynamic patrol status to 1.

[0107] It should be noted that if patrol is turned on in the terminal custom layout, the corresponding conference terminal requests a video stream, which will trigger the request for video stream to the patrolled terminal to be cleared, which means that the terminal does not request any video stream in the custom layout, so that the on-demand request for video stream can be triggered through the media service, thereby entering the on-demand uplink logic of the patrol.

[0108] Through this embodiment, according to the real-time patrol status of each target layout, it is determined whether any target layout in each target layout has patrol enabled, and according to the determination result, the field value corresponding to the dynamic patrol status is updated to obtain an accurate real-time patrol status.

[0109] In some embodiments, in step S240, according to the static patrol state corresponding to each level of conference system, controlling the conference system to use the static video stream request list or the target video stream request list to upload the video stream includes the following steps:

[0110] Step S241, when the static patrol state corresponding to the conference system is patrol on, control the conference system to use the target video stream request list to upload the video stream;

[0111] Step S242: When the static patrol state corresponding to the conference system is closed patrol, the conference system is controlled to use the static video stream request list to upload the video stream.

[0112] Specifically, the static patrol status of each level of conference terminals is determined. If the static patrol status is turned on, indicating that the conference is configured with patrol, the conference terminal is controlled to use the target video stream request list for uplink video stream. If the static patrol status is turned off, indicating that the conference is not currently configured with patrol, the conference terminal is controlled to use the static video stream request list for uplink video stream.

[0113] Among them, when the static patrol state is turned on, if it is detected that the target video stream request list has not been configured by the second video stream request, an empty list is used to upload the video stream, and the top-level conference terminal is waited to trigger the second video stream request to configure the target video stream request list.

[0114] Through this embodiment, when the static patrol state corresponding to the conference system is patrol on, the conference system is controlled to use the target video stream request list to upload the video stream, and when the static patrol state corresponding to the conference system is patrol off, the conference system is controlled to use the static video stream request list to upload the video stream, so that according to the current conference static patrol state, the accurate video stream request list can be selected to upload the video stream on demand, avoiding conflicts between patrol screen layouts of different channels, resulting in abnormalities in each patrol screen, so as to meet the requests for on-demand upstream video streams of multiple cross-level patrol screen layouts.

[0115] The present embodiment is described and illustrated below through preferred embodiments.

[0116] Figure 6 is a flow chart of the cross-level patrol method of the cascade video conference of the preferred embodiment, such as Figure 6 As shown, the cross-level patrol method of the cascade video conference includes the following steps:

[0117] Step S610, determining static configuration information of each level of conference system according to the video streams required for each multi-screen fusion layout and the organizational affiliation of each level of conference system; the static configuration information includes a static video stream request list and a static patrol status corresponding to each level of conference system;

[0118] Step S620, during the conference, according to the real-time patrol status of each target layout, determine the dynamic patrol status corresponding to each target layout;

[0119] Step S630, generating a first video stream request based on the dynamic patrol state and the first layout requirement list corresponding to each target layout;

[0120] Step S640, generating a target video stream request list corresponding to each level of conference system based on the first video stream request and other currently received video stream requests;

[0121] Step S650, when the static patrol state corresponding to the conference system is patrol on, controlling the conference system to use the target video stream request list to upload the video stream;

[0122] Step S660: When the static patrol state corresponding to the conference system is closed patrol, the conference system is controlled to use the static video stream request list to upload the video stream.

[0123] Through this embodiment, according to the video streams required by each multi-screen fusion layout and the organizational affiliation of conference systems at all levels, the static video stream request list and static patrol status of each level of conference system are determined. During the conference, according to the real-time patrol status of each target layout, the dynamic patrol status corresponding to each target layout is determined, and based on the dynamic patrol status and the first layout requirement list corresponding to each target layout, the first video stream request is generated, and based on the first video stream request and other currently received video stream requests, the target video stream request list corresponding to each level of conference system is generated, so as to accurately obtain the dynamic patrol information during the conference.

[0124] Furthermore, when the static patrol state corresponding to the conference system is patrol on, the conference system is controlled to use the target video stream request list to upload the video stream. When the static patrol state corresponding to the conference system is patrol off, the conference system is controlled to use the static video stream request list to upload the video stream. This solves the problem that cascaded video conferencing cannot support multi-channel cross-level screen patrol for a single conference, and realizes the need for multi-channel cross-level screen patrol in cascaded video conferencing.

[0125] It should be noted that the steps shown in the above process or the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0126] In this embodiment, a cross-level patrol device for cascade video conferencing is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and will not be repeated hereafter. The terms "module", "unit", "subunit", etc. used below may be a combination of software and / or hardware that implements predetermined functions. Although the devices described in the following embodiments are preferably implemented in software, the implementation in hardware, or a combination of software and hardware, is also possible and conceivable.

[0127] Figure 7 : is a structural block diagram of the cross-level patrol device of the cascade video conference of this embodiment, such as Figure 7 As shown, the device includes: a static module 10, a dynamic module 20 and a control module 30;

[0128] The static module 10 is used to determine the static configuration information of each level of conference system according to the video stream required by each multi-screen fusion layout and the organizational affiliation of each level of conference system; the static configuration information includes a static video stream request list and a static patrol status corresponding to each level of conference system;

[0129] The dynamic module 20 is used to determine the multi-screen fusion layout for starting the fusion session as the target layout during the conference;

[0130] The dynamic module 20 is further used to generate a target video stream request list corresponding to each level of conference system based on the first layout requirement list corresponding to each target layout and the real-time patrol status;

[0131] The control module 30 is used to control the conference system to use the static video stream request list or the target video stream request list to upload the video stream according to the static patrol state corresponding to each level of the conference system.

[0132] Through this embodiment, the static configuration information of each level of conference system is determined according to the video streams required for each multi-screen fusion layout and the organizational affiliation of the conference systems at each level; the static configuration information includes the static video stream request list and static patrol status corresponding to each level of conference system; during the conference, the multi-screen fusion layout for starting the fusion session is determined as the target layout; based on the first layout requirement list and the real-time patrol status corresponding to each target layout, the target video stream request list corresponding to each level of conference system is generated; further, according to the static patrol status corresponding to each level of conference system, the conference system is controlled to use the static video stream request list or the target video stream request list for uplink video stream, which solves the problem that a single conference cannot support multi-channel cross-level screen patrol in cascaded video conferencing, and realizes that the needs of multi-channel cross-level screen patrol are met in cascaded video conferencing.

[0133] In some of the embodiments, the dynamic module 20 is further used to determine the dynamic patrol status corresponding to each target layout based on the real-time patrol status of each target layout; generate a first video stream request based on the dynamic patrol status and the first layout requirement list corresponding to each target layout; and generate a target video stream request list corresponding to each level of conference system based on the first video stream request and other video stream requests currently received.

[0134] In some of the embodiments, the dynamic module 20 is also used to obtain a first layout requirement list corresponding to each target layout; the first layout requirement list is used to record multiple video stream synchronization source identifiers required for the target layout; the first layout requirement lists are de-duplicated and merged to obtain a corresponding second layout requirement list; and a first video stream request is generated based on the second layout requirement list and the dynamic patrol status.

[0135] In some of the embodiments, the dynamic module 20 is also used to de-duplicate and merge the dynamic video stream list in the first video stream request and other currently received video stream requests to obtain a first video stream request list; generate a corresponding second video stream request based on the first video stream request list and the dynamic patrol status; when each level of the conference system receives the second video stream request, generate a target video stream request list corresponding to the conference system according to the second video stream request.

[0136] In some of the embodiments, the dynamic module 20 is also used to obtain the dynamic patrol status in the second video stream request when each level of the conference system receives the second video stream request; when the dynamic patrol status is on patrol, configure the target video stream request list corresponding to the conference system according to the first video stream request list in the second video stream request; when the dynamic patrol status is off patrol, set the target video stream request list corresponding to the conference system to an invalid value.

[0137] In some of the embodiments, the dynamic module 20 is further used to determine whether any target layout among the target layouts has patrol enabled according to the real-time patrol status of each target layout; and update the field value corresponding to the dynamic patrol status according to the determination result.

[0138] In some of the embodiments, the control module 30 is also used to control the conference system to use the target video stream request list for uplink video stream when the static patrol state corresponding to the conference system is patrol on; and to control the conference system to use the static video stream request list for uplink video stream when the static patrol state corresponding to the conference system is patrol off.

[0139] It should be noted that the above modules can be functional modules or program modules, and can be implemented by software or hardware. For modules implemented by hardware, the above modules can be located in the same processor; or the above modules can be located in different processors in any combination.

[0140] In this embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0141] Optionally, the computer device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0142] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:

[0143] S1, according to the video streams required by each multi-screen fusion layout and the organizational affiliation of conference systems at each level, determine the static configuration information of each level of conference system; the static configuration information includes a static video stream request list and a static patrol status corresponding to each level of conference system;

[0144] S2, during the conference, determining the multi-screen fusion layout of the fusion session as the target layout;

[0145] S3, generating a target video stream request list corresponding to each level of conference system based on the first layout requirement list corresponding to each target layout and the real-time patrol status;

[0146] S4, according to the static patrol status corresponding to each level of conference system, control the conference system to use the static video stream request list or the target video stream request list to upload the video stream.

[0147] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementation modes, and will not be repeated in this embodiment.

[0148] In addition, in combination with the cross-level patrol method for cascaded video conferences provided in the above embodiments, a storage medium can also be provided in this embodiment to implement the method. The storage medium stores a computer program; when the computer program is executed by a processor, any cross-level patrol method for cascaded video conferences in the above embodiments is implemented.

[0149] It should be understood that the specific embodiments described herein are only used to explain the application, rather than to limit it. Based on the embodiments provided in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the protection scope of this application.

[0150] Obviously, the drawings are only some examples or embodiments of the present application. For ordinary technicians in the field, the present application can also be applied to other similar situations based on these drawings without creative work. In addition, it is understandable that although the work done in this development process may be complicated and lengthy, for ordinary technicians in the field, certain changes in design, manufacturing or production based on the technical content disclosed in this application are only conventional technical means and should not be regarded as insufficient content disclosed in this application.

[0151] The term "embodiment" in this application refers to a specific feature, structure or characteristic described in conjunction with the embodiment that can be included in at least one embodiment of the present application. The appearance of this phrase in various locations in the specification does not necessarily mean the same embodiment, nor does it mean that it is mutually exclusive with other embodiments and is independent or optional. It is clearly or implicitly understood by those of ordinary skill in the art that the embodiments described in this application can be combined with other embodiments without conflict.

[0152] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of patent protection. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the scope of protection of the present application. Therefore, the scope of protection of the present application shall be subject to the attached claims.

Claims

1. A cross-level patrol method for cascaded video conferencing, characterized in that: The method comprises: According to the video streams required by each multi-screen fusion layout and the organizational affiliation of conference systems at all levels, the static configuration information of each level of the conference system is determined; the static configuration information includes a static video stream request list and a static patrol status corresponding to each level of the conference system; During the conference, the multi-screen fusion layout that starts the fusion session is determined as the target layout; Based on the first layout requirement list and the real-time patrol status corresponding to each target layout, generating a target video stream request list corresponding to each level of the conference system; According to the static patrol state corresponding to each level of the conference system, the conference system is controlled to use the static video stream request list or the target video stream request list to upload the video stream.

2. The cross-level patrol method of cascade video conferencing according to claim 1 is characterized in that: The generating of a target video stream request list corresponding to each level of the conference system based on the first layout requirement list corresponding to each target layout and the real-time patrol status includes: Determine the dynamic patrol state corresponding to each target layout according to the real-time patrol state of each target layout; Generate a first video stream request based on the dynamic patrol state and a first layout requirement list corresponding to each of the target layouts; Based on the first video stream request and other currently received video stream requests, a target video stream request list corresponding to each level of the conference system is generated.

3. The cross-level patrol method of cascade video conferencing according to claim 2 is characterized in that: The generating a first video stream request based on the dynamic patrol state and a first layout requirement list corresponding to each of the target layouts includes: Acquire a first layout requirement list corresponding to each of the target layouts; the first layout requirement list is used to record multiple video stream synchronization source identifiers required for the target layout; De-duplicate and merge the first layout requirement lists to obtain corresponding second layout requirement lists; Based on the second layout requirement list and the dynamic patrol status, the first video stream request is generated.

4. The cross-level patrol method of cascade video conferencing according to claim 2 is characterized in that: The generating, based on the first video stream request and other currently received video stream requests, a target video stream request list corresponding to each level of the conference system comprises: De-duplication and merging the dynamic video stream list in the first video stream request and the other video stream requests currently received to obtain a first video stream request list; Based on the first video stream request list and the dynamic patrol state, generating a corresponding second video stream request; When the conference system at each level receives the second video stream request, a target video stream request list corresponding to the conference system is generated according to the second video stream request.

5. The cross-level patrol method of cascade video conferencing according to claim 4 is characterized in that: When the conference system at each level receives the second video stream request, generating a target video stream request list corresponding to the conference system according to the second video stream request includes: When the conference system at each level receives the second video stream request, obtaining the dynamic patrol status in the second video stream request; When the dynamic patrol state is patrol on, configuring a target video stream request list corresponding to the conference system according to the first video stream request list in the second video stream request; When the dynamic patrol state is closed patrol, the target video stream request list corresponding to the conference system is set to an invalid value.

6. The cross-level patrol method of cascade video conferencing according to claim 2, characterized in that: Determining the dynamic patrol state corresponding to each target layout according to the real-time patrol state of each target layout includes: According to the real-time patrol status of each of the target layouts, determining whether any of the target layouts has started patrolling; According to the judgment result, the field value corresponding to the dynamic patrol status is updated.

7. The cross-level patrol method of cascade video conferencing according to claim 1, characterized in that: The method of controlling the conference system to use the static video stream request list or the target video stream request list to upload the video stream according to the static patrol state corresponding to each level of the conference system includes: When the static patrol state corresponding to the conference system is patrol on, controlling the conference system to use the target video stream request list to upload the video stream; When the static patrol state corresponding to the conference system is closed patrol, the conference system is controlled to use the static video stream request list to upload the video stream.

8. A cross-level patrol device for cascade video conferencing, characterized in that: The device comprises: a static module, a dynamic module and a control module; The static module is used to determine the static configuration information of each level of the conference system according to the video stream required by each multi-screen fusion layout and the organizational affiliation of the conference systems at each level; the static configuration information includes a static video stream request list and a static patrol status corresponding to each level of the conference system; The dynamic module is used to determine the multi-screen fusion layout of the fusion session as the target layout during the conference; The dynamic module is further used to generate a target video stream request list corresponding to each level of the conference system based on the first layout requirement list and the real-time patrol status corresponding to each target layout; The control module is used to control the conference system to use the static video stream request list or the target video stream request list to upload the video stream according to the static patrol state corresponding to each level of the conference system.

9. A computer device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps of the cross-level patrol method for cascaded video conferencing according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the cross-level patrol method for cascaded video conferencing described in any one of claims 1 to 7 are implemented.