MCU resource scheduling system and scheduling method for multi-platform video conference
Through adaptive resource reservation, cross-platform resource pool, heterogeneous platform adaptation and dynamic scheduling algorithms, the complexity of resource seizing and cross-platform scheduling of video conferencing platforms is solved, ensuring the stable operation and resource utilization efficiency of important-level meetings.
Patent Information
- Application Number
- CN202411122759.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-15
- Publication Date
- 2024-12-06
AI Technical Summary
The existing video conferencing platform has resource preemption problems when it comes to high concurrency and multi-type conference needs, and cannot effectively respond to resource guarantees for important meetings. The MCU resource specifications and interface protocols of different platforms are heterogeneous, resulting in the complexity of cross-platform resource scheduling and difficulty.
Adaptive resource reservation module, cross-platform resource pool module, heterogeneous platform adaptation module and dynamic scheduling algorithm module are adopted to generate resource reservation strategies based on the conference level, build heterogeneous MCU resource pools, determine standardized communication interfaces, and dynamically pass The scheduling algorithm implements MCU resource scheduling.
It solves the problem of uneven resource allocation and scheduling of video conferencing platforms, ensures the stable operation of important-level conferences, and improves the stability and resource utilization efficiency of video conferencing.
Smart Images

Figure CN119094691A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of video communication technology, and in particular to an MCU resource scheduling system and scheduling method for multi-platform video conferencing. Background Art
[0002] At present, with the growing demand for remote collaboration, video conferencing has become an important tool for daily work. Existing technologies work well on a single video conferencing platform and can basically meet the resource scheduling needs of general meetings.
[0003] However, when facing the needs of high-concurrency and multi-type meetings, existing video conferencing platforms often have the problem of resource grabbing, especially in terms of resource guarantee for important meetings, which leads to a decline in the experience of important meetings due to insufficient resources. In addition, when conducting video conferencing on multiple platforms, the resources of each video conferencing platform are relatively independent, and it is impossible to effectively respond to the need to call resources from other platforms when resources on a single platform are tight. In addition, different video conferencing platforms have heterogeneous compatibility, and the MCU resource specifications and interface protocols between different platforms are different, which leads to the complexity and difficulty of cross-platform resource scheduling.
[0004] In summary, current video conferencing has technical problems such as uneven resource allocation and scheduling on different video platforms, resulting in the lack of operational guarantees for important-level meetings. Summary of the invention
[0005] In view of this, the embodiments of the present application provide an MCU resource scheduling system and scheduling method and system for multi-platform video conferencing, which solves the technical problem of uneven resource allocation and scheduling in current video conferencing on different video platforms.
[0006] In the first aspect, the present application provides an MCU resource dynamic scheduling system for a video conferencing platform, which adopts the following technical solutions: An adaptive resource reservation module, used to generate a resource reservation strategy according to the conference level of the target conference, wherein the resource reservation strategy is used to start the target conference; A cross-platform resource pool module, used to build an MCU resource pool according to heterogeneous MCU resources of different video conferencing platforms in the target conference; A heterogeneous platform adaptation module, used for determining a standardized communication interface according to MCU resource differences of the heterogeneous MCU resources; The dynamic scheduling algorithm module is used to perform MCU resource scheduling on the MCU resource pool through the standardized communication interface according to the real-time MCU resource demand of the target conference.
[0007] Optionally, the system further includes: A component compatibility testing module, used to verify the compatibility of the different video conferencing platforms and determine which compatible video conferencing platforms can enter the target conference; The coordination protocol module is used to determine the communication rules and operation procedures for the heterogeneous platform adaptation module to schedule the target MCU resources.
[0008] Optionally, the adaptive resource reservation module includes: A conference level identification submodule, used to determine the conference level according to the conference attributes of the target conference; The resource reservation strategy submodule allocates and locks necessary MCU resources for the target conference according to the conference level.
[0009] Optionally, the dynamic scheduling algorithm module includes: A real-time monitoring submodule, used to monitor the usage of all MCU resources of the different video conferencing platforms; The resource matching submodule is used to determine the optimal resource scheduling solution for the target conference according to the usage of all MCU resources.
[0010] Optionally, the heterogeneous platform adaptation module is a group of API interfaces and middleware, and the group of API interfaces and the middleware are used to shield the differences in MCU resources of the different video conferencing platforms, thereby realizing the calling of the heterogeneous MCU resources on the different video conferencing platforms.
[0011] In a second aspect, the present application provides a method for dynamic scheduling of MCU resources for a video conferencing platform, the method comprising: Generating a resource reservation policy according to the conference level of the target conference, wherein the resource reservation policy is used to start the target conference; Building an MCU resource pool according to heterogeneous MCU resources of different video conferencing platforms in the target conference; Determining a standardized communication interface according to MCU resource differences of the heterogeneous MCU resources; According to the real-time MCU resource demand of the target conference, MCU resource scheduling is performed on the MCU resource pool through the standardized communication interface.
[0012] Optionally, generating a resource reservation strategy according to the conference level of the target conference includes: When the conference level is a common conference, the MCU resource margin of the target conference video platform is obtained, and when the MCU resource margin meets the MCU resource requirement of the target conference, the MCU resource margin is locked and reserved; When the conference level is greater than the ordinary conference, necessary MCU resources are determined according to conference attributes, and the necessary MCU resources are locked and reserved through the adaptive resource module.
[0013] Optionally, performing MCU resource scheduling on the MCU resource pool through the standardized communication interface according to the real-time MCU resource demand of the target conference includes: Acquire a first idle MCU resource in the MCU resource pool; When the idle MCU resources are less than the real-time MCU resource demand, the largest idle MCU resource platform among the different video conferencing platforms is acquired in real time, and the largest MCU idle resource platform is scheduled to supplement the MCU resource pool with resources to obtain a second idle MCU resource; When the second idle MCU resources meet the real-time MCU resource requirements, the second idle MCU resources are scheduled through the standardized communication interface.
[0014] In a third aspect, the present application provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method for dynamic scheduling of MCU resources for a video conferencing platform when executing the computer program.
[0015] In a fourth aspect, the present application provides a computer-readable storage medium, including a computer program, which, when executed by a processor, implements the steps of the method for dynamic scheduling of MCU resources for a video conferencing platform.
[0016] The present application provides a MCU resource dynamic scheduling system for a video conferencing platform, including: an adaptive resource reservation module, a cross-platform resource pool module, a heterogeneous platform adaptation module, and a dynamic scheduling algorithm module, and executes the method: according to the target conference level, determine the resource reservation strategy of the target conference; according to the heterogeneous MCU resources of different video conferencing platforms, build a heterogeneous MCU resource pool; according to the technical differences of heterogeneous MCU resources, obtain a standardized communication interface; according to the dynamic scheduling algorithm, determine the target scheduling MCU resources, and schedule the target scheduling MCU resources in real time according to the standardized communication interface. It solves the technical problem of uneven resource allocation and scheduling in different video platforms of current video conferencing, ensures the stable operation of important level meetings, and improves the stability of video conferencing. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 A system architecture diagram of a MCU resource dynamic scheduling system for a video conferencing platform shown in an embodiment of the present application; Figure 2A schematic diagram of a flow chart of a method for dynamically scheduling MCU resources for a video conferencing platform according to an embodiment of the present application; Figure 3 A schematic diagram of the target conference determination process shown in an embodiment of the present application; Figure 4 A schematic diagram of the structure of an electronic device shown in an embodiment of the present application; DETAILED DESCRIPTION The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations comprising one or more of the listed items.
[0018] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.
[0019] The independent MCU resource management system of the existing traditional video conferencing platform includes a conference management module: responsible for the creation, reservation, modification, cancellation and other functions of the conference, directly interacting with the user interface, receiving and processing user meeting requests. MCU resource management module: manages the MCU resources within a single video conferencing platform, including resource statistics, allocation, and recycling. This module is closely integrated with the conference management module and allocates appropriate MCU resources to it according to conference requirements. User terminal module: includes various types of client applications (such as desktop and mobile applications), and users join the conference through these terminals. The user terminal interacts with the conference management module through the network communication interface to obtain conference information and access addresses.
[0020] Among them, the conference management module: as the center of the system, it is responsible for processing all conference-related operations initiated by users, judging the conference level, expected number of participants, etc. based on the information input by users, and providing a basis for subsequent resource allocation. MCU resource management module: according to the conference demand information provided by the conference management module, allocate appropriate resources from the local MCU resource pool to the designated conference. After the meeting, it is responsible for recycling the allocated resources. This module does not have cross-platform resource scheduling capabilities. User terminal module: provides users with a convenient way to access conferences, supporting audio, video, screen sharing and other functions. The user terminal connects to the allocated MCU resources through the conference information provided by the conference management module to achieve audio and video exchanges with other participants.
[0021] The existing technology works well on a single video conferencing platform and can basically meet the resource scheduling needs of general meetings. However, it has the following significant shortcomings and deficiencies: 1. The MCU resources of each video conferencing platform are managed independently, and there is a lack of effective cross-platform resource sharing mechanism. When the internal resources of a platform are tight, it is impossible to mobilize resources from other platforms to cope with sudden large-scale or important-level conference needs, resulting in a decline in conference service quality or even the inability to hold conferences.
[0022] 2. Existing technologies usually allocate resources on a first-come, first-served basis, without making special arrangements for important meetings. In high-concurrency situations, important meetings may not be able to obtain sufficient MCU support because their resources are preempted by low-priority meetings, affecting meeting quality and participant experience.
[0023] 3. Different video conferencing platforms have different MCU resource specifications and interface protocols, and it is technically difficult to directly perform cross-platform resource scheduling. Existing technologies do not solve this problem and cannot achieve seamless heterogeneous platform resource mobilization.
[0024] 4. Faced with rapid changes in resource demands, existing technologies lack real-time monitoring and dynamic scheduling capabilities and cannot quickly adjust resource allocation based on real-time resource utilization and conference demands, resulting in low resource utilization efficiency and slow response speed.
[0025] In the present application, the above-mentioned corresponding technical problems are solved.
[0026] See also Figure 1 As shown, it is a system framework diagram of an MCU resource scheduling system for multi-platform video conferencing shown in an embodiment of the present application.
[0027] S11, an adaptive resource reservation module, used to generate a resource reservation policy according to the conference level of a target conference, wherein the resource reservation policy is used to start the target conference.
[0028] Among them, the meeting level of the target meeting is divided into ordinary meeting, important meeting, emergency meeting and special meeting; the resource reservation strategy refers to the strategy of pre-allocating and locking the necessary MCU resources for the target meeting according to the meeting level of the target meeting, and is set to ordinary resource reservation strategy, important resource reservation strategy, emergency resource reservation strategy and special resource reservation strategy corresponding to the meeting level. Different resource reservation strategies allocate different MCU resources for MCU resources, where MCU resources refer to the hardware resources and software resources used to realize audio and video communications on different video conferencing platforms.
[0029] In the conference reservation stage, the conference level of the target conference is determined according to the target conference reserved by the user. In the adaptive resource module, there is a resource reservation strategy submodule, which can obtain the resource reservation strategy in the preset resource strategy matching library according to the conference level.
[0030] In the above embodiment, through the adaptive resource reservation module, resources are reserved in the conference reservation stage to meet the resource requirements of different conference types, avoiding the problem of the target conference being delayed or unable to start normally due to insufficient resources when starting. And the reserved resources are dynamically allocated according to the conference level of the target conference, and more MCU resources are allocated to high-level conferences, so as to avoid the high-level conference being affected by the resource preemption of other low-priority conferences when the system is running multiple conferences at the same time, thereby ensuring the conference quality of high-level conferences.
[0031] In an optional embodiment, the adaptive resource reservation module includes: A conference level identification submodule, used to determine the conference level according to the conference attributes of the target conference; The resource reservation strategy submodule allocates and locks necessary MCU resources for the target conference according to the conference level.
[0032] Among them, the meeting attributes include the level of participants, the number of participants, the meeting theme, and the scheduled time. In the meeting level identification submodule, these meeting attributes will be preset to different importance levels. Different weights are pre-set based on the level of participants, the number of participants, the meeting theme, and the scheduled time to determine the meeting level. When any of the meeting attributes reaches the highest attribute, for example, the participant level is the top management level, the target meeting will be defined as an emergency meeting. When the meeting attributes involve special needs, the target meeting will be defined as a special meeting.
[0033] In the reserved resource strategy submodule, the necessary MCU resources pre-set according to the conference level can be reserved to generate a reserved resource strategy. For example, when the target conference is an ordinary conference, the ordinary resource reservation strategy is implemented, and only the MCU resources that are just enough to support the start of the ordinary conference are allocated and reserved for the target conference in the system; when the target conference is an important conference, the important resource reservation strategy is implemented, including reserving more MCU resources in advance to ensure that when the important conference is started, it is sufficient to support higher traffic and the number of conference participants; when the target conference is an emergency conference, the emergency resource reservation strategy is implemented to immediately lock a large number of MCU resources and dedicated bandwidth channels and backup servers, etc., to ensure that the emergency conference can be started in the shortest time and remain stable to cope with the high traffic and high bandwidth requirements in emergency situations; when the target conference is a special conference, some special resources are reserved based on the specific needs of the special conference, such as special security measures, encrypted communications, and server deployment in specific geographical locations.
[0034] In the above embodiment, through the conference level identification submodule, the conference level can be intelligently determined, the important level conference can be accurately judged, and it can be ensured that it obtains priority in resource allocation, avoiding the impact of important conferences due to resource preemption, and improving the service quality and stability of high-level conferences. Through the reserved resource strategy submodule, resources are reserved at the conference reservation stage, avoiding delays or service quality degradation caused by insufficient resources at the beginning of the meeting, and enhancing the planning of the conference organizer and the comfort of the participants.
[0035] S12, a cross-platform resource pool module, is used to build an MCU resource pool according to the heterogeneous MCU resources of different video conferencing platforms in the target conference.
[0036] Among them, heterogeneous MCU resources refer to MCU resources with different structures and characteristics on different video conferencing platforms. The heterogeneity of different video conferencing platforms is mainly reflected in hardware configuration, number of channels, supported video codec formats, etc. The MCU resource pool refers to the database in the system used to store MCU resources of different video conferencing platforms.
[0037] When the target meeting is in progress, the cross-platform resource pool module will obtain information from different conference video conferencing platforms, such as Huawei SMC (Smart Meeting Collaboration, an enterprise-level video conferencing platform), ZOOM (China-US Video) or other platforms, and send the corresponding request MCU resource information based on the platform type. After passing, it will call the corresponding interface to obtain the MCU resource information, and standardize the corresponding MCU resource information and store it in the MCU resource pool.
[0038] In the above embodiment, heterogeneous MCU resources of different video conferencing platforms are obtained through a cross-platform resource pool module, and a heterogeneous MCU resource pool is constructed, which can break the platform barriers of different video conferencing platforms, solve the isolated state of resources of a single video conferencing platform, and realize global management and flexible scheduling of resources.
[0039] S13, a heterogeneous platform adaptation module, used to determine a standardized communication interface according to the MCU resource differences of the heterogeneous MCU resources.
[0040] The heterogeneous platform adaptation module analyzes the characteristics of the heterogeneous MCU resources of different video conferencing platforms to obtain the differences in their communication protocols, data formats, interface specifications, etc. According to the results of the characteristic analysis of these different video conferencing platforms, the communication protocols and data formats of different video conferencing platforms are converted or parsed and reorganized to ensure smooth communication between different platforms. A unified interface standard is designed to obtain a standardized communication interface so that the heterogeneous MCU resources of different video conferencing platforms can be accessed and called in the same way through the standardized communication interface.
[0041] In the above embodiment, through the heterogeneous platform adaptation module, seamless access and calling of cross-platform resources can be achieved, the complexity of cross-platform resource scheduling is simplified, and the technical threshold for adding or integrating other video conferencing platforms to the target conference is reduced. Through the heterogeneous platform adaptation module, the system can easily cope with the complex environment of multiple platforms, multiple devices, and multiple protocols, enhance the flexibility and scalability of the overall system, and adapt to the development trend of the future video conferencing market.
[0042] In an optional embodiment, the heterogeneous platform adaptation module is a set of API interfaces and middleware, and the differences in MCU resources of the different video conferencing platforms are shielded by the set of API interfaces and the middleware, so as to realize the calling of the heterogeneous MCU resources on the different video conferencing platforms.
[0043] Among them, a set of API (Application Programming Interface) interfaces refers to a set of defined functions used to interact with heterogeneous MCU resources of different video conferencing platforms. The API interface can be used to implement common functions in video conferencing, such as creating a meeting, joining a meeting, sending messages, managing participants, etc. Middleware refers to the bridge connecting the API interface with different video conferencing platforms. It is responsible for converting the unified API interface calls into the native calls required by different video conferencing platforms (the resource scheduling method in the original video conferencing platform) and handling compatibility issues between different platforms.
[0044] Specifically, when conducting video conferences in different video conference platforms, you only need to call a set of API interfaces provided by the heterogeneous platform adaptation module, without having to worry about what the underlying video conference platform is and the technical differences between them. The middleware will forward the request to the corresponding video conference platform based on the called API interface, and perform heterogeneous MCU resource scheduling to respond to the request through the standardized communication interface. In addition, the heterogeneous platform adaptation module adopts the design of API interface and middleware, so it is relatively easy to add new video conference platform support or update and expand existing platforms.
[0045] In the above embodiment, the technical differences of heterogeneous MCU resources of different video conferencing platforms are shielded through a unified API interface and middleware, so that MCU resources can be scheduled from different video conferencing platforms when the target conference is in progress. For example, when the internal resources of a certain video conferencing platform are tight, idle MCU resources can be mobilized from other video conferencing platforms, breaking the isolated state of video conferencing platform resources, realizing global management and flexible scheduling of MCU resources, ensuring that the needs of various conferences are met in a timely manner, and enabling the system to easily cope with complex environments with multiple platforms, multiple devices, and multiple protocols.
[0046] S14, a dynamic scheduling algorithm module, is used to perform MCU resource scheduling on the MCU resource pool through the standardized communication interface according to the real-time MCU resource demand of the target conference.
[0047] Among them, the real-time MCU resource demand refers to the MCU resources required when the target conference is in progress. During the process of the target conference, the demand for MCU resources is in a dynamic change process. The MCU resources reserved for the target conference based on the reserved resource strategy may not meet the requirements of the target conference in real time under the premise of starting the target conference. The elements that affect the conference demand may include changes in the number of participants, changes in the clarity of the video conference, and the execution of additional functions of the target conference (such as screen sharing, document sharing, and real-time translation).
[0048] During the target conference, the dynamic scheduling algorithm module will monitor the real-time MCU resource requirements of the target conference, including the number of video streams, resolution, frame rate, number of audio channels, etc., and determine the real-time MCU resources required by the target conference according to the characteristics of the conference and the needs of the participants. At the same time, the dynamic scheduling algorithm module will query the current available MCU resources in the MCU resource pool in real time, including the number and type of idle resources. According to the real-time required MCU resources and the currently available MCU resources, MCU resources are scheduled according to the conference priority.
[0049] For meetings with higher priority, a scheduling request is sent to the MCU resource pool using a standardized communication interface to indicate the allocation and release of resources. The scheduling algorithm can determine how resources are allocated based on different strategies, such as minimizing resource waste and giving priority to meeting the needs of high-priority meetings. In addition, the dynamic scheduling algorithm module regularly monitors the use of MCU resources and the real-time needs of meetings, and dynamically adjusts resources based on the situation. If the resource requirements of a meeting change or a new meeting is added, resources are reallocated in a timely manner to ensure the effective use of resources and the smooth progress of the meeting.
[0050] In the above embodiment, through the dynamic scheduling algorithm module, the resource pool status is monitored in real time through the dynamic scheduling algorithm, which can quickly respond to changes in resource demand and quickly allocate resources to ensure the stability and efficiency of conference services. Based on the real-time matching of conference demand and resource availability, MCU resources are scheduled across video conferencing platforms, while maximizing the use of MCU resources to improve the efficiency and performance of the overall system.
[0051] In an optional embodiment, the dynamic scheduling algorithm module includes: A real-time monitoring submodule, used to monitor the usage of all MCU resources of the different video conferencing platforms; The resource matching submodule is used to determine the optimal resource scheduling solution for the target conference according to the usage of all MCU resources.
[0052] Among them, all MCU resources include the video conferencing platform where the target conference is held, as well as the MCU resource usage of other video conferencing platforms. The real-time monitoring submodule monitors the usage of all MCU resources on different video conferencing platforms in real time. It can obtain the meeting requirements of the target conference and the resource availability in the heterogeneous MCU resource pool. The resource matching submodule matches the corresponding target scheduling MCU resources based on resource availability in the heterogeneous MCU resource pool according to the meeting requirements of the target conference, and obtains the optimal resource scheduling solution.
[0053] In the above embodiment, the real-time monitoring submodule can obtain the utilization of the system MCU resources in real time, so as to carry out effective resource scheduling and management, thereby ensuring the quality of the conference and user experience. The resource matching submodule can effectively utilize the available MCU resources of the system to meet the needs of different conferences, thereby providing stable and high-quality video conferencing services.
[0054] In an optional embodiment, the MCU resource dynamic scheduling system for the video conferencing platform further includes: A component compatibility testing module, used to verify the compatibility of the different video conferencing platforms and determine which compatible video conferencing platforms can enter the target conference; The coordination protocol module is used to determine the communication rules and operation procedures for the heterogeneous platform adaptation module to schedule the target MCU resources.
[0055] Among them, the component compatibility test module covers multiple aspects of compatibility testing of different video conferencing platforms, including communication protocol compatibility, functional compatibility, data format compatibility and performance compatibility. For video conferencing platforms that meet the compatibility requirements, they will be identified and can join the target conference. The coordination protocol module is used to ensure that the heterogeneous platform adaptation module can effectively schedule the target MCU resources and communicate with the resource pool in a stable and orderly manner. The coordination protocol can include resource application specifications, resource authorization mechanisms, and resource release specifications to ensure the normal scheduling of MCU resources.
[0056] In the above embodiment, through the cooperation of the component compatibility test module and the coordination protocol module, it is possible to effectively ensure seamless connection between different video conferencing platforms and resource pools, avoid data loss and communication anomalies, and ensure the orderly progress of the resource scheduling process.
[0057] In this application, by obtaining an adaptive resource reservation module, a cross-platform resource pool module, a heterogeneous platform adaptation module and a dynamic scheduling algorithm module, problems such as resource preemption, platform isolation and heterogeneous compatibility in the existing conference system are solved, and effective resource allocation for video conferencing and cross-platform scheduling of MCU resources are achieved, thereby ensuring the normal startup and stable operation of video conferencing.
[0058] See also Figure 2 The figure is a flow chart of a method for scheduling MCU resources for a multi-platform video conference shown in an embodiment of the present application.
[0059] S21: Generate a resource reservation strategy according to the conference level of the target conference.
[0060] Among them, the meeting level of the target meeting is divided into ordinary meeting, important meeting, emergency meeting and special meeting; the resource reservation strategy refers to the strategy of pre-allocating and locking the necessary MCU resources for the target meeting according to the meeting level of the target meeting, and is set to ordinary resource reservation strategy, important resource reservation strategy, emergency resource reservation strategy and special resource reservation strategy corresponding to the meeting level. Different resource reservation strategies allocate different MCU resources for MCU resources, where MCU resources refer to the hardware resources and software resources used to realize audio and video communications on different video conferencing platforms.
[0061] In the conference reservation stage, the conference level of the target conference is determined according to the target conference reserved by the user. In the adaptive resource module, there is a resource reservation strategy submodule, which can obtain the resource reservation strategy in the preset resource strategy matching library according to the conference level.
[0062] In the above embodiment, through the adaptive resource reservation module, resources are reserved in the conference reservation stage to meet the resource requirements of different conference types, avoiding the problem of the target conference being delayed or unable to start normally due to insufficient resources when starting. And the reserved resources are dynamically allocated according to the conference level of the target conference, and more MCU resources are allocated to high-level conferences, so as to avoid the high-level conference being affected by the resource preemption of other low-priority conferences when the system is running multiple conferences at the same time, thereby ensuring the conference quality of high-level conferences.
[0063] In an optional embodiment, generating a resource reservation strategy according to the conference level of the target conference includes: When the conference level is a common conference, the MCU resource margin of the target conference video platform is obtained, and when the MCU resource margin meets the MCU resource requirement of the target conference, the MCU resource margin is locked and reserved; When the conference level is greater than the ordinary conference, necessary MCU resources are determined according to conference attributes, and the necessary MCU resources are locked and reserved through the adaptive resource module.
[0064] See also Figure 3 As shown, when making a meeting reservation, the meeting level is determined according to the meeting attributes input by the user, and the meeting level is determined. When the meeting level is a normal meeting, the system obtains the MCU resource margin of the video platform for holding the video conference, and calculates whether it is sufficient to support the holding of the target meeting. When the MCU resource margin meets the MCU resource requirements of the target meeting, the corresponding MCU resource margin is locked, and the corresponding MCU resources are used when the target meeting is held.
[0065] When the target meeting is one of the important meetings, emergency meetings and special meetings, the necessary MCU resources are calculated through the adaptive resource module, and resources are reserved for the target meeting's video platform. When the real-time MCU resources are insufficient, the adaptive resource reservation module will cancel some other MCU resource occupation based on the required MCU resources to support the convening of the target meeting.
[0066] In the above embodiment, the system can effectively reserve resources for convening meetings of different levels, thereby improving resource utilization and conference service quality.
[0067] S22, building an MCU resource pool according to the heterogeneous MCU resources of different video conferencing platforms in the target conference.
[0068] Among them, heterogeneous MCU resources refer to MCU resources with different structures and characteristics on different video conferencing platforms. The heterogeneity of different video conferencing platforms is mainly reflected in hardware configuration, number of channels, supported video codec formats, etc. The MCU resource pool refers to the database in the system used to store MCU resources of different video conferencing platforms.
[0069] When the target meeting is in progress, the cross-platform resource pool module will obtain information from different conference video conferencing platforms, such as Huawei SMC (Smart Meeting Collaboration, an enterprise-level video conferencing platform), ZOOM (China-US Video) or other platforms, and send the corresponding request MCU resource information based on the platform type. After passing, it will call the corresponding interface to obtain the MCU resource information, and standardize the corresponding MCU resource information and store it in the MCU resource pool.
[0070] In the above embodiment, heterogeneous MCU resources of different video conferencing platforms are obtained through a cross-platform resource pool module, and a heterogeneous MCU resource pool is constructed, which can break the platform barriers of different video conferencing platforms, solve the isolated state of resources of a single video conferencing platform, and realize global management and flexible scheduling of resources.
[0071] S23: determining a standardized communication interface according to the MCU resource differences of the heterogeneous MCU resources.
[0072] The heterogeneous platform adaptation module analyzes the characteristics of the heterogeneous MCU resources of different video conferencing platforms to obtain the differences in their communication protocols, data formats, interface specifications, etc. According to the results of the characteristic analysis of these different video conferencing platforms, the communication protocols and data formats of different video conferencing platforms are converted or parsed and reorganized to ensure smooth communication between different platforms. A unified interface standard is designed to obtain a standardized communication interface so that the heterogeneous MCU resources of different video conferencing platforms can be accessed and called in the same way through the standardized communication interface.
[0073] Specifically, the heterogeneous platform adaptation module is a set of API interfaces and middleware. When conducting video conferences in different video conferencing platforms, you only need to call a set of API interfaces provided by the heterogeneous platform adaptation module, without having to worry about what the underlying video conferencing platform is and the technical differences between them. The middleware will forward the request to the corresponding video conferencing platform based on the called API interface, and perform heterogeneous MCU resource scheduling to respond to the request through standardized communication interfaces. In addition, the heterogeneous platform adaptation module adopts the design of API interfaces and middleware, so it is relatively easy to add new video conferencing platform support or update and expand existing platforms.
[0074] In the above embodiment, through the heterogeneous platform adaptation module, seamless access and calling of cross-platform resources can be achieved, the complexity of cross-platform resource scheduling is simplified, and the technical threshold for adding or integrating other video conferencing platforms to the target conference is reduced. Through the heterogeneous platform adaptation module, the system can easily cope with the complex environment of multiple platforms, multiple devices, and multiple protocols, enhancing the flexibility and scalability of the overall system.
[0075] S24, performing MCU resource scheduling on the MCU resource pool through the standardized communication interface according to the real-time MCU resource demand of the target conference.
[0076] Among them, the real-time MCU resource demand refers to the MCU resources required when the target conference is in progress. During the process of the target conference, the demand for MCU resources is in a dynamic change process. The MCU resources reserved for the target conference based on the reserved resource strategy may not meet the requirements of the target conference in real time under the premise of starting the target conference. The elements that affect the conference demand may include changes in the number of participants, changes in the clarity of the video conference, and the execution of additional functions of the target conference (such as screen sharing, document sharing, and real-time translation).
[0077] During the target conference, the dynamic scheduling algorithm module will monitor the real-time MCU resource requirements of the target conference, including the number of video streams, resolution, frame rate, number of audio channels, etc., and determine the real-time MCU resources required by the target conference according to the characteristics of the conference and the needs of the participants. At the same time, the dynamic scheduling algorithm module will query the current available MCU resources in the MCU resource pool in real time, including the number and type of idle resources. According to the real-time required MCU resources and the currently available MCU resources, MCU resources are scheduled according to the conference priority.
[0078] For meetings with higher priority, a scheduling request is sent to the MCU resource pool using a standardized communication interface to indicate the allocation and release of resources. The scheduling algorithm can determine how resources are allocated based on different strategies, such as minimizing resource waste and giving priority to meeting the needs of high-priority meetings. In addition, the dynamic scheduling algorithm module regularly monitors the use of MCU resources and the real-time needs of meetings, and dynamically adjusts resources based on the situation. If the resource requirements of a meeting change or a new meeting is added, resources are reallocated in a timely manner to ensure the effective use of resources and the smooth progress of the meeting.
[0079] In the above embodiment, through the dynamic scheduling algorithm module, the resource pool status is monitored in real time through the dynamic scheduling algorithm, which can quickly respond to changes in resource demand and quickly allocate resources to ensure the stability and efficiency of conference services. Based on the real-time matching of conference demand and resource availability, MCU resources are scheduled across video conferencing platforms, while maximizing the use of MCU resources to improve the efficiency and performance of the overall system.
[0080] In an optional embodiment, performing MCU resource scheduling on the MCU resource pool through the standardized communication interface according to the real-time MCU resource demand of the target conference includes: Acquire a first idle MCU resource in the MCU resource pool; When the idle MCU resources are less than the real-time MCU resource demand, the largest idle MCU resource platform among the different video conferencing platforms is acquired in real time, and the largest MCU idle resource platform is scheduled to supplement the MCU resource pool with resources to obtain a second idle MCU resource; When the second idle MCU resources meet the real-time MCU resource requirements, the second idle MCU resources are scheduled through the standardized communication interface.
[0081] When the target meeting is in progress, the system will retrieve the idle MCU resources in the MCU resource pool, that is, the first idle MCU resources. When the first idle MCU resources are insufficient to meet the real-time MCU resource 0 demand, the system will monitor different video conferencing platforms in real time, select the platform with the most idle resources, and schedule its MCU resources to the MCU resource pool to obtain the second idle MCU resources.
[0082] It should be noted that the selection of the platform with the most idle resources is a dynamic selection process. After obtaining a certain amount of idle MCU resources from the platform with the most idle resources, a new platform with the most idle MCU resources appears, and the system will switch to the new platform to obtain idle MCU resources. Once the second idle resource meets the current demand, the system will schedule its MCU resources through the standardized communication interface to ensure the effective use of resources and meet the meeting needs.
[0083] In the above embodiment, the optimal MCU resources are allocated in real time to ensure smooth conference running. The resource utilization rate is improved and the stable operation of the conference is ensured by dynamically monitoring and switching to the idle resource MCU platform for resource scheduling.
[0084] In summary, the present application provides a MCU resource dynamic scheduling system for a video conferencing platform, including: an adaptive resource reservation module, a cross-platform resource pool module, a heterogeneous platform adaptation module, and a dynamic scheduling algorithm module, and executes the method: according to the target conference level, determine the resource reservation strategy of the target conference; according to the heterogeneous MCU resources of different video conferencing platforms, build a heterogeneous MCU resource pool; according to the technical differences of heterogeneous MCU resources, obtain a standardized communication interface; according to the dynamic scheduling algorithm, determine the target scheduling MCU resources, and schedule the target scheduling MCU resources in real time according to the standardized communication interface. It solves the technical problem of uneven resource allocation and scheduling in different video platforms for current video conferencing, ensures the stable operation of important level meetings, and improves the stability of video conferencing.
[0085] See also Figure 4 FIG. 1 is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. In a preferred embodiment of the present application, the electronic device 4 includes a memory 41 , at least one processor 42 , and at least one communication bus processor 43 .
[0086] Those skilled in the art should understand that Figure 3 The structure of the electronic device shown does not constitute a limitation of the embodiments of the present application, and may be either a bus structure or a star structure. The electronic device may also include more or less other hardware or software than shown in the figure, or a different component arrangement.
[0087] The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium is, for example, a non-volatile memory, such as: magnetic media (such as hard disks, floppy disks, and tapes), optical media (such as CDROM disks and DVDs), magneto-optical media (such as optical disks), and hardware devices specially constructed to store and execute computer-executable instructions (such as read-only memory (ROM), random access memory (RAM), flash memory, etc.). Computer-executable instructions are stored on the computer-readable storage medium. The computer-readable storage medium can be executed by one or more processors or processing devices to implement the MCU resource dynamic scheduling method for the video conferencing platform in the aforementioned embodiment.
[0088] In addition, it can be understood that the aforementioned embodiments are merely illustrative descriptions of the present application. Under the premise that the technical features do not conflict, the structures do not contradict, and the purpose of the invention of the present application is not violated, the technical solutions of the various embodiments can be arbitrarily combined and used in combination.
[0089] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the system or device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the system or unit can be electrical, mechanical or other forms.
[0090] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0091] In addition, each functional unit / module in each embodiment of the present application may be integrated into one processing unit / module, or each unit / module may exist physically separately, or two or more units / modules may be integrated into one unit / module. The above-mentioned integrated unit / module may be implemented in the form of hardware or in the form of hardware plus software functional units / modules.
[0092] The above-mentioned integrated unit / module implemented in the form of a software functional unit / module can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for enabling one or more processors of a computer device (which can be a personal computer, a server, or a network device, etc.) to perform some steps of the methods of each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.
[0093] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A MCU resource scheduling system for multi-platform video conferencing, characterized in that: The system comprises: An adaptive resource reservation module, used to generate a resource reservation strategy according to the conference level of the target conference, wherein the resource reservation strategy is used to start the target conference; A cross-platform resource pool module, used to build an MCU resource pool according to heterogeneous MCU resources of different video conferencing platforms in the target conference; A heterogeneous platform adaptation module, used for determining a standardized communication interface according to MCU resource differences of the heterogeneous MCU resources; The dynamic scheduling algorithm module is used to perform MCU resource scheduling on the MCU resource pool through the standardized communication interface according to the real-time MCU resource demand of the target conference.
2. The MCU resource scheduling system for multi-platform video conferencing according to claim 1, characterized in that: The system further comprises: A component compatibility testing module, used to verify the compatibility of the different video conferencing platforms and determine which compatible video conferencing platforms can enter the target conference; The coordination protocol module is used to determine the communication rules and operation procedures for the heterogeneous platform adaptation module to schedule the target MCU resources.
3. The MCU resource scheduling system for multi-platform video conferencing according to claim 1 or 2, characterized in that: The adaptive resource reservation module comprises: A conference level identification submodule, used to determine the conference level according to the conference attributes of the target conference; The resource reservation strategy submodule allocates and locks necessary MCU resources for the target conference according to the conference level.
4. The MCU resource scheduling system for multi-platform video conferencing according to claim 1, characterized in that: The dynamic scheduling algorithm module includes: A real-time monitoring submodule, used to monitor the usage of all MCU resources of the different video conferencing platforms; The resource matching submodule is used to determine the optimal resource scheduling solution for the target conference according to the usage of all MCU resources.
5. The MCU resource scheduling system for multi-platform video conferencing according to claim 1, characterized in that: The heterogeneous platform adaptation module is a group of API interfaces and middleware. The group of API interfaces and the middleware are used to shield the differences in MCU resources of the different video conferencing platforms, thereby realizing the calling of the heterogeneous MCU resources on the different video conferencing platforms.
6. According to the MCU resource scheduling system for multi-platform video conferencing according to claim 1, the present application also provides an MCU resource scheduling method for multi-platform video conferencing, characterized in that: The method comprises: Generating a resource reservation policy according to the conference level of the target conference, wherein the resource reservation policy is used to start the target conference; Building an MCU resource pool according to heterogeneous MCU resources of different video conferencing platforms in the target conference; Determining a standardized communication interface according to MCU resource differences of the heterogeneous MCU resources; According to the real-time MCU resource demand of the target conference, MCU resource scheduling is performed on the MCU resource pool through the standardized communication interface.
7. The MCU resource scheduling method for multi-platform video conferencing according to claim 6, characterized in that: The generating a resource reservation strategy according to the conference level of the target conference includes: When the conference level is a common conference, the MCU resource margin of the target conference video platform is obtained, and when the MCU resource margin meets the MCU resource requirement of the target conference, the MCU resource margin is locked and reserved; When the conference level is greater than the ordinary conference, necessary MCU resources are determined according to conference attributes, and the necessary MCU resources are locked and reserved through the adaptive resource module.
8. The MCU resource scheduling method for multi-platform video conferencing according to claim 7, wherein the step of performing MCU resource scheduling on the MCU resource pool through the standardized communication interface according to the real-time MCU resource demand of the target conference comprises: Acquire a first idle MCU resource in the MCU resource pool; When the idle MCU resources are less than the real-time MCU resource demand, the largest idle MCU resource platform among the different video conferencing platforms is acquired in real time, and the largest MCU idle resource platform is scheduled to supplement the MCU resource pool with resources to obtain a second idle MCU resource; When the second idle MCU resources meet the real-time MCU resource requirements, the second idle MCU resources are scheduled through the standardized communication interface.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the MCU resource scheduling method for multi-platform video conferencing as described in any one of claims 6 to 8 when executing the computer program.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the MCU resource scheduling method for implementing multi-platform video conferencing described in any one of claims 6 to 8 are implemented.
Citation Information
Patent Citations
MCU resource scheduling method based on television video conference
CN105049220A
Heterogeneous resource scheduling method, device and equipment and computer readable storage medium
CN113051053A
Intelligent scheduling method and system for multiple video conference resources
CN113132396A
Heterogeneous computing-oriented resource scheduling method, node, system, equipment and medium
CN114996018A
Resource scheduling method and device, storage medium and product
CN116506570A
Cited By
Communication signal processing method and communication receiver
CN119996499A
A communication signal processing method and a communication receiver
CN119996499B
