Resource scheduling method for video conference, electronic equipment and computer readable storage medium

Abstract

The embodiment of the invention provides a resource scheduling method for a video conference, electronic equipment and a computer readable storage medium. The method comprises the steps that a service processing system acquires media resource information on a first resource processing system and media resource information on a second resource processing system; performing resource scheduling during a video conference according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system; wherein the media resource information on the first resource processing system is coded and decoded based on a graphics processing unit (GPU), and the media resource information on the second resource processing system is coded and decoded based on a central processing unit (CPU).

Description

Technical Field

[0001] This application relates to the field of communication technologies, and in particular, to a resource scheduling method, an electronic device, and a computer-readable storage medium for video conferencing. Background Art

[0002] Video conferencing is a multimedia communication means that can simultaneously implement the interactive functions of images, voices, and data between two or more locations. A video conferencing system generally consists of a service processing system, a media subsystem, and terminals. Among them, with the rapid development of network technologies, people's requirements for aspects such as video conferencing quality and video conferencing capacity are also getting higher and higher. That is to say, how to improve the capacity of the conference and the clarity of the video has become the key to the conference system.

[0003] In response to this, the video conferencing system expansion solution adopted in the related art is: adding a media resource domain of the same type to the video conferencing network, such as a hard media resource domain or a soft media resource domain, and hanging it under the service processing system to increase the capacity of the video conferencing system.

[0004] However, in the expansion solution adopted in the related art, although the soft media resource has the advantage of supporting large-capacity video conferencing, the performance of the media codec chip in the cloud environment that supports the installation of the soft media resource cannot reach the 4K processing ability, which affects the video conferencing quality. Although the hard media resource can meet the user's need to hold a 4K video conference, due to the limitation of the hard media resource, if a large-capacity conference is to be satisfied, multiple servers need to be deployed, resulting in poor economic benefits. Summary of the Invention

[0005] The purpose of the embodiments of this application is to provide a resource scheduling method, an electronic device, and a computer-readable storage medium for video conferencing, which can avoid the problem of limited hard media resources while realizing the expansion of video conferencing resources, meet the video conferencing quality, and ensure economic benefits.

[0006] To solve the above technical problems, the embodiments of this application are implemented through the following aspects.

[0007] In a first aspect, the embodiments of this application provide a resource scheduling method for video conferencing, which is executed by a service processing system. The method includes: obtaining media resource information on a first resource processing system and media resource information on a second resource processing system; performing resource scheduling during a video conference according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system; where the media resource information on the first resource processing system is encoded and decoded based on a graphics processing unit (GPU), and the media resource information on the second resource processing system is encoded and decoded based on a central processing unit (CPU).

[0008] Second aspect, an embodiment of the present application provides a resource scheduling method for a video conference, which is executed by a third resource processing system. The method includes: reporting media resource information to a service processing system; wherein, the media resource information is used for resource scheduling during a video conference by the service processing system. The media resources in the third resource processing system are first media resources or second media resources. The first media resources are encoded and decoded based on a graphics processing unit (GPU), and the second media resources are encoded and decoded based on a central processing unit (CPU).

[0009] Third aspect, an embodiment of the present application provides a video conference system, including: a first resource processing system for providing media resources encoded and decoded based on a GPU; a second resource processing system for providing media resources encoded and decoded based on a CPU; a service processing system for performing resource scheduling during a video conference according to the media resource information reported by the first resource processing system and the media resource information reported by the second resource processing system.

[0010] Fourth aspect, an embodiment of the present application provides an electronic device, including: a memory, a processor, and computer executable instructions stored on the memory and executable on the processor. When the computer executable instructions are executed by the processor, the steps of the method described in the first aspect or the second aspect are implemented.

[0011] Fifth aspect, an embodiment of the present application provides a computer-readable storage medium for storing computer executable instructions. When the computer executable instructions are executed by a processor, the steps of the method described in the first aspect or the second aspect are implemented.

[0012] In the embodiment of the present application, the service processing system obtains the media resource information in the first resource processing system and the second resource processing system, and then performs flexible scheduling of software and hardware media resources according to the obtained media resource information, so as to meet different video conference requirements such as large capacity and high definition while ensuring economic benefits. Description of the Drawings

[0013] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments recorded in the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0014] Figure 1 The networking schematic diagram of the video conference system provided by the embodiment of the present application is shown.

[0015] Figure 2aShows one of the schematic diagrams of the media resource reporting process.

[0016] Figure 2b Shows another schematic diagram of the media resource reporting process.

[0017] Figure 3 Shows one of the schematic diagrams of the resource scheduling method for video conferencing provided by the embodiments of the present application.

[0018] Figure 4a Shows another schematic diagram of the resource scheduling method for video conferencing provided by the embodiments of the present application.

[0019] Figure 4b Shows a third schematic diagram of the resource scheduling method for video conferencing provided by the embodiments of the present application.

[0020] Figure 5 Shows one of the schematic diagrams of the process for establishing a resource cascading channel provided by the embodiments of the present application.

[0021] Figure 6a Shows another schematic diagram of the process for establishing a resource cascading channel provided by the embodiments of the present application.

[0022] Figure 6b Shows a third schematic diagram of the process for establishing a resource cascading channel provided by the embodiments of the present application.

[0023] Figure 7 Shows a fourth schematic diagram of the resource scheduling method for video conferencing provided by the embodiments of the present application.

[0024] Figure 8 Shows one of the schematic diagrams of the structure of the resource scheduling device for video conferencing provided by the embodiments of the present application.

[0025] Figure 9 Shows another schematic diagram of the structure of the resource scheduling device for video conferencing provided by the embodiments of the present application.

[0026] Figure 10 Is a schematic diagram of the hardware structure of an electronic device for executing the XXXX method provided by the embodiments of the present application. Detailed implementation manners

[0027] In order to enable those skilled in the art to better understand the technical solutions in the present application, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0028] With the rapid development of network technology, people's requirements for the quality of video conferencing are getting higher and higher, especially for the clarity of video conferencing. At the same time, with the full coverage of 5G networks and the like, users can join video conferences anytime and anywhere, without being restricted to the previous fixed conference room terminals. As a result, the number of users accessing the conference system has increased linearly, which also poses a challenge to the capacity of the video conferencing system. In this context, the present application provides a video conferencing system, and the networking structure of the video conferencing system is as Figure 1 shown, which may include, but is not limited to, a first resource processing system, a second resource processing system, a service processing system, and a plurality of terminals connected to the first resource processing system and the second resource processing system. The first resource processing system, the second resource processing system, and the service processing system are deployed in the same network.

[0029] Among them, the first resource processing system can also be called a hard media resource system, which is deployed based on physical machines and static containers to provide media resources encoded and decoded based on a Graphics Processing Unit (GPU), that is, hard media resources. In this embodiment, the first resource processing system has a high quality of video conferencing, such as being able to provide 4K conference processing capabilities. Optionally, the video conferences mentioned in the context of the present application can be instant conferences or reservation conferences, etc., which are not limited here.

[0030] The second resource processing system can also be called a soft media resource system, which is deployed based on a cloud platform and a cloud base (Tulip Elastic Cloud System Cloud Foundry, TCF) to provide media resources encoded and decoded based on a Central Processing Unit (CPU), that is, soft media resources. In this embodiment, the second resource processing system has the ability to support large-capacity video conferences. For example, the maximum capacity of a single group of video conferences can reach 2000 parties. Among them, TCF is a dual-core operation platform that supports TECS (Tulip Elastic Cloud System) and K8S.

[0031] The service processing system is similar to the second resource processing system and is also deployed based on a cloud platform and TCF to perform resource scheduling during video conferencing according to the media resource information reported by the first resource processing system and the media resource information reported by the second resource processing system. Thus, by fusing and deploying soft media resources and hard media resources, it is possible to expand the video conferencing resources while avoiding the problem of limited hard media resources, meet the quality of video conferencing, and ensure economic benefits.

[0032] That is to say, considering that due to the version differences between hard media resources and soft media resources in the related art, cascading cannot be directly performed. Only hard media resources can be cascaded with hard media resources, or soft media resources can be cascaded with soft media resources. As a result, a single soft media cascade cannot hold a 4K multi-view conference because the performance of the media encoding and decoding chips in the server for processing media cannot reach the 4K processing capacity, and a single hard media cascade cannot stably hold a large-capacity conference due to limited resources. In response to this, the present application fuses and deploys soft media resources and hard media resources, and moves the original Resource Management System (RMS) configured in the first resource processing system and the second resource processing system from the first resource processing system and the second resource processing system to the service processing system. Moreover, the media resource cascading in the first resource processing system and the second resource processing system is modified to achieve the purpose of hard and soft media cascading, so that the redesigned video conferencing system can support holding 4K conferences, and the maximum capacity of a single group of conferences can reach 2000 parties, etc. Among them, the aforementioned RMS can also be referred to as a resource scheduling unit, which is used to manage media resources such as audio, video, network, and files, and perform statistics, scheduling, scaling, etc. on information such as the total resource volume and the currently used resource volume.

[0033] Exemplarily, please refer to Figure 2a and Figure 2b . Before moving the RMS from the first resource processing system and the second resource processing system to the service processing system, the media resource reporting process is as Figure 2a shown. The first resource processing system reports its own media resource information to the Media Process Control (MPC) through the X process service (XPS), and then the MPC reports the resource information to the RMS; similarly, the second resource processing system can also report its own media resource information to the MPC through the XPS, and then the MPC reports the media resource information to the RMS. In this case, since the RMSs in the first resource processing system and the second resource processing system are different, there is no module in the video conferencing system to uniformly manage hard media resources and soft media resources, that is, the usage of resources in the entire video conferencing system is invisible, and the optimal use of resources cannot be achieved. In response to this, the present application considers moving the RMSs in the first resource processing system and the second resource processing to the service processing system, as Figure 2bAs shown, after the XPSs in the first resource processing system and the second resource processing system respectively report their own media resource information to the MPCs they belong to, the MPCs can respectively report the resource information to the RMS in the service processing system via http or other means. Thus, the service processing system can obtain the media resource information in the entire video conferencing system, such as the resource usage situation, and perform real-time resource scheduling during the video conference according to the resource usage situation, realizing the hybrid deployment of software and hardware resources. It can be understood that the reporting processes of the hard media resources in the first resource processing system and the soft media resources in the second resource processing system are the same, and will not be elaborated here.

[0034] Among them, the MPC can also be called the media control unit, which is used to uniformly access the media streams of various terminals, process the media streams according to the publish-subscribe instructions, support audio sorting and forwarding, transcoding, mixing, video forwarding and switching, and has extremely high requirements for forwarding capacity and latency. The XPS is the general term for Media process service (MPS), Video process service (VPS), Flexible Capacity Service (FCS), etc.

[0035] The MPS can be called the audio-video forwarding processing unit, audio codec unit, etc., and is used for audio-video forwarding, audio codec, etc.

[0036] The VPS can be called the video processing unit, which is used to provide functions such as video synthesis, video transcoding, video scaling, etc., has extremely high requirements for processing latency, and supports heterogeneous acceleration, etc.

[0037] In addition, the resources in the video conferencing system mentioned in this application generally refer to media resources, that is, codec resources, such as GPU codec resources, CPU codec resources, etc. In addition, the video conferencing system may include but is not limited to the foregoing Figure 1 As shown, for example, the video conferencing system may include multiple first resource processing systems, multiple second resource processing systems, etc., which are not limited here.

[0038] Based on the foregoing provided video conferencing system, as Figure 3 shown, it shows a schematic flowchart of a resource scheduling method 300 for a video conference provided by an embodiment of the present application. This method 300 can be executed by a service processing system. In other words, the method 300 can be executed by software and / or hardware installed in the service processing system. The service processing system may include but is not limited to: terminal devices, single servers, server clusters, cloud servers or cloud server clusters, etc. As Figure 3 shown, this method 300 may but is not limited to include the following steps.

[0039] S310, obtain the media resource information on the first resource processing system and the media resource information on the second resource processing system.

[0040] Among them, the media resource information on the first resource processing system is encoded and decoded based on the GPU, and the media resource information on the second resource processing system is encoded and decoded based on the CPU.

[0041] In this embodiment, please refer to again Figure 1 , Figure 2b , there are various ways for the service processing system to obtain the media resource information. For example, it can be that the service processing system actively requests or triggers the first resource processing system and the second resource processing system to report their own media resource information, or it can also be that the first resource processing system and the second resource processing system report their own media resource information to the service processing system periodically or in real time, etc., which is not limited here.

[0042] Optionally, the media resource information may include but is not limited to the amount of media resources currently used, the remaining amount of media resources, the media resource type, etc. in the first resource processing system and the second resource processing system. The media resource type can be whether the media resources in the first resource processing system and the second resource processing system are soft media resources or hard media resources, etc.

[0043] S320, perform resource scheduling during a video conference according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system.

[0044] Among them, the video conference can be an instant conference or a scheduled conference, etc.

[0045] In this embodiment, the service processing system obtains the media resource information in the first resource processing system and the second resource processing system, and then performs flexible scheduling of soft and hard media resources according to the obtained media resource information, so as to meet different video conference requirements such as large capacity and high definition while ensuring economic benefits.

[0046] Based on this, in some embodiments, according to different requirements of the video conference, there are various implementation methods for the resource scheduling during the video conference described in S320 according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system. For example, when the video conference requirement is only for large capacity, the service processing system can only schedule the media resources in the second resource processing system for the video conference. For example, during a video conference, the service processing system forwards the meeting request information to the second resource processing system for processing, etc.

[0047] When the video conferencing requirement is only for high definition, the service processing system may schedule the media resources in the first resource processing system for video conferencing. For example, during a video conference, the service processing system forwards the meeting request information to the first resource processing system for processing, etc.

[0048] When the video conferencing requirement is for large capacity and high definition, the media resources in the first resource processing system and the second resource processing system may be scheduled simultaneously for video conferencing. For example, during a video conference, the service processing system forwards the meeting request information sent by different terminals to the corresponding first resource processing system or second resource processing system for processing, etc., without limitation here.

[0049] For example, when a first terminal attached to the first resource processing system or the second resource processing system needs to hold a video conference, the first terminal can convene a video conference on the video interface, such as an instant conference or a scheduled conference, and send a first video conference request to the service processing system. Among them, the first video conference request may carry information such as a meeting theme, a meeting type (such as an instant conference or a scheduled conference), and a meeting capability template. The meeting capability template may include, but is not limited to, meeting time, number of participants, meeting clarity or resolution requirements, etc. It can be understood that when the first terminal sends the first video conference request to the service processing system, the first video conference request may be forwarded to the service processing system through the first resource processing system or the second resource processing system, but is not limited to this.

[0050] Correspondingly, the service processing system receives the first video conference request sent by the first terminal, and determines whether the media resource information on the first resource processing system and / or the media resource information on the second resource processing system meets the meeting resource requirements corresponding to the first video conference request according to the obtained media resource information on the first resource processing system and / or the media resource information on the second resource processing system. For example, after receiving the first video conference request through the RMS, the service processing system can calculate the size and type of media resources required for the video conference, and determine whether the current media resources meet the meeting resource requirements corresponding to the first video conference request according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system.

[0051] Next, when the service processing system determines that the meeting resource requirements corresponding to the first video conference request are not met, it returns a meeting failure response to the first terminal. Or, when the service processing system determines that the meeting resource requirements corresponding to the first video conference request are met, it invokes the media resources on the first resource processing system and / or the media resources on the second resource processing system for video conferencing.

[0052] It should be noted that, if the video conference is an instant conference, then, when the service processing system determines that the meeting resource requirements corresponding to the first video conference request are met, it can instantaneously call the media resources on the first resource processing system and / or the media resources on the second resource processing system to conduct the video conference; if the video conference is a scheduled conference, then, when the service processing system determines that the meeting resource requirements corresponding to the first video conference request are met, it can call the media resources on the first resource processing system and / or the media resources on the second resource processing system according to the scheduled time of the scheduled conference to conduct the video conference.

[0053] Optionally, in some embodiments, the process of the service processing system calling the media resources on the first resource processing system and / or the media resources on the second resource processing system to conduct the video conference may further include: when the first capability is included in the first video conference request, the service processing system can call the media resources on the first resource processing system to conduct the video conference. Wherein, the first capability includes that the resolution of the video conference is a preset value, such as 4K, etc.

[0054] Or, when the first capability is not included in the video conference request but the second capability is included, the service processing system can call the media resources on the second resource processing system to conduct the video conference. Wherein, the first capability includes that the resolution of the video conference is a preset value, such as 4K, etc., and the second capability includes that the resolution of the video conference is other values except the preset value, such as the second capability includes that the resolution of the video conference is less than 4K, etc.

[0055] It can be understood that the foregoing "calling the media resources on the first resource processing system or the second resource processing system to conduct the video conference" can be understood as: when conducting the video conference, the service server sends the received meeting request for the subsequent video conference to the first resource processing system or the second resource processing system for encoding, decoding, etc., which is not limited herein.

[0056] Exemplarily, for the convenience of understanding, the following further combines Figure 4a , and gives an exemplary description of the resource scheduling process when the foregoing first terminal initiates a video conference, and the content is as follows.

[0057] S411, the first terminal (or called the user terminal or user) opens the meeting APP and convenes a meeting on the meeting interface, such as an instant meeting or a scheduled meeting, and sends a first video conference request to the service processing system.

[0058] S412. The business processing system analyzes the user's input, such as information like meeting theme, meeting type, meeting capability template, etc., according to the received first video conference request. Among them, the meeting capability template information includes a first capability (such as 4K capability, etc.), a second capability (such as non-4K capability, etc.), etc.

[0059] S413. The business processing system calculates the media resources required for the video conference through RMS, and determines whether the current resource usage on the first resource processing system and the second resource processing system meets the media resources required for the video conference. If it meets the requirements, S414 is executed; otherwise, it is determined that the meeting fails to be held.

[0060] S414. The business processing system responds to the first video conference request, and further determines whether the meeting capability template in the first video conference request carries a 4K capability. If so, S415 is executed; otherwise, S416 is executed.

[0061] S415. The business processing system can call the media resources on the first resource processing system for the video conference, such as sending the meeting request for the subsequent video conference to the first resource processing system, that is, the hard media resource system.

[0062] S416. The business processing system can call the media resources on the second resource processing system for the video conference, such as sending the meeting request for the subsequent video conference to the second resource processing system, that is, the soft media resource system.

[0063] It should be noted that, please refer back again Figure 2b In the video conference, when the MPC in the first resource processing system receives the video meeting request sent by the business processing system, it can forward the video meeting request to the XPS. Then the XPS returns the response result corresponding to the video meeting request to the MPC, and the MPC then returns the meeting response result to the business processing system. Thus, the meeting process ends, and the user can see the corresponding meeting information on the interface.

[0064] In this example, through the above S411 - S416, the video conference system can hold a video conference that meets the user's needs according to the user's input, and achieve the optimal scheduling of media resources, such as avoiding the situation where a 4K meeting is required but there are no resources, and the hard media resources are occupied by other non-4K meetings.

[0065] Based on this, in one implementation, if during the video conference, a second terminal that is new and subordinate to the first resource processing system or the second resource processing system joins the video conference, then the second terminal may send a second video conference request to the service processing system. For example, the second terminal may input the video conference number to be joined on the conference interface to request to join the video conference, and the video conference number may correspond to the video conference initiated by the aforementioned first terminal. It can be understood that when the second terminal sends a second video conference request to the service processing system, the second video conference request may be forwarded to the service processing system through, but not limited to, the first resource processing system or the second resource processing system.

[0066] Correspondingly, after the service processing system receives the second video conference request sent by the second terminal and the second video conference request includes the first capability, it determines whether the remaining media resources on the first resource processing system meet the conference access requirements of the second terminal. If the service processing system determines that the conference access requirements of the second terminal are met, it initiates an add-terminal process to the first resource processing system and accesses the second terminal to the video conference based on the first capability and the remaining media resources on the first resource processing system. On the contrary, the service processing system may initiate an add-terminal process to the second resource processing system, such as sending an add-terminal request to the second resource processing system, and access the second terminal to the video conference based on the remaining media resources on the second resource processing system.

[0067] In addition, if the second video conference request includes the first capability and the second capability and the service processing system determines that the remaining media resources on the first resource processing system do not meet the conference access requirements of the second terminal, then the service processing system may initiate an add-terminal process to the second resource processing system, such as sending an add-terminal request to the second resource processing system, and access the second terminal to the video conference based on the second capability and the media resources on the second resource processing system. Thus, it can be effectively determined that 4K terminals preferentially access through hard media resources, and when the hard media resources are insufficient, it can also ensure that the terminal can successfully join the conference, greatly reducing the probability of the terminal's failure to join the conference.

[0068] Exemplarily, for ease of understanding, the following further combines Figure 4b to exemplarily illustrate the resource scheduling process when the aforementioned second terminal joins the video conference, and the content is as follows.

[0069] S421, the second terminal (or called the user terminal or user) inputs the video conference number to be joined on the conference interface, such as the video conference initiated by the aforementioned first terminal, and sends a second video conference request to the service processing system.

[0070] S422. The service processing system receives a second video conferencing request from a second terminal and analyzes the capabilities carried in the second video conferencing request, such as whether the first capability or the second capability is carried.

[0071] S423. The service processing system determines whether the first capability is carried in the second video conferencing request. For example, when the resolution is 4K, if it is carried, S424 is executed; otherwise, S425 is executed.

[0072] S424. Determine whether the currently remaining media resources in the first resource processing system are sufficient for the second terminal to join the conference with the first capability. If it is sufficient, S426 is executed; otherwise, S427 is executed.

[0073] S425. The service processing system initiates an add - terminal process to the second resource processing system. For example, the service processing system sends an add - terminal request to the second resource processing system to request the second terminal to access the video conference through non - 4K capabilities in the soft media resources.

[0074] S426. The service processing system initiates an add - terminal process to the first resource processing system. For example, the service processing system sends an add - terminal request to the first resource processing system to request the second terminal to directly join the conference through the hard media resources with the first capability.

[0075] S427. The service processing system determines whether the second capability is included in the second video conferencing request, such as other non - 4K capabilities. If it is included, S428 is executed; otherwise, it is determined that the second terminal fails to join the conference.

[0076] S428. The service processing system sends an add - terminal request to the second resource processing system, and the second terminal joins the conference through non - 4K capabilities in the soft media resources.

[0077] In this example, through the resource scheduling strategy provided in S421 - S428 above, it is possible to effectively determine that 4K terminals preferentially access through hard media resources. When the hard media resources are insufficient, it can also ensure that the terminals can successfully join the conference, greatly reducing the probability of terminal failure to join the conference.

[0078] Further, in the resource scheduling process of the video conference provided in this application, if it is necessary to schedule the media resources in the first resource processing system and the media resources in the second resource processing system, then the service processing system and each terminal participating in the video conference (such as the first terminal and the second terminal) can transmit audio and video content based on the resource cascading channel between the first resource processing system and the second resource processing system. Thus, when a part of the users in the same video conference access the conference through the first resource processing system and another part of the users access the conference through the second resource processing system, it can enable the two parts of users to achieve audio and video intercommunication while the user side is unaware of the media resources they access, thereby ensuring the video conference experience of users.

[0079] Optionally, in some embodiments, the creation process of the resource cascading channel can be as Figure 5 shown, for example, it can include but is not limited to S510 - S530. It should be noted that in the context of this application, if the third resource processing system is the aforementioned first resource processing system, then the fourth resource processing system is the aforementioned second resource processing system; if the third resource processing system is the aforementioned second resource processing system, then the fourth resource processing system is the aforementioned first resource processing system.

[0080] S510, when the Transmission Control Protocol (TCP) connection establishment between the third resource processing system and the fourth resource processing system is successful, the third resource processing system sends a first request to the fourth resource processing system through the target processing service (such as XPS). The first request includes the type of media resources that the third resource processing system can provide (such as soft media resources or hard media resources) and the version number of the target processing service.

[0081] Among them, the successful TCP connection establishment can be understood as the establishment of an initial connection between the third resource processing system and the fourth resource processing system through a three - way handshake protocol or the like.

[0082] It can be understood that when the third resource processing system is the source end or the initiating end, it can be understood that the source terminal attached to the third resource processing system needs to perform audio and video communication with the destination terminal attached to the fourth resource processing system.

[0083] S520, the third resource processing system receives a first response sent by the fourth resource processing system through the target processing service. The first response includes the type of media resources that the fourth resource processing system can provide (such as soft media resources or hard media resources) and the version number of the target processing service in the fourth resource processing system.

[0084] S530, the third resource processing system creates a resource cascade channel according to the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system.

[0085] Among them, in this embodiment, through the interaction of the foregoing first request and first response, the query of the XPS version can be realized. Furthermore, when establishing the cascade channel, the third resource processing system can adopt different cascade protocols according to the peer media resource types to achieve the unified scheduling of software and hardware media resources.

[0086] Optionally, the process for the third resource processing system to create a resource cascade channel according to the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system may include but is not limited to: when the media resources meet the video conferencing requirements initiated by the third terminal, the third resource processing system sends a channel creation request to the fourth resource processing system according to the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system, and the routing information of the third resource processing system is carried in the channel creation request.

[0087] Correspondingly, after receiving the channel creation request, the fourth resource processing system can determine that the media resources meet the video conferencing requirements initiated by the third terminal. If not, it determines that the creation of the resource cascade channel fails. On the contrary, if it meets the requirements, the fourth resource processing system records the routing information of the third resource processing system and sends a channel creation response to the third resource processing system, and the routing information of the fourth resource processing system is carried in the channel creation response. Then, after receiving the channel creation response sent by the fourth resource processing system, the third resource processing system completes the creation of the resource cascade channel according to the routing information of the third resource processing system and the fourth resource processing system.

[0088] It should be noted that in the foregoing process of establishing the resource cascade channel, the third resource processing system acts as the initiator or source end, and the fourth resource processing system acts as the destination end. However, as an implementation method, the fourth resource processing system can also act as the initiator or source end, and the third resource processing system acts as the destination end, and its implementation process is similar to the process of establishing the resource cascade channel with the third resource processing system acting as the initiator or source end and the fourth resource processing system acting as the destination end, which will not be elaborated here.

[0089] For example, when the TCP connection is successfully established between the third resource processing system and the fourth resource processing system, the target processing service receives a second request sent by the fourth resource processing system. The second request includes the media resource types that the fourth resource processing system can provide and the version number of the target processing service of the fourth resource processing system. The target processing service sends a second response to the fourth resource processing system. The second response includes the media resource types that the third resource processing system can provide and the version number of the target processing service in the third resource processing system.

[0090] Optionally, the process of creating the resource cascading channel further includes: receiving a channel creation request sent by the fourth resource processing system, where the channel creation request carries the routing information of the fourth resource processing system; recording the routing information of the fourth resource processing system, and when the media resource meets the video conferencing requirements, sending a channel creation response to the fourth resource processing system, where the channel creation response carries the routing information of the fourth resource processing system; and creating the resource cascading channel according to the routing information of the third resource processing system and the fourth resource processing system.

[0091] Based on this, the following further combines Figure 6a and Figure 6b , and gives an exemplary description of the process of creating the foregoing resource cascading channel, as follows. Among them, it is assumed that the first resource processing system is the source end, and the second resource processing system is the destination end. Correspondingly, the terminal attached to the first resource processing system is the source terminal, and the terminal attached to the second resource processing system is the destination terminal.

[0092] S611, when the terminal (i.e., the source user or source terminal) attached to the first resource processing system needs to communicate with the terminal (i.e., the destination user or destination terminal) on the second resource processing system for audio and video, the first resource processing system uses the MPC to send the specific information of the destination user, such as the XPS address where the destination user is located, to the XPS in the first resource processing system.

[0093] Among them, the terminal attached to the first resource processing system can be, but is not limited to, the foregoing first terminal, and the terminal on the second resource processing system can be, but is not limited to, other terminals participating in the video conference except the first terminal.

[0094] S612, the XPS in the first resource processing system determines whether the destination user is in its own media system according to the specific information of the destination user. If it exists, S613 is executed; otherwise, S614 is executed.

[0095] S613. The first resource processing system directly forwards the audio and video sent by the source user to the destination user.

[0096] S614. The first resource processing system creates a TCP connection with the second resource processing system, such as sending a connection establishment request to the second resource processing system.

[0097] S615. After receiving the connection establishment request, when the second resource processing system determines that its media system is fault-free, it sends a connection establishment response to the first resource processing system according to the connection establishment request to indicate successful establishment.

[0098] S616. After receiving the connection establishment response sent by the second resource processing system through XPS, the first resource processing system sends a first request to the second resource processing system. The first request carries the media resource types that it can provide (such as soft media resources or hard media resources) and the version number of XPS, to request to query the media resource types and XPS version number of the second resource processing system.

[0099] S617. After receiving the first request, the second resource processing system sends a first response to the first resource processing system. The first response carries the media resources that it can provide (such as soft media resources or hard media resources) and the version number of XPS. At this point, the media resource types and version information of both communication parties have been determined.

[0100] S618. The first resource processing system sends a channel creation request to the second resource processing system according to the media resource types and version number of the second resource processing system.

[0101] S619. The second resource processing system responds to the channel creation request, such as sending a channel creation response to the first resource processing system. At this point, the soft and hard media can successfully communicate with each other, that is, the resource cascade channel is successfully created.

[0102] S620. The first resource processing system synchronizes the routing information obtained from the MPC to the XPS of the second resource processing system through XPS.

[0103] S621. The audio and video of the source user in the first resource processing system can be correctly transmitted to the destination user of the second resource processing system through the cascade channel.

[0104] In this example, through the resource cascade channel creation process provided in S611 - S621 above, it is implemented before the resource scheduling of the video conference, that is, the foregoing resource scheduling scheme can be based on the resource cascade channel for normal audio and video intercommunication.

[0105] Compared with a single conference system, in the technical solution adopted in this application, by moving the RMS from the resource processing system to the service processing system, the service processing system supports a method of hybrid deployment of software and hardware media and a resource flexible scheduling solution based on the hybrid deployment method to meet the customer's needs for simultaneously holding large-capacity and 4K conferences, effectively reducing costs. For example, when a user needs to hold a 4K conference, the resource scheduling module schedules the conference to be held on the hard media; when a user needs to hold a large-capacity conference, the resource scheduling module schedules the conference to be held on the soft media. If a single conference spans domains, that is, there are terminals on both the hard media and the soft media, an adaptive media cascade is created to ensure the correct conference function. In addition, under the hybrid deployment of software and hardware media resources, terminals can access the conference according to their optimal capabilities.

[0106] In addition, this application can also add an operation to query the version in the channel creation request, and can adopt different cascade protocols according to the peer media resource type, so as to realize the unified scheduling of software and hardware media resources.

[0107] As Figure 7 shown, a flowchart of a resource scheduling method 700 for a video conference provided by an embodiment of this application is shown. This method can be executed by a third resource processing system. In other words, the method 700 can be executed by software and / or hardware installed in the third resource processing system. The third resource processing system includes but is not limited to: terminal devices, single servers, server clusters, cloud servers, or cloud server clusters, etc. As Figure 7 shown, the method 700 may but is not limited to include the following steps.

[0108] S710, the third resource processing system reports media resource information to the service processing system.

[0109] Among them, the media resource information is used for resource scheduling during a video conference by the service processing system. The media resources in the third resource processing system are the first media resources or the second media resources. The first media resources are encoded and decoded based on a graphics processing unit (GPU), and the second media resources are encoded and decoded based on a central processing unit (CPU).

[0110] Optionally, the method further includes: during the video conference, audio and video content is transmitted between a third terminal and a fourth terminal through a resource cascade channel between the third resource processing system and the fourth resource processing system; wherein, the fourth resource processing system is used to provide the first media resources or the second media resources, the third terminal is attached to the third resource processing system, and the fourth terminal is attached to the fourth resource processing system.

[0111] Optionally, the process of creating the resource cascading channel includes: when the Transmission Control Protocol (TCP) connection establishment between the third resource processing system and the fourth resource processing system is successful, sending a first request to the fourth resource processing system through the target processing service, where the first request includes the media resource types that the third resource processing system can provide and the version number of the target processing service; receiving a first response sent by the fourth resource processing system through the target processing service, where the first response includes the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system; creating a resource cascading channel based on the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system.

[0112] Optionally, the step of creating a resource cascading channel based on the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system includes: when the media resources of the third resource processing system meet the video conferencing requirements initiated by the third terminal, sending a channel creation request to the fourth resource processing system based on the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system, where the channel creation request carries the routing information of the third resource processing system; receiving a channel creation response sent by the fourth resource processing system, where the channel creation response carries the routing information of the fourth resource processing system; creating a resource cascading channel based on the routing information of the third resource processing system and the fourth resource processing system.

[0113] Optionally, the process of creating the resource cascading channel includes: when the TCP connection establishment between the third resource processing system and the fourth resource processing system is successful, receiving a second request sent by the fourth resource processing system through the target processing service, where the second request includes the media resource types that the fourth resource processing system can provide and the version number of the target processing service of the fourth resource processing system; sending a second response to the fourth resource processing system through the target processing service, where the second response includes the media resource types that the third resource processing system can provide and the version number of the target processing service in the third resource processing system.

[0114] Optionally, the process of creating the resource cascading channel further includes: receiving a channel creation request sent by the fourth resource processing system, where the routing information of the fourth resource processing system is carried in the channel creation request; recording the routing information of the fourth resource processing system, and when the media resource meets the video conferencing requirements, sending a channel creation response to the fourth resource processing system, where the routing information of the fourth resource processing system is carried in the channel creation response; creating a resource cascading channel according to the routing information of the third resource processing system and the fourth resource processing system.

[0115] It can be understood that each implementation in Method Embodiment 700 has the same or corresponding technical features as those in the foregoing Method Embodiment 300. Therefore, the implementation process of each implementation in Method Embodiment 700 can refer to the description in the foregoing Method Embodiment 300 and achieve the same or corresponding technical effects. To avoid repetition, it will not be elaborated here.

[0116] Figure 8 FIG. 8 shows a schematic structural diagram of a resource scheduling device 800 for a video conference provided by an embodiment of the present application. The device 800 is applied to a service processing system. The device 800 includes: an obtaining module 810, configured to obtain media resource information on a first resource processing system and media resource information on a second resource processing system; a scheduling module 820, configured to perform resource scheduling during a video conference according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system; where the media resource information on the first resource processing system is encoded and decoded based on a graphics processing unit (GPU), and the media resource information on the second resource processing system is encoded and decoded based on a central processing unit (CPU).

[0117] Optionally, when the scheduling module 820 performs resource scheduling during a video conference according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system, it includes: receiving a first video conference request sent by a first terminal, where the first terminal is connected to the first resource processing system or the second resource processing system; determining whether the meeting resource requirements corresponding to the first video conference request are met according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system; and when the meeting resource requirements corresponding to the first video conference request are met, invoking the media resources on the first resource processing system and / or the media resources on the second resource processing system to conduct a video conference.

[0118] Optionally, the scheduling module 820 invokes the media resources on the first resource processing system and / or the media resources on the second resource processing system for a video conference, including any of the following: when the first video conference request includes the first capability, invoking the media resources on the first resource processing system for the video conference; when the video conference request does not include the first capability but includes the second capability, invoking the media resources on the second resource processing system for the video conference; wherein, the first capability includes that the resolution of the video conference is a preset value, and the second capability includes that the resolution of the video conference is a value other than the preset value.

[0119] Optionally, the scheduling module 820 is further configured to, during the video conference, receive a second video conference request sent by a second terminal; when the second video conference request includes the first capability, determine whether the remaining media resources on the first resource processing system meet the conference access requirements of the second terminal; when the conference access requirements of the second terminal are met, initiate an adding terminal process to the first resource processing system, and based on the first capability and the remaining media resources on the first resource processing system, connect the second terminal to the video conference.

[0120] Optionally, when the conference access requirements of the second terminal are not met, if the second video conference request includes the second capability, the scheduling module 820 is further configured to initiate an adding terminal process to the second resource processing system, and based on the second capability and the media resources on the second resource processing system, connect the second terminal to the video conference.

[0121] Optionally, when the second video conference request does not include the first capability, the scheduling module 820 is further configured to initiate an adding terminal process to the second resource processing system, and based on the remaining media resources on the second resource processing system, connect the second terminal to the video conference.

[0122] Optionally, during the video conference, the scheduling module 820 is further configured to transmit audio and video content based on the resource cascading channel between the first resource processing system and the second resource processing system.

[0123] The apparatus 800 provided in the embodiments of the present application can execute the various methods described in the foregoing method embodiment 300, and implement the functions and beneficial effects of the various methods described in the foregoing method embodiment 300, which will not be elaborated herein.

[0124] Figure 9The structural schematic diagram of a resource scheduling device 900 for a video conference provided by an embodiment of the present application is shown. The device 900 is applied to the third resource processing system. The device 900 includes: a transmission module 910, configured to report media resource information to a service processing system; wherein, the media resource information is used for resource scheduling during a video conference by the service processing system. The media resources in the third resource processing system are the first media resources or the second media resources. The first media resources are encoded and decoded based on a graphics processing unit (GPU), and the second media resources are encoded and decoded based on a central processing unit (CPU).

[0125] Optionally, the transmission module 910 is further configured to, during a video conference, perform audio and video content transmission between a third terminal and a fourth terminal through a resource cascading channel between the third resource processing system and a fourth resource processing system; wherein, the fourth resource processing system is configured to provide the first media resources or the second media resources. The third terminal is subordinate to the third resource processing system, and the fourth terminal is subordinate to the fourth resource processing system.

[0126] Optionally, the device 900 further includes a creation module, configured to create the resource cascading channel. The process of the creation module creating the resource cascading channel includes: when a TCP connection is successfully established between the third resource processing system and the fourth resource processing system, sending a first request to the fourth resource processing system through a target processing service. The first request includes the type of media resources that the third resource processing system can provide and the version number of the target processing service in the third resource processing system; receiving a first response sent by the fourth resource processing system through the target processing service. The first response includes the type of media resources that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system; creating a resource cascading channel according to the type of media resources that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system.

[0127] Optionally, the creating module creates a resource cascading channel according to the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system, including: when the media resources meet the video conferencing requirements initiated by the third terminal, sending a channel creation request to the fourth resource processing system according to the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system, where the channel creation request carries the routing information of the third resource processing system; receiving a channel creation response sent by the fourth resource processing system, where the channel creation response carries the routing information of the fourth resource processing system; and creating a resource cascading channel according to the routing information of the third resource processing system and the fourth resource processing system.

[0128] Optionally, the process of the creating module creating a resource cascading channel includes: when the TCP connection is successfully established between the third resource processing system and the fourth resource processing system, receiving a second request sent by the fourth resource processing system through the target processing service, where the second request includes the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system; and sending a second response to the fourth resource processing system through the target processing service, where the second response includes the media resource types that the third resource processing system can provide and the version number of the target processing service in the third resource processing system.

[0129] Optionally, the process of the creating module creating a resource cascading channel further includes: receiving a channel creation request sent by the fourth resource processing system, where the channel creation request carries the routing information of the fourth resource processing system; recording the routing information of the fourth resource processing system, and when the media resources meet the video conferencing requirements, sending a channel creation response to the fourth resource processing system, where the channel creation response carries the routing information of the fourth resource processing system; and creating a resource cascading channel according to the routing information of the third resource processing system and the fourth resource processing system.

[0130] The apparatus 900 provided in the embodiments of the present application can execute the various methods described in the foregoing method embodiment 700, and implement the functions and beneficial effects of the various methods described in the foregoing method embodiments, which will not be elaborated herein.

[0131] Figure 10The figure shows a schematic diagram of the hardware structure of the electronic device provided in the embodiments of the present application. Referring to this figure, at the hardware level, the electronic device includes a processor, and optionally, an internal bus, a network interface, and a memory. Among them, the memory may include internal memory, such as high-speed random access memory (RAM), and may also include non-volatile memory, such as at least one disk memory, etc. Of course, the electronic device may also include other hardware required for other services.

[0132] The processor, network interface, and memory can be interconnected through an internal bus, and this internal bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, only a bidirectional arrow is used in this figure, but it does not mean that there is only one bus or one type of bus.

[0133] The memory is used to store programs. Specifically, the program may include program code, and the program code includes computer operation instructions. The memory may include internal memory and non-volatile memory, and provide instructions and data to the processor.

[0134] The processor reads the corresponding computer program from the non-volatile memory into the internal memory and then runs it, forming a device for locating a specified user at the logical level. The processor executes the program stored in the memory and is specifically used to execute: Figures 3 - 7 The methods disclosed in the illustrated embodiments and implement the functions and beneficial effects of the various methods described in the foregoing method embodiments, which will not be elaborated herein.

[0135] The above is as described in the present application Figures 3 - 7The method disclosed in the illustrated embodiment can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit in the hardware of the processor or instructions in the form of software. The above-mentioned processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor. The software module may be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and combines its hardware to complete the steps of the above method.

[0136] The electronic device can also execute the various methods described in the foregoing method embodiments and achieve the functions and beneficial effects of the various methods described in the foregoing method embodiments, which will not be elaborated here.

[0137] Of course, in addition to the software implementation manner, the electronic device of the present application does not exclude other implementation manners, such as a logic device or a combination of software and hardware, etc. That is to say, the execution subject of the following processing flow is not limited to each logic unit, and may also be hardware or a logic device.

[0138] The embodiments of the present application also propose a computer-readable storage medium. The computer-readable medium stores one or more programs. When the one or more programs are executed by an electronic device including a plurality of application programs, the electronic device is caused to execute Figures 3 - 7 the method disclosed in the illustrated embodiment and achieve the functions and beneficial effects of the various methods described in the foregoing method embodiments, which will not be elaborated here.

[0139] Among them, the computer-readable storage medium includes a read-only memory (ROM), a random access memory (RAM), a magnetic disk, an optical disc, etc.

[0140] Furthermore, an embodiment of the present application also provides a computer program product. The computer program product includes a computer program stored on a non-transitory computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a computer, the following processes are implemented: Figures 1 - 3 The method disclosed in the illustrated embodiment realizes the functions and beneficial effects of each method described in the foregoing method embodiments, and will not be elaborated herein.

[0141] In summary, the above are only the preferred embodiments of the present application and are not intended to limit the protection scope of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

[0142] The systems, devices, modules or units illustrated in the above embodiments can be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or any combination of these devices.

[0143] Computer-readable media includes permanent and non-permanent, removable and non-removable media and can be implemented by any method or technology for information storage. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

[0144] It should also be noted that the terms "comprising", "including" or any other variants thereof are intended to cover non-exclusive inclusion, such that a process, method, commodity or device comprising a series of elements not only includes those elements but also other elements not expressly listed, or further includes elements inherent to such process, method, commodity or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the existence of additional identical elements in the process, method, commodity or device comprising said element.

[0145] Each embodiment in this specification is described in a progressive manner. For the identical or similar parts among the embodiments, reference can be made to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and reference can be made to the relevant parts of the method embodiment for the related content.

Claims

1. A resource scheduling method for video conferencing, characterized in that, it is executed by a service processing system, and the method includes: obtaining media resource information on a first resource processing system and media resource information on a second resource processing system; performing resource scheduling during a video conference according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system; wherein, the media resource information on the first resource processing system is encoded and decoded based on a graphics processing unit (GPU), and the media resource information on the second resource processing system is encoded and decoded based on a central processing unit (CPU).

2. The method according to claim 1, characterized in that, the performing resource scheduling during a video conference according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system includes: receiving a first video conference request sent by a first terminal, where the first terminal is subordinate to the first resource processing system or the second resource processing system; determining whether the meeting resource requirements corresponding to the first video conference request are met according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system; when the meeting resource requirements corresponding to the first video conference request are met, invoking the media resources on the first resource processing system and / or the media resources on the second resource processing system to conduct a video conference.

3. The method according to claim 2, characterized in that, the invoking the media resources on the first resource processing system and / or the media resources on the second resource processing system to conduct a video conference includes any one of the following: when the first video conference request includes a first capability, invoking the media resources on the first resource processing system to conduct a video conference; when the video conference request does not include the first capability but includes a second capability, invoking the media resources on the second resource processing system to conduct a video conference; wherein, the first capability includes that the resolution of the video conference is a preset value, and the second capability includes that the resolution of the video conference is a value other than the preset value.

4. The method according to any one of claims 1-3, characterized in that, the method further includes: during the video conference, receiving a second video conference request sent by a second terminal; when the second video conference request includes a first capability, determining whether the remaining media resources on the first resource processing system meet the meeting access requirements of the second terminal; when the meeting access requirements of the second terminal are met, initiating an adding terminal process to the first resource processing system, and accessing the second terminal to the video conference based on the first capability and the remaining media resources on the first resource processing system.

5. The method according to claim 4, characterized in that, the method further includes: In the case where the meeting access requirements of the second terminal are not met, if the second video conference request includes a second capability, initiate an adding-terminal process to the second resource processing system, and access the second terminal to the video conference based on the second capability and the media resources on the second resource processing system.

6. The method according to claim 4, wherein, the method further includes: In the case where the first capability is not included in the second video conference request, initiate an adding-terminal process to the second resource processing system, and access the second terminal to the video conference based on the remaining media resources on the second resource processing system.

7. The method according to any one of claims 1-3, wherein, the method further includes: During the video conference, transmit audio and video content based on the resource cascading channel between the first resource processing system and the second resource processing system.

8. A resource scheduling method for a video conference, wherein, executed by a third resource processing system, the method includes: Report media resource information to the service processing system; wherein, the media resource information is used for resource scheduling during a video conference by the service processing system, the media resources in the third resource processing system are first media resources or second media resources, the first media resources are encoded and decoded based on a graphics processing unit (GPU), and the second media resources are encoded and decoded based on a central processing unit (CPU).

9. The method according to claim 8, wherein, the method further includes: During the video conference, transmit audio and video content between a third terminal and a fourth terminal through the resource cascading channel between the third resource processing system and the fourth resource processing system; wherein, the fourth resource processing system is used to provide the first media resources or the second media resources, the third terminal is connected to the third resource processing system, and the fourth terminal is connected to the fourth resource processing system.

10. The method according to claim 9, wherein, the process of creating the resource cascading channel includes: In the case where the Transmission Control Protocol (TCP) connection establishment between the third resource processing system and the fourth resource processing system is successful, send a first request to the fourth resource processing system through the target processing service, the first request includes the type of media resources that the third resource processing system can provide and the version number of the target processing service; Receive a first response sent by the fourth resource processing system through the target processing service, the first response includes the type of media resources that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system; Create a resource cascading channel according to the type of media resources that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system.

11. The method according to claim 10, wherein, Creating a resource cascading channel according to the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system, includes: When the media resources in the third resource processing system meet the video conferencing requirements initiated by the third terminal, the third resource processing system sends a channel creation request to the fourth resource processing system according to the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system. The channel creation request carries the routing information of the third resource processing system; Receiving a channel creation response sent by the fourth resource processing system, where the channel creation response carries the routing information of the fourth resource processing system; Completing the creation of the resource cascading channel according to the routing information of the third resource processing system and the fourth resource processing system.

12. The method according to claim 9, characterized in that, The process of creating the resource cascading channel includes: When the TCP connection is successfully established between the third resource processing system and the fourth resource processing system, receiving a second request sent by the fourth resource processing system through the target processing service. The second request includes the media resource types that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system; Sending a second response to the fourth resource processing system through the target processing service. The second response includes the media resource types that the third resource processing system can provide and the version number of the target processing service in the third resource processing system.

13. The method according to claim 12, characterized in that, The process of creating the resource cascading channel further includes: Receiving a channel creation request sent by the fourth resource processing system, where the channel creation request carries the routing information of the third resource processing system; Recording the routing information of the fourth resource processing system, and when the media resources meet the video conferencing requirements, sending a channel creation response to the fourth resource processing system. The channel creation response carries the routing information of the fourth resource processing system; Completing the creation of the resource cascading channel according to the routing information of the third resource processing system and the fourth resource processing system.

14. A video conferencing system, characterized in that, includes: A first resource processing system for providing media resources encoded and decoded based on the GPU; A second resource processing system for providing media resources encoded and decoded based on the CPU; A service processing system for performing resource scheduling during video conferencing according to the media resource information reported by the first resource processing system and the media resource information reported by the second resource processing system.

15. An electronic device, characterized in that, includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the computer program is executed by the processor, it implements the steps of the video conferencing resource scheduling method according to any one of claims 1-13.

16. A computer-readable medium, It is characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the resource scheduling method for video conferencing according to any one of claims 1-13 are implemented.

Images