Resource scheduling method for video conference, and electronic device and computer-readable storage medium

Abstract

Provided in the embodiments of the present application are a resource scheduling method for a video conference, and an electronic device and a computer-readable storage medium. The method comprises: a service processing system acquiring media resource information on a first resource processing system and media resource information on a second resource processing system (S310); and performing resource scheduling during a video conference on the basis of the media resource information on the first resource processing system and / or the media resource information on the second resource processing system (S320), wherein the media resource information on the first resource processing system is encoded and decoded on the basis of a graphics processing unit (GPU), and the media resource information on the second resource processing system is encoded and decoded on the basis of a central processing unit (CPU).

Description

Resource scheduling method for video conferencing, electronic device, and computer-readable storage medium

[0001] Cross-references

[0002] This application claims priority to a Chinese patent application filed with the Patent Office of China on December 7, 2023, with application number 202311685615.8 and titled “Resource Scheduling Method, Electronic Device and Computer-Readable Storage Medium for Video Conferencing”. The entire contents of the application are incorporated by reference into this application. Technical Field

[0003] The present application relates to the field of communication technology, and in particular to a resource scheduling method for video conferencing, an electronic device, and a computer-readable storage medium. Background Art

[0004] Video conferencing is a multimedia communication method that enables simultaneous exchange of images, voice, and data between two or more locations. A video conferencing system generally consists of a service processing system, a media subsystem, and terminals. With the rapid development of network technology, demands for video conferencing quality and capacity are increasing. Improving conference capacity and video clarity has become a key requirement for conferencing systems.

[0005] In this regard, the video conferencing system expansion solution adopted in related technologies is: add a media resource domain of the same type, such as a hard media resource domain or a soft media resource domain, to the video conferencing group network, and hang it under the business processing system to increase the capacity of the video conferencing system.

[0006] However, in the capacity expansion solutions adopted in related technologies, although soft media resources have the advantage of supporting large-capacity video conferencing, the performance of the media codec chips in the cloud environment that supports the installation of soft media resources cannot meet the 4K processing capabilities, affecting the quality of video conferencing; and although hard media resources can meet the needs of users to hold 4K video conferencing, due to the limited hard media resources, if large-capacity meetings are to be held, multiple servers need to be deployed, which has poor economic benefits. Summary of the Invention

[0007] Embodiments of the present application provide a resource scheduling method for a video conference, an electronic device, and a computer-readable storage medium.

[0008] In a first aspect, an embodiment of the present application provides a resource scheduling method for video conferencing, which is executed by a business processing system. The method includes: obtaining media resource information on a first resource processing system and media resource information on a second resource processing system; performing resource scheduling during video conferencing based on the media resource information on the first resource processing system and / or the media resource information on the second resource processing system; wherein the media resource information on the first resource processing system is encoded and decoded based on a graphics processing unit GPU, and the media resource information on the second resource processing system is encoded and decoded based on a central processing unit CPU.

[0009] In the second aspect, an embodiment of the present application provides a resource scheduling method for video conferencing, which is executed by a third resource processing system, and the method includes: reporting media resource information to a business processing system; wherein, the media resource information is used for resource scheduling when the business processing system conducts a video conference, and the media resources in the third resource processing system are first media resources or second media resources, the first media resource is encoded and decoded based on a graphics processing unit GPU, and the second media resource is encoded and decoded based on a central processing unit CPU.

[0010] In a third aspect, an embodiment of the present application provides a video conferencing system, comprising: a first resource processing system for providing media resources for encoding and decoding based on a GPU; a second resource processing system for providing media resources for encoding and decoding based on a CPU; and a business processing system for performing resource scheduling during video conferencing based on the media resource information reported by the first resource processing system and the media resource information reported by the second resource processing system.

[0011] In a fourth aspect, an embodiment of the present application provides an electronic device comprising: a memory, a processor, and computer-executable instructions stored on the memory and executable on the processor, wherein the computer-executable instructions, when executed by the processor, implement the steps of the method described in the first aspect or the second aspect.

[0012] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, which is used to store computer-executable instructions. When the computer-executable instructions are executed by a processor, the steps of the method described in the first aspect or the second aspect are implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in this application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0014] FIG1 shows a schematic diagram of a network of a video conferencing system according to an embodiment of the present application.

[0015] FIG. 2 a shows one schematic diagram of a media resource reporting process.

[0016] FIG2 b shows a second schematic diagram of the media resource reporting process.

[0017] FIG3 shows one of the flow charts of the resource scheduling method for a video conference provided in an embodiment of the present application.

[0018] FIG4 a shows a second flow chart of a resource scheduling method for a video conference provided in an embodiment of the present application.

[0019] FIG4 b shows a third flow chart of the resource scheduling method for a video conference provided in an embodiment of the present application.

[0020] FIG5 shows one of the flowcharts of the resource cascade channel establishment process provided in an embodiment of the present application.

[0021] FIG6 a shows a second flow chart of the resource cascade channel establishment process provided in an embodiment of the present application.

[0022] FIG6 b shows a third flow chart of the resource cascade channel establishment process provided in an embodiment of the present application.

[0023] FIG7 shows a fourth flow chart of the resource scheduling method for a video conference provided in an embodiment of the present application.

[0024] FIG8 shows one of the structural diagrams of the resource scheduling device for video conferencing provided in an embodiment of the present application.

[0025] FIG9 shows a second structural diagram of the resource scheduling device for video conferencing provided in an embodiment of the present application.

[0026] FIG10 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the technical solutions in this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0028] With the rapid development of network technology, people's requirements for the quality of video conferencing are getting higher and higher, especially for the clarity of video conferencing. At the same time, with the full coverage of 5G networks, users can join video conferences anytime and anywhere, without being restricted to the previously fixed conference room terminals, so that the number of users accessing the conference system is growing in a thread, which also poses a challenge to the capacity of the video conferencing system. In this case, the present application provides a video conferencing system, the networking structure of which is shown in Figure 1, which may include but is not limited to a first resource processing system, a second resource processing system, a business processing system, and multiple terminals hanging under the first resource processing system and the second resource processing system, and the first resource processing system, the second resource processing system, and the business processing system are deployed in the same network.

[0029] Among them, the first resource processing system can also be called a hard media resource system, which is deployed based on physical machines and static containers to provide media resources based on graphics processing units (GPUs) for encoding and decoding, that is, hard media resources. In this embodiment, the first resource processing system has a high video conferencing quality, such as being able to provide 4K conference processing capabilities. Optionally, the video conference mentioned in the context of this application can be an instant conference or a scheduled conference, etc., which is not limited here.

[0030] The second resource processing system can also be called a soft media resource system, which is based on the cloud platform and cloud base (Tulip Elastic Cloud System Cloud Foundry, TCF) for business deployment to provide media resources based on the central processing unit (Central Processing Unit / Processor, CPU) for encoding and decoding, that is, soft media resources. In this embodiment, the second resource processing system has the ability to conduct large-capacity video conferencing, such as the maximum capacity of a single group video conferencing can reach 2,000 parties. Among them, TCF is a dual-core operating platform that supports TECS (Tulip Elastic Cloud System) and the open source container orchestration platform kubernetes (K8S).

[0031] The business processing system is similar to the second resource processing system, and is also based on a cloud platform and TCF for business deployment, so as to be used for resource scheduling during video conferencing based on the media resource information reported by the first resource processing system and the media resource information reported by the second resource processing system. Therefore, by integrating the deployment of soft media resources and hard media resources, it is possible to achieve the expansion of video conferencing resources while avoiding the problem of limited hard media resources, thereby meeting the quality of video conferencing and ensuring economic benefits.

[0032] That is to say, considering that the related technologies cannot be directly cascaded due to the version differences between hard media resources and soft media resources, only hard media resources can be cascaded with hard media resources, or soft media resources can be cascaded with soft media resources, resulting in a single soft media cascade being unable to hold a 4K multi-screen conference because the performance of the server's media codec chip cannot reach the 4K processing capability, and a single hard media cascade cannot stably hold a large-capacity conference due to limited resources. In response to this, the present application integrates the deployment of soft media resources and hard media resources, and moves the resource management system (RMS) originally configured in the first resource processing system and the second resource processing system from the first resource processing system and the second resource processing system to the business processing system, and modifies the media resource cascade in the first resource processing system and the second resource processing system to achieve the purpose of soft and hard media cascade, so that the redesigned video conferencing system can support 4K conferences and video conferencing with a maximum capacity of 2,000 parties for a single group conference. The aforementioned RMS can also be called a resource scheduling unit, which is used to manage media resources such as audio, video, network, and files, and to perform statistics, scheduling, scaling, etc. on information such as the total amount of resources and the currently used amount of resources.

[0033] For example, please refer to Figures 2a and 2b. Before the RMS is moved from the first resource processing system and the second resource processing system to the business processing system, the media resource reporting process is shown in Figure 2a. The first resource processing system reports its own media resource information to the media process control (MPC) through the service general term (X process service, XPS), and then the MPC reports the resource information to the RMS. Similarly, the second resource processing system can also report its own media resource information to the MPC through the XPS, and then the MPC reports the media resource information to the RMS. In this case, because the RMSs in the first resource processing system and the second resource processing system are different, there is no module in the video conferencing system to uniformly manage hard media resources and soft media resources. In other words, the resource usage in the entire video conferencing system is invisible, and optimal resource utilization cannot be achieved. In this regard, the present application considers moving the RMS in the first resource processing system and the second resource processing to the business processing system, as shown in Figure 2b. Then, after the XPS in the first resource processing system and the second resource processing respectively report their own media resource information to their respective MPCs, the MPCs can report the resource information to the RMS in the business processing system through http, etc., so that the business processing system can obtain the media resource information in the entire video conferencing system, such as resource usage, and perform real-time resource scheduling during video conferencing based on resource usage, thus realizing the hybrid deployment of soft and hard resources. It can be understood that the reporting process of hard media resources in the first resource processing system and soft media resources in the second resource processing system is consistent and will not be repeated here.

[0034] Among them, MPC, also known as the media control unit, is used to uniformly access the media streams of various terminals, process the media streams according to publish and subscribe instructions, support audio sorting, forwarding, transcoding, mixing, video forwarding, switching, and has extremely high requirements for forwarding capacity and latency. XPS is a general term for media processing services (MPS), video processing services (VPS), and flexible capacity services (FCS).

[0035] The MPS may be referred to as an audio and video forwarding processing unit, an audio codec unit, etc., and is used for audio and video forwarding, audio codec, etc.

[0036] The VPS can be called a video processing unit, which is used to provide functions such as video synthesis, video transcoding, and video scaling. It has extremely high requirements for processing latency and supports heterogeneous acceleration.

[0037] In addition, the resources in the video conferencing system mentioned in this application generally refer to media resources, that is, codec resources, such as GPU codec resources, CPU codec resources, etc. In addition, the video conferencing system may include but is not limited to that shown in Figure 1 above. For example, the video conferencing system may include multiple first resource processing systems, multiple second resource processing systems, etc., which are not limited here.

[0038] Based on the aforementioned video conferencing system, as shown in FIG3 , a flow chart of a resource scheduling method 300 for a video conference provided in an embodiment of the present application is shown. This method 300 can be executed by a business processing system. In other words, the method 300 can be executed by software and / or hardware installed in the business processing system. The business processing system may include, but is not limited to, a terminal device, a single server, a server cluster, a cloud server, or a cloud server cluster. As shown in FIG3 , the method 300 may, but is not limited to, include the following steps S310 and S320.

[0039] S310: Acquire media resource information on the first resource processing system and media resource information on the second resource processing system.

[0040] The media resource information on the first resource processing system is encoded and decoded based on a GPU, and the media resource information on the second resource processing system is encoded and decoded based on a CPU.

[0041] In this embodiment, referring again to Figures 1 and 2b, the business processing system may obtain media resource information in a variety of ways. For example, the business processing system may proactively request or trigger the first resource processing system or the second resource processing system to report its own media resource information. Alternatively, the first resource processing system or the second resource processing system may periodically or in real time report its own media resource information to the business processing system, and the like, without limitation.

[0042] Optionally, the media resource information may include but is not limited to the amount of media resources currently used in the first resource processing system and the second resource processing system, the amount of remaining media resources, the type of media resources, etc. The media resource type may be that the media resources in the first resource processing system and the second resource processing system are soft media resources or hard media resources, etc.

[0043] S320: Perform resource scheduling for the video conference according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system.

[0044] The video conference may be an instant conference or a scheduled conference.

[0045] In this embodiment, the business processing system obtains media resource information from the first resource processing system and the second resource processing system, and then flexibly schedules soft and hard media resources based on the obtained media resource information to ensure economic benefits while meeting different video conferencing requirements such as large capacity and high definition.

[0046] Based on this, in some embodiments, depending on the different requirements of the video conference, the resource scheduling described in S320 for conducting a video conference based on the media resource information on the first resource processing system and / or the media resource information on the second resource processing system can be implemented in various ways. For example, when the video conference requirement is only for high capacity, the business processing system may only schedule the media resources in the second resource processing system for the video conference. For example, during the video conference, the business processing system may forward the meeting request information to the second resource processing system for processing.

[0047] When the video conference requires only high definition, the business processing system can schedule media resources in the first resource processing system for video conferencing. For example, during the video conference, the business processing system forwards the meeting request information to the first resource processing system for processing.

[0048] When the video conference requires large capacity and high definition, the media resources in the first resource processing system and the second resource processing system can be scheduled simultaneously for video conferencing. For example, during the video conference, the business processing system forwards the meeting request information sent by different terminals to the corresponding first resource processing system or second resource processing system or processes it, etc. There is no restriction here.

[0049] For example, when the first terminal connected to the first resource processing system or the second resource processing system needs to conduct a video conference, the first terminal can convene a video conference on the video interface, such as an instant meeting or a scheduled meeting, and send a first video conference request to the business processing system, wherein the first video conference request may carry information such as the meeting subject, the meeting type (such as an instant meeting or a scheduled meeting), and the meeting capability template. The meeting capability template may include but is not limited to the meeting time, the number of participants, the meeting clarity or resolution requirements, etc. It can be understood that when the first terminal sends the first video conference request to the business processing system, it can, but is not limited to, forward the first video conference request to the business processing system through the first resource processing system or the second resource processing system.

[0050] Correspondingly, the business processing system receives the first video conference request sent by the first terminal, and determines whether the media resource information on the first resource processing system and / or the media resource information on the second resource processing system meets the conference resource requirements corresponding to the first video conference request based on the acquired media resource information on the first resource processing system and / or the acquired media resource information on the second resource processing system. For example, after receiving the first video conference request through the RMS, the business processing system can calculate the size and type of media resources required for the video conference, and determine whether the current media resources meet the conference resource requirements corresponding to the first video conference request based on the media resource information on the first resource processing system and / or the acquired media resource information on the second resource processing system.

[0051] Then, if the business processing system determines that the conference resource requirements corresponding to the first video conference request are not met, it returns a conference convening failure response to the first terminal. Alternatively, if the business processing system determines that the conference resource requirements corresponding to the first video conference request are met, it calls the media resources on the first resource processing system and / or the media resources on the second resource processing system to conduct the video conference.

[0052] It is worth noting that if the video conference is an instant conference, then the business processing system can immediately call the media resources on the first resource processing system and / or the media resources on the second resource processing system for the video conference if it is determined that the conference resource requirements corresponding to the first video conference request are met; if the video conference is a scheduled conference, then the business processing system can call the media resources on the first resource processing system and / or the media resources on the second resource processing system for the video conference according to the scheduled time of the scheduled conference if it is determined that the conference resource requirements corresponding to the first video conference request are met.

[0053] Optionally, in some embodiments, the process of the business processing system invoking the media resources on the first resource processing system and / or the media resources on the second resource processing system for the video conference may further include: if the first video conference request includes a first capability, the business processing system may invoking the media resources on the first resource processing system for the video conference. The first capability includes setting the resolution of the video conference to a preset value, such as 4K.

[0054] Alternatively, if the video conference request does not include the first capability but includes a second capability, the service processing system may invoke media resources on the second resource processing system to conduct the video conference. The first capability includes a preset resolution for the video conference, such as 4K, and the second capability includes a resolution other than the preset value, such as a resolution less than 4K.

[0055] It can be understood that the aforementioned "calling the media resources on the first resource processing system or the second resource processing system for video conferencing" can be understood as: when conducting a video conference, the business server will send the meeting request received during the subsequent video conference to the first resource processing system or the second resource processing system for encoding and decoding, etc., and no restrictions are imposed here.

[0056] For ease of understanding, the resource scheduling process when the first terminal initiates a video conference is exemplarily described below with reference to FIG. 4 a , as follows.

[0057] S411, the first terminal (or referred to as the user terminal or the user) opens the conference APP, and convenes a meeting on the conference interface, such as a real-time meeting or a scheduled meeting, and sends a first video conference request to the business processing system.

[0058] S412: The service processing system analyzes the user input, such as the conference topic, conference type, and conference capability template, based on the received first video conference request. The conference capability template information includes a first capability (such as 4K capability), a second capability (such as non-4K capability), and the like.

[0059] S413, the business processing system calculates the media resources required for the video conference based on the first video conference request through RMS, and determines whether the media resources required for the video conference are met based on the current resource usage on the first resource processing system and the second resource processing system. If so, execute S414; otherwise, determine that the meeting has failed.

[0060] S414: The business processing system responds to the first video conference request and determines whether the conference capability template in the first video conference request carries 4K capability. If so, execute S415; otherwise, execute S416.

[0061] S415 , the business processing system may call the media resources on the first resource processing system to conduct a video conference, such as sending a meeting request for a subsequent video conference to the first resource processing system, ie, the hard media resource system.

[0062] S416: The business processing system may call the media resources on the second resource processing system to conduct a video conference, such as sending a subsequent video conference request to the second resource processing system, ie, the soft media resource system.

[0063] It is worth noting that, please refer to Figure 2b again. In a video conference, when the MPC in the first resource processing system receives a video conference request issued by the business processing system, it can forward the video conference request to the XPS. Then the XPS returns the response result corresponding to the video conference request to the MPC, and the MPC returns the response result of the meeting to the business processing system. At this point, the meeting process ends, and the user can see the corresponding meeting information on the interface.

[0064] In this example, through the above steps S411 to S416, the video conferencing system can hold a video conference that meets user needs according to user input and achieve optimal scheduling of media resources, that is, avoid the situation where a 4K conference is needed but there are no resources, and the hard media resources are occupied by other non-4K conferences.

[0065] Based on this, in an optional embodiment, if a new second terminal connected to the first resource processing system or the second resource processing system joins the video conference during the video conference, the second terminal may send a second video conference request to the business processing system. For example, the second terminal may enter the video conference number to be joined on the conference interface to request to join the video conference, and the video conference number may correspond to the video conference initiated by the first terminal. It is understood that when the second terminal sends the second video conference request to the business processing system, the second video conference request may be forwarded to the business processing system via the first resource processing system or the second resource processing system, but is not limited to being forwarded to the business processing system.

[0066] Correspondingly, after the business processing system receives the second video conference request sent by the second terminal, and if the second video conference request includes the first capability, it determines whether the remaining media resources on the first resource processing system meet the conference access requirements of the second terminal. If the business processing system determines that the conference access requirements of the second terminal are met, it initiates an add-end process to the first resource processing system, and connects the second terminal to the video conference based on the first capability and the remaining media resources on the first resource processing system. Conversely, the business processing system may initiate an add-end process to the second resource processing system, such as sending an add-end request to the second resource processing system, and connect the second terminal to the video conference based on the remaining media resources on the second resource processing system.

[0067] Furthermore, if the second video conference request includes both the first and second capabilities, and the business processing system determines that the remaining media resources on the first resource processing system do not meet the conference access requirements of the second terminal, the business processing system may initiate a terminal addition process with the second resource processing system, such as sending a terminal addition request to the second resource processing system and connecting the second terminal to the video conference based on the second capability and the media resources on the second resource processing system. This effectively ensures that 4K terminals are prioritized for access through hard media resources. This also ensures that terminals can successfully join the conference when hard media resources are insufficient, significantly reducing the probability of terminal entry failure.

[0068] For ease of understanding, the resource scheduling process when the second terminal joins the video conference is exemplarily described below with reference to FIG. 4 b , as follows.

[0069] S421, the second terminal (or referred to as user terminal or user) enters the video conference number to be joined on the conference interface, such as the video conference initiated by the first terminal, and sends a second video conference request to the business processing system.

[0070] S422: The service processing system receives a second video conference request from a second terminal and analyzes the capabilities carried in the second video conference request, such as whether the second capability is carried.

[0071] S423, the service processing system determines whether the second video conference request carries the first capability. For example, if the resolution is 4K, if it carries the first capability, execute S424; otherwise, execute S425.

[0072] S424: Determine whether the current remaining media resources in the first resource processing system meet the requirements for the second terminal to join the conference with the first capability. If yes, execute S426; otherwise, execute S427.

[0073] S425, the business processing system initiates an add-end process to the second resource processing system, such as the business processing system sends an add-end request to the second resource processing system to request the second terminal to access the video conference through the non-4K capabilities in the soft media resources.

[0074] S426, the business processing system initiates a terminal adding process to the first resource processing system, such as the business processing system sending a terminal adding request to the first resource processing system to request the second terminal to join the conference directly through the hard media resource and with the first capability.

[0075] S427, the business processing system determines whether the second video conference request includes the second capability, such as other non-4K capabilities. If so, S428 is executed. Otherwise, it is determined that the second terminal has failed to join the conference.

[0076] S428: The service processing system initiates a request to add a terminal to the second resource processing system, and the second terminal joins the conference through the non-4K capability in the soft media resource.

[0077] In this example, the resource scheduling strategy provided in steps S421 to S428 above can effectively ensure that 4K terminals are preferentially accessed through hard media resources. When hard media resources are insufficient, it can also ensure that the terminals can successfully join the meeting, greatly reducing the probability of terminal joining failure.

[0078] In the resource scheduling process of the aforementioned video conference provided in this application, if it is necessary to schedule the media resources in the first resource processing system and the media resources in the second resource processing system, then the business processing system and the terminals participating in the video conference (such as the first terminal and the second terminal) can transmit audio and video content based on the resource cascade channel between the first resource processing system and the second resource processing system. Thus, when some users in the same video conference access the conference through the first resource processing system and the other users access the conference through the second resource processing system, the two parts of users can achieve audio and video intercommunication while the user side is unaware of the media resources they have accessed, thereby ensuring the user's video conference experience.

[0079] In an optional embodiment, the process of creating the resource cascade channel may be as shown in FIG5 , which may include but is not limited to S510 to S530. It should be noted that, in the context of this application, if the third resource processing system is the aforementioned first resource processing system, then the fourth resource processing system is the aforementioned second resource processing system; if the third resource processing system is the aforementioned second resource processing system, then the fourth resource processing system is the aforementioned first resource processing system.

[0080] S510, when the Transmission Control Protocol (TCP) link is successfully established between the third resource processing system and the fourth resource processing system, the third resource processing system sends a first request to the fourth resource processing system through a target processing service (such as XPS), and the first request includes the type of media resources that the third resource processing system can provide (such as soft media resources or hard media resources) and the version number of the target processing service.

[0081] The successful TCP link establishment can be understood as an initial connection being established between the third resource processing system and the fourth resource processing system through a three-way handshake protocol or the like.

[0082] When the third resource processing system serves as a source end or an initiating end, it can be understood that a source terminal connected to the third resource processing system needs to perform audio and video communication with a destination terminal connected to the fourth resource processing system.

[0083] S520, the third resource processing system receives the first response sent by the fourth resource processing system through the target processing service. The first response includes the media resource type (such as soft media resources or hard media resources) that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system.

[0084] S530: The third resource processing system creates a resource cascade channel according to the media resource types that can be provided by the fourth resource processing system and the version number of the target processing service in the fourth resource processing system.

[0085] Among them, in this embodiment, through the interaction of the aforementioned first request and the first response, the query of the XPS version can be realized, and then when the cascade channel is established, the third resource processing system can adopt different cascade protocols according to the type of media resources on the other end to achieve unified scheduling of soft and hard media resources.

[0086] Optionally, the process of the third resource processing system creating a resource cascade channel based on the media resource type that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system may include but is not limited to: when the media resources meet the video conferencing requirements initiated by the third terminal, the third resource processing system sends a channel creation request to the fourth resource processing system based on the media resource type that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system, and the channel creation request carries the routing information of the third resource processing system.

[0087] Correspondingly, after receiving the channel creation request, the fourth resource processing system can determine whether the media resources meet the video conferencing requirements initiated by the third terminal. If not, it determines that the resource cascade channel creation has failed. Conversely, if the requirements are met, the fourth resource processing system records the routing information of the third resource processing system and sends a channel creation response to the third resource processing system. The channel creation response carries the routing information of the fourth resource processing system. Then, after receiving the channel creation response sent by the fourth resource processing system, the third resource processing system completes the creation of the resource cascade channel based on the routing information of the third resource processing system and the fourth resource processing system.

[0088] It is worth noting that in the process of establishing the aforementioned resource cascade channel, the third resource processing system acts as the initiator or source end, and the fourth resource processing system acts as the destination end. However, as an implementation method, the fourth resource processing system can also act as the initiator or source end, and the third resource processing system acts as the destination end. Its implementation process is similar to the process of establishing a resource-level channel with the third resource processing system as the initiator or source end and the fourth resource processing system as the destination end, and will not be repeated here.

[0089] For example, when the TCP link between the third resource processing system and the fourth resource processing system is successfully established, a second request sent by the fourth resource processing system is received through the target processing service, and the second request includes the media resource type that the fourth resource processing system can provide and the version number of the target processing service of the fourth resource processing system; a second response is sent to the fourth resource processing system through the target processing service, and the second response includes the media resource type that the third resource processing system can provide and the version number of the target processing service in the third resource processing system.

[0090] Optionally, the process of creating the resource cascade channel also includes: receiving a channel creation request sent by the fourth resource processing system, the channel creation request carrying the routing information of the fourth resource processing system; recording the routing information of the fourth resource processing system, and sending a channel creation response to the fourth resource processing system when the media resources meet the video conferencing requirements, the channel creation response carrying the routing information of the fourth resource processing system; completing the creation of the resource cascade channel according to the routing information of the third resource processing system and the fourth resource processing system.

[0091] Based on this, the following exemplary description of the process of creating the aforementioned resource cascade channel is provided in conjunction with Figures 6a and 6b. Assume that the first resource processing system is the source end and the second resource processing system is the destination end. Accordingly, the terminal attached to the first resource processing system is the source terminal and the terminal attached to the second resource processing system is the destination terminal.

[0092] S611, when the terminals connected to the first resource processing system (i.e., source users or source terminals) need to communicate with the terminals on the second resource processing system (i.e., destination users or destination terminals) via audio and video, the first resource processing system sends the specific information of the destination user, such as the XPS address of the destination user, to the XPS in the first resource processing system through MPC.

[0093] The terminals connected to and connected to the first resource processing system may be but are not limited to the aforementioned first terminal, and the terminals on the second resource processing system may be but are not limited to other terminals participating in the video conference except the first terminal.

[0094] S612, the XPS in the first resource processing system determines whether the target user is in its own media system based on the specific information of the target user. If so, execute S613, otherwise execute S614.

[0095] S613: The first resource processing system directly forwards the audio and video sent by the source user to the destination user.

[0096] S614: The first resource processing system establishes a TCP link with the second resource processing system, such as sending a link establishment request to the second resource processing system.

[0097] S615: After receiving the link establishment request, the second resource processing system sends a link establishment response to the first resource processing system according to the link establishment request to indicate that the link establishment is successful when determining that its own media system is not faulty.

[0098] S616, after the first resource processing system receives the link establishment response sent by the second resource processing system through XPS, it sends a first request to the second resource processing system. The first request carries the media resource type (such as soft media resources or hard media resources) that it can provide and the XPS version number, in order to request to query the media resource type and XPS version number of the second resource processing system.

[0099] S617: After receiving the first request, the second resource processing system sends a first response to the first resource processing system. The first response includes the media resources it can provide (e.g., soft media resources or hard media resources) and the XPS version number. At this point, the media resource types and versions of both communicating parties have been determined.

[0100] S618: The first resource processing system sends a channel creation request to the second resource processing system according to the media resource type and version number of the second resource processing system.

[0101] S619, the second resource processing system responds to the channel creation request, such as sending a channel creation response to the first resource processing system. At this point, the soft and hard media can successfully communicate with each other, that is, the resource cascade channel is successfully created.

[0102] S620: The first resource processing system synchronizes the routing information obtained from the MPC to the XPS of the second resource processing system via the XPS.

[0103] S621: The audio and video of the source user in the first resource processing system can be correctly transmitted to the destination user in the second resource processing system through the cascade channel.

[0104] In this example, the resource cascade channel creation process provided in the above S611-S621 is implemented before the resource scheduling of the video conference, that is, the above resource scheduling solution can be based on the resource cascade channel for normal audio and video intercommunication.

[0105] Compared with a single conference system, the technical solution adopted in this application moves the RMS from the resource processing system to the business processing system, so that the business processing system supports the hybrid deployment method of soft and hard media and the flexible resource scheduling solution based on the hybrid deployment method, so as to meet the needs of customers to hold large-capacity and 4K conferences at the same time, and effectively reduce costs. For example, when a user needs to hold a 4K conference, the resource scheduling module will schedule the conference to be held on hard media; when a user needs to hold a large-capacity conference, the resource scheduling module will schedule the conference to be held on soft media. If a single conference crosses domains, that is, there are terminals on hard media and terminals on soft media, an adaptive media cascade is created to ensure the correct function of the conference. In addition, under the hybrid deployment of soft and hard media resources, the conference can be accessed according to the optimal capabilities of the terminal.

[0106] In addition, the present application can also add a query version operation in the channel creation request, and can adopt different cascade protocols according to the type of media resources on the other end, thereby achieving unified scheduling of soft and hard media resources.

[0107] As shown in Figure 7, a flow chart of a resource scheduling method 700 for a video conference provided in an embodiment of the present application is shown. This method can be executed by a third resource processing system. In other words, the method 700 can be executed by software and / or hardware installed in the third resource processing system. The third resource processing system includes, but is not limited to, a terminal device, a single server, a server cluster, a cloud server, or a cloud server cluster. As shown in Figure 7, the method 700 can include, but is not limited to, the following step S710.

[0108] S710: The third resource processing system reports media resource information to the business processing system.

[0109] Among them, the media resource information is used for resource scheduling when the business processing system conducts video conferencing. The media resources in the third resource processing system are first media resources or second media resources. The first media resource is encoded and decoded based on the graphics processing unit GPU, and the second media resource is encoded and decoded based on the central processing unit CPU.

[0110] Optionally, the method also includes: during the video conference, transmitting audio and video content between the third terminal and the fourth terminal through the resource cascade channel between the third resource processing system and the fourth resource processing system; wherein the fourth resource processing system is used to provide the first media resource or the second media resource, the third terminal is connected to the third resource processing system, and the fourth terminal is connected to the fourth resource processing system.

[0111] Optionally, the process of creating the resource cascade channel includes: when the Transmission Control Protocol TCP link is successfully established between the third resource processing system and the fourth resource processing system, sending a first request to the fourth resource processing system through the target processing service, the first request including the media resource type that the third resource processing system can provide and the version number of the target processing service; receiving a first response sent by the fourth resource processing system through the target processing service, the first response including the media resource type that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system; creating a resource cascade channel according to the media resource type that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system.

[0112] Optionally, the creating of a resource cascade channel according to the media resource type that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system includes: the third resource processing system sending a channel creation request to the fourth resource processing system when the media resources meet the video conferencing requirements initiated by the third terminal, according to the media resource type that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system, the channel creation request carrying the routing information of the third resource processing system; receiving a channel creation response sent by the fourth resource processing system, the channel creation response carrying the routing information of the fourth resource processing system; and completing the creation of the resource cascade channel according to the routing information of the third resource processing system and the fourth resource processing system.

[0113] Optionally, the process of creating the resource cascade channel includes: when the TCP link is successfully established between the third resource processing system and the fourth resource processing system, receiving a second request sent by the fourth resource processing system through the target processing service, the second request including the type of media resources that the fourth resource processing system can provide and the version number of the target processing service of the fourth resource processing system; sending a second response to the fourth resource processing system through the target processing service, the second response including the type of media resources that the third resource processing system can provide and the version number of the target processing service in the third resource processing system.

[0114] Optionally, the process of creating the resource cascade channel also includes: receiving a channel creation request sent by the fourth resource processing system, the channel creation request carrying the routing information of the fourth resource processing system; recording the routing information of the fourth resource processing system, and sending a channel creation response to the fourth resource processing system when the media resources meet the video conferencing requirements, the channel creation response carrying the routing information of the fourth resource processing system; completing the creation of the resource cascade channel according to the routing information of the third resource processing system and the fourth resource processing system.

[0115] It can be understood that each implementation method in method embodiment 700 has the same or corresponding technical features as the aforementioned method embodiment 300. Therefore, the implementation process of each implementation method in method embodiment 700 can refer to the description in the aforementioned method embodiment 300 and achieve the same or corresponding technical effects. To avoid repetition, it will not be repeated here.

[0116] Figure 8 shows a structural schematic diagram of a resource scheduling device 800 for video conferencing provided in an embodiment of the present application. The device 800 is applied to a business processing system, and the device 800 includes: an acquisition module 810, used to obtain media resource information on a first resource processing system and media resource information on a second resource processing system; a scheduling module 820, used to perform resource scheduling during a video conference based on the media resource information on the first resource processing system and / or the media resource information on the second resource processing system; wherein the media resource information on the first resource processing system is encoded and decoded based on a graphics processing unit GPU, and the media resource information on the second resource processing system is encoded and decoded based on a central processing unit CPU.

[0117] Optionally, the scheduling module 820 performs resource scheduling during video conferencing based on the media resource information on the first resource processing system and / or the media resource information on the second resource processing system, including: receiving a first video conferencing request sent by a first terminal, the first terminal being connected to the first resource processing system or the second resource processing system; determining whether the conference resource requirements corresponding to the first video conferencing request are met based on the media resource information on the first resource processing system and / or the media resource information on the second resource processing system; and calling the media resources on the first resource processing system and / or the media resources on the second resource processing system to conduct a video conference if the conference resource requirements corresponding to the first video conferencing request are met.

[0118] Optionally, the scheduling module 820 calls the media resources on the first resource processing system and / or the media resources on the second resource processing system for video conferencing, including any one of the following: when the first video conferencing request includes a first capability, calling the media resources on the first resource processing system for video conferencing; when the video conferencing request does not include the first capability but includes a second capability, calling the media resources on the second resource processing system for video conferencing; wherein, the first capability includes the resolution of the video conferencing as a preset value, and the second capability includes the resolution of the video conferencing as a value other than the preset value.

[0119] Optionally, the scheduling module 820 is also used to receive a second video conference request sent by a second terminal during the video conference; when the second video conference request includes the first capability, determine whether the remaining media resources on the first resource processing system meet the conference access requirements of the second terminal; when the conference access requirements of the second terminal are met, initiate an add terminal process to the first resource processing system, and connect the second terminal to the video conference based on the first capability and the remaining media resources on the first resource processing system.

[0120] Optionally, the scheduling module 820 is also used to initiate an add-end process to the second resource processing system if the second video conference request includes a second capability when the conference access requirements of the second terminal are not met, and to connect the second terminal to the video conference based on the second capability and the media resources on the second resource processing system.

[0121] Optionally, the scheduling module 820 is also used to initiate an add-end process to the second resource processing system when the second video conference request does not include the first capability, and to connect the second terminal to the video conference based on the remaining media resources on the second resource processing system.

[0122] Optionally, the scheduling module 820 is further configured to transmit audio and video content based on the resource cascade channel between the first resource processing system and the second resource processing system during a video conference.

[0123] The device 800 provided in the embodiment of the present application can execute the various methods described in the method embodiment 300 above, and realize the functions and beneficial effects of the various methods described in the method embodiment 300 above, which will not be repeated here.

[0124] Figure 9 shows a structural diagram of a resource scheduling device 900 for video conferencing provided in an embodiment of the present application. The device 900 is applied to the third resource processing system. The device 900 includes: a transmission module 910, which is used to report media resource information to the business processing system; wherein, the media resource information is used for resource scheduling when the business processing system conducts a video conference, and the media resources in the third resource processing system are first media resources or second media resources, the first media resources are encoded and decoded based on the graphics processing unit GPU, and the second media resources are encoded and decoded based on the central processing unit CPU.

[0125] Optionally, the transmission module 910 is also used to transmit audio and video content between the third terminal and the fourth terminal through the resource cascade channel between the third resource processing system and the fourth resource processing system during a video conference; wherein the fourth resource processing system is used to provide the first media resource or the second media resource, the third terminal is connected to the third resource processing system, and the fourth terminal is connected to the fourth resource processing system.

[0126] Optionally, the device 900 also includes a creation module for creating the resource cascade channel, wherein the process of the creation module creating the resource cascade channel includes: when the TCP link is successfully established between the third resource processing system and the fourth resource processing system, sending a first request to the fourth resource processing system through the target processing service, the first request including the media resource type that the third resource processing system can provide and the version number of the target processing service; receiving a first response sent by the fourth resource processing system through the target processing service, the first response including the media resource type that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system; creating a resource cascade channel according to the media resource type that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system.

[0127] Optionally, the creation module creates a resource cascade channel based on the media resource type that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system, including: when the media resources meet the video conferencing requirements initiated by the third terminal, sending a channel creation request to the fourth resource processing system based on the media resource type that the fourth resource processing system can provide and the version number of the target processing service in the fourth resource processing system, the channel creation request carrying the routing information of the third resource processing system; receiving a channel creation response sent by the fourth resource processing system, the channel creation response carrying the routing information of the fourth resource processing system; and completing the creation of the resource cascade channel based on the routing information of the third resource processing system and the fourth resource processing system.

[0128] Optionally, the process of the creation module creating a resource cascade channel includes: when the TCP link is successfully established between the third resource processing system and the fourth resource processing system, receiving a second request sent by the fourth resource processing system through the target processing service, the second request including the media resource type that the fourth resource processing system can provide and the version number of the target processing service of the fourth resource processing system; sending a second response to the fourth resource processing system through the target processing service, the second response including the media resource type that the third resource processing system can provide and the version number of the target processing service in the third resource processing system.

[0129] Optionally, the process of the creation module creating a resource cascade channel also includes: receiving a channel creation request sent by the fourth resource processing system, the channel creation request carrying the routing information of the fourth resource processing system; recording the routing information of the fourth resource processing system, and sending a channel creation response to the fourth resource processing system when the media resources meet the video conferencing requirements, the channel creation response carrying the routing information of the fourth resource processing system; completing the creation of the resource cascade channel according to the routing information of the third resource processing system and the fourth resource processing system.

[0130] The device 900 provided in the embodiment of the present application can execute the various methods described in the above method embodiment 700 and realize the functions and beneficial effects of the various methods described in the above method embodiment, which will not be repeated here.

[0131] FIG10 shows a schematic diagram of the hardware structure of an electronic device 1000 provided by an embodiment of the present application. Referring to the figure, at the hardware level, the electronic device includes a processor, and optionally, an internal bus, a network interface, and a memory. Among them, the memory may include a memory, such as a high-speed random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage. Of course, the electronic device 1000 may also include hardware required for other services.

[0132] The processor, network interface, and memory can be interconnected via an internal bus, such as an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. These buses can be classified as address buses, data buses, and control buses. For ease of illustration, the figure uses only one bidirectional arrow, but this does not imply that there is only one bus or only one type of bus.

[0133] The memory is used to store programs. Specifically, the program may include program code, which includes computer operating instructions. The memory may include internal memory and non-volatile memory, and provides instructions and data to the processor.

[0134] The processor reads the corresponding computer program from the non-volatile memory into the internal memory and then runs it, logically forming a device for locating a specific user. The processor executes the program stored in the memory and is specifically configured to perform the methods disclosed in the embodiments shown in Figures 3-7 and to achieve the functions and benefits of the various methods described in the preceding method embodiments, which will not be further described here.

[0135] The methods disclosed in the embodiments shown in Figures 3 to 7 of the present application can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits in the processor or software instructions. The above processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of the present application can be directly implemented as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and, in conjunction with its hardware, completes the steps of the above method.

[0136] The electronic device can also execute the methods described in the above method embodiments and realize the functions and beneficial effects of the methods described in the above method embodiments, which will not be described in detail here.

[0137] Of course, in addition to software implementation, the electronic device of this application does not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc. That is to say, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0138] An embodiment of the present application also proposes a computer-readable storage medium, which stores one or more programs. When the one or more programs are executed by an electronic device including multiple applications, the electronic device executes the methods disclosed in the embodiments shown in Figures 3 to 7 and realizes the functions and beneficial effects of the various methods described in the previous method embodiments, which will not be repeated here.

[0139] The computer-readable storage medium includes a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0140] An embodiment of the present application also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the following process is implemented: the method disclosed in the embodiments shown in Figures 3 to 7 and the functions and beneficial effects of the various methods described in the previous method embodiments are implemented, which will not be repeated here.

[0141] In short, the above description is only part of the embodiments of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

[0142] The systems, devices, modules, or units described in the above embodiments may be implemented by computer chips or entities, or by products having certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0143] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change RAM (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media such as modulated data signals and carrier waves.

[0144] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0145] The various embodiments in this specification are described in a progressive manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences between the other embodiments. In particular, the system embodiments are generally similar to the method embodiments, so the description is relatively simple. For relevant parts, refer to the description of the method embodiments.

Claims

1. A resource scheduling method for a video conference, executed by a business processing system, the method comprising: Acquire media resource information on the first resource processing system and media resource information on the second resource processing system; Perform resource scheduling during video conferencing according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system; The media resource information on the first resource processing system is encoded and decoded based on a graphics processing unit GPU, and the media resource information on the second resource processing system is encoded and decoded based on a central processing unit CPU.

2. The method of claim 1, wherein: The resource scheduling for video conferencing according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system includes: receiving a first video conference request sent by a first terminal, where the first terminal is connected to the first resource processing system or the second resource processing system; determining, according to the media resource information on the first resource processing system and / or the media resource information on the second resource processing system, whether a conference resource demand corresponding to the first video conference request is met; When the conference resource requirements corresponding to the first video conference request are met, the media resources on the first resource processing system and / or the media resources on the second resource processing system are called to conduct the video conference.

3. The method of claim 2, wherein: The calling of the media resource on the first resource processing system and / or the media resource on the second resource processing system for the video conference includes any of the following: In a case where the first video conference request includes the first capability, calling the media resources on the first resource processing system to conduct the video conference; In a case where the video conference request does not include the first capability but includes the second capability, calling the media resource on the second resource processing system to conduct the video conference; The first capability includes that the resolution of the video conference is a preset value, and the second capability includes that the resolution of the video conference is other value except the preset value.

4. The method according to any one of claims 1 to 3, wherein: The method further comprises: During the video conference, receiving a second video conference request sent by a second terminal; In a case where the second video conference request includes the first capability, determining whether the remaining media resources on the first resource processing system meet the conference access requirements of the second terminal; When the conference access requirements of the second terminal are met, a terminal adding process is initiated to the first resource processing system, and the second terminal is connected to the video conference based on the first capability and the remaining media resources on the first resource processing system.

5. The method of claim 4, wherein: The method further comprises: When the conference access requirements of the second terminal are not met, if the second video conference request includes a second capability, an add terminal process is initiated to the second resource processing system, and the second terminal is connected to the video conference based on the second capability and the media resources on the second resource processing system.

6. The method of claim 4, wherein: The method further comprises: In the case that the second video conference request does not include the first capability, a terminal adding process is initiated to the second resource processing system, and the second terminal is connected to the video conference based on the remaining media resources on the second resource processing system.

7. The method according to any one of claims 1 to 3, wherein: The method further comprises: During the video conference, the audio and video contents are transmitted based on the resource cascade channel between the first resource processing system and the second resource processing system.

8. A resource scheduling method for a video conference, executed by a third resource processing system, the method comprising: Report media resource information to the business processing system; Among them, the media resource information is used for resource scheduling when the business processing system conducts video conferencing, the media resources in the third resource processing system are the first media resources or the second media resources, the first media resources are encoded and decoded based on the graphics processing unit GPU, and the second media resources are encoded and decoded based on the central processing unit CPU.

9. The method of claim 8, wherein: The method further comprises: During the video conference, audio and video content transmission between the third terminal and the fourth terminal is performed through the resource cascade channel between the third resource processing system and the fourth resource processing system; The fourth resource processing system is used to provide the first media resource or the second media resource, the third terminal is connected to the third resource processing system, and the fourth terminal is connected to the fourth resource processing system.

10. The method of claim 9, wherein: The process of creating the resource cascade channel includes: When a transmission control protocol TCP link is successfully established between the third resource processing system and the fourth resource processing system, a first request is sent to the fourth resource processing system through a target processing service, wherein the first request includes a type of media resources that can be provided by the third resource processing system and a version number of the target processing service; receiving, through the target processing service, a first response sent by the fourth resource processing system, wherein the first response includes a type of media resources that can be provided by the fourth resource processing system and a version number of the target processing service in the fourth resource processing system; A resource cascade channel is created according to the media resource types that can be provided by the fourth resource processing system and the version number of the target processing service in the fourth resource processing system.

11. The method of claim 10, wherein: The creating a resource cascade channel according to the media resource type that can be provided by the fourth resource processing system and the version number of the target processing service in the fourth resource processing system includes: When the media resources meet the video conference requirements initiated by the third terminal, the third resource processing system sends a channel creation request to the fourth resource processing system according to the media resource type that can be provided by the fourth resource processing system and the version number of the target processing service in the fourth resource processing system, wherein the channel creation request carries the routing information of the third resource processing system; receiving a channel creation response sent by the fourth resource processing system, wherein the channel creation response carries routing information of the fourth resource processing system; The resource cascade channel is created according to the routing information of the third resource processing system and the fourth resource processing system.

12. The method of claim 9, wherein: The process of creating the resource cascade channel includes: In the case where the TCP link between the third resource processing system and the fourth resource processing system is successfully established, receiving a second request sent by the fourth resource processing system through the target processing service, wherein the second request includes a type of media resources that can be provided by the fourth resource processing system and a version number of the target processing service of the fourth resource processing system; A second response is sent to the fourth resource processing system through the target processing service, wherein the second response includes the type of media resources that can be provided by the third resource processing system and the version number of the target processing service in the third resource processing system.

13. The method of claim 12, wherein: The process of creating the resource cascade channel also includes: receiving a channel creation request sent by the fourth resource processing system, wherein the channel creation request carries routing information of the third resource processing system; Recording the routing information of the fourth resource processing system, and sending a channel creation response to the fourth resource processing system when the media resources meet the video conferencing requirements, wherein the channel creation response carries the routing information of the fourth resource processing system; The resource cascade channel is created according to the routing information of the third resource processing system and the fourth resource processing system.

14. A video conferencing system, comprising: A first resource processing system, used for providing media resources for encoding and decoding based on GPU; The second resource processing system is used to provide media resources for encoding and decoding based on the CPU; The business processing system is used to perform resource scheduling during video conferencing based on the media resource information reported by the first resource processing system and the media resource information reported by the second resource processing system.

15. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the resource scheduling method for a video conference as described in any one of claims 1 to 13.

16. A computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the resource scheduling method for a video conference as described in any one of claims 1 to 13.

Images