Method, device and storage medium for link optimization based on media capability

Abstract

The present application relates to a method, device and storage medium for optimizing a link based on media capabilities, and relates to the field of audio and video call technology. The method includes: obtaining the media capabilities of the endpoints on the first link; determining the target transmission mode on the first link based on the media capabilities of the endpoints, so that the endpoints on the first link obtain media information that meets their media capabilities, wherein the target transmission mode is that the intermediate nodes of the first link transmit media information according to a preset transmission mode. In this way, the media capabilities of the endpoints on the first link can be comprehensively considered through the decision node, and the target transmission mode of the first link can be determined according to the media capabilities of the endpoints. Compared with the segmented negotiation and symmetric negotiation mechanism between the nodes in the first link in the prior art, the present application can avoid unnecessary transcoding in the first link, thereby saving link resources.

Description

Technical Field

[0001] The present application relates to the field of audio and video call technology, and in particular to a method, device, and storage medium for link optimization based on media capabilities. Background Art

[0002] When initiating an audio or video call between two endpoints, media capabilities negotiation is required based on the media capabilities of each node in the call link (including both endpoints) to establish a matching Real-Time Transport Protocol (RTP) stream. If the two endpoints lack mutually applicable media capabilities, an intermediate node must perform media format conversion. Due to the limitations of segmented and symmetric negotiation in existing audio and video call links, unnecessary conversions can occur within the link, leading to a waste of link resources. Summary of the Invention

[0003] The present application provides a method, device and storage medium for link optimization based on media capabilities to address the limitations of segmented negotiation and symmetric negotiation in existing audio and video call links, which easily lead to some unnecessary conversions in the link and thus waste link resources.

[0004] In a first aspect, the present application provides a method for optimizing a link based on media capabilities, applied to a decision node, where the decision node is any node in a first link, the method comprising:

[0005] Obtaining media capabilities of the endpoint on the first link;

[0006] A target transmission mode on the first link is determined based on the media capabilities of the endpoints, so that the endpoints on the first link obtain media information that meets their media capabilities, wherein the target transmission mode is that the intermediate nodes of the first link transmit media information according to a preset transmission mode.

[0007] Optionally, determining a target transmission mode on the first link based on the media capabilities of the endpoint includes:

[0008] Determining whether the endpoints have the same media capabilities;

[0009] In a case where it is determined that the endpoints have the same media capabilities, determining the target transmission mode based on the same media capabilities of the endpoints, wherein the target transmission mode is that the intermediate nodes in the first link transparently transmit the media information based on the same media capabilities of the endpoints; or

[0010] When it is determined that the endpoints do not have the same media capabilities, the media capabilities of the intermediate nodes on the first link are obtained, and the target transmission mode is determined based on the media capabilities of each node, wherein the media capabilities of each node include the media capabilities of the endpoints and the media capabilities of the intermediate nodes, and the target transmission mode is that the intermediate nodes in the first link transparently transmit or transcode the media information based on their respective media capabilities.

[0011] Optionally, before determining the target transmission mode on the first link based on the media capability of the endpoint, the method further includes:

[0012] Acquiring media capabilities of the intermediate node on the first link;

[0013] The determining a target transmission mode on the first link based on the media capability of the endpoint includes:

[0014] The target transmission mode is determined based on the media capability of each node, where the media capability of each node includes the media capability of the endpoint and the media capability of the intermediate node.

[0015] Optionally, determining the target transmission mode based on the media capability of each node includes:

[0016] Determining, based on the media capabilities of each node, a candidate transmission mode for transmitting the media information, wherein the candidate transmission mode is used to represent a processing mode of the media information by each node in the first link when receiving the media information from a previous node or a subsequent node, the processing mode including transparently transmitting the media information or transmitting the media information after transcoding; the candidate transmission mode satisfies a preset condition, wherein the preset condition is that the media capabilities supported by the first link meet the media capability requirements of the endpoints, and the media capabilities of the intermediate nodes of the first link can implement media transmission of the media information between the endpoints;

[0017] The target transmission mode is determined from the candidate transmission modes.

[0018] Optionally, determining the target transmission mode from the candidate transmission modes includes:

[0019] If the first link is used to transmit audio media information and there are multiple candidate transmission modes, determining the target transmission mode based on the number of transcoding times and / or occupied bandwidth of the candidate transmission modes, with the number of transcoding times having a higher priority than the occupied bandwidth, and the occupied bandwidth being determined based on the media capabilities of each node in the first link; or

[0020] When the first link is used to transmit video media information and there are multiple candidate transmission modes, the target transmission mode is determined based on the number of transcoding times and / or resolutions of the candidate transmission modes, where the priority of the number of transcoding times is higher than the priority of the resolution, and the resolution is determined based on the media capabilities of each node in the first link.

[0021] Optionally, acquiring the media capability of the intermediate node on the first link includes:

[0022] sending a probe instruction along a first direction of the first link, wherein the probe instruction is configured to add the media capabilities of each node passed through to the probe instruction after each node passed through in the first direction, until the probe instruction reaches an endpoint in the first direction, the first direction being a direction away from the decision node;

[0023] Receive a reply instruction along a second direction of the first link, wherein the reply instruction is obtained by the endpoint in response to the detection instruction, and each node in the second direction forwards the reply instruction, and the second direction is opposite to the first direction. Optionally, after determining the target transmission mode on the first link based on the media capabilities of the endpoint, the method further includes:

[0024] sending an optimization instruction along a third direction of the first link, wherein the optimization instruction is used to notify the corresponding node of optimization information of each node passed through after passing through the node in the third direction, and delete the optimization information of the passed node from the optimization instruction, until the optimization instruction reaches an end point in the third direction, where the third direction is a direction away from the decision node;

[0025] A feedback instruction is received along a fourth direction of the first link, wherein the feedback instruction is obtained by the endpoint in response to the optimization instruction, the feedback instruction is sent to the decision node along the fourth direction, and each node in the fourth direction forwards the feedback instruction, and the fourth direction is opposite to the third direction.

[0026] Optionally, the receiving a feedback instruction along the fourth direction of the first link includes:

[0027] If the feedback instruction is not received within a preset time period, the step of sending the optimization instruction along the third direction of the first link is re-executed until the decision node receives the feedback instruction.

[0028] Optionally, the decision node is a node corresponding to the middlemost node position in the first link.

[0029] Optionally, the preset transmission mode includes a transmission mode with the least number of transcoding times determined according to media capabilities of remaining nodes in the first link after the transmission mode of any one or more intermediate nodes in the first link is specified.

[0030] In a second aspect, the present application further provides a device for optimizing a link based on media capabilities, which is applied to a decision node, where the decision node is any node in the first link, and the device includes:

[0031] an acquisition module, configured to acquire the media capabilities of the endpoint on the first link;

[0032] A determination module is used to determine a target transmission mode on the first link based on the media capabilities of the endpoint, so that the endpoint on the first link obtains media information that meets its media capabilities, wherein the target transmission mode is that the intermediate node of the first link transmits media information according to a preset transmission mode.

[0033] In a third aspect, the present application further provides an electronic device, comprising a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0034] Memory for storing computer programs;

[0035] The processor is configured to implement the steps of the method for optimizing links based on media capabilities as described in any one of the embodiments of the first aspect when executing the program stored in the memory.

[0036] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for optimizing links based on media capabilities as described in any embodiment of the first aspect are implemented.

[0037] In an embodiment of the present application, the media capabilities of the endpoints on the first link are obtained through a decision node; based on the media capabilities of the endpoints, a target transmission mode on the first link is determined so that the endpoints on the first link obtain media information that meets their media capabilities, wherein the target transmission mode is for the intermediate nodes of the first link to transmit media information according to a preset transmission mode. In this way, the media capabilities of the endpoints on the first link can be comprehensively considered by the decision node, and the target transmission mode of the first link can be determined based on the media capabilities of the endpoints. Compared with the segmented negotiation and symmetric negotiation mechanism between the nodes in the first link in the prior art, the present application can avoid unnecessary transcoding in the first link, thereby saving link resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0040] Figure 1 A flowchart of a method for link optimization based on media capabilities provided in an embodiment of the present application;

[0041] Figure 2 A schematic diagram of the structure of the first link provided in an embodiment of the present application;

[0042] Figure 3 One of the schematic diagrams of the transmission mode of each node provided in the embodiment of the present application;

[0043] Figure 4 Schematic diagram 2 of the transmission method of each node provided in the embodiment of the present application;

[0044] Figure 5 A schematic diagram of the structure of an apparatus for optimizing a link based on media capabilities provided in an embodiment of the present application;

[0045] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0047] See also Figure 1 , Figure 1 Schematic diagram of the process of optimizing the link based on media capabilities provided in the embodiment of the present application. Figure 1 As shown, the method for optimizing links based on media capabilities is applied to a decision node, which is any node in the first link. The method for optimizing links based on media capabilities includes the following steps:

[0048] Step 101: Obtain the media capabilities of an endpoint on a first link.

[0049] Specifically, the above-mentioned first link is a link that can transmit audio media information and / or video media information. The first link may include multiple nodes, each node having at least one media capability, such as at least one type of audio encoding and decoding capability or at least one type of video encoding and decoding capability. The above-mentioned decision node can be any node in the above-mentioned first link, such as an endpoint in the above-mentioned first link, or an intermediate node in the above-mentioned first link, and this application does not make specific limitations. The above-mentioned media capability refers to the ability to forward or transparently transmit audio media information and / or video media information. The endpoint in the above-mentioned first link has both media capabilities and media requirements.

[0050] It should be noted that the endpoints on the above-mentioned first link can refer to two endpoints in a physical link, or they can refer to two endpoints in a link that needs to complete a certain media requirement. For example, node A and node B are two intermediate nodes in a physical link, and the audio playback media requirement needs to be completed between the two intermediate nodes. At this time, the link from node A to node B can be regarded as a first link, and node A and node B can be regarded as the two endpoints of the first link. In other words, the endpoints on the above-mentioned first link can be endpoints in the actual sense, or they can be endpoints determined according to the media requirements of the nodes. The media requirements here include but are not limited to business-level requirements such as audio and / or video playback, audio and / or video recording, mixing, and screen fusion.

[0051] The method for obtaining the media capabilities of the endpoint on the first link can be that the decision node directly sends a media capability acquisition request to the endpoint, and then the endpoint responds to the request and returns its own media capabilities to the decision node; or the decision node sends a request to obtain node information to the adjacent nodes in the first link, and the adjacent nodes transmit the request to the endpoint in turn, and then the endpoint responds to the request and returns its own media capabilities to the nodes adjacent to the endpoint, and the nodes adjacent to the endpoint pass the media capabilities to the decision node in turn.

[0052] Step 102: Determine a target transmission mode on the first link based on the media capabilities of the endpoints, so that the endpoints on the first link obtain media information that meets their media capabilities. The target transmission mode is that the intermediate nodes of the first link transmit media information according to a preset transmission mode.

[0053] Specifically, the intermediate nodes of the first link transmit media information according to a preset transmission method, which may include the intermediate nodes of the first link transmitting media information according to a transmission method with the least number of transcoding times, or the intermediate nodes of the first link transmitting media information according to the transmission method of the entire link after specifying the transmission method of a certain intermediate node.

[0054] In this step, based on the media capabilities of the two endpoints of the first link, it can be determined whether the two endpoints have the same media capabilities. Then, based on the determination result, different methods can be used to determine the target transmission mode. If the two endpoints have the same media capabilities, the target transmission mode is directly determined based on the same media capabilities. If the two endpoints do not have the same media capabilities, the media capabilities of each node on the first link can be obtained, and the target transmission mode can be determined based on the media capabilities of each node. Of course, as another implementation method, the media capabilities of each node on the first link can also be directly obtained, and the target transmission mode can be determined based on the media capabilities of each node. This application does not specifically limit this.

[0055] In this embodiment, the decision node can comprehensively consider the media capabilities of the endpoints on the first link and determine the target transmission mode of the first link based on the media capabilities of the endpoints. Compared with the existing technology that uses segmented negotiation and symmetric negotiation mechanisms between nodes in the first link, this application can avoid unnecessary transcoding in the first link, thereby saving link resources.

[0056] Furthermore, the above step 102, determining the target transmission mode on the first link based on the media capabilities of the endpoint, includes:

[0057] Determine whether the endpoints have the same media capabilities;

[0058] In the case where it is determined that the endpoints have the same media capabilities, determining a target transmission mode based on the same media capabilities of the endpoints, wherein the target transmission mode is that the intermediate nodes in the first link transparently transmit the media information based on the same media capabilities of the endpoints; or

[0059] When it is determined that the endpoints do not have the same media capabilities, the media capabilities of each node on the first link are obtained, and a target transmission mode is determined based on the media capabilities of each node, wherein the target transmission mode is that the intermediate nodes in the first link transparently transmit or transcode the media information based on their respective media capabilities.

[0060] In one embodiment, when determining the target transmission mode on the first link based on the media capabilities of the endpoints, it is possible to first determine whether the two endpoints have the same media capabilities based on the media capabilities of the two endpoints of the first link, and then determine the target transmission mode using different methods based on the determination result. If the two endpoints have the same media capabilities, the target transmission mode is directly determined based on the same media capabilities; if the two endpoints do not have the same media capabilities, the media capabilities of each node on the first link can be obtained, and the target transmission mode is determined based on the media capabilities of each node. For example, assuming that the first link includes five nodes from node A to node E, and endpoint A and endpoint E both have Adaptive Multi-Rate (AMR) codec capabilities, then when using the first link to transmit audio media information, regardless of whether the intermediate nodes have AMR codec capabilities, the intermediate nodes do not need to transcode the media information and can directly transparently transmit the media information using the AMR format. When endpoint A and endpoint E do not have the same encoding and decoding capabilities, it is necessary to comprehensively consider the media capabilities of the intermediate nodes and endpoints to determine which format each node uses for transmission, that is, to determine the transcoding format of the node that needs transcoding in the first link.

[0061] In this embodiment, it is possible to first determine whether the two endpoints of the first link have the same media capabilities, and then use different methods to determine the target transmission mode based on the determination result. Therefore, in the scenario where the two endpoints of the first link have the same media capabilities, the process of obtaining the media capabilities of the intermediate nodes and determining the target transmission mode based on the media capabilities of each node can be omitted, which is conducive to improving the decision-making efficiency of the decision node.

[0062] Furthermore, before the above step 102 of determining the target transmission mode on the first link based on the media capabilities of the endpoint, the method further includes:

[0063] Obtaining media capabilities of the intermediate node on the first link;

[0064] The above step 102, determining the target transmission mode on the first link based on the media capabilities of the endpoint, includes:

[0065] The target transmission mode is determined based on the media capabilities of each node. The media capabilities of each node include the media capabilities of the endpoint and the media capabilities of the intermediate nodes.

[0066] As another implementation method, the decision node does not need to first determine whether the two endpoints of the first link have the same media capabilities, but instead directly obtains the media capabilities of each node on the first link and determines the target transmission mode based on the media capabilities of each node. In this embodiment, after obtaining the media capabilities of each node on the first link, the decision node can determine the candidate transmission modes for transmitting media information based on the media capabilities of each node, and then determine the target transmission mode from the candidate transmission modes. In this way, the media capabilities of each node can be comprehensively considered, and the transmission mode with the least number of transcoding times can be selected from the multiple candidate transmission modes of the first link. This can avoid unnecessary transcoding in the link due to the limitations of segmented negotiation and symmetric negotiation, thereby saving link resources.

[0067] Furthermore, the above step of determining the target transmission mode based on the media capabilities of each node includes:

[0068] Determining, based on the media capabilities of each node, a candidate transmission mode for transmitting the media information, wherein the candidate transmission mode represents a processing mode of the media information by each node in the first link upon receiving the media information from the previous node or the next node, including transparent transmission of the media information or transmission of the media information after transcoding; the candidate transmission mode satisfies a preset condition, wherein the preset condition is that the media capabilities supported by the first link meet the media capability requirements of the endpoints, and the media capabilities of the intermediate nodes in the first link enable media transmission of the media information between the endpoints;

[0069] A target transmission mode is determined from the candidate transmission modes.

[0070] Specifically, the process of determining the candidate transmission mode is as follows: starting from the transmitting end of the first link, according to the combination of media capabilities, the media information passes through each node in turn, and the transmission mode that can reach the receiving end of the first link is the candidate transmission mode. For the first node, each media capability is a branch; for the intermediate node, if the media capability of the intermediate node supports the media format of the previous node, then the intermediate node can both transmit transparently and transcode; if the intermediate node does not support the media format of the previous node, then the intermediate node can only transmit transparently; for the last node, if it supports the media format of the previous node, it constitutes a candidate transmission mode; if it does not support the media format of the previous node, it does not constitute a candidate transmission mode. It should be noted that since this application is an asymmetric negotiation, the first link needs to collect link transmission modes twice, once from left to right and once from right to left, and the collection results in the two directions are independent. After collecting all the candidate transmission modes in the first link, they can be sorted from small to large according to the number of transcoding times, and the candidate transmission mode ranked first is taken as the target transmission mode.

[0071] Assume that the first link is Figure 2As shown, the first link includes five nodes (node ​​A to node E), and the media capabilities of each node are: the media capability of node A is Adaptive Multi-Rate (AMR); the media capability of node B is AMR and G711 (an audio coding method developed by the International Telecommunication Union ITU-T, also known as ITU-TG.711); the media capability of node C is G711 and Advanced Audio Coding (AAC); the media capability of node D is AMR and G711; the media capability of node E is AMR.

[0072] The process of determining multiple candidate transmission modes on the first link is as follows:

[0073] If node A only supports AMR, then node A-node B must be AMR;

[0074] Node B supports AMR-G711 conversion and supports AMR input from the previous node. Then, Node B-Node C may be AMR or G711.

[0075] If node C supports G711-AAC conversion, it can only transparently transmit AMR for AMR input of the previous node; it can output G711 or AAC for G711 input of the previous node.

[0076] Node D supports AMR-G711 conversion. Therefore, for AMR input of the previous node, it can output G711 and AMR; for G711 input of the previous node, it can output G711 and AMR; for AAC input of the previous node, it can only transparently transmit AAC.

[0077] Node E only supports AMR, and the AMR input of the previous node constitutes a candidate transmission mode; the G711 and AAC input of the previous node do not constitute a candidate transmission mode. Specifically, the transmission mode of each node from node A to node E is as follows: Figure 3 shown.

[0078] After collecting candidate transmission methods from node A to node E using the same method, there are four options, which are ranked as shown in Table 1 below:

[0079]

[0080] As shown in Table 1, based on the number of transcoding times for each candidate transmission method, Option 1 uses AMR throughout the entire link, with no transcoding. However, Options 2 through 4 involve two transcoding cycles, converting from AMR to G711 and back to AMR. Therefore, Option 1 is the optimal solution. It should be noted that when there are multiple candidate transmission methods with the lowest number of transcoding times, the target transmission method, i.e., the optimal solution, can be further determined based on the bandwidth occupied or resolution of the candidate transmission methods with the lowest number of transcoding times.

[0081] Compared with the existing technology, assuming that the existing technology also adopts Figure 2 The first link shown is used to establish a call. Due to the existing technology, media types need to be negotiated in segments, such as Figure 2 Each segment from node A to node B, node B to node C, node C to node D, and node D to node E requires media type negotiation, with the negotiation result being the intersection of the two ends of each segment. Furthermore, the negotiation results for each segment must be symmetrical. That is, if the media type from node A to node B is G711, then the media type from node B to node A must also be G711. Based on this principle, for a successful call establishment, the media capabilities of each node must be converted to: the segment from node A to node B uses AMR (the unique intersection of nodes A and B), the segment from node B to node C uses G711 (the unique intersection of nodes B and C), the segment from node C to node D uses G711 (the unique intersection of nodes C and D), and the segment from node D to node E uses AMR (the unique intersection of nodes D and E). Therefore, using existing technology requires conversion between AMR and G711 on nodes B and D. With the technical solution of this application, since both nodes A and E support AMR, call establishment can be achieved simply by using AMR transmission throughout the entire link. There's no need to convert to G711 and then back to AMR. This eliminates unnecessary transcoding, saving computing resources, and also conserves bandwidth, as G711 consumes more bandwidth than AMR.

[0082] Furthermore, the above step of determining the target transmission mode from the candidate transmission modes includes:

[0083] When the first link is used to transmit audio media information and there are multiple candidate transmission modes, the target transmission mode is determined based on the number of transcoding times and / or occupied bandwidth of the candidate transmission modes, with the number of transcoding times taking precedence over the priority of occupied bandwidth. The occupied bandwidth is determined based on the media capabilities of each node in the first link; or

[0084] When the first link is used to transmit video media information and there are multiple candidate transmission modes, the target transmission mode is determined based on the number of transcoding times and / or resolutions of the candidate transmission modes. The number of transcoding times takes precedence over the resolution. The resolution is determined based on the media capabilities of each node in the first link.

[0085] In one embodiment, when determining the target transmission mode, the target transmission mode may be further determined based on the link requirements of the first link, namely, whether the first link transmits audio media information or video media information. Specifically, if the first link transmits audio media information, the target transmission mode may be determined based on one or a combination of transcoding times and bandwidth usage. When only transcoding times or bandwidth usage are considered, the target transmission mode may be determined directly based on the transcoding times or bandwidth usage of each candidate transmission mode, without considering their priority. When both transcoding times and bandwidth usage are considered, the final target transmission mode may be determined based on the priority of transcoding times and bandwidth usage. If the first link transmits video media information, the target transmission mode may be determined based on one or a combination of transcoding times and resolution. When only transcoding times or resolution are considered, the target transmission mode may be determined directly based on the transcoding times or resolution of each candidate transmission mode, without considering their priority. When both transcoding times and resolution are considered, the final target transmission mode may be determined based on their priority.

[0086] For example, among the multiple candidate transmission modes shown in Table 1, a selection can be made based on the number of transcoding attempts. Then, from among the candidate transmission modes with the lowest number of transcoding attempts, the one with the lowest bandwidth usage is selected as the target transmission mode. This reduces the transcoding and bandwidth resources used by a single call, thereby increasing the overall system concurrency.

[0087] Assumptions Figure 2The first link shown is used to transmit video media information. The media capabilities of each node are: the media capabilities of node A are 720P (a video display format with a resolution of 1280x720) encoding and 1080P (a video display format with a resolution of 1920x1080) decoding; the media capabilities of node B are CIF (resolution of 352x288) transcoding; the media capabilities of node C are 1080P (resolution of 1920x1080) transcoding; the media capabilities of node D are Common Intermediate Format (CIF, resolution of 352x288) transcoding; the media capabilities of node E are Video Graphic Array (VGA, resolution of 640x480) encoding and 1080P (resolution of 1920x1080) decoding. Based on the media capabilities of each node, the transmission method of each node from node A to node E can be obtained as follows: Figure 4 As shown in the figure, the same method can be used to collect the transmission methods of each node from Node E to Node A. If both transcoding times and resolution are considered, the transmission method from Node A to Node E with the fewest transcoding times and the highest resolution is when each node uses 720P as the encoding type, while the transmission method from Node E to Node A with the fewest transcoding times and the highest resolution is when each node uses VGA as the decoding type. This not only ensures video clarity but also saves unnecessary transcoding, reduces latency, and improves the system's concurrency capabilities.

[0088] It should be noted that, the video call link takes 720P, CIF, VGA and 1080P as an example. When establishing a video call link, if node A needs to support the 720P encoding type, then node A also supports encoding types with a resolution smaller than 720P, such as CIF and VGA. In this case, the encoding types that node A can actually support are 720P, CIF and VGA. For example, if node B needs to support the CIF encoding type, since CIF is the encoding type with the smallest resolution among the four encoding methods, node B can only support node A. The input 720P, CIF and VGA are transparently transmitted and cannot be transcoded. For example, if node C needs to support the encoding type of 1080P, then node C also supports encoding types with lower resolution than 1080P, such as 720P, CIF and VGA. In this case, node C can actually support the encoding types of 1080P, 720P, CIF and VGA. For example, if node D needs to support the encoding type of VGA, then node C also supports encoding types with lower resolution than VGA, such as CIF. In this case, node D can actually support the encoding types of CIF and VGA.

[0089] In this embodiment, in addition to determining the target transmission mode based on the number of transcoding times in the first link, the target transmission mode may be further determined based on factors such as occupied bandwidth and resolution, so that the final optimization solution is optimal.

[0090] Furthermore, in the above step, obtaining the media capability of the intermediate node on the first link includes:

[0091] Sending a probe instruction along a first direction of the first link, wherein the probe instruction is used to add the media capabilities of each node passed through to the probe instruction after each node passed through in the first direction until the probe instruction reaches an endpoint in the first direction, where the first direction is a direction away from the decision node;

[0092] A reply instruction is received along a second direction of the first link, wherein the reply instruction is obtained by the endpoint in response to the detection instruction, and each node in the second direction forwards the reply instruction, and the second direction is opposite to the first direction.

[0093] Specifically, the first direction refers to the direction from the decision node to the endpoint, and the second direction refers to the direction from the endpoint to the decision node. When the decision node is an intermediate node, the first direction includes two directions: the direction from the decision node to the sender and the direction from the decision node to the receiver. The second direction includes two directions: the direction from the sender to the decision node and the direction from the receiver to the decision node.

[0094] Continue to see Figure 2 For example, let's use the first link shown in the figure as an example. Assume that node C, acting as a decision node, sends a probe command to node B. This probe command is of the probe type and carries node C's node number, but not C's node information. Node B, acting as an intermediate node in the first link, adds its own node information to the probe command after receiving it, generating a new probe command. It then forwards the new probe command in the same direction to node A. Node A, acting as an endpoint in the first link, adds its own node information to the probe command, generates a reply command carrying node information for both nodes B and A, and forwards it back to node B. Node B then determines that it is not a decision node and directly forwards the reply command to node A. Upon receiving the reply command, node A determines that it is a decision node and saves the information for the left link, completing the left-side probe. Similarly, when node C sends a probe command to node D, it obtains information about the right link, namely, the node information for nodes D and E.

[0095] It should be noted that, in addition to the media capabilities of the node, the above-mentioned node information may also include the node's media needs, the node's current status, the node's position in the first link, and media channel information with adjacent nodes. The media channel information with adjacent nodes here may include information such as the Internet Protocol (IP) address, port address, and type of transmission media at both ends of the node. The media capabilities of a node include the encoding capabilities of the endpoint, the decoding capabilities of the endpoint, and the transcoding capabilities of the intermediate node. Video encoding and decoding capabilities may include type, resolution, bit rate, frame rate, etc.; audio encoding and decoding capabilities may include type, bit rate, sampling rate, number of channels, bit width, etc. The current status of a node includes the encoding type of the endpoint, the decoding type of the endpoint, and the transcoding type of the intermediate node. The media needs of a node include playback (decoding), recording, mixing, screen fusion, etc. However, forwarding is not considered a demand, and transcoding is considered a demand, but the current status is not a demand. For example, an endpoint may have a playback (decoding) demand, while an intermediate node generally has no demand. The relationship between a node's media capabilities, media requirements, and node status is as follows: for a node, media capabilities are fixed; media requirements are determined by the link's service requirements and cannot be changed; node status is the link's current implementation and can be changed. The optimization implemented in this application is to modify the status of some nodes based on their media capabilities and media requirements on the first link, achieving optimal conversion and bandwidth strategies.

[0096] For example, the node information of node A obtained by the decision node may be as follows:

[0097] Node A's media capabilities: AMR encoding, AMR decoding;

[0098] Node A's media requirements: playback (decoding);

[0099] The current status of node A is: AMR encoding, AMR decoding;

[0100] The position of node A in the first link: node A is the endpoint and the adjacent node is node B;

[0101] Media channel information with adjacent nodes: Node A-Node B media channel information: Node A's IP address, port address, etc.; Node B's IP address, port address, etc.; media type is AMR.

[0102] The node information of node B obtained by the decision node may include the following:

[0103] Node B media capabilities: G711 / AMR codecs, and conversion between the two;

[0104] Node B media requirements: None;

[0105] The current status of Node B is: performing AMR-G711 conversion;

[0106] Node B's position in the first link: Node B is an intermediate node, with Node A and Node C on either side.

[0107] Media channel information with adjacent nodes: Node A-Node B media channel information: Node A's IP address, port address, etc.; Node B's IP address, port address, etc.; media type is AMR; Node B-Node C media channel information: Node B's IP address, port address, etc.; Node C's IP address, port address, etc.; media type is G711.

[0108] By analogy, the decision node can also obtain detailed node information of nodes C to E. In addition, the method for determining the node status of each node here will be described in detail in subsequent embodiments and will not be repeated here.

[0109] In this embodiment, a detection instruction can be sent by the decision node to obtain node information of each node on the first link, so that the candidate transmission mode of the first link can be determined based on the node information of each node on the first link, thereby achieving the effect of optimizing the first link based on the media capabilities of each node.

[0110] Furthermore, after determining the target transmission mode on the first link based on the media capabilities of the endpoint in step 102, the method further includes:

[0111] Sending an optimization instruction along a third direction of the first link, wherein the optimization instruction is used to notify the corresponding node of the optimization information of each node passed through in the third direction and delete the optimization information of the passed node from the optimization instruction until the optimization instruction reaches the endpoint of the third direction, which is the direction away from the decision node;

[0112] A feedback instruction is received along a fourth direction of the first link, wherein the feedback instruction is obtained by the endpoint in response to the optimization instruction, the feedback instruction is sent to the decision node along the fourth direction, and each node in the fourth direction forwards the feedback instruction, and the fourth direction is opposite to the third direction.

[0113] Specifically, the third direction refers to the direction from the decision node to the endpoint, and the fourth direction refers to the direction from the endpoint to the decision node. When the decision node is an intermediate node, the third direction includes two directions: from the decision node to the sender and from the decision node to the receiver. The fourth direction includes two directions: from the sender to the decision node and from the receiver to the decision node.

[0114] The optimization instruction carries optimization information for all nodes in the third direction. When the optimization instruction passes through a node, the node can obtain its own optimization information from the optimization instruction, delete its own optimization information from the optimization instruction, and then continue forwarding the optimization instruction to the next adjacent node along the third direction. The optimization information can be the optimization result adjusted relative to the node status of each node. The optimization results include maintaining the same state, changing from non-transcoding to transcoding, changing from transcoding to non-transcoding, and changing transcoding parameters in the case of transcoding.

[0115] In one embodiment, after the decision node determines the target transmission mode, it needs to notify all nodes on the link of the target transmission mode. The notification process is as follows:

[0116] Step 301: A decision node sends an optimization instruction to its neighboring nodes. For example, node C, acting as a decision node, can send optimization instructions to nodes B and D. The optimization instruction may include the instruction type (optimization or feedback); the node ID of the decision node; and the node IDs and optimization information for all nodes on the notification path. Assuming that node C sends an optimization instruction to node B, the optimization instruction may include optimization information for both nodes A and B.

[0117] Step 302: After receiving the optimization instruction, the intermediate node obtains its own optimization information, removes its own optimization information from the optimization instruction, and then continues forwarding in the same direction. For example, after receiving the optimization instruction, node B removes its own optimization information from the optimization instruction and sends the optimization instruction carrying node A's optimization information to node A.

[0118] In step 303, after receiving the optimization instruction, the endpoint obtains its own node's optimization information, removes its own optimization information from the optimization instruction, generates a feedback instruction, and sends it back in the opposite direction. For example, after receiving the optimization instruction from node B, node A removes its own optimization information from the optimization instruction, generates a feedback instruction, and sends it to node B. Clearly, the feedback instruction does not carry any node's optimization information.

[0119] Step 304: The non-decision point directly forwards the feedback instruction. For example, after receiving the feedback instruction from node A, node B finds that it is not the first point, so it forwards the feedback instruction to node C.

[0120] Step 305: After receiving the feedback, the decision point confirms the success of the optimization. For example, after receiving the feedback from node B, node C discovers that it is the decision node and the left optimization is successful. When both sides are successfully optimized, the first link executes the optimization solution.

[0121] In this way, by sending optimization instructions, each node on the first link can obtain the optimization information of its own node, so that each node can subsequently optimize the link based on the optimization information and transmit media information based on the optimized transmission method.

[0122] Furthermore, receiving a feedback instruction includes:

[0123] If no feedback instruction is received within the preset time period, the step of sending the optimization instruction along the third direction of the first link is re-executed until the decision node receives the feedback instruction.

[0124] In one embodiment, if the decision node does not receive a feedback instruction within a preset time period, it can re-send the optimization instruction along the third direction of the first link, so as to achieve the function of re-initiating the optimization instruction when the decision node times out and does not receive the feedback instruction. This can avoid the situation where some nodes do not receive the optimization information due to network interruption or network congestion, thereby improving the stability of the system.

[0125] Furthermore, the decision node is a node corresponding to the middlemost node position in the first link.

[0126] In one embodiment, the node located in the middle of the first link can be used as a decision node. Specifically, when each node obtains node information for each node on the first link, it can determine whether it is the node located in the middle of the first link based on the node number in the node information. If so, it can be determined to be a decision node; otherwise, it can be determined to be a non-decision node. In this way, all nodes have node information for each node on the first link, but only one node is required to determine the target transmission mode in the first link and then notify other nodes of the optimization results. This calculation node can also be called a decision point.

[0127] Assuming that the total number of nodes in the first link is N, compare the node numbers of the two endpoints. The node with the smallest node number is the sending end of the first link, and its node number is recorded as 0; the node numbers of adjacent nodes are recorded as 1, 2, etc. in sequence. The node with the largest node number is the receiving end of the first link, and its node number is recorded as N-1. The node number of the decision node is N / 2 and rounded up. Figure 2The first link shown has a total of 5 nodes, so N = 5. The two endpoints are nodes A and E. Assuming that node A has a lower node number than node E, node A is the transmitter, with node number 0, node B is 1, node C is 2, and node D is 3. Node E is the receiver, with node number 4. From this, we can calculate that 5 / 2 = 2.5, which is rounded to 2. Therefore, node C, with node number 2, is the decision node. Node C determines that it is the decision node through calculation and proceeds with subsequent calculations. Other nodes, however, determine that they are not decision nodes through calculations and wait for node C to complete its calculations and notify themselves of the optimization results.

[0128] It should be noted that each node can perform optimization after receiving the optimization plan. However, there is a synchronization issue with the optimization, that is, different nodes may apply the new plan at different times. The solution is to discard data that does not meet expectations. For example, in the media channel from node B to node C, the pre-optimization G711 encoding format is changed to the optimized AMR encoding format. If node B applies the optimization plan first, node C still expects to receive the G711 encoding format. If node C actually receives the AMR encoding format, the media information will be discarded. If node C applies the optimization plan first, node C already expects to receive the AMR encoding format. If node C actually receives the G711 encoding format, the media information will be discarded.

[0129] In this embodiment, the node at the most middle node position in the first link is selected as the decision node. Since the number of nodes that need to be transferred from the node at the most middle node position to the endpoints on both sides is similar, after the decision node determines the target transmission mode, the decision node can quickly notify the target transmission mode to each node, thereby improving the optimization efficiency of the first link.

[0130] Furthermore, the preset transmission mode includes a transmission mode with the least number of transcoding times determined according to the media capabilities of the remaining nodes of the first link after the transmission mode of any one or more intermediate nodes in the first link is specified.

[0131] In this application, in addition to determining the target transmission mode of the first link based on the media capabilities of each node in the first link, after the user specifies the transmission mode of any one or more intermediate nodes in the first link, the transmission mode with the least number of transcoding times can be determined based on the media capabilities of the remaining nodes in the first link, and this transmission mode can be used as the target transmission mode. Figure 2On the first link shown, assuming the user specifies that intermediate node C transmit in the G711 format, the decision node can determine candidate transmission modes that allow node C to transmit in the G711 format based on the media capabilities of nodes A to B and D to E, and then based on the media capabilities of nodes A to B and D to E. Finally, the decision node determines the target transmission mode from the candidate transmission modes based on the number of transcoding operations. In this way, the target transmission mode for the first link can be determined based on the user's personalized needs.

[0132] See also Figure 5 , Figure 5 This is a schematic diagram of the structure of the device for optimizing link based on media capability provided in the embodiment of the present application. Figure 5 As shown, the apparatus 500 for optimizing a link based on media capabilities includes:

[0133] A first acquisition module 501 is configured to acquire the media capabilities of an endpoint on a first link;

[0134] The first determination module 502 is used to determine a target transmission mode on the first link based on the media capabilities of the endpoint, so that the endpoint on the first link obtains media information that meets its media capabilities, wherein the target transmission mode is that the intermediate node of the first link transmits media information according to a preset transmission mode.

[0135] Optionally, the first determining module 502 includes:

[0136] The judgment submodule is used to judge whether the endpoints have the same media capabilities;

[0137] A first determining submodule is configured to, when it is determined that the endpoints have the same media capabilities, determine a target transmission mode based on the same media capabilities of the endpoints, wherein the target transmission mode is that the intermediate nodes in the first link transparently transmit the media information based on the same media capabilities of the endpoints; or

[0138] The second determination submodule is used to obtain the media capabilities of the intermediate nodes on the first link when it is determined that the endpoints do not have the same media capabilities, and determine the target transmission mode based on the media capabilities of each node, wherein the media capabilities of each node include the media capabilities of the endpoints and the media capabilities of the intermediate nodes, and the target transmission mode is that the intermediate nodes in the first link transmit or transcode the media information based on their respective media capabilities.

[0139] Optionally, the apparatus 500 for optimizing a link based on media capabilities further includes:

[0140] A second acquisition module, configured to acquire the media capabilities of the intermediate node on the first link;

[0141] The first determination module is further configured to determine a target transmission mode based on the media capabilities of each node, where the media capabilities of each node include the media capabilities of the endpoint and the media capabilities of the intermediate node.

[0142] Optionally, the second determining submodule includes:

[0143] A first determining unit is configured to determine, based on the media capabilities of each node, a candidate transmission mode for transmitting the media information, wherein the candidate transmission mode is used to represent a processing mode of the media information by each node in the first link when receiving the media information from a previous node or a next node, the processing mode including transparent transmission of the media information or transmission of the media information after transcoding; the candidate transmission mode satisfies a preset condition, wherein the preset condition is that the media capabilities supported by the first link meet the media capability requirements of the endpoints, and the media capabilities of the intermediate nodes in the first link can realize media transmission of the media information between the endpoints;

[0144] The second determining unit is configured to determine a target transmission mode from candidate transmission modes.

[0145] Optionally, the second determining unit is further configured to:

[0146] When the first link is used to transmit audio media information and there are multiple candidate transmission modes, the target transmission mode is determined based on the number of transcoding times and / or occupied bandwidth of the candidate transmission modes, with the number of transcoding times taking precedence over the priority of occupied bandwidth. The occupied bandwidth is determined based on the media capabilities of each node in the first link; or

[0147] When the first link is used to transmit video media information and there are multiple candidate transmission modes, the target transmission mode is determined based on the number of transcoding times and / or resolutions of the candidate transmission modes. The number of transcoding times takes precedence over the resolution. The resolution is determined based on the media capabilities of each node in the first link.

[0148] Optionally, the second acquisition module includes:

[0149] a sending submodule, configured to send a detection instruction along a first direction of the first link, wherein the detection instruction is configured to add the media capabilities of the passed node to the detection instruction after each node passed through in the first direction, until the detection instruction reaches an endpoint in the first direction, the first direction being a direction away from the decision node;

[0150] The receiving submodule is configured to receive a reply instruction along a second direction of the first link, wherein the reply instruction is obtained by the endpoint in response to the detection instruction, and each node in the second direction forwards the reply instruction. The second direction is opposite to the first direction.

[0151] Optionally, the apparatus 500 for optimizing a link based on media capabilities further includes:

[0152] a sending module, configured to send an optimization instruction along a third direction of the first link, wherein the optimization instruction is configured to notify the corresponding node of optimization information of each node passed through after the optimization instruction passes through the node in the third direction, and delete the optimization information of the passed node from the optimization instruction until the optimization instruction reaches an endpoint in the third direction, where the third direction is a direction away from the decision node;

[0153] A receiving module is configured to receive a feedback instruction along a fourth direction of the first link, wherein the feedback instruction is obtained by the endpoint in response to the optimization instruction, the feedback instruction is sent to the decision node along the fourth direction, and each node in the fourth direction forwards the feedback instruction, and the fourth direction is opposite to the third direction.

[0154] Optionally, the receiving module is configured to:

[0155] If no feedback instruction is received within the preset time period, the step of sending the optimization instruction along the third direction of the first link is re-executed until the decision node receives the feedback instruction.

[0156] Optionally, the decision node is a node corresponding to the middlemost node position in the first link.

[0157] Optionally, the preset transmission mode includes a transmission mode with the least number of transcoding times determined according to the media capabilities of the remaining nodes in the first link after the transmission mode of any one or more intermediate nodes in the first link is specified.

[0158] It should be noted that the apparatus 500 for optimizing links based on media capabilities can execute the steps in each embodiment of the above-mentioned method for optimizing links based on media capabilities and achieve the same technical effects, which will not be described in detail here.

[0159] like Figure 6 As shown, an embodiment of the present application provides an electronic device, including a processor 611, a communication interface 612, a memory 613 and a communication bus 614, wherein the processor 611, the communication interface 612, and the memory 613 communicate with each other through the communication bus 614.

[0160] Memory 613, for storing computer programs;

[0161] In one embodiment of the present application, the processor 611 is configured to implement the method for optimizing a link based on media capabilities provided by any of the aforementioned method embodiments when executing a program stored in the memory 613, including:

[0162] Obtaining the media capabilities of the endpoint on the first link;

[0163] A target transmission mode on the first link is determined based on the media capabilities of the endpoints, so that the endpoints on the first link obtain media information that meets their media capabilities, wherein the target transmission mode is that the intermediate nodes of the first link transmit media information according to a preset transmission mode.

[0164] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the method for optimizing a link based on media capabilities as provided in any of the aforementioned method embodiments are implemented.

[0165] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0166] The foregoing description is intended only to provide specific embodiments of the present invention, which will enable those skilled in the art to understand and implement the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention is not intended to be limited to the embodiments shown herein, but is intended to be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A method for optimizing a link based on media capabilities, characterized in that: Applied to a decision node, the decision node being any node in a first link, the method comprising: Acquire the media capability of the endpoint on the first link; Determining a target transmission mode on the first link based on the media capabilities of the endpoints, so that the endpoints on the first link obtain media information that meets their media capabilities, wherein the target transmission mode is that the intermediate nodes of the first link transmit media information according to a preset transmission mode; The determining of the target transmission mode on the first link based on the media capability of the endpoint includes: Determining whether the endpoints have the same media capabilities; When it is determined that the endpoints have the same media capabilities, the target transmission mode is determined based on the same media capabilities of the endpoints, wherein the target transmission mode is that the intermediate nodes in the first link transparently transmit the media information based on the same media capabilities of the endpoints.

2. The method according to claim 1, characterized in that The determining the target transmission mode on the first link based on the media capability of the endpoint further includes: When it is determined that the endpoints do not have the same media capabilities, the media capabilities of the intermediate nodes on the first link are obtained, and the target transmission mode is determined based on the media capabilities of each node, wherein the media capabilities of each node include the media capabilities of the endpoints and the media capabilities of the intermediate nodes, and the target transmission mode is that the intermediate nodes in the first link perform transparent transmission or transcoding transmission of media information based on their respective media capabilities.

3. The method according to claim 1, characterized in that Before determining the target transmission mode on the first link based on the media capability of the endpoint, the method further includes: Acquire the media capability of the intermediate node on the first link; The determining a target transmission mode on the first link based on the media capability of the endpoint includes: The target transmission mode is determined based on the media capability of each node, where the media capability of each node includes the media capability of the endpoint and the media capability of the intermediate node.

4. The method according to claim 2 or 3, characterized in that: The determining the target transmission mode based on the media capability of each node includes: Based on the media capabilities of each node, determine a candidate transmission mode for transmitting the media information, wherein the candidate transmission mode is used to characterize a processing mode of the media information by each node in the first link when receiving the media information from the previous node or the next node, and the processing mode includes transparently transmitting the media information or transmitting the media information after transcoding; the candidate transmission mode meets a preset condition, and the preset condition is that the media capabilities supported by the first link meet the media capability requirements of the endpoints, and the media capabilities of the intermediate nodes of the first link can realize media transmission of the media information between the endpoints; The target transmission mode is determined from the candidate transmission modes.

5. The method according to claim 4, characterized in that The determining the target transmission mode from the candidate transmission modes includes: When the first link is used to transmit audio media information and there are multiple candidate transmission modes, the target transmission mode is determined based on the number of transcoding times and / or occupied bandwidth of the candidate transmission modes, the priority of the number of transcoding times is higher than the priority of the occupied bandwidth, and the occupied bandwidth is determined based on the media capability of each node in the first link; or When the first link is used to transmit video media information and there are multiple candidate transmission modes, the target transmission mode is determined based on the number of transcoding times and / or resolutions of the candidate transmission modes, the priority of the number of transcoding times is higher than the priority of the resolution, and the resolution is determined based on the media capabilities of each node in the first link.

6. The method according to claim 2 or 3, characterized in that: The acquiring the media capability of the intermediate node on the first link includes: Sending a detection instruction along a first direction of the first link, wherein the detection instruction is used to add the media capability of the passed node to the detection instruction after each node passed through in the first direction, until the detection instruction reaches an endpoint in the first direction, the first direction being a direction away from the decision node; A reply instruction is received along a second direction of the first link, wherein the reply instruction is obtained by the endpoint in response to the detection instruction, and each node in the second direction forwards the reply instruction, and the second direction is opposite to the first direction.

7. The method according to claim 1, characterized in that After determining the target transmission mode on the first link based on the media capability of the endpoint, the method further includes: Sending an optimization instruction along a third direction of the first link, wherein the optimization instruction is used to notify the corresponding node of the optimization information of the passed node after each node is passed in the third direction, and delete the optimization information of the passed node from the optimization instruction, until the optimization instruction reaches an end point in the third direction, and the third direction is a direction away from the decision node; A feedback instruction is received along a fourth direction of the first link, wherein the feedback instruction is obtained by the endpoint in response to the optimization instruction, the feedback instruction is sent to the decision node along the fourth direction, each node in the fourth direction forwards the feedback instruction, and the fourth direction is opposite to the third direction.

8. The method according to claim 7, characterized in that The receiving a feedback instruction along a fourth direction of the first link includes: If the feedback instruction is not received within a preset time period, the step of sending the optimization instruction along the third direction of the first link is re-executed until the decision node receives the feedback instruction.

9. The method according to claim 1, characterized in that: The decision node is a node corresponding to the middlemost node position in the first link.

10. The method according to claim 1, characterized in that The preset transmission mode includes a transmission mode with the least number of transcoding times determined according to the media capabilities of the remaining nodes of the first link after the transmission mode of any one or more intermediate nodes in the first link is specified.

11. A device for optimizing a link based on media capabilities, characterized in that: Applied to a decision node, the decision node being any node in a first link, the device comprising: An acquisition module, used to acquire the media capability of the endpoint on the first link; a determination module, configured to determine a target transmission mode on the first link based on the media capability of the endpoint, so that the endpoint on the first link obtains media information that satisfies its media capability, wherein the target transmission mode is that the intermediate node of the first link transmits the media information according to a preset transmission mode; The determining of the target transmission mode on the first link based on the media capability of the endpoint includes: Determining whether the endpoints have the same media capabilities; When it is determined that the endpoints have the same media capabilities, the target transmission mode is determined based on the same media capabilities of the endpoints, wherein the target transmission mode is that the intermediate nodes in the first link transparently transmit the media information based on the same media capabilities of the endpoints.

12. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; The processor is used to implement the steps of the method for optimizing links based on media capabilities as described in any one of claims 1 to 10 when executing the program stored in the memory.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method for optimizing links based on media capabilities as described in any one of claims 1 to 10 are implemented.

Images