Video transmission methods, equipment, systems and storage media

Abstract

This application provides a video transmission method, device, system, and storage medium, including: a first media gateway receiving an uplink media packet sent by a first terminal, the uplink media packet carrying information about the first terminal's ability to support asymmetric uplink and downlink resolutions and an uplink media stream of the first terminal at a first resolution; the first media gateway sending a first downlink media packet to the first terminal, the first downlink media packet carrying a downlink media stream of the first terminal at a second resolution, the first resolution and the second resolution being different. This solution is applicable to terminals that support different resolutions in the sending and receiving directions. During video calls, the resolution can be lowered according to channel quality to distribute video packets, and the resolution can be adjusted when network resources are sufficient, achieving optimal utilization of network resources, ensuring image quality at the receiving end, enhancing video call quality, and reducing bandwidth costs for video transmission.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a video transmission method, video transmission device, video transmission system and storage medium. Background Art

[0002] Mobile communication networks have upgraded from 3G to 4G. Besides faster internet speeds, 4G networks also offer high-definition voice and video calls. With the widespread adoption of 4G, various apps have flourished. Instant messaging apps are constantly eroding the voice market share of traditional telecom operators. Furthermore, looking towards the future 5G network, instant messaging apps will offer even more competitive service experiences.

[0003] Faced with current competition and greater future risks, operators need to continuously reduce costs and provide better service experiences. The two basic products operators offer to the public are data traffic and voice calls. Data traffic demand has been increasing rapidly and has become the main source of revenue for operators. Voice call demand, however, is approaching saturation. Therefore, operators prioritize data traffic planning when designing wireless networks, followed by voice call planning. Data traffic and voice call performance differ in wireless networks. Data traffic is characterized by low uplink bandwidth and high downlink bandwidth. Generally, uplink bandwidth accounts for 10% of downlink bandwidth. The recommended construction standard by domestic operators is 0.5Mbps uplink and 5Mbps downlink. Voice calls require 24.85Kbps uplink and 24.85kbps downlink for audio calls; and 1Mbps uplink and 1Mbps downlink for video calls.

[0004] In other words, when the data domain's traffic requirements meet coverage standards, the requirements for audio calls are also met. However, the requirements for video calls cannot be met. Furthermore, currently, most of the power consumption in wireless networks is in the downlink, with operators allocating more resources to downlink. However, the telephone model consumes the same resources for both uplink and downlink, easily leading to significant resource waste. Summary of the Invention

[0005] This application discloses a video transmission method, video transmission device, video transmission system, and storage medium, which can achieve optimal utilization of network resources.

[0006] In a first aspect, embodiments of this application provide a video transmission method, comprising: a first media gateway receiving an uplink media packet sent by a first terminal, the uplink media packet carrying information that the first terminal supports uplink and downlink resolution asymmetry capability and an uplink media stream of the first terminal at a first resolution; the first media gateway sending a first downlink media packet to the first terminal, the first downlink media packet carrying a downlink media stream of the first terminal at a second resolution, wherein the first resolution and the second resolution are different.

[0007] Through the embodiments of this application, the first media gateway can receive an uplink media stream of a first resolution sent by a first terminal, and can also send a downlink media stream of a second resolution sent by the first terminal to the first terminal. This solution is applicable to terminals that support different resolutions in the sending and receiving directions. During video calls, the resolution can be lowered according to channel quality to distribute video packets, while the resolution can be raised when network resources are sufficient. This achieves optimal utilization of network resources, while ensuring the image quality of the receiving end, enhancing the quality of video calls, improving the user's viewing experience, and reducing the bandwidth cost of video transmission.

[0008] As an optional implementation, it further includes: the first media gateway receiving a second downlink media packet sent by the second media gateway, the second downlink media packet carrying a downlink media stream of third resolution; the first media gateway performing super resolution (SR) processing on the downlink media stream of third resolution to obtain the downlink media stream of second resolution.

[0009] In this solution, when the first media gateway supports super-resolution, it performs super-resolution processing on low-resolution uplink media streams to convert them into high-resolution uplink media streams that can be supported by network resources, and then sends them to the terminal. This solution is applicable when network resources are sufficient, leveraging the video super-resolution capabilities of media processing network element nodes to perform super-resolution on video media streams, achieving optimal utilization of network resources while ensuring image quality at the receiving end, enhancing video call quality, and improving the user's viewing experience.

[0010] As another optional implementation, it further includes: the first media gateway receiving the first downlink media packet sent by the second media gateway.

[0011] The method further includes: the second media gateway receiving a second downlink media packet sent by the second terminal, the second downlink media packet carrying a downlink media stream of third resolution; the second media gateway performing super-resolution processing on the downlink media stream of third resolution to obtain a downlink media stream of second resolution; and the second media gateway sending the downlink media stream of second resolution to the first media gateway through the first downlink media packet.

[0012] In this embodiment, when the second media gateway has super-resolution capability, it performs super-resolution processing on the low-resolution uplink media stream into a high-resolution uplink media stream that can be supported by network resources, and then sends it to the terminal. This solution is applicable to performing super-resolution on video media streams using the video super-resolution capability of media processing network element nodes when network resources are sufficient, achieving optimal utilization of network resources while ensuring the image quality at the receiving end, enhancing video call quality, and improving the user's viewing experience.

[0013] Secondly, embodiments of this application provide a video transmission method, comprising: a first terminal sending an uplink media packet to a media gateway, the uplink media packet carrying the resolution of a downlink media stream supported by the first terminal and the uplink media stream of the first terminal; the first terminal receiving a downlink media packet sent by the media gateway, the resolution of the downlink media stream carried in the downlink media packet being the resolution supported by the first terminal.

[0014] In this embodiment, when a first terminal sends an uplink media packet to a media gateway, the uplink media packet carries the resolution of the downlink media stream supported by the first terminal and the uplink media stream of the first terminal. Specifically, the first terminal sends the resolution of its supported downlink media stream along with the uplink media stream, ensuring that the downlink media stream resolution carried in the downlink media packet sent by the media gateway is the resolution supported by the first terminal. This method improves video transmission efficiency, ensures video transmission reliability, and reduces video transmission bandwidth costs.

[0015] The first terminal performs super-resolution on the received downlink media stream and plays it.

[0016] The uplink media packet carries information about the first terminal's ability to support asymmetric uplink and downlink resolution.

[0017] The uplink media packet is an RTP message.

[0018] The resolution of the downlink media stream supported by the first terminal is carried in the header of the RTP message.

[0019] The information regarding the first terminal's ability to support asymmetric uplink and downlink resolution is carried in the header of the RTP message.

[0020] Before the first terminal sends the uplink media packet to the media gateway, the method further includes: the first terminal sending a media session request to the media gateway, requesting to establish a media session with the second terminal; and after the first terminal establishes a media session with the second terminal, sending the uplink media packet to the media gateway.

[0021] Alternatively, before the first terminal sends the uplink media packet to the media gateway, the method further includes: the first terminal receiving a media session request from the second terminal sent by the media gateway, the media session being used to request the establishment of a media session with the first terminal; the first terminal sending a media session response to the media gateway to establish a media session with the second terminal; and the first terminal sending the uplink media packet to the media gateway after establishing a media session with the second terminal.

[0022] The media session request is a Session Description Protocol (SDP) session request.

[0023] The media session response carries indication information indicating that the first terminal supports super-resolution capability.

[0024] Thirdly, embodiments of this application also provide a video transmission method, comprising: a first media gateway receiving a first message sent by a base station, the first message carrying a first resolution; the first media gateway sending a second message to a first terminal, the second message carrying the first resolution; the first media gateway receiving and processing an uplink media packet sent by the first terminal, the uplink media packet carrying an uplink media stream of the first terminal, the resolution of the uplink media stream being the first resolution.

[0025] In this embodiment, the first media gateway sends a message to the first terminal based on messages sent by the base station, instructing the first terminal to send a media stream at a resolution supported by the base station. This method improves the efficiency and ensures the reliability of video transmission.

[0026] The method further includes: the first media gateway performing super-resolution processing on the uplink media stream to obtain a video image with a second resolution, the second resolution being higher than the first resolution; and the first media gateway sending the uplink media stream with the second resolution to the second terminal.

[0027] This also includes: the first media gateway sending the uplink media packet to the second media gateway.

[0028] The first message is the first RTCP message, and the second message is the second RTCP message.

[0029] The uplink media packet is an uplink RTP packet.

[0030] Fourthly, embodiments of this application also provide a video transmission method, comprising: a second media gateway receiving an uplink media packet from a first media gateway to a first terminal, the uplink media packet carrying an uplink media stream of the first terminal, the resolution of the uplink media stream being a first resolution; the second media gateway receiving a third message from a base station, the third message carrying a second resolution, the second resolution being higher than the first resolution; the second media gateway performing super-resolution processing on the uplink media stream to obtain a video image of the second resolution; and the second media gateway sending the uplink media stream of the second resolution to a second terminal.

[0031] In this embodiment, when the second media gateway has super-resolution capability, it performs super-resolution processing on the low-resolution uplink media stream into a high-resolution uplink media stream that can be supported by network resources, and then sends it to the terminal. This solution is applicable to performing super-resolution on video media streams using the video super-resolution capability of media processing network element nodes when network resources are sufficient, achieving optimal utilization of network resources while ensuring the image quality at the receiving end, enhancing video call quality, and improving the user's viewing experience.

[0032] The third message is the third RTCP message.

[0033] The uplink media packet is an uplink RTP packet.

[0034] Fifthly, embodiments of this application also provide a video transmission method, comprising: a terminal receiving an RTCP message sent by a media gateway, the RTCP message carrying a first resolution; the terminal sending an uplink media stream to the media gateway, the resolution of the uplink media stream being the first resolution.

[0035] Sixthly, this application provides a video transmission device, including a memory and a processor coupled to each other, wherein the memory stores computer program code, and the processor calls and executes the computer program code in the memory, causing the video transmission device to perform the video transmission method.

[0036] In a seventh aspect, this application provides a video transmission system, including a first media gateway, wherein the first media gateway is further configured to: receive an uplink media packet sent by a first terminal, the uplink media packet carrying information that the first terminal supports uplink and downlink resolution asymmetry capability and an uplink media stream of the first terminal at a first resolution; and send a first downlink media packet to the first terminal, the first downlink media packet carrying a downlink media stream of the first terminal at a second resolution, wherein the first resolution and the second resolution are different.

[0037] The first media gateway is further configured to: receive a second downlink media packet sent by the second media gateway, wherein the second downlink media packet carries a downlink media stream of a third resolution; and perform super-resolution processing on the downlink media stream of the third resolution to obtain a downlink media stream of the second resolution.

[0038] The first media gateway is also configured to: receive the first downlink media packet sent by the second media gateway.

[0039] The system further includes a second media gateway, which is configured to: receive a second downlink media packet sent by a second terminal, the second downlink media packet carrying a downlink media stream of a third resolution; perform super-resolution processing on the downlink media stream of the third resolution to obtain a downlink media stream of the second resolution; and send the downlink media stream of the second resolution to the first media gateway through the first downlink media packet.

[0040] Eighthly, this application provides a terminal device for: sending an uplink media packet to a media gateway, the uplink media packet carrying the resolution of a downlink media stream supported by the first terminal and the uplink media stream of the first terminal; and receiving a downlink media packet sent by the media gateway, the resolution of the downlink media stream carried in the downlink media packet being the resolution supported by the first terminal.

[0041] It also includes: super-splitting and playing the received downlink media stream.

[0042] It is also used to: send a media session request to the media gateway, requesting to establish a media session with the second terminal; and after establishing a media session with the second terminal, send the uplink media packet to the media gateway.

[0043] The terminal device is further configured to: receive a media session request from a second terminal sent by the media gateway, the media session being used to request the establishment of a media session with the first terminal; send a media session response to the media gateway to establish a media session with the second terminal; and after establishing a media session with the second terminal, send the uplink media packet to the media gateway.

[0044] Ninthly, this application provides a computer storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform a method provided as provided in any of the possible implementations of the first aspect and / or any of the possible implementations of the second aspect and / or any of the possible implementations of the third aspect and / or any of the possible implementations of the fourth aspect and / or any of the possible implementations of the fifth aspect.

[0045] In a tenth aspect, embodiments of this application provide a computer program product that, when run on a computer, causes the computer to perform a method provided as provided in any of the possible implementations of the first aspect and / or any of the possible implementations of the second aspect and / or any of the possible implementations of the third aspect and / or any of the possible implementations of the fourth aspect and / or any of the possible implementations of the fifth aspect.

[0046] Eleventhly, this application provides a base station device, which includes a memory and a processor. The memory stores computer instructions, and the processor calls and executes the computer instructions in the memory, causing the base station to perform the above-described media video transmission method and communicate with a first media gateway and / or a second media gateway.

[0047] In one possible scenario, the aforementioned base station communicates with the terminal device.

[0048] In a twelfth aspect, this application provides a terminal device including a memory and a processor. The memory stores computer instructions, and the processor calls and executes the computer instructions in the memory, causing a base station to perform the aforementioned media video transmission method and communicate with a first media gateway and / or a second media gateway.

[0049] In one possible scenario, the aforementioned terminal is either a first terminal or a second terminal.

[0050] It is understood that the device described in the sixth aspect, the system described in the seventh aspect, the terminal described in the eighth aspect, the computer storage medium described in the ninth aspect, or the computer program product described in the tenth aspect are all used to execute the methods provided in any of the first, second, third, fourth, and fifth aspects. Therefore, the beneficial effects they can achieve can be referred to in the beneficial effects of the corresponding methods, and will not be repeated here.

[0051] In all the solutions provided above, the uplink media packet carries the set of uplink and downlink resolutions supported by the first terminal.

[0052] In one possible implementation, the uplink media packet carries an indication of whether the super-resolution capability of the first terminal is enabled.

[0053] In one possible scenario, the first media gateway sends the uplink media packet to the second media gateway or the second terminal.

[0054] In one possible approach, the first media gateway sends a notification message to the base station, which carries information that the first terminal supports uplink and downlink resolution asymmetry capabilities.

[0055] In one possible implementation, the second media gateway receives the uplink media packet sent by the first media gateway and sends a notification message to the base station, which carries information about the first terminal's support for uplink and downlink resolution asymmetry.

[0056] In one possible scenario, the notification message is an RTCP message.

[0057] In the above-mentioned solutions, the transmission and negotiation of super-resolution capabilities are carried out through uplink media packets and RTCP messages on the media plane, which is more efficient than the transmission and negotiation of super-resolution capabilities through signals plane messages. Attached Figure Description

[0058] The accompanying drawings used in the embodiments of this application are described below.

[0059] Figure 1a This is a schematic diagram of the structure of a video transmission system provided in an embodiment of this application;

[0060] Figure 1b This is a schematic diagram of another video transmission system provided in an embodiment of this application;

[0061] Figure 1c This is a flowchart illustrating a video transmission method provided in an embodiment of this application;

[0062] Figure 2a This is a flowchart illustrating another video transmission method provided in an embodiment of this application;

[0063] Figure 2b This is a schematic diagram of the structure of an RTP message provided in an embodiment of this application;

[0064] Figure 3a This is a flowchart illustrating another video transmission method provided in an embodiment of this application;

[0065] Figure 3b This is a schematic diagram of the structure of an RTCP message provided in an embodiment of this application;

[0066] Figure 4 This is a flowchart illustrating another video transmission method provided in an embodiment of this application;

[0067] Figure 5 This is a schematic diagram illustrating a specific process of a video transmission method provided in an embodiment of this application;

[0068] Figure 6 This is a schematic diagram illustrating the specific process of another video transmission method provided in this application embodiment;

[0069] Figure 7 This is a schematic flowchart of another video transmission method provided in the embodiments of this application;

[0070] Figure 8 This is a schematic diagram of the structure of a video transmission device provided in an embodiment of this application;

[0071] Figure 9 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application. Detailed Implementation

[0072] The embodiments of this application are described below with reference to the accompanying drawings. The terminology used in the implementation section of this application is for explaining specific embodiments only and is not intended to limit the scope of this application.

[0073] Reference Figure 1a This is a schematic diagram of a video transmission system provided in an embodiment of this application. The video transmission system may include a first terminal and a first media gateway. The first media gateway is used to receive uplink media packets sent by the first terminal, the uplink media packets carrying information about the first terminal's support for asymmetric uplink and downlink resolutions, and an uplink media stream of the first terminal at a first resolution. The first media gateway is also used to send a first downlink media packet to the first terminal, the first downlink packet carrying a downlink media stream of the first terminal at a second resolution, wherein the first resolution and the second resolution are different.

[0074] Furthermore, the aforementioned first media gateway can be Figure 1b In the video transmission system shown, the IP Multimedia Subsystem Access Gateway (IMS-AGW1) can be the first terminal, which may be the User Equipment (UE1); alternatively, the first media gateway may also be... Figure 1b In the IMS-AGW2, the first terminal mentioned above can also be user equipment UE2. Here, user equipment can be referred to as a terminal.

[0075] The media gateway in this application embodiment is only illustrated by taking the IMS access gateway IMS-AGW as an example. The media gateway may also be a multimedia resource function (MRF) device or a session board controller (SBC) in the IMS core network. This solution does not specifically limit it.

[0076] Through the embodiments of this application, the first media gateway can receive an uplink media stream of a first resolution sent by a first terminal, and can also send a downlink media stream of a second resolution sent by the first terminal to the first terminal. This solution is applicable to terminals that support different resolutions in the sending and receiving directions. During video calls, the resolution can be lowered according to channel quality to distribute video packets, while the resolution can be raised when network resources are sufficient, achieving optimal utilization of network resources, ensuring image quality at the receiving end, enhancing video call quality, improving the user's viewing experience, and reducing bandwidth costs for video transmission. The above video call can be implemented based on LTE network voice service (VoLTE) or NR network voice service (VoNR).

[0077] Wherein, when the first media gateway supports super-resolution, the first media gateway is also used to receive a second downlink media packet sent by the second media gateway, the second downlink media packet carrying a downlink media stream of a third resolution; the first media gateway performs super-resolution processing on the downlink media stream of the third resolution to obtain a downlink media stream of the second resolution, wherein the second resolution is higher than the third resolution.

[0078] The first media gateway is also used to receive the first downlink media packet sent by the second media gateway.

[0079] When the second media gateway supports super-resolution, the second media gateway is used to receive a second downlink media packet sent by the second terminal, the second downlink media packet carrying a downlink media stream of third resolution; the second media gateway performs super-resolution processing on the downlink media stream of third resolution to obtain a downlink media stream of second resolution; the second media gateway sends the downlink media stream of second resolution to the first media gateway through the first downlink media packet.

[0080] Reference Figure 1c This is a flowchart illustrating a video transmission method provided in an embodiment of this application. Figure 1c As shown, it includes steps 101-102, as follows:

[0081] 101. The first media gateway receives an uplink media packet sent by the first terminal, wherein the uplink media packet carries information that the first terminal supports uplink and downlink resolution asymmetry capability and an uplink media stream of the first resolution of the first terminal;

[0082] The information that the first terminal supports asymmetric uplink and downlink resolution means that the first terminal supports different resolutions in the receiving and transmitting directions.

[0083] The uplink media packet is a Real-time Transport Protocol (RTP) message. Information regarding the first terminal's support for asymmetric uplink and downlink resolution can be carried in the header of the RTP message.

[0084] Specifically, information about the terminal's ability to support asymmetric uplink and downlink resolutions can be added to the RTP header extension, as shown in the following example:

[0085] ResSymmetry{0,1}. This field occupies 2 bits and indicates whether the terminal supports asymmetric uplink and downlink resolution. When the value is 0, it corresponds to Limted, which means that the terminal only supports symmetric uplink and downlink; when the value is 1, it corresponds to NoLimited, which means that the terminal does not limit whether it is symmetric or not, that is, the terminal supports asymmetric uplink and downlink resolution.

[0086] The first media gateway can send the received uplink media packet from the first terminal to the second media gateway, so that the second media gateway can send the uplink media packet from the first terminal to the second terminal.

[0087] 102. The first media gateway sends a first downlink media packet to the first terminal, the downlink media packet carrying a downlink media stream of the first terminal at a second resolution, the first resolution and the second resolution being different.

[0088] The first media gateway can also send a first downlink media packet to the first terminal, the downlink media packet carrying a downlink media stream at a second resolution for the first terminal. Since the first terminal supports asymmetric uplink and downlink resolution, the first media gateway can send a downlink media stream at a second resolution to the first terminal based on network resource availability. The first media gateway can also receive uplink media packets at a first resolution sent by the first terminal. The first resolution and the second resolution are different. Both the first resolution and the second resolution are resolutions supported by the first terminal.

[0089] The first media gateway can receive the first downlink media packet sent by the second media gateway. Specifically, the second media gateway can send the received first downlink media packet from the second terminal to the first media gateway, so that the first media gateway can send the first downlink media packet from the second terminal to the first terminal.

[0090] Before the first media gateway sends the first downlink media packet to the first terminal, the first media gateway may also receive a second downlink media packet sent by the second media gateway. The second downlink media packet carries a downlink media stream with a third resolution. The first media gateway performs super-resolution processing on the downlink media stream with the third resolution to obtain the downlink media stream with the second resolution.

[0091] In other words, when the first media gateway supports super-resolution, it can perform super-resolution processing on the received downlink media stream at the third resolution to obtain a downlink media stream at the second resolution, and then send the downlink media stream at the second resolution to the first terminal. The second resolution is higher than the third resolution.

[0092] Through the embodiments of this application, the first media gateway can receive an uplink media stream of a first resolution sent by a first terminal, and can also send a downlink media stream of a second resolution sent by the first terminal to the first terminal. This solution is applicable to terminals that support different resolutions in the sending and receiving directions. During video calls, the resolution can be lowered according to channel quality to distribute video packets, while the resolution can be raised when network resources are sufficient. This achieves optimal utilization of network resources, while ensuring the image quality of the receiving end, enhancing the quality of video calls, improving the user's viewing experience, and reducing the bandwidth cost of video transmission.

[0093] Reference Figure 2a This is a flowchart illustrating another video transmission method provided in an embodiment of this application. Figure 2a As shown, it includes steps 201-202, as follows:

[0094] 201. The first terminal sends an uplink media packet to the media gateway, the uplink media packet carrying the resolution of the downlink media stream supported by the first terminal and the uplink media stream of the first terminal;

[0095] The resolution of the downlink media stream supported by the first terminal is used to indicate the resolution of the media stream supported by the first terminal in the downlink direction.

[0096] The uplink media packet can be an RTP message. The resolution of the downlink media stream supported by the first terminal is carried in the header of the RTP message.

[0097] Furthermore, the uplink media packet may also carry information about the first terminal's support for asymmetric uplink and downlink resolution. This information is carried in the header of the RTP message.

[0098] The aforementioned RTP header extension can carry information about the resolution of the downlink media stream supported by the first terminal and the first terminal's ability to support asymmetric uplink and downlink resolution. The RTP header extension can also carry information about whether the first terminal supports super-resolution capabilities. These three parameters can correspond to, respectively, as follows: Figure 2b The RTP message structure includes fields ID1, ID2, and ID3. The RTP header extension can contain two formats. For example... Figure 2b The RTP packet structure uses a 1-byte header extension. The 0xBE and 0xDE fields in this RTP packet structure indicate that the RTP header extension is a 1-byte extension mode, meaning each extension unit (containing ID + len + data) occupies one byte; the length field indicates the length. It can also be a 2-byte header extension. Correspondingly, Figure 2b The 0xBE and 0xDE fields in the header should be replaced with 0x10 and 0x00 respectively. Here, 0x10 and 0x00 indicate that the RTP header extension is a 2-byte header extension mode, meaning that each extension unit (containing ID + len + data) occupies two bytes.

[0099] Specifically, a) ResSymmetry{0,1}: This field occupies 2 bits and indicates whether the terminal supports asymmetric uplink and downlink resolution. When the value is 0, it corresponds to Limted, which means that the terminal only supports symmetric uplink and downlink; when the value is 1, it corresponds to NoLimited, which means that the terminal does not limit whether it is symmetric or not, that is, the terminal supports asymmetric uplink and downlink resolution.

[0100] b) ResolutionSet{0,1,2,3,4,5}: This field occupies 4 bits and indicates the set of resolutions supported by the terminal. The value is 0 for 180p; 1 for 360p; 2 for 720p; 3 for 1080p; 4 for 2K; and 5 for 4K. The reserved bits can be expanded according to the actual situation, and no specific limitation is made here.

[0101] c) SuperResInd: Occupies 2 bits, indicating whether the terminal supports super-resolution capability. A value of 0 means on, indicating that the terminal supports super-resolution; a value of 1 means off, indicating that the terminal does not support super-resolution.

[0102] In this scheme, when an intermediate network element performs super-division, the RTP message carries d)ExecutorforRS: occupying 8 bits, which is used to carry the identifier of the network element performing super-division.

[0103] Among them, e)AlgorithmParaofSR{}: occupies 8 bits, reserved for expansion of the actual parameter data of the super-resolution algorithm. If ID4 needs to be expanded, it represents AlgorithmParaofSR.

[0104] When the first terminal is the calling party, steps A11-A12 are included before step 201, as follows:

[0105] A11. The first terminal sends a media session request to the media gateway, requesting to establish a media session with the second terminal;

[0106] The media session request can be an SDP session request.

[0107] A12. After establishing a media session with the second terminal, the first terminal sends the uplink media packet to the media gateway.

[0108] Once the first terminal has established a media session with the second terminal, step 201 above can be triggered.

[0109] Furthermore, when the first terminal is the called party, steps B11-B13 may be included before step 201, as follows:

[0110] B11. The first terminal receives a media session request from the second terminal sent by the media gateway, wherein the media session is used to request the establishment of a media session with the first terminal;

[0111] The media session request can be an SDP session request.

[0112] B12. The first terminal sends a media session response to the media gateway to establish a media session with the second terminal;

[0113] The media session response may carry indication information that the first terminal supports super-resolution capability, which is used to indicate that the first terminal can perform super-resolution.

[0114] The media session request may carry super-resolution capability information of the second terminal, and the media session response may carry super-resolution capability information of the first terminal.

[0115] Specifically, ID1, ID2, and ID3 are defined in a=extmap in SDP, corresponding to m lines of media in a video call. The syntax of a=extmap is as follows:

[0116] a = extmap: <value> [" / " <direction> ] <uri> <extensionattributes>

[0117] When a = extmap:1URI-ResSymmetry, it indicates whether the terminal supports asymmetric uplink and downlink resolution.

[0118] When a = extmap:2URI-ResolutionSet, it indicates the set of resolutions supported by the terminal.

[0119] When a = extmap:3 / recvonly URI-SuperRes, it occupies 2 bits and indicates whether the terminal supports super-resolution capability. When the value is 0, it corresponds to "on", indicating that the terminal supports super-resolution; when the value is 1, it corresponds to "off", indicating that the terminal does not support super-resolution.

[0120] B13. After establishing a media session with the second terminal, the first terminal sends the uplink media packet to the media gateway.

[0121] Once the first terminal has established a media session with the second terminal, step 201 above can be triggered.

[0122] 202. The first terminal receives a downlink media packet sent by the media gateway, wherein the resolution of the downlink media stream carried in the downlink media packet is a resolution supported by the first terminal.

[0123] The aforementioned uplink media packet carries the resolution of the downlink media stream supported by the first terminal. Therefore, the resolution of the downlink media stream carried by the downlink media packet sent by the media gateway is the resolution supported by the first terminal.

[0124] In this embodiment, when a first terminal sends an uplink media packet to a media gateway, the uplink media packet carries the resolution of the downlink media stream supported by the first terminal and the uplink media stream of the first terminal. Specifically, the first terminal sends the resolution of its supported downlink media stream along with the uplink media stream, ensuring that the downlink media stream resolution carried in the downlink media packet sent by the media gateway is the resolution supported by the first terminal. This method improves video transmission efficiency, ensures video transmission reliability, and reduces video transmission bandwidth costs.

[0125] Reference Figure 3a This is a flowchart illustrating another video transmission method provided in an embodiment of this application. Figure 3a As shown, it includes steps 301-303, as follows:

[0126] 301. The first media gateway receives a first message sent by the base station, wherein the first message carries a first resolution;

[0127] Specifically, when a base station senses changes in channel quality or wireless resources, it determines the first resolution that the base station can support based on the current network resources.

[0128] The first media gateway can receive a first message carrying a first resolution sent by the base station. This first message can be an RTCP message.

[0129] Specifically, such as Figure 3b The image shows the format of a Real-Time Transport Control Protocol (RTCP) message. In this RTCP message, field V indicates the protocol version number is 2, field P indicates additional information, and field PT indicates the payload, which marks the type of information carried by the RTP / RTCP packet. There are several types, with APP being one of them. APP can include the following types: RR: receiver report; SR: sender report; SDES: source description items; BYE: indicates end of participation; APP: application specific functions. The field length indicates the length, field SSRC indicates the data source identifier, and field CSRC indicates the contributing data source identifier. The RTCP message also includes a name field, and the Application-dependent data field indicates the content carried by the protocol when PT is APP, such as the expected target resolution. The unit is kbps.

[0130] 302. The first media gateway sends a second message to the first terminal, the second message carrying the first resolution;

[0131] The first media gateway sends a second message to the first terminal based on the first message sent by the base station. The second message carries the first resolution to instruct the first terminal to send an uplink media stream with the first resolution.

[0132] The second message can also be an RTCP message.

[0133] 303. The first media gateway receives and processes the uplink media packet sent by the first terminal, wherein the uplink media packet carries the uplink media stream of the first terminal, and the resolution of the uplink media stream is the first resolution.

[0134] The first media gateway can send the uplink media packet to the second media gateway.

[0135] Furthermore, when the first media gateway supports super-resolution, the first media gateway can perform super-resolution processing on the uplink media stream to obtain a video image with a second resolution, which is higher than the first resolution; the first media gateway then sends the uplink media stream with the second resolution to the second terminal.

[0136] The uplink media packet is an uplink RTP packet.

[0137] In this embodiment, the first media gateway sends a message to the first terminal based on messages sent by the base station, instructing the first terminal to send a media stream with a resolution supported by the base station. This method allows for adaptive adjustment of video resolution when wireless resources change dynamically, improving video transmission efficiency and ensuring its reliability.

[0138] Reference Figure 4 This is a flowchart illustrating another video transmission method provided in an embodiment of this application. Figure 4 As shown, it includes steps 401-404, as detailed below:

[0139] 401. The second media gateway receives an uplink media packet from the first terminal sent by the first media gateway, wherein the uplink media packet carries an uplink media stream of the first terminal, and the resolution of the uplink media stream is a first resolution;

[0140] The uplink media packet is an uplink RTP packet.

[0141] Optionally, the aforementioned first resolution can be based on Figure 3a The method is obtained from the base station, and the first resolution is supported by the second terminal.

[0142] 402. The second media gateway receives a third message sent by the base station, the third message carrying a second resolution, the second resolution being higher than the first resolution;

[0143] The third message is an RTCP message.

[0144] In this embodiment, the base station and Figure 3a The base stations in the embodiments described can be the same base station or different base stations; no specific limitation is made here.

[0145] 403. The second media gateway performs super-resolution processing on the uplink media stream to obtain a video image with a second resolution;

[0146] When the second media gateway supports super-resolution, it can perform super-resolution processing on the uplink media stream to obtain a high-resolution media stream.

[0147] 404. The second media gateway sends the uplink media stream of the second resolution to the second terminal.

[0148] In this embodiment, when the second media gateway has super-resolution capability, it performs super-resolution processing on the low-resolution uplink media stream into a high-resolution uplink media stream that can be supported by network resources, and then sends it to the terminal. This solution is applicable to performing super-resolution on video media streams using the video super-resolution capability of media processing network element nodes when network resources are sufficient, achieving optimal utilization of network resources while ensuring the image quality at the receiving end, enhancing video call quality, and improving the user's viewing experience.

[0149] This application also provides a video transmission method, which includes:

[0150] The first media gateway receives a first message sent by the first terminal. The first message carries super-resolution capability indication information of the first terminal and the resolution supported by the first terminal. The super-resolution capability indication information of the first terminal is used to indicate whether the first terminal has super-resolution capability.

[0151] The first media gateway sends a second message to the second media gateway. The second message carries reference super-resolution capability indication information and the resolution supported by the first terminal. The reference super-resolution capability indication information is used to indicate whether the first media gateway has super-resolution capability and whether the first terminal has super-resolution capability.

[0152] The first media gateway receives a video image of a first resolution sent by the second media gateway, wherein the first resolution is a resolution supported by the first terminal and a resolution that can be supported by network resources;

[0153] When the reference super-resolution capability indication information indicates that the first media gateway has super-resolution capability and the first terminal does not have super-resolution capability, the first media gateway performs super-resolution processing on the video image at the first resolution to obtain a video image at the second resolution. The second resolution is higher than the first resolution, the second resolution is the resolution supported by the first terminal, and the second resolution is the resolution that network resources can support.

[0154] The first media gateway sends the video image at the second resolution to the first terminal.

[0155] In this embodiment, when the first media gateway has super-resolution capability but the first terminal does not, the first media gateway performs super-resolution processing on the received low-resolution video image supported by network resources, converting it into a high-resolution video image supported by network resources, and then sends it to the terminal. This solution is applicable to terminals that support different resolutions in the sending and receiving directions. During video calls, the resolution can be lowered according to channel quality to distribute video packets. When network resources are sufficient, the video super-resolution capability of the media processing network element node is used to perform super-resolution on the video media stream, achieving optimal utilization of network resources, while ensuring the image quality of the receiving end, enhancing video call quality, improving the user's viewing experience, and reducing the bandwidth cost of video transmission.

[0156] The method further includes:

[0157] When the reference super-resolution capability indication information indicates that the first terminal has super-resolution capability, the first media gateway receives the video image at the first resolution and sends the video image at the first resolution to the first terminal so that the first terminal can perform super-resolution processing on the video image at the first resolution to obtain a video image at the third resolution. The third resolution is higher than the first resolution, the third resolution is a resolution supported by the first terminal, and the third resolution is a resolution that network resources can support.

[0158] The method further includes:

[0159] When the reference super-resolution capability indication information indicates that neither the first terminal nor the first media gateway has super-resolution capability, the first media gateway, after receiving the video image at the first resolution, sends the video image at the first resolution to the first terminal.

[0160] The first resolution is determined by the second media gateway based on a reference resolution and the resolution supported by the first terminal, wherein the reference resolution is obtained by the second media gateway from the first base station.

[0161] Furthermore, if the reference resolution is a resolution supported by the first terminal, then the reference resolution is the first resolution;

[0162] If the reference resolution is not among the resolutions supported by the first terminal, then the resolution supported by the first terminal that is lower than the reference resolution shall be the first resolution.

[0163] Before the first media gateway performs super-resolution processing on the video frame at the first resolution, it further includes:

[0164] The first media gateway receives a third message sent by the second base station, the third message carrying the second resolution.

[0165] The first message is a media stream packet, and the super-resolution capability indication information of the first terminal, the asymmetric capability indication information of the first terminal, and the resolution supported by the first terminal are all located in the header extension of the media stream packet.

[0166] The third message is a media control message.

[0167] The first message also carries asymmetric capability indication information of the first terminal, which is used to indicate whether the first terminal supports different resolutions in the sending and receiving directions.

[0168] The following describes in detail a video transmission method provided by the embodiments of this application using three specific examples.

[0169] As one implementation method, refer to Figure 5 The diagram shown is a flowchart illustrating a video transmission method provided in an embodiment of this application. It includes steps 501-515, as detailed below:

[0170] 501. User terminal UE1 sends an SDP session request to user terminal UE2.

[0171] The SDP session request carries the super-resolution information of user terminal UE1.

[0172] 502. After receiving the above-mentioned SDP session request message, user terminal UE2 sends an SDP session response to user terminal UE1.

[0173] When user terminal UE2 receives the aforementioned SDP session request message, it recognizes it as a video call initiated by UE1 and includes UE2's super-resolution information in the SDP session response. This super-resolution information is located in the SDP's a=extmap and carries RTP header extension information.

[0174] At this point, the Session Initiation Protocol (SIP) / SDP video session is established and bidirectional media stream transmission can begin.

[0175] 503. After the session is established, UE2 sends a message to IMS-AGW2, which carries the super-resolution capability indication information of UE2 and the resolution supported by UE2.

[0176] Once the session is established, UE2 initiates an RTP media stream, carrying the set of resolutions supported by UE2 and the fact that UE2 does not support video super-resolution in the RTP header extension.

[0177] Furthermore, the message may also carry asymmetric capability information of UE2, which is used to indicate that UE2 supports asymmetric resolution in the transmitting and receiving directions.

[0178] 504. IMS-AGW2 parses the message, saves the resolution supported by UE2, and sends a message to IMS-AGW1 after identifying that UE2 does not have super-resolution capability. This message is used to indicate that IMS-AGW2 has super-resolution capability.

[0179] Specifically, IMS-AGW2 identifies the RTP header extension information, recognizes that UE2 supports asymmetric resolution (i.e., the possibility of unidirectional resolution modification), and saves the set of resolutions supported by UE2. It also identifies that UE2 does not support video super-resolution based on the "SuperResInd" parameter in the RTP header extension information. If IMS-AGW2 supports super-resolution, it fills the "ExecutorforRS" field in the RTP header extension with the network element identifier of IMS-AGW2, indicating that IMS-AGW2 can perform super-resolution processing on the video stream received from IMS-AGW1 before sending it to UE2.

[0180] Specifically, IMS-AGW2 forwards RTP header extension information to IMS-AGW1, which carries the RTP header extension parameters that identify the uplink / downlink asymmetric resolution supported by UE2, the resolution set supported by UE2, and the identifier of the network element or terminal performing super-resolution. Here, the identifier of the network element or terminal performing super-resolution is the network element identifier of IMS-AGW2.

[0181] At the same time, IMS-AGW2 notifies eNB2 that UE2 supports resolution asymmetry, which is used to instruct UE2 to support unidirectional resolution adjustment.

[0182] Furthermore, if UE2 does not support resolution asymmetry, then when adjusting the resolution based on resources, the receiving direction and transmitting direction of UE2 can be adjusted simultaneously.

[0183] 505. IMS-AGW1 identifies the "network element or terminal identifier performing super-resolution", i.e., the front end performs super-resolution and saves the resolution set of UE2.

[0184] IMS-AGW1 also notifies eNB1 that UE2 supports asymmetric uplink and downlink resolution, that is, instructs UE2 to support unidirectional resolution adjustment.

[0185] 506. IMS-AGW1 forwards RTP header extension information to UE1, which carries the asymmetric resolution supported by UE2, the resolution set supported by UE2, and the "identifier of the network element or terminal performing super-resolution".

[0186] 507. UE1 records UE2's support for resolution asymmetry and the supported resolution set.

[0187] The two-way media stream is still being sent continuously.

[0188] When the eNB1 senses a change in channel quality or radio resources, i.e., a change in uplink channel quality or uplink radio resources, it determines the resolution that the eNB1 can support based on the current resources.

[0189] If both uplink and downlink resources deteriorate and UE2 supports asymmetric resolution, eNB1 can determine the corresponding target resolution for uplink and downlink adjustments based on the uplink and downlink resources respectively. If both uplink and downlink resources deteriorate and UE2 does not support asymmetric resolution, eNB1 can determine the unified target resolution for uplink and downlink based on the worst uplink and downlink resources.

[0190] 508. eNB1 notifies IMS-AGW1 of its desired resolution adjustment.

[0191] 509. IMS-AGW1 determines the final adjusted resolution based on the received desired adjusted resolution and the set of resolutions supported by UE2.

[0192] Specifically, IMS-AGW1 determines whether the desired resolution adjustment sent by the base station belongs to the resolutions supported by UE2. If it does, IMS-AGW1 sends the desired resolution adjustment to UE1. If the desired resolution adjustment sent by the base station does not belong to the resolutions supported by UE2, IMS-AGW1 selects the final adjustment resolution corresponding to the desired resolution adjustment of eNB1 from the set of resolutions supported by UE2. For example, if the set of resolutions supported by UE2 is {360, 720, 1080}, and the desired resolution adjustment of eNB1 is 540, since only 360 is less than 540, the final adjustment resolution determined by IMS-AGW1 is 360.

[0193] 510. IMS-AGW1 notifies UE1 to send video packets according to the final adjusted resolution.

[0194] 511. UE1 sends video packets according to the final adjusted resolution.

[0195] In this case, the resolution of the upstream media stream is reduced, thus reducing the bandwidth it occupies.

[0196] 512. After receiving the video packet, IMS-AGW1 sends it to IMS-AGW2.

[0197] Among them, IMS-AGW1 notifies eNB1 of the adjustment results.

[0198] 513. After receiving the above video packet, IMS-AGW2 sends a request to eNB2 to obtain the target resolution.

[0199] In this process, IMS-AGW2 queries eNB2 to see if the uplink network resources can support a higher resolution. Whether it can support a higher resolution is relative to the current resolution, such as the resolution 360 in step 509.

[0200] 514. eNB2 determines the desired resolution based on the radio channel quality and radio resources, and sends the desired resolution to IMS-AGW2.

[0201] 515. IMS-AGW2 receives the desired resolution, determines the target resolution for super-resolution based on the resolution set supported by UE2, and performs super-resolution.

[0202] Specifically, IMS-AGW2 determines whether the desired resolution is in the set of resolutions supported by UE2. If the desired resolution is a resolution supported by UE2, it is used as the target resolution for super-resolution. If the desired resolution is not a resolution supported by UE2, it selects the final adjusted resolution corresponding to the desired adjusted resolution of eNB2 from the set of resolutions supported by UE2 and uses the final adjusted resolution as the target resolution for super-resolution.

[0203] In other words, when IMS-AGW2 has super-resolution capability and the other terminal UE2 does not, super-resolution is performed by IMS-AGW2.

[0204] At this point, the resolution of the upstream media stream is increased by super-resolution.

[0205] In this embodiment, when the peer media gateway (IMS-AGW2) has super-resolution capability and the peer terminal (UE2) does not, super-resolution will be performed by IMS-AGW2 regardless of whether IMS-AGW1 has super-resolution capability. Of course, when IMS-AGW1 also has super-resolution capability, it can also perform super-resolution; this is not specifically limited here.

[0206] As another implementation method, refer to Figure 6 The diagram shown is a flowchart illustrating a video transmission method provided in an embodiment of this application. It includes steps 601-613, as detailed below:

[0207] 601. User terminal UE1 sends an SDP session request to user terminal UE2.

[0208] The SDP session request carries the super-resolution information of user terminal UE1.

[0209] 602. After receiving the above-mentioned SDP session request message, user terminal UE2 sends an SDP session response to user terminal UE1.

[0210] When user terminal UE2 receives the aforementioned SDP session request message, it recognizes it as a video call initiated by UE1 and includes UE2's super-resolution information in the SDP session response. This super-resolution information is located in the SDP's a=extmap and carries RTP header extension information.

[0211] At this point, the SIP / SDP video session is established and bidirectional media stream transmission can begin.

[0212] 603. After the session is established, UE2 sends a message to IMS-AGW2, which carries the super-resolution capability indication information of UE2 and the resolution supported by UE2.

[0213] Once the session is established, UE2 initiates an RTP media stream, carrying the set of resolutions supported by UE2 and the fact that UE2 does not support video super-resolution in the RTP header extension.

[0214] Furthermore, the message may also carry asymmetric capability information of UE2, which is used to indicate that UE2 supports asymmetric resolution in the transmitting and receiving directions.

[0215] 604. IMS-AGW2 parses the message, saves the resolution supported by UE2, and if it finds that UE2 does not have super-resolution capability and it does not have super-resolution capability itself, it will transmit the message to IMS-AGW1.

[0216] Specifically, IMS-AGW2 identifies the RTP header extension information, recognizes that UE2 supports asymmetric resolution (i.e., the possibility of unidirectional resolution modification), saves the set of resolutions supported by UE2, and identifies that UE2 does not support video super-resolution based on the parameter "SuperResInd" in the RTP header extension information. If IMS-AGW2 also does not support super-resolution, then IMS-AGW2 directly forwards the packet.

[0217] At the same time, IMS-AGW2 notifies eNB2 that UE2 supports resolution asymmetry, which is used to instruct UE2 to support unidirectional resolution adjustment.

[0218] If IMS-AGW2 supports super-resolution, then the video super-resolution capability in the RTP header extension is modified to "On," indicating to the front end that the back end is performing super-resolution. Alternatively, a self-identifier can be added to the extension header to indicate which device is performing super-resolution; other forms are also possible, and this solution does not specify any particular limitation.

[0219] Furthermore, if UE2 does not support resolution asymmetry, then when adjusting the resolution based on resources, the receiving direction and the transmitting direction can be adjusted simultaneously.

[0220] 605. If IMS-AGW1 identifies that the backend has no super-resolution capability, then IMS-AGW1 fills the "ExecutorforRS" in the RTP header extension with the network element identifier of IMS-AGW1. This means that IMS-AGW1 can perform super-resolution processing on the video stream of UE1 that will be received in the future and then send it to IMS-AGW2. At the same time, IMS-AGW1 saves the set of resolutions supported by UE2.

[0221] IMS-AGW1 also notifies eNB1 that UE2 supports asymmetric uplink and downlink resolution, that is, instructs UE2 to support unidirectional resolution adjustment.

[0222] 606. IMS-AGW1 forwards RTP header extension information to UE1, which carries the asymmetric resolution supported by UE2, the resolution set supported by UE2, and "identification of the network element or terminal performing super-resolution".

[0223] 607. UE1 records UE2's support for resolution asymmetry and the set of supported resolutions.

[0224] The two-way media stream is still being sent continuously.

[0225] When the eNB1 senses a change in channel quality or radio resources, i.e., a change in uplink channel quality or uplink radio resources, it determines the resolution that the eNB1 can support based on the current resources.

[0226] If both uplink and downlink resources deteriorate and UE2 supports asymmetric resolution, eNB1 can determine the corresponding target resolution for uplink and downlink adjustments based on the uplink and downlink resources respectively. If both uplink and downlink resources deteriorate and UE2 does not support asymmetric resolution, eNB1 can determine the unified target resolution for uplink and downlink based on the worst uplink and downlink resources.

[0227] 608. eNB1 notifies IMS-AGW1 of its desired resolution adjustment.

[0228] 609. IMS-AGW1 determines the final adjusted resolution based on the received desired adjusted resolution and the set of resolutions supported by UE2.

[0229] Specifically, IMS-AGW1 determines whether the desired resolution adjustment sent by the base station belongs to the resolutions supported by UE2. If it does, IMS-AGW1 sends the desired resolution adjustment to UE1. If the desired resolution adjustment sent by the base station does not belong to the resolutions supported by UE2, IMS-AGW1 selects the final adjustment resolution corresponding to the desired resolution adjustment of eNB1 from the set of resolutions supported by UE2. For example, if the set of resolutions supported by UE2 is {360, 720, 1080}, and the desired resolution adjustment of eNB1 is 540, since only 360 is less than 540, the final adjustment resolution determined by IMS-AGW1 is 360.

[0230] 610. IMS-AGW1 notifies UE1 to send video packets according to the final adjusted resolution.

[0231] 611. UE1 sends video packets according to the final adjusted resolution.

[0232] In this case, the resolution of the upstream media stream is reduced, thus reducing the bandwidth it occupies.

[0233] 612. After receiving the video packet, IMS-AGW1 determines the target resolution based on the resolution set supported by UE2 and performs super-resolution.

[0234] Specifically, IMS-AGW1 notifies eNB1 of the adjustment results. IMS-AGW1 determines the target resolution for super-resolution based on the resolution set supported by UE2 and performs super-resolution. This target resolution is higher than the resolution of the video packets sent by UE1.

[0235] When IMS-AGW1 has super-resolution capability and neither terminal UE2 nor IMS-AGW2 has super-resolution capability, then IMS-AGW1 will perform super-resolution.

[0236] At this point, the resolution of the upstream media stream is increased by super-resolution.

[0237] 613. IMS-AGW1 sends the super-resolution video packet to IMS-AGW2 so that IMS-AGW2 can forward the video packet to UE2 for playback.

[0238] In this embodiment, when neither terminal UE2 nor IMS-AGW2 has super-resolution capability, but IMS-AGW1 has super-resolution capability, then IMS-AGW1 performs super-resolution.

[0239] As another implementation method, refer to Figure 7 The diagram shown is a flowchart illustrating a video transmission method provided in an embodiment of this application. It includes steps 701-714, as detailed below:

[0240] 701. User terminal UE1 sends an SDP session request to user terminal UE2.

[0241] The SDP session request carries the super-resolution information of user terminal UE1.

[0242] 702. After receiving the above-mentioned SDP session request message, user terminal UE2 sends an SDP session response to user terminal UE1.

[0243] When user terminal UE2 receives the aforementioned SDP session request message, it recognizes it as a video call initiated by UE1 and includes UE2's super-resolution information in the SDP session response. This super-resolution information is located in the SDP's a=extmap and carries RTP header extension information.

[0244] At this point, the SIP / SDP video session is established and bidirectional media stream transmission can begin.

[0245] 703. After the session is established, UE2 sends a message to IMS-AGW2, which carries the super-resolution capability indication information of UE2 and the resolution supported by UE2.

[0246] Once the session is established, UE2 initiates an RTP media stream, carrying the set of resolutions supported by UE2 and the video super-resolution supported by UE2 in the RTP header extension.

[0247] Furthermore, the message may also carry asymmetric capability information of UE2, which is used to indicate that UE2 supports asymmetric resolution in the transmitting and receiving directions.

[0248] 704. IMS-AGW2 parses the message, saves the resolution supported by UE2, and after recognizing that UE2 has super-resolution capability, it transmits the message to IMS-AGW1.

[0249] Specifically, IMS-AGW2 identifies RTP header extension information, recognizes that UE2 supports asymmetric resolution (i.e., the possibility of unidirectional resolution modification), and saves the set of resolutions supported by UE2. After recognizing that UE2 has super-resolution capability, regardless of whether IMS-AGW2 supports super-resolution, UE2 will perform super-resolution, therefore it does not need to carry the parameter "carry the network element performing super-resolution".

[0250] IMS-AGW2 forwards RTP header extension information to IMS-AGW1, carrying identification RTP header extension information, namely "UE2 terminal supports uplink and downlink asymmetric resolution", "UE2 terminal supports resolution set", and "UE2 terminal supports video super-resolution capability".

[0251] At the same time, IMS-AGW2 notifies eNB2 that UE2 supports resolution asymmetry, which is used to instruct UE2 to support unidirectional resolution adjustment.

[0252] Furthermore, if UE2 does not support resolution asymmetry, then when adjusting the resolution based on resources, the receiving direction and the transmitting direction can be adjusted simultaneously.

[0253] 705. IMS-AGW1 identifies that UE2 has super-resolution capability. Regardless of whether IMS-AGW1 supports super-resolution, it does not need to carry the parameter "carry the network element that performs super-resolution". At the same time, IMS-AGW1 stores the set of resolutions supported by UE2.

[0254] IMS-AGW1 also notifies eNB1 that UE2 supports asymmetric uplink and downlink resolution, that is, instructs UE2 to support unidirectional resolution adjustment.

[0255] 706. IMS-AGW1 forwards RTP header extension information to UE1, which carries information such as UE2's support for asymmetric resolution, the resolution set supported by UE2, and UE2's "terminal support for video super-resolution capability".

[0256] 707. UE1 records UE2's support for resolution asymmetry and the set of supported resolutions.

[0257] The two-way media stream is still being sent continuously.

[0258] When the eNB1 senses a change in channel quality or radio resources, i.e., a change in uplink channel quality or uplink radio resources, it determines the resolution that the eNB1 can support based on the current resources.

[0259] If both uplink and downlink resources deteriorate and UE2 supports asymmetric resolution, eNB1 can determine the corresponding target resolution for uplink and downlink adjustments based on the uplink and downlink resources respectively. If both uplink and downlink resources deteriorate and UE2 does not support asymmetric resolution, eNB1 can determine the unified target resolution for uplink and downlink based on the worst uplink and downlink resources.

[0260] 708. eNB1 notifies IMS-AGW1 of its desired resolution adjustment.

[0261] 709. IMS-AGW1 determines the final adjusted resolution based on the received desired adjusted resolution and the set of resolutions supported by UE2.

[0262] Specifically, IMS-AGW1 determines whether the desired resolution adjustment sent by the base station belongs to the resolutions supported by UE2. If it does, IMS-AGW1 sends the desired resolution adjustment to UE1. If the desired resolution adjustment sent by the base station does not belong to the resolutions supported by UE2, IMS-AGW1 selects the final adjustment resolution corresponding to the desired resolution adjustment of eNB1 from the set of resolutions supported by UE2. For example, if the set of resolutions supported by UE2 is {360, 720, 1080}, and the desired resolution adjustment of eNB1 is 540, since only 360 is less than 540, the final adjustment resolution determined by IMS-AGW1 is 360.

[0263] 710. IMS-AGW1 notifies UE1 to send video packets according to the final adjusted resolution.

[0264] 711. UE1 sends video packets according to the final adjusted resolution.

[0265] In this case, the resolution of the upstream media stream is reduced, thus reducing the bandwidth it occupies.

[0266] 712. After receiving the video packet, IMS-AGW1 sends it to IMS-AGW2.

[0267] Among them, IMS-AGW1 notifies eNB1 of the adjustment results.

[0268] 713. After receiving the above video packet, IMS-AGW2 forwards it to UE2.

[0269] 714. After receiving the above video packet, UE2 determines the target resolution for super-resolution based on the resolution set supported by UE2, performs super-resolution, and plays the video.

[0270] Among them, UE2 determines the target resolution for super-resolution based on its own capabilities, and then performs super-resolution.

[0271] At this point, the resolution of the upstream media stream is increased by super-resolution.

[0272] In this embodiment of the application, when terminal UE2 has super-resolution capability, super-resolution is performed by UE2 regardless of whether IMS-AGW1 and IMS-AGW2 have super-resolution capability. Of course, when IMS-AGW1 and IMS-AGW2 also have super-resolution capability, super-resolution can be performed by either IMS-AGW1 or IMS-AGW2, and no specific limitation is made here.

[0273] The above embodiments only use UE1 sending video as an example to illustrate the super-resolution process for one-way video from UE1 to UE2. For the super-resolution process for UE2 sending video to UE1, please refer to the above content, which will not be repeated here.

[0274] Reference Figure 8 The diagram shown is a structural schematic of a video transmission device provided in an embodiment of this application. Figure 8 As shown, the video transmission device 8000 includes a processor 8001 and a memory 8002 coupled to each other. The memory 8002 stores computer program code. The processor 8001 calls and executes the computer program code in the memory 8002, causing the video transmission device 8000 to execute the video transmission method provided in the above embodiments. This video transmission device can be a media gateway, an access gateway, a multimedia resource function device, or an SBC.

[0275] Specifically, the video transmission device 8000 can be used to perform:

[0276] Receive an uplink media packet sent by a first terminal, wherein the uplink media packet carries information about the first terminal's ability to support asymmetric uplink and downlink resolutions, and an uplink media stream with the first resolution of the first terminal;

[0277] A first downlink media packet is sent to the first terminal, the downlink media packet carrying a downlink media stream of the first terminal at a second resolution, the first resolution and the second resolution being different.

[0278] It is also used to receive a second downlink media packet sent by a second media gateway, wherein the second downlink media packet carries a downlink media stream of a third resolution;

[0279] Super-resolution processing is performed on the downlink media stream of the third resolution to obtain the downlink media stream of the second resolution.

[0280] It is also used to receive the first downlink media packet sent by the second media gateway.

[0281] Furthermore, it is also used to receive a second downlink media packet from a second terminal, wherein the second downlink media packet carries a downlink media stream of a third resolution;

[0282] Super-resolution processing is performed on the downlink media stream of the third resolution to obtain the downlink media stream of the second resolution;

[0283] The downlink media stream of the second resolution is sent to the first media gateway via the first downlink media packet.

[0284] Reference Figure 9 The diagram shown is a structural schematic of a terminal provided in an embodiment of this application. Figure 9 As shown, the terminal 9000 includes a display 9001, an input / output interface 9002, a memory 9003 coupled to each other, and a processor 9004. The memory 9003 stores computer program code, and the processor 9004 calls and executes the computer program code in the memory 9003, so that the terminal 9000 executes the video transmission method.

[0285] Specifically, the terminal 9000 can be used to perform:

[0286] Send an uplink media packet to the media gateway, the uplink media packet carrying the resolution of the downlink media stream supported by the first terminal and the uplink media stream of the first terminal;

[0287] The terminal receives downlink media packets sent by the media gateway, wherein the resolution of the downlink media stream carried in the downlink media packets is a resolution supported by the terminal.

[0288] It also includes: super-splitting and playing the received downlink media stream.

[0289] It is also used to send a media session request to the media gateway, requesting to establish a media session with the second terminal;

[0290] After establishing a media session with the second terminal, the uplink media packet is sent to the media gateway.

[0291] Furthermore, it is also used to receive a media session request from a second terminal sent by the media gateway, the media session being used to request the establishment of a media session with the first terminal;

[0292] Send a media session response to the media gateway to establish a media session with the second terminal;

[0293] After establishing a media session with the second terminal, the uplink media packet is sent to the media gateway.

[0294] This application also provides a computer-readable storage medium storing instructions that, when executed on a computer or processor, cause the computer or processor to perform one or more steps of any of the above methods.

[0295] This application also provides a computer program product containing instructions. When the computer program product is run on a computer or processor, it causes the computer or processor to perform one or more steps of any of the methods described above.

[0296] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0297] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0298] The above description is merely a specific implementation of the embodiments of this application, but the protection scope of the embodiments of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the embodiments of this application should be covered within the protection scope of the embodiments of this application. Therefore, the protection scope of the embodiments of this application should be determined by the protection scope of the claims.< / extensionattributes> < / uri> < / direction> < / value>

Claims

1. A video transmission method, characterized in that, include: The first media gateway receives an uplink media packet from the first terminal, the uplink media packet carrying information that the first terminal supports uplink and downlink resolution asymmetry capability and the uplink media stream of the first terminal at a first resolution; The information indicating that the first terminal supports uplink and downlink resolution asymmetry capability indicates that the first terminal supports different resolutions in the receiving and transmitting directions; The first media gateway sends a first downlink media packet to the first terminal. The first downlink media packet carries a downlink media stream of the first terminal at a second resolution, and the first resolution and the second resolution are different.

2. The method according to claim 1, characterized in that, Also includes: The first media gateway receives a second downlink media packet from the second media gateway, the second downlink media packet carrying a downlink media stream of third resolution; The first media gateway performs super-resolution processing on the downlink media stream of the third resolution to obtain the downlink media stream of the second resolution.

3. The method according to claim 1, characterized in that, Also includes: The first media gateway receives the first downlink media packet from the second media gateway.

4. The method according to claim 1, characterized in that, Also includes: The second media gateway receives a second downlink media packet from the second terminal, the second downlink media packet carrying a downlink media stream of third resolution; The second media gateway performs super-resolution processing on the downlink media stream of the third resolution to obtain the downlink media stream of the second resolution; The second media gateway sends the downlink media stream of the second resolution to the first media gateway through the first downlink media packet.

5. A video transmission method, characterized in that, include: The first terminal sends an uplink media packet to the media gateway. The uplink media packet carries information about the first terminal's ability to support asymmetric uplink and downlink resolutions and the uplink media stream of the first terminal at a first resolution. The information indicating that the first terminal supports uplink and downlink resolution asymmetry capability indicates that the first terminal supports different resolutions in the receiving and transmitting directions; The first terminal receives a first downlink media packet from the media gateway. The first downlink media packet carries a downlink media stream with a second resolution. The first terminal supports the second resolution, and the first resolution and the second resolution are different.

6. The method according to claim 5, characterized in that, Also includes: The first terminal performs super-resolution on the downlink media stream and plays it.

7. The method according to claim 5, characterized in that, The uplink media packet is a Real-Time Transport Protocol (RTP) message.

8. The method according to claim 7, characterized in that, The information regarding the first terminal's ability to support asymmetric uplink and downlink resolution is carried in the header of the RTP message.

9. The method according to claim 5, characterized in that, Also includes: The first terminal sends a media session request to the media gateway, requesting to establish a media session with the second terminal; After establishing a media session with the second terminal, the first terminal sends the uplink media packet to the media gateway.

10. The method according to claim 5, characterized in that, Also includes: The first terminal receives a media session request from the second terminal of the media gateway, the media session being used to request the establishment of a media session with the first terminal; The first terminal sends a media session response to the media gateway to establish a media session with the second terminal; After establishing a media session with the second terminal, the first terminal sends the uplink media packet to the media gateway.

11. The method according to claim 9 or 10, characterized in that, The media session request is a Session Description Protocol (SDP) session request.

12. The method according to claim 10, characterized in that, The media session response carries indication information indicating that the first terminal supports super-resolution capabilities.

13. A video transmission device, characterized in that, The device includes a memory and a processor coupled together, wherein the memory stores computer program code, and the processor calls and executes the computer program code in the memory, causing the video transmission device to perform the video transmission method as described in any one of claims 1 to 4, and / or the video transmission method as described in any one of claims 5 to 12.

14. A video transmission system, characterized in that, Includes a first media gateway, wherein the first media gateway is used for: Receive an uplink media packet from a first terminal, the uplink media packet carrying information that the first terminal supports uplink and downlink resolution asymmetry capability and an uplink media stream of the first terminal at a first resolution; the information that the first terminal supports uplink and downlink resolution asymmetry capability indicates that the first terminal supports different resolutions in the receiving direction and the transmitting direction; A first downlink media packet is sent to the first terminal, the first downlink media packet carrying a downlink media stream of the first terminal at a second resolution, the first resolution and the second resolution being different.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that is executed by a processor to implement the video transmission method according to any one of claims 1 to 4, and / or the video transmission method according to any one of claims 5 to 12.

16. A computer program product, characterized in that, The computer program product includes relevant program instructions, which, when executed, cause the method as described in any one of claims 1-12 to be implemented.

Images