Control method and device for AI video super-resolution processing of video call data

Abstract

The embodiment of the invention provides a control method and device for AI video super-resolution processing of video call data. The method comprises the following steps: a first terminal device receives a data packet; the data packet comprises video call data and data packet control information; the data packet control information comprises distance information of a human body and a camera and video resolution, or the data packet control information comprises the video resolution; the first terminal equipment dynamically decides whether the video call data meets an AI video super-resolution processing condition or not according to the data packet control information, the load capacity and the negotiation information; the negotiation information comprises a negotiation video resolution corresponding to the second terminal device and an AI video super-resolution capability parameter corresponding to the first terminal device; and on the basis that the video call data meets the AI video super-resolution processing condition, performing AI video super-resolution processing on the video call data to obtain processed video call data, and rendering and displaying the processed video call data. The resolution of video call data can be improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of video communication technology, and in particular to a control method and device for AI video super-resolution processing of video call data. Background Art

[0002] During long-distance video calls, if the network conditions are poor, the resolution will be reduced based on packet loss rate and other conditions, resulting in low resolution of long-distance video call data, which in turn affects the user experience. In addition, in scenarios where the human body is far from the camera, such as online dance teaching, or when uploading video ID information, the resolution of video call data is low, which affects the user experience.

[0003] In the related art, the resolution of video call data can be improved by increasing the network bandwidth.

[0004] However, the related art method of increasing the resolution of video call data by increasing network bandwidth has the problem of high cost. Summary of the invention

[0005] The embodiments of the present application provide a control method and device for AI video super-resolution processing of video call data, which can improve the resolution of video call data.

[0006] In a first aspect, an embodiment of the present application provides a control method for AI video super-resolution processing of video call data, which is applied to a first terminal device, and the method includes:

[0007] receiving a data packet; the data packet includes video call data and data packet control information; the data packet control information includes distance information between the human body and the camera and video resolution, or the data packet control information includes video resolution;

[0008] Determine whether the video call data meets the artificial intelligence AI video super-resolution processing conditions according to the data packet control information, the load, and the pre-acquired negotiation information; the negotiation information includes the negotiated video resolution corresponding to the second terminal device and the AI ​​video super-resolution capability parameter corresponding to the first terminal device;

[0009] Based on the fact that the video call data meets the AI ​​video super-resolution processing conditions, AI video super-resolution processing is performed on the video call data to obtain processed video call data, and the processed video call data is rendered and displayed.

[0010] In one implementation, determining whether the video call data meets the AI ​​video super-resolution processing condition based on the data packet control information, the payload, and the pre-acquired negotiation information includes:

[0011] Determine, according to the video call data, configuration information corresponding to the first terminal device, and computing capability information corresponding to the first terminal device, a load for performing AI video super-resolution processing on the video call data;

[0012] Determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, payload, and negotiation information.

[0013] In one implementation, the packet control information includes distance information and video resolution;

[0014] Determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, payload, and negotiation information, including:

[0015] Determining whether each of the following multiple conditions is met;

[0016] Determining that the video call data meets the AI ​​video super-resolution processing condition based on satisfying each of the following multiple conditions;

[0017] Determining that the video call data does not meet the AI ​​video super-resolution processing condition based on at least one of the following multiple conditions not being met;

[0018] Several conditions include:

[0019] The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has the AI ​​video super-resolution processing capability;

[0020] The distance information is greater than the preset distance information, or the video resolution is less than the negotiated resolution corresponding to the second terminal device;

[0021] The load is less than the preset load.

[0022] In one implementation, the packet control information includes video resolution;

[0023] Determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, payload, and negotiation information, including:

[0024] Determining whether each of the following multiple conditions is met;

[0025] Determining that the video call data meets the AI ​​video super-resolution processing condition based on satisfying each of the following multiple conditions;

[0026] Determining that the video call data does not meet the AI ​​video super-resolution processing condition based on at least one of the following multiple conditions not being met;

[0027] Several conditions include:

[0028] The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has the AI ​​video super-resolution processing capability;

[0029] The video resolution is smaller than the negotiated resolution corresponding to the second terminal device;

[0030] The load is less than the preset load.

[0031] In one implementation, determining whether the video call data meets the AI ​​video super-resolution processing condition based on the data packet control information, the payload, and the pre-acquired negotiation information includes:

[0032] After receiving the data packet, the count value is incremented by 1 to obtain an updated count value;

[0033] Determine whether the updated count value reaches the pre-designed value;

[0034] Based on the updated count value, when the pre-designed value is reached, the updated count value is cleared, and based on the control information, load, and negotiation information, it is determined whether the video call data meets the AI ​​video super-resolution processing conditions.

[0035] In one implementation, before receiving the data packet, the method further includes:

[0036] Sending a first negotiation request to the second terminal device;

[0037] receiving first negotiation information corresponding to the second terminal device; the first negotiation information includes a negotiated video resolution corresponding to the second terminal device; the first negotiation information is sent by the second terminal device based on the first negotiation request;

[0038] Negotiation information is obtained according to the first negotiation information and the second negotiation information corresponding to the first terminal device; the second negotiation information includes the AI ​​video super-resolution capability parameters corresponding to the first terminal device.

[0039] In a second aspect, an embodiment of the present application provides a control method for AI video super-resolution processing of video call data, which is applied to a second terminal device, and the method includes:

[0040] Acquire a data packet; the data packet includes video call data and data packet control information; the data packet control information includes distance information between the human body and the camera and video resolution, or the data packet control information includes video resolution;

[0041] Send a data packet to the first terminal device.

[0042] In one implementation, obtaining a data packet includes:

[0043] Get video call data;

[0044] Obtaining the acquisition method corresponding to the video call data; the acquisition method is used to indicate whether the video call data is the video call data collected by the camera;

[0045] According to the acquisition method, obtain the data packet control information;

[0046] The data packet is obtained according to the data packet control information and the video call data.

[0047] In one implementation, obtaining data packet control information according to an acquisition method includes:

[0048] When the acquisition method indicates that the video call data is video call data collected by a camera, detecting and processing the distance between the human body and the camera to obtain distance information;

[0049] Add distance information to data packet control information.

[0050] In one implementation, when the acquisition method indicates that the video call data is video call data collected by a camera, detecting and processing the distance between the human body and the camera to obtain the distance information includes:

[0051] When the acquisition method indicates that the video call data is video call data collected by a camera, determining whether the first terminal device has the AI ​​video super-resolution processing capability according to the AI ​​video super-resolution capability parameter corresponding to the first terminal device; the AI ​​video super-resolution capability parameter corresponding to the first terminal device is used to indicate whether the first terminal device has the AI ​​video super-resolution processing capability;

[0052] Based on the fact that the first terminal device has AI video super-resolution processing capability, the distance between the human body and the camera is detected and processed to obtain distance information.

[0053] In one implementation, before obtaining the video call data, the method further includes:

[0054] Sending a second negotiation request to the first terminal device;

[0055] receiving second negotiation information corresponding to the first terminal device; the second negotiation information includes an AI video super-resolution capability parameter corresponding to the first terminal device; the second negotiation information is sent by the first terminal device based on the second negotiation request;

[0056] Negotiation information is obtained according to the second negotiation information and the first negotiation information corresponding to the second terminal device; the first negotiation information includes the negotiated video resolution corresponding to the second terminal device.

[0057] In one implementation, the data packet is sent via an Internet Protocol IP Multimedia Subsystem IMS data channel.

[0058] In a third aspect, an embodiment of the present application provides a control device for AI video super-resolution processing of video call data, which is applied to a first terminal device, and the device includes:

[0059] A transceiver module, configured to receive a data packet; the data packet includes video call data and data packet control information; the data packet control information includes distance information between the human body and the camera and video resolution, or the data packet control information includes video resolution;

[0060] A processing module, used to determine whether the video call data meets the artificial intelligence AI video super-resolution processing conditions according to the data packet control information, the load, and the pre-acquired negotiation information; the negotiation information includes the negotiated video resolution corresponding to the second terminal device and the AI ​​video super-resolution capability parameter corresponding to the first terminal device;

[0061] The processing module is also used to perform AI video super-resolution processing on the video call data based on the video call data meeting the AI ​​video super-resolution processing conditions, obtain the processed video call data, and render and display the processed video call data.

[0062] In one implementation, the processing module is specifically configured to:

[0063] Determine, according to the video call data, configuration information corresponding to the first terminal device, and computing capability information corresponding to the first terminal device, a load for performing AI video super-resolution processing on the video call data;

[0064] Determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, payload, and negotiation information.

[0065] In one implementation, the packet control information includes distance information and video resolution;

[0066] Processing module, specifically used for:

[0067] Determining whether each of the following multiple conditions is met;

[0068] Determining that the video call data meets the AI ​​video super-resolution processing condition based on satisfying each of the following multiple conditions;

[0069] Determining that the video call data does not meet the AI ​​video super-resolution processing condition based on at least one of the following multiple conditions not being met;

[0070] Several conditions include:

[0071] The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has the AI ​​video super-resolution processing capability;

[0072] The distance information is greater than the preset distance information, or the video resolution is less than the negotiated resolution corresponding to the second terminal device;

[0073] The load is less than the preset load.

[0074] In one implementation, the packet control information includes video resolution;

[0075] Processing module, specifically used for:

[0076] Determining whether each of the following multiple conditions is met;

[0077] Determining that the video call data meets the AI ​​video super-resolution processing condition based on satisfying each of the following multiple conditions;

[0078] Determining that the video call data does not meet the AI ​​video super-resolution processing condition based on at least one of the following multiple conditions not being met;

[0079] Several conditions include:

[0080] The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has the AI ​​video super-resolution processing capability;

[0081] The video resolution is smaller than the negotiated resolution corresponding to the second terminal device;

[0082] The load is less than the preset load.

[0083] In one implementation, the processing module is specifically configured to:

[0084] After receiving the data packet, the count value is incremented by 1 to obtain an updated count value;

[0085] Determine whether the updated count value reaches the pre-designed value;

[0086] Based on the updated count value, when the pre-designed value is reached, the updated count value is cleared, and based on the control information, load, and negotiation information, it is determined whether the video call data meets the AI ​​video super-resolution processing conditions.

[0087] In one implementation, the communication module is specifically configured to:

[0088] Sending a first negotiation request to the second terminal device;

[0089] receiving first negotiation information corresponding to the second terminal device; the first negotiation information includes a negotiated video resolution corresponding to the second terminal device; the first negotiation information is sent by the second terminal device based on the first negotiation request;

[0090] Negotiation information is obtained according to the first negotiation information and the second negotiation information corresponding to the first terminal device; the second negotiation information includes the AI ​​video super-resolution capability parameters corresponding to the first terminal device.

[0091] In a fourth aspect, an embodiment of the present application provides a control device for AI video super-resolution processing of video call data, which is applied to a second terminal device, and the device includes:

[0092] A processing module, used for acquiring a data packet; the data packet includes video call data and data packet control information; the data packet control information includes distance information between the human body and the camera and video resolution, or the data packet control information includes video resolution;

[0093] The transceiver module is used to send a data packet to the first terminal device.

[0094] In one implementation, the processing module is specifically configured to:

[0095] Get video call data;

[0096] Obtaining the acquisition method corresponding to the video call data; the acquisition method is used to indicate whether the video call data is the video call data collected by the camera;

[0097] According to the acquisition method, obtain the data packet control information;

[0098] The data packet is obtained according to the data packet control information and the video call data.

[0099] In one implementation, the processing module is specifically configured to:

[0100] When the acquisition method indicates that the video call data is video call data collected by a camera, detecting and processing the distance between the human body and the camera to obtain distance information;

[0101] Add distance information to data packet control information.

[0102] In one implementation, the processing module is specifically configured to:

[0103] When the acquisition method indicates that the video call data is video call data collected by a camera, determining whether the first terminal device has the AI ​​video super-resolution processing capability according to the AI ​​video super-resolution capability parameter corresponding to the first terminal device; the AI ​​video super-resolution capability parameter corresponding to the first terminal device is used to indicate whether the first terminal device has the AI ​​video super-resolution processing capability;

[0104] Based on the fact that the first terminal device has AI video super-resolution processing capability, the distance between the human body and the camera is detected and processed to obtain distance information.

[0105] In one implementation, the communication module is specifically configured to:

[0106] Sending a second negotiation request to the first terminal device;

[0107] receiving second negotiation information corresponding to the first terminal device; the second negotiation information includes an AI video super-resolution capability parameter corresponding to the first terminal device; the second negotiation information is sent by the first terminal device based on the second negotiation request;

[0108] Negotiation information is obtained according to the second negotiation information and the first negotiation information corresponding to the second terminal device; the first negotiation information includes the negotiated video resolution corresponding to the second terminal device.

[0109] In one implementation, the data packet is sent via an Internet Protocol IP Multimedia Subsystem IMS data channel.

[0110] In a fifth aspect, the present application provides a chip having a computer program stored thereon, and when the computer program is executed by the chip, the method as described in any one of the first aspects is implemented.

[0111] In a sixth aspect, the present application provides a chip having a computer program stored thereon, and when the computer program is executed by the chip, the method as described in any one of the second aspects is implemented.

[0112] In a seventh aspect, the present application provides a chip module having a computer program stored thereon, and when the computer program is executed by the chip module, the method of any one of the first aspects is implemented.

[0113] In an eighth aspect, the present application provides a chip module having a computer program stored thereon. When the computer program is executed by the chip module, the method of any one of the second aspects is implemented.

[0114] In a ninth aspect, an embodiment of the present application provides a first terminal device, including: a memory and a processor;

[0115] Memory stores computer-executable instructions;

[0116] The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to the first aspect.

[0117] In a tenth aspect, an embodiment of the present application provides a second terminal device, including: a memory and a processor;

[0118] Memory stores computer-executable instructions;

[0119] The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to the second aspect.

[0120] In the eleventh aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-readable storage medium is stored computer execution instructions, which are used to implement the method of the first aspect or the second aspect when the computer execution instructions are executed by a processor.

[0121] In a twelfth aspect, an embodiment of the present application provides a computer program product, comprising computer execution instructions, which, when executed by a processor, enable the method of the first aspect or the second aspect to be executed.

[0122] The embodiment of the present application provides a control method and device for AI video super-resolution processing of video call data. In the method, the second terminal device can obtain a data packet. The second terminal device can send a data packet to the first terminal device; wherein the data packet includes video call data and data packet control information; the data packet control information includes the distance information between the human body and the camera and the video resolution, or the data packet control information includes the video resolution. The first terminal device can dynamically decide whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, the load, and the pre-acquired negotiation information. The first terminal device performs AI video super-resolution processing on the video call data based on the video call data meeting the AI ​​video super-resolution processing conditions, obtains the processed video call data, and renders and displays the processed video call data. The method of the embodiment of the present application does not need to increase the network bandwidth at a cost, but performs AI video super-resolution processing on the video call data at the receiving end of the data packet (the first terminal device), thereby improving the resolution of the video call data, saving bandwidth, improving the display effect of the video call data, and improving the user experience. In addition, the method of the embodiment of the present application does not need to consume resources to perform AI video super-resolution processing on all video call data. Instead, AI video super-resolution processing is performed on the video call data when it is determined that the video call data meets the AI ​​video super-resolution processing conditions based on the negotiation information obtained in advance according to the data packet control information and the load amount. This improves the targetedness of the AI ​​video super-resolution processing and thereby improves resource utilization. BRIEF DESCRIPTION OF THE DRAWINGS

[0123] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0124] Figure 1 A schematic diagram of an application scenario provided in an embodiment of the present application;

[0125] Figure 2 A flowchart of a first embodiment of a control method for AI video super-resolution processing of video call data provided in an embodiment of the present application;

[0126] Figure 3 A flowchart of a second embodiment of a control method for AI video super-resolution processing of video call data provided in an embodiment of the present application;

[0127] Figure 4a A flowchart of a third embodiment of a control method for AI video super-resolution processing of video call data provided in an embodiment of the present application;

[0128] Figure 4b A schematic diagram of a scene of online dance teaching demonstration provided in an embodiment of the present application;

[0129] Figure 4c A schematic diagram of a scenario of uploading certificate information for an online business provided in an embodiment of the present application;

[0130] Figure 5 A schematic diagram of the software structure of the first terminal device provided in an embodiment of the present application;

[0131] Figure 6 A schematic diagram of the software structure of the second terminal device provided in the embodiment of the present application;

[0132] Figure 7 A schematic diagram of the structure of a control device for AI video super-resolution processing of video call data provided in an embodiment of the present application;

[0133] Figure 8 A schematic diagram of the structure of another control device for AI video super-resolution processing of video call data provided in an embodiment of the present application;

[0134] Fig. 9 A schematic diagram of the structure of a first terminal device provided in an embodiment of the present application;

[0135] Fig.10 A schematic diagram of the structure of a second terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0136] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0137] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0138] In this application, "at least one" means one or more, and "a plurality of" means two or more. In addition, in this application, "equal to" can be used in conjunction with "greater than" or "less than". When "equal to" is used in conjunction with "greater than", the technical solution of "greater than" is adopted; when "equal to" is used in conjunction with "less than", the technical solution of "less than" is adopted.

[0139] Video call: Compared with voice calls which only involve the exchange of uplink and downlink voice data, video calls refer to calls that include both uplink and downlink voice data and uplink and downlink video call data.

[0140] Artificial Intelligence (AI) Video Super Resolution Engine: An engine that uses artificial intelligence and deep learning technology to improve video quality. AI video super resolution technology uses deep learning methods to learn the feature representation of high-resolution video call data from a large amount of low-resolution video call data, and uses this feature information to generate high-resolution video call data. The principle of AI video super resolution is mainly based on Convolutional Neural Networks (CNN) in deep learning.

[0141] Long-distance communication: Long-distance communication is the transmission of data between devices over long distances, usually involving distances of tens to hundreds of kilometers, or even around the world, and mainly uses wide area networks, Internet technologies such as cellular networks, satellite communications, fiber optic communications, etc.

[0142] Figure 1 For a schematic diagram of an application scenario provided in an embodiment of the present application, see Figure 1 , the application scenario includes a first terminal device 10 and a second terminal device 20.

[0143] It should be noted that the first terminal device 10 may be a mobile phone, a computer, a wearable device, etc. The second terminal device 20 may be a mobile phone, a computer, a wearable device, etc.

[0144] The first terminal device 10 and the second terminal device 20 can be connected in communication. For example, the first terminal device 10 and the second terminal device 20 can be connected in communication via a cellular network. For another example, the first terminal device 10 and the second terminal device 20 can be connected in communication via an Internet Protocol (IP) network (such as an IP network that uses optical fiber for data transmission). For another example, the first terminal device 10 and the second terminal device 20 can be connected in communication via a satellite.

[0145] Long-distance communication, such as a long-distance video call, can be performed between the first terminal device 10 and the second terminal device 20 .

[0146] During long-distance video calls, if the network conditions are poor, the resolution will be reduced based on packet loss rate and other conditions, resulting in low resolution of long-distance video call data, which in turn affects the user experience. In addition, in scenarios where the human body is far from the camera, such as online dance teaching, or when uploading video ID information, the resolution of video call data is low, which affects the user experience.

[0147] In the related art, the resolution of video call data can be improved by increasing the network bandwidth.

[0148] However, the related art method of increasing the resolution of video call data by increasing network bandwidth has the problem of high cost.

[0149] Based on the above technical problems, an embodiment of the present application provides a control method for AI video super-resolution processing of video call data, which can perform AI video super-resolution processing on the video call data when it is determined that the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information in the data packet (including the distance information between the human body and the camera and the video resolution, or including the video resolution), the load, and the pre-acquired negotiation information (including the negotiated video resolution corresponding to the second terminal device and the AI ​​video super-resolution capability parameter corresponding to the first terminal device), to obtain the processed video call data, and perform rendering processing and display processing based on the processed video call data.

[0150] By performing AI video super-resolution processing on video call data as described above, the resolution of the video call data is improved, thereby improving the display effect of the video call data and improving the user experience.

[0151] The technical solutions shown in the present application are described in detail below through specific embodiments. It should be noted that the following embodiments can exist independently or in combination with each other, and the same or similar contents will not be described repeatedly in different embodiments.

[0152] Figure 2 This is a flowchart of a control method for AI video super-resolution processing of video call data provided in an embodiment of the present application. Figure 2 , the method may include:

[0153] S201: The second terminal device obtains a data packet.

[0154] In this embodiment, the first terminal device can be registered on the mobile network. That is, the first terminal device can be connected and authenticated through the network of the mobile operator. Similarly, the second terminal device can be registered on the mobile network.

[0155] After registering on the mobile network, the first terminal device can perform communication negotiation with the second terminal device.

[0156] Next, the process of communication negotiation between the first terminal device and the second terminal device is described.

[0157] In one implementation,

[0158] The first terminal device may send a first negotiation request to the second terminal device. The first negotiation request includes second negotiation information corresponding to the first terminal device. The second terminal device may send the first negotiation information to the first terminal device based on the first negotiation request. The first terminal device may receive the first negotiation information.

[0159] Among them, the first negotiation information may include the negotiated video resolution corresponding to the second terminal device (the video resolution supported by the second terminal device). In addition, the first negotiation information may also include the AI ​​video super-resolution capability parameter corresponding to the second terminal device, the negotiated video encoding method corresponding to the second terminal device (the video encoding method supported by the second terminal device), the negotiated bit rate corresponding to the second terminal device (the bit rate supported by the second terminal device), the negotiated frame rate corresponding to the second terminal device (the frame rate supported by the second terminal device), etc.

[0160] The first terminal device may obtain the negotiation information according to the first negotiation information and the second negotiation information corresponding to the first terminal device.

[0161] In addition, the second terminal device may send a second negotiation request to the first terminal device. The second negotiation request includes first negotiation information corresponding to the second terminal device. The first terminal device may send second negotiation information to the second terminal device based on the second negotiation request. The second terminal device may receive the second negotiation information.

[0162] The second negotiation information may include the AI ​​video super-resolution capability parameter corresponding to the first terminal device. In addition, the second negotiation information may also include the negotiated video resolution corresponding to the first terminal device (the video resolution supported by the first terminal device), the negotiated video encoding method corresponding to the first terminal device (the video encoding method supported by the first terminal device), the negotiated bit rate corresponding to the first terminal device (the bit rate supported by the first terminal device), the negotiated frame rate corresponding to the first terminal device (the frame rate supported by the first terminal device), etc.

[0163] The second terminal device may obtain the negotiation information according to the second negotiation information and the first negotiation information corresponding to the second terminal device.

[0164] In this embodiment, after the communication negotiation, the first terminal device can make a long-distance video call with the second terminal device. During the long-distance video call, the second terminal device can obtain a data packet. It can be understood that the second terminal device can obtain a data packet after the communication negotiation.

[0165] The data packet may include video call data and data packet control information.

[0166] It should be noted that, in one implementation, the data packet control information includes video resolution. In one implementation, the data packet control information includes distance information between the human body and the camera and video resolution.

[0167] S202: The first terminal device receives a data packet.

[0168] In this embodiment, the second terminal device may send a data packet to the first terminal device. In one implementation, the data packet may be sent through an IMS data channel.

[0169] It should be noted that the data packet is used for the first terminal device to determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, load, and pre-acquired negotiation information, and based on the video call data meeting the AI ​​video super-resolution processing conditions, perform AI video super-resolution processing on the video call data to obtain the processed video call data, and render and display the processed video call data.

[0170] The first terminal device may receive the data packet.

[0171] S203: The first terminal device determines whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, the load, and the pre-acquired negotiation information.

[0172] In this embodiment, the first terminal device can determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, the load, and the pre-acquired negotiation information.

[0173] Based on the video call data satisfying the AI ​​video super-resolution processing condition, the first terminal device may execute S204;

[0174] Based on the fact that the video call data does not meet the AI ​​video super-resolution processing conditions, the first terminal device can execute S205.

[0175] Next, the process by which the first terminal device determines whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, load, and negotiation information is described.

[0176] In one implementation,

[0177] In the case where the data packet control information includes the video resolution, the first terminal device may determine whether each of the following multiple conditions is satisfied;

[0178] Determining that the video call data meets the AI ​​video super-resolution processing condition based on satisfying each of the following multiple conditions;

[0179] Determining that the video call data does not meet the AI ​​video super-resolution processing condition based on at least one of the following multiple conditions not being met;

[0180] Several conditions include:

[0181] The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has the AI ​​video super-resolution processing capability;

[0182] The video resolution is smaller than the negotiated video resolution corresponding to the second terminal device (the negotiated video resolution corresponding to the second terminal device in the negotiation information);

[0183] The load is less than the preset load.

[0184] In one implementation,

[0185] In the case where the data packet control information includes video resolution and distance information, the first terminal device may determine whether each of the following multiple conditions is satisfied;

[0186] Determining that the video call data meets the AI ​​video super-resolution processing condition based on satisfying each of the following multiple conditions;

[0187] Determining that the video call data does not meet the AI ​​video super-resolution processing condition based on at least one of the following multiple conditions not being met;

[0188] Several conditions include:

[0189] The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has the AI ​​video super-resolution processing capability;

[0190] The distance information is greater than the preset distance information, or the video resolution is less than the negotiated resolution corresponding to the second terminal device;

[0191] The load is less than the preset load.

[0192] In one implementation,

[0193] The first terminal device can determine the load of performing AI video super-resolution processing on the video call data based on the video call data.

[0194] The first terminal device can determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, load, and negotiation information.

[0195] In addition, it should be noted that:

[0196] In one implementation,

[0197] After receiving the data packet, the first terminal device may add 1 to the count value to obtain an updated count value.

[0198] The first terminal device may determine whether the updated count value reaches a pre-set value;

[0199] The first terminal device can clear the updated count value based on the updated count value reaching the pre-designed value, and determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the control information, load, and negotiation information.

[0200] It should be noted that, based on the updated count value, the first terminal device does not reach the pre-designed value, and can determine that the video call data in the data packet meets the AI ​​video super-resolution processing conditions when it is determined that the first target data packet meets the AI ​​video super-resolution processing conditions. Alternatively, based on the updated count value, the first terminal device does not reach the pre-designed value, and can determine that the video call data in the data packet does not meet the AI ​​video super-resolution processing conditions when it is determined that the first target data packet does not meet the AI ​​video super-resolution processing conditions.

[0201] The first target data packet is a data packet before the data packet, and the first target data packet is a data packet whose corresponding updated count value reaches a pre-designed value, or is the first data packet.

[0202] It should also be noted that, for the first data packet, the first terminal device can directly determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, load, and negotiation information. The first data packet is the first data packet received by the first terminal device.

[0203] S204: Based on the fact that the video call data meets the AI ​​video super-resolution processing conditions, the first terminal device performs AI video super-resolution processing on the video call data to obtain the processed video call data, and renders and displays the processed video call data.

[0204] In this embodiment, the first terminal device can perform AI video super-resolution processing on the video call data to obtain processed video call data when it is determined that the video call data meets the AI ​​video super-resolution processing conditions.

[0205] In one implementation, the first terminal device can use the AI ​​video super-resolution engine to perform AI video super-resolution processing on the video call data to obtain processed video call data.

[0206] After obtaining the processed video call data, the first terminal device may render and display the processed video call data.

[0207] S205: The first terminal device renders and displays the video call data based on the fact that the video call data does not meet the AI ​​video super-resolution processing conditions.

[0208] In this embodiment, the first terminal device can directly render and display the video call data when it is determined that the video call data does not meet the AI ​​video super-resolution processing conditions.

[0209] Beneficial effects of this embodiment: The second terminal device can obtain a data packet, wherein the data packet includes video call data and data packet control information; the data packet control information includes the distance information between the human body and the camera and the video resolution, or the data packet control information includes the video resolution. The second terminal device can send a data packet. The first terminal device can receive a data packet. The first terminal device can make a dynamic decision based on the data packet control information, the load, and the pre-acquired negotiation information (including the negotiated video resolution corresponding to the second terminal device and the AI ​​video super-resolution capability parameter corresponding to the first terminal device) to determine that the video call data meets the AI ​​video super-resolution processing conditions, and then perform AI video super-resolution processing on the video call data to obtain the processed video call data, and render and display the processed video call data. The method of the embodiment of the present application does not need to increase the network bandwidth at a cost, but performs AI video super-resolution processing on the video call data at the receiving end of the data packet (the first terminal device), thereby improving the resolution of the video call data, thereby improving the display effect of the video call data, and improving the user experience. In addition, the method of the embodiment of the present application does not need to consume resources to perform AI video super-resolution processing on all video call data. Instead, when it is determined that the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, payload, and pre-acquired negotiation information, AI video super-resolution processing is performed on the video call data, thereby improving the targetedness of AI video super-resolution processing and thereby improving resource utilization.

[0210] Figure 3 This is a flow chart of a second embodiment of a control method for AI video super-resolution processing of video call data provided in an embodiment of the present application. Figure 3 , the method may include:

[0211] S301: The second terminal device obtains a data packet.

[0212] In this embodiment, the second terminal device can obtain the data packet.

[0213] S302: The first terminal device receives a data packet.

[0214] In this embodiment, the second terminal device may send a data packet to the first terminal device.

[0215] The first terminal device may receive the data packet.

[0216] S303: The first terminal device determines the load of performing AI video super-resolution processing on the video call data based on the video call data, the configuration information corresponding to the first terminal device, and the computing power information corresponding to the first terminal device.

[0217] In this embodiment, the first terminal device can determine the load of performing AI video super-resolution processing on the video call data based on the video call data, the configuration information corresponding to the first terminal device, and the computing power information corresponding to the first terminal device.

[0218] In one implementation, the first terminal device can use a computing power model to determine the load of the first terminal device performing AI video super-resolution processing on the video call data based on the video call data, the configuration information of the first terminal device, and the computing capability information (computing power) of the first terminal device.

[0219] It should be noted that the load of AI video super-resolution processing on video call data refers to the load of the first terminal device performing AI video super-resolution processing on video call data using the AI ​​video super-resolution engine.

[0220] S304: The first terminal device determines whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, load, and negotiation information.

[0221] In this embodiment, the first terminal device can determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, load, and negotiation information.

[0222] Based on the video call data satisfying the AI ​​video super-resolution processing condition, executing S305;

[0223] Based on the fact that the video call data does not meet the AI ​​video super-resolution processing conditions, execute S306.

[0224] Next, the process by which the first terminal device determines whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, load, and negotiation information is described.

[0225] In one implementation,

[0226] In the case where the video call data is video call data collected by the second terminal device through a camera, the data packet control information may include distance information between the human body and the camera and video resolution.

[0227] The first terminal device may determine whether each of the following multiple conditions is met. Based on each of the multiple conditions being met, the first terminal device may determine that the video call data meets the AI ​​video super-resolution processing condition. Alternatively, based on at least one of the multiple conditions not being met, the first terminal device may determine that the video call data does not meet the AI ​​video super-resolution processing condition.

[0228] Among them, several conditions include:

[0229] The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has the AI ​​video super-resolution processing capability;

[0230] The distance information is greater than the preset distance information, or the video resolution is less than the negotiated resolution corresponding to the second terminal device;

[0231] The load is less than the preset load.

[0232] In one implementation,

[0233] In the case where the video call data is not the video call data collected by the second terminal device through a camera, that is, in the case where the video call data is the video call data pre-stored in the memory of the second terminal device, the data packet control information may include the video resolution. The data packet control information does not include the distance information between the human body and the camera.

[0234] The first terminal device may determine whether each of the following multiple conditions is met. Based on each of the multiple conditions being met, the first terminal device may determine that the video call data meets the AI ​​video super-resolution processing condition. Alternatively, based on at least one of the multiple conditions not being met, the first terminal device may determine that the video call data does not meet the AI ​​video super-resolution processing condition.

[0235] Among them, several conditions include:

[0236] The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has the AI ​​video super-resolution processing capability;

[0237] The video resolution is smaller than the negotiated resolution corresponding to the second terminal device.

[0238] The load is less than the preset load.

[0239] S305: Based on the fact that the video call data meets the AI ​​video super-resolution processing conditions, the first terminal device performs AI video super-resolution processing on the video call data to obtain the processed video call data, and renders and displays the processed video call data.

[0240] In this embodiment, the first terminal device can perform AI video super-resolution processing on the video call data based on the video call data meeting the AI ​​video super-resolution processing conditions to obtain processed video call data, and render and display the processed video call data.

[0241] S306: The first terminal device renders and displays the video call data based on the fact that the video call data does not meet the AI ​​video super-resolution processing conditions.

[0242] In this embodiment, the first terminal device can directly render and display the video call data based on the fact that the video call data does not meet the AI ​​video super-resolution processing conditions.

[0243] Beneficial effects of this embodiment: In this embodiment, the first terminal device can determine the load of performing AI video super-resolution processing on the video call data based on the video call data. The first terminal device can determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information (the data packet control information includes the distance information between the human body and the camera and the video resolution, or the data packet control information includes the video resolution), the load, and the negotiation information (including the negotiated video resolution corresponding to the second terminal device and the AI ​​video super-resolution capability parameter corresponding to the first terminal device). By incorporating the load of performing AI video super-resolution processing on the video call data into the process of determining whether the video call data meets the AI ​​video super-resolution processing conditions, AI video super-resolution processing can be performed on the video call data when the load is small, thereby improving the resolution of the video call data, saving bandwidth, and improving the user experience.

[0244] Next, S201 in method embodiment 1 and S301 in method embodiment 2 are described in detail through method embodiment 3.

[0245] Figure 4a This is a flowchart of a third embodiment of a control method for AI video super-resolution processing of video call data provided in an embodiment of the present application. Figure 4a , the method may include:

[0246] S401: The second terminal device obtains video call data.

[0247] In this embodiment, during a long-distance video call, the second terminal device can obtain video call data.

[0248] In one implementation, the video call data may be video call data pre-stored in a memory of the second terminal device.

[0249] In one implementation, the video call data may be video call data collected by the second terminal device through a camera.

[0250] It should be noted that the video call data may include one frame of image or multiple frames of image.

[0251] S402: The second terminal device obtains the corresponding acquisition method of the video call data.

[0252] In this embodiment, the second terminal device is provided with a camera.

[0253] The second terminal device may obtain the acquisition method corresponding to the video call data, wherein the acquisition method is used to indicate whether the video call data is video call data collected by a camera.

[0254] Figure 4b A schematic diagram of an online dance teaching demonstration scenario provided in an embodiment of the present application.

[0255] like Figure 4b As shown, in the scenario of online dance teaching demonstration, the second terminal device can collect video call data through a camera. The second terminal device can obtain the acquisition method corresponding to the video call data. Among them, the acquisition method indicates that the video call data is video call data collected by a camera.

[0256] Figure 4c A schematic diagram of a scenario of uploading certificate information for an online business provided in an embodiment of the present application.

[0257] like Figure 4c As shown, the second terminal device can store the certificate information (video call data) in advance in the memory of the second terminal device. In the scenario where the network service uploads the certificate information, the second terminal device can obtain the acquisition method corresponding to the video call data. Among them, the acquisition method indicates that the video call data is not the video call data collected by the camera.

[0258] S403: The second terminal device obtains the data packet control information according to the acquisition method.

[0259] In this embodiment, the second terminal device can obtain the data packet control information according to the acquisition method.

[0260] In one implementation,

[0261] When the acquisition method does not indicate that the video call data is video call data collected by a camera, in other words, when the video call data is video call data pre-stored in a memory of the second terminal device, the second terminal device may add the video resolution to the data packet control information, wherein the data packet control information includes the video resolution.

[0262] In one implementation,

[0263] The second terminal device can detect and process the distance between the human body and the camera to obtain the distance information when the acquisition method indicates that the video call data is video call data collected by a camera.

[0264] The second terminal device may add the distance information to the data packet control information. That is, the data packet control information includes the distance information. In addition, the second terminal device may also add the video resolution to the data packet control information. That is, the data packet control information includes the distance information and the video resolution.

[0265] Next, a process of detecting and processing the distance between a human body and a camera to obtain distance information when the acquisition mode indicates that the video call data is video call data collected by a camera by the second terminal device is described.

[0266] In one implementation,

[0267] The second terminal device can determine whether the first terminal device has the AI ​​video super-resolution processing capability based on the AI ​​video super-resolution capability parameter (vsr_cap) corresponding to the first terminal device when the acquisition method indicates that the video call data is video call data collected by a camera.

[0268] Based on the fact that the first terminal device has AI video super-resolution processing capabilities, the second terminal device can detect and process the distance between the human body and the camera to obtain distance information.

[0269] S404: The second terminal device obtains a data packet according to the data packet control information and the video call data.

[0270] In this embodiment, the second terminal device can obtain the data packet according to the data packet control information and the video call data.

[0271] Beneficial effects of this embodiment: In this embodiment, the second terminal device can obtain video call data. The second terminal device can obtain the acquisition method corresponding to the video call data, and obtain the data packet control information according to the acquisition method. The second terminal device can obtain the data packet according to the data packet control information and the video call data. The method of the embodiment of the present application obtains different data packet control information for different video call data acquisition methods, that is, the content included in the data packet control information is different. As a result, the first terminal device determines whether the video call data meets the AI ​​video super-resolution processing conditions according to the data packet control information in a different process, thereby improving the process of determining whether the video call data meets the AI ​​video super-resolution processing conditions, and the matching degree with the actual acquisition method of the video call data, thereby improving the accuracy of AI video super-resolution processing of the video call data.

[0272] Next, from a software perspective, a process of processing video call data when the video call data is video call data collected by a camera is described.

[0273] Figure 5 A schematic diagram of the software structure of the first terminal device provided in the embodiment of the present application. Figure 5 As shown, the first terminal device 10 includes a first communication service processing module 11, a first camera module 12, a first audio and video codec module 13, and a first AI video super-resolution processing module 14.

[0274] Figure 6 A schematic diagram of the software structure of the second terminal device provided in the embodiment of the present application. Figure 6 As shown, the second terminal device 20 includes a second communication service processing module 21, a second camera module 22, a second audio and video codec module 23, and a second AI video super-resolution processing module 24.

[0275] In this embodiment, the first communication service processing module 11 can perform communication negotiation with the second communication service processing module 22, so that the first communication service processing module 11 obtains the first negotiation information corresponding to the second terminal device 20, and the second communication service processing module 21 obtains the second negotiation information corresponding to the first terminal device 10. In other words, the first terminal device 10 can obtain the negotiation information, and the second terminal device 20 can also obtain the negotiation information. The negotiation information includes the first negotiation information and the second negotiation information.

[0276] Among them, the first negotiation information may include the negotiated video resolution corresponding to the second terminal device 20. In addition, the first negotiation information may also include the AI ​​video super-resolution capability parameter corresponding to the second terminal device 20, the negotiated video encoding method corresponding to the second terminal device 20, the negotiated bit rate corresponding to the second terminal device 20, the negotiated frame rate corresponding to the second terminal device 20, etc.

[0277] The second negotiation information may include the AI ​​video super-resolution capability parameter corresponding to the first terminal device 10. In addition, the second negotiation information may also include the negotiated video resolution corresponding to the first terminal device 10, the negotiated video encoding method corresponding to the first terminal device 10, the negotiated bit rate corresponding to the first terminal device 10, the negotiated frame rate corresponding to the first terminal device 10, etc.

[0278] It should be noted that the first communication service processing module 11 of the first terminal device 10 can access the network (such as a cellular network or an IP network, etc.) and use the interactive interface and protocol regulations provided by the network to process the video phone service. Among them, the video phone service includes establishing a video call, connecting a video call, hanging up a video call, etc. The first communication service processing module 11 can also perform communication negotiation processing, establish a bearer and a video media channel. In addition, the first communication service processing module can also negotiate and establish an IMS data channel (DataChannel) when the first terminal device 10 supports the IMS data channel.

[0279] The second camera module 22 can collect video call data during a long-distance video call. The second audio and video codec module 23 can receive the video call data sent by the second camera module 22, and encode and package the video call data to obtain a data packet.

[0280] The second communication service processing module 21 can receive the data packet sent by the second audio and video codec module 23, and send the data packet to the first communication service processing module 11 of the first terminal device 10. It should be noted that, in one implementation, the second communication service processing module 21 can send the data packet to the first communication service processing module 11 through the video media channel or the IMS data channel.

[0281] The first communication service processing module 11 may receive a data packet sent by the second communication service processing module 21 .

[0282] After receiving the data packet sent by the first communication service processing module 11, the first audio and video codec module 13 can unpack and decode the data packet to obtain the distance information and video resolution included in the video call data and the data packet control information, or obtain the video resolution in the video call data and the data packet control information.

[0283] After receiving the video call data and the data packet control information sent by the first audio and video codec module 13, the first AI video super-resolution processing module 14 can determine whether the video call data meets the AI ​​video super-resolution processing conditions according to the data packet control information, the load, and the pre-acquired negotiation information. In one implementation, the load can be determined by the first AI video super-resolution processing module 14 according to the video call data, the configuration information corresponding to the first terminal device 10, and the computing power information corresponding to the first terminal device 10.

[0284] The first AI video super-resolution processing module 14 can perform AI video super-resolution processing on the video call data when it is determined that the video call data meets the AI ​​video super-resolution processing conditions to obtain processed video call data, and render and display the processed video call data.

[0285] It should be noted that the processing process of the second terminal device 20 for the data packet sent by the first terminal device 10 is similar to the processing process of the first terminal device 10 for the data packet sent by the second terminal device 20 mentioned above, and will not be repeated here.

[0286] Beneficial effects of this embodiment: In this embodiment, the first AI video super-resolution processing module of the first terminal device can determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, load, and negotiation information, and then perform AI video super-resolution processing on the video call data when it is determined that the video call data meets the AI ​​video super-resolution processing conditions, and render and display the processed video call data. In this way, the resolution of the video call data is improved, thereby improving the display effect of the video call data and improving the user experience.

[0287] Figure 7 A schematic diagram of the structure of a control device for AI video super-resolution processing of video call data provided in an embodiment of the present application. A control device 70 for AI video super-resolution processing of video call data is applied to a first terminal device. The device includes a transceiver module 71, a processing module 72, and a communication module 73. Among them,

[0288] The transceiver module 71 is used to receive a data packet; the data packet includes video call data and data packet control information; the data packet control information includes the distance information between the human body and the camera and the video resolution, or the data packet control information includes the video resolution;

[0289] The processing module 72 is used to determine whether the video call data meets the artificial intelligence AI video super-resolution processing condition according to the data packet control information, the load, and the pre-acquired negotiation information; the negotiation information includes the negotiated video resolution corresponding to the second terminal device and the AI ​​video super-resolution capability parameter corresponding to the first terminal device;

[0290] The processing module 72 is also used to perform AI video super-resolution processing on the video call data based on the video call data satisfying the AI ​​video super-resolution processing conditions, obtain the processed video call data, and render and display the processed video call data.

[0291] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0292] In one implementation, the processing module 72 is specifically configured to:

[0293] Determine, according to the video call data, configuration information corresponding to the first terminal device, and computing capability information corresponding to the first terminal device, a load for performing AI video super-resolution processing on the video call data;

[0294] Determine whether the video call data meets the AI ​​video super-resolution processing conditions based on the data packet control information, payload, and negotiation information.

[0295] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0296] In one implementation, the packet control information includes distance information and video resolution;

[0297] The processing module 72 is specifically used for:

[0298] Determining whether each of the following multiple conditions is met;

[0299] Determining that the video call data meets the AI ​​video super-resolution processing condition based on satisfying each of the following multiple conditions;

[0300] Determining that the video call data does not meet the AI ​​video super-resolution processing condition based on at least one of the following multiple conditions not being met;

[0301] Several conditions include:

[0302] The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has the AI ​​video super-resolution processing capability;

[0303] The distance information is greater than the preset distance information, or the video resolution is less than the negotiated resolution corresponding to the second terminal device;

[0304] The load is less than the preset load.

[0305] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0306] In one implementation, the packet control information includes video resolution;

[0307] The processing module 72 is specifically used for:

[0308] Determining whether each of the following multiple conditions is met;

[0309] Determining that the video call data meets the AI ​​video super-resolution processing condition based on satisfying each of the following multiple conditions;

[0310] Determining that the video call data does not meet the AI ​​video super-resolution processing condition based on at least one of the following multiple conditions not being met;

[0311] Several conditions include:

[0312] The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has the AI ​​video super-resolution processing capability;

[0313] The video resolution is smaller than the negotiated resolution corresponding to the second terminal device;

[0314] The load is less than the preset load.

[0315] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0316] In one implementation, the processing module 72 is specifically configured to:

[0317] After receiving the data packet, the count value is incremented by 1 to obtain an updated count value;

[0318] Determine whether the updated count value reaches the pre-designed value;

[0319] Based on the updated count value, when the pre-designed value is reached, the updated count value is cleared, and based on the control information, load, and negotiation information, it is determined whether the video call data meets the AI ​​video super-resolution processing conditions.

[0320] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0321] In one implementation, the communication module 73 is specifically configured to:

[0322] Sending a first negotiation request to the second terminal device;

[0323] receiving first negotiation information corresponding to the second terminal device; the first negotiation information includes a negotiated video resolution corresponding to the second terminal device; the first negotiation information is sent by the second terminal device based on the first negotiation request;

[0324] Negotiation information is obtained according to the first negotiation information and the second negotiation information corresponding to the first terminal device; the second negotiation information includes the AI ​​video super-resolution capability parameters corresponding to the first terminal device.

[0325] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0326] Figure 8 A schematic diagram of the structure of another control device for AI video super-resolution processing of video call data provided in an embodiment of the present application. The control device 80 for AI video super-resolution processing of video call data is applied to a second terminal device.

[0327] like Figure 8 As shown, the control device 80 for AI video super-resolution processing of video call data includes a processing module 81, a transceiver module 82, and a communication module 83.

[0328] The processing module 81 is used to obtain a data packet; the data packet includes video call data and data packet control information; the data packet control information includes the distance information between the human body and the camera and the video resolution, or the data packet control information includes the video resolution;

[0329] The transceiver module 82 is used to send a data packet to the first terminal device.

[0330] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0331] In one implementation, the processing module 81 is specifically configured to:

[0332] Get video call data;

[0333] Obtaining the acquisition method corresponding to the video call data; the acquisition method is used to indicate whether the video call data is the video call data collected by the camera;

[0334] According to the acquisition method, obtain the data packet control information;

[0335] The data packet is obtained according to the data packet control information and the video call data.

[0336] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0337] In one implementation, the processing module 81 is specifically configured to:

[0338] When the acquisition method indicates that the video call data is video call data collected by a camera, detecting and processing the distance between the human body and the camera to obtain distance information;

[0339] Add distance information to data packet control information.

[0340] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0341] In one implementation, the processing module 81 is specifically configured to:

[0342] When the acquisition method indicates that the video call data is video call data collected by a camera, determining whether the first terminal device has the AI ​​video super-resolution processing capability according to the AI ​​video super-resolution capability parameter corresponding to the first terminal device; the AI ​​video super-resolution capability parameter corresponding to the first terminal device is used to indicate whether the first terminal device has the AI ​​video super-resolution processing capability;

[0343] Based on the fact that the first terminal device has AI video super-resolution processing capability, the distance between the human body and the camera is detected and processed to obtain distance information.

[0344] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0345] In one implementation, the communication module 83 is specifically configured to:

[0346] Sending a second negotiation request to the first terminal device;

[0347] receiving second negotiation information corresponding to the first terminal device; the second negotiation information includes an AI video super-resolution capability parameter corresponding to the first terminal device; the second negotiation information is sent by the first terminal device based on the second negotiation request;

[0348] According to the second negotiation information and the first negotiation information corresponding to the second terminal device, the negotiation information is obtained; the first negotiation information includes the negotiated video resolution corresponding to the second terminal device.

[0349] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0350] In one implementation, the data packet is sent via an Internet Protocol IP Multimedia Subsystem IMS data channel.

[0351] The control device for AI video super-resolution processing of video call data provided in the embodiment of the present application can execute the technical solution shown in the above method embodiment. Its implementation principle and beneficial effects are similar and will not be repeated here.

[0352] The embodiment of the present application also provides a chip. It can be understood that the chip can be a fifth generation mobile communication technology (5th Generation Mobile Communication Technology, referred to as 5G) chip.

[0353] A computer program is stored on the chip, and when the computer program is executed by the chip, the method in the first terminal device of the above method embodiment is implemented.

[0354] The embodiment of the present application also provides a chip. It can be understood that the chip can be a 5G chip.

[0355] A computer program is stored on the chip, and when the computer program is executed by the chip, the method in the second terminal device of the above method embodiment is implemented.

[0356] The embodiment of the present application also provides a chip module. It can be understood that the chip module can be a 5G chip module.

[0357] A computer program is stored on the chip module. When the computer program is executed by the chip module, the method in the first terminal device of the above method embodiment is implemented.

[0358] The embodiment of the present application also provides a chip module. It can be understood that the chip module can be a 5G chip module.

[0359] A computer program is stored on the chip module. When the computer program is executed by the chip module, the method in the second terminal device of the above method embodiment is implemented.

[0360] Fig. 9 A schematic diagram of the structure of a first terminal device provided in an embodiment of the present application. It can be understood that the first terminal device can be a 5G chip module.

[0361] See also Fig. 9 The first terminal device 90 may include a processor 91 and a memory 92. Exemplarily, the processor 91 and the memory 92 are interconnected via a bus 93.

[0362] Memory 92 stores computer executable instructions;

[0363] The processor 91 executes the computer execution instructions stored in the memory 92, so that the processor 91 executes the method in the first terminal device as shown in the above method embodiment.

[0364] Fig.10 A schematic diagram of the structure of a second terminal device provided in an embodiment of the present application. It can be understood that the second terminal device can be a 5G chip module.

[0365] See also Fig.10 The second terminal device 100 may include a processor 110 and a memory 120. Exemplarily, the processor 110 and the memory 120 are interconnected via a bus 130.

[0366] Memory 120 stores computer executable instructions;

[0367] The processor 110 executes the computer-executable instructions stored in the memory 120, so that the processor 110 executes the method in the second terminal device as shown in the above method embodiment.

[0368] All or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a readable memory. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned memory (storage medium) includes: read-only memory (English: read-only memory, abbreviated: ROM), RAM, flash memory, hard disk, solid state drive, magnetic tape (English: magnetic tape), floppy disk (English: floppy disk), optical disc (English: optical disc) and any combination thereof.

[0369] Accordingly, an embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, the method of the above method embodiment is used to implement the method.

[0370] Accordingly, an embodiment of the present application may also provide a computer program product, including computer execution instructions, which, when executed by a processor, enable the method shown in the above method embodiment to be executed.

[0371] These computer executable instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0372] These computer executable instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0373] Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

[0374] In the present application, the term "include" and its variations may refer to non-restrictive inclusion; the term "or" and its variations may refer to "and / or". The terms "first", "second", etc. in the present application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. In the present application, "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B may mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previously associated objects are in an "or" relationship.

Claims

1. A control method for AI video super-resolution processing of video call data, characterized in that: Applied in a first terminal device, the method includes: receiving a data packet; the data packet includes video call data and data packet control information; the data packet control information includes distance information between a human body and a camera and a video resolution, or the data packet control information includes the video resolution; Determine whether the video call data meets the AI ​​video super-resolution processing condition according to the data packet control information, the load, and the pre-acquired negotiation information; the negotiation information includes the negotiated video resolution corresponding to the second terminal device and the AI ​​video super-resolution capability parameter corresponding to the first terminal device; Based on the fact that the video call data meets the AI ​​video super-resolution processing condition, the video call data is subjected to AI video super-resolution processing to obtain processed video call data, and the processed video call data is rendered and displayed.

2. The method according to claim 1, characterized in that: Determining whether the video call data meets the AI ​​video super-resolution processing condition according to the data packet control information, the load, and the pre-acquired negotiation information includes: Determine the load of performing AI video super-resolution processing on the video call data according to the video call data, configuration information corresponding to the first terminal device, and computing capability information corresponding to the first terminal device; Determine whether the video call data meets AI video super-resolution processing conditions based on the data packet control information, the load, and the negotiation information.

3. The method according to claim 2, characterized in that The data packet control information includes the distance information and the video resolution; Determining whether the video call data meets the AI ​​video super-resolution processing condition according to the data packet control information, the load, and the negotiation information includes: Determining whether each of the following multiple conditions is met; Determining that the video call data satisfies the AI ​​video super-resolution processing condition based on satisfying each of the following multiple conditions; Determining that the video call data does not meet the AI ​​video super-resolution processing condition based on at least one of the following multiple conditions not being met; The multiple conditions include: The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has AI video super-resolution processing capability; The distance information is greater than the preset distance information, or the video resolution is less than the negotiated resolution corresponding to the second terminal device; The load amount is smaller than a preset load amount.

4. The method according to claim 2, characterized in that: The data packet control information includes the video resolution; Determining whether the video call data meets the AI ​​video super-resolution processing condition according to the data packet control information, the load, and the negotiation information includes: Determining whether each of the following multiple conditions is met; Determining that the video call data satisfies the AI ​​video super-resolution processing condition based on satisfying each of the following multiple conditions; Determining that the video call data does not meet the AI ​​video super-resolution processing condition based on at least one of the following multiple conditions not being met; The multiple conditions include: The AI ​​video super-resolution capability parameter corresponding to the first terminal device indicates that the first terminal device has AI video super-resolution processing capability; The video resolution is smaller than the negotiated resolution corresponding to the second terminal device; The load amount is smaller than a preset load amount.

5. The method according to any one of claims 1 to 4, characterized in that: The determining, according to the data packet control information, the load, and the pre-acquired negotiation information, whether the video call data meets the AI ​​video super-resolution processing condition includes: After receiving the data packet, the count value is incremented by 1 to obtain an updated count value; Determining whether the updated count value reaches a pre-designed value; Based on the updated count value, when the pre-designed value is reached, the updated count value is cleared, and based on the control information, the load, and the negotiation information, it is determined whether the video call data meets the AI ​​video super-resolution processing conditions.

6. The method according to any one of claims 1 to 5, characterized in that: Before receiving the data packet, the method further includes: Sending a first negotiation request to the second terminal device; receiving first negotiation information corresponding to the second terminal device; the first negotiation information includes a negotiated video resolution corresponding to the second terminal device; the first negotiation information is sent by the second terminal device based on the first negotiation request; The negotiation information is obtained according to the first negotiation information and the second negotiation information corresponding to the first terminal device; the second negotiation information includes the AI ​​video super-resolution capability parameters corresponding to the first terminal device.

7. A control method for AI video super-resolution processing of video call data, characterized in that: Applied in a second terminal device, the method includes: Acquire a data packet; the data packet includes video call data and data packet control information; the data packet control information includes distance information between the human body and the camera and video resolution, or the data packet control information includes the video resolution; The data packet is sent to the first terminal device.

8. The method according to claim 7, characterized in that The obtaining of the data packet comprises: Acquiring the video call data; Acquire the acquisition method corresponding to the video call data; the acquisition method is used to indicate whether the video call data is video call data collected by a camera; According to the acquisition method, acquiring the data packet control information; The data packet is obtained according to the data packet control information and the video call data.

9. The method according to claim 8, characterized in that Acquiring the data packet control information according to the acquisition method includes: When the acquisition method indicates that the video call data is video call data collected by a camera, detecting and processing the distance between the human body and the camera to obtain the distance information; The distance information is added to the data packet control information.

10. The method according to claim 9, characterized in that When the acquisition method indicates that the video call data is video call data collected by a camera, detecting and processing the distance between the human body and the camera to obtain the distance information includes: In a case where the acquisition method indicates that the video call data is video call data collected by a camera, determining whether the first terminal device has AI video super-resolution processing capability according to the AI ​​video super-resolution capability parameter corresponding to the first terminal device; the AI ​​video super-resolution capability parameter corresponding to the first terminal device is used to indicate whether the first terminal device has AI video super-resolution processing capability; Based on the fact that the first terminal device has AI video super-resolution processing capability, the distance between the human body and the camera is detected and processed to obtain the distance information.

11. The method according to claim 10, characterized in that Before acquiring the video call data, the method further includes: Sending a second negotiation request to the first terminal device; receiving second negotiation information corresponding to the first terminal device; the second negotiation information includes an AI video super-resolution capability parameter corresponding to the first terminal device; the second negotiation information is sent by the first terminal device based on the second negotiation request; Negotiation information is obtained according to the second negotiation information and first negotiation information corresponding to the second terminal device; the first negotiation information includes a negotiated video resolution corresponding to the second terminal device.

12. The method according to claim 11, characterized in that The data packet is sent via an Internet Protocol IP Multimedia Subsystem IMS data channel.

13. A control device for AI video super-resolution processing of video call data, characterized in that: Applied in a first terminal device, the apparatus comprises: A transceiver module, configured to receive a data packet; the data packet includes video call data and data packet control information; the data packet control information includes distance information between a human body and a camera and a video resolution, or the data packet control information includes the video resolution; A processing module, configured to determine whether the video call data meets the artificial intelligence (AI) video super-resolution processing condition according to the data packet control information, the load, and the pre-acquired negotiation information; the negotiation information includes the negotiated video resolution corresponding to the second terminal device and the AI ​​video super-resolution capability parameter corresponding to the first terminal device; The processing module is also used to perform AI video super-resolution processing on the video call data based on the video call data satisfying the AI ​​video super-resolution processing conditions, obtain processed video call data, and render and display the processed video call data.

14. A control device for AI video super-resolution processing of video call data, characterized in that: Applied in a second terminal device, the apparatus comprises: A processing module, configured to obtain a data packet; the data packet includes video call data and data packet control information; the data packet control information includes distance information between a human body and a camera and a video resolution, or the data packet control information includes the video resolution; The transceiver module is used to send the data packet to the first terminal device.

15. A first terminal device, characterized in that: include: Memory and processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 6.

16. A second terminal device, characterized in that: include: Memory and processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 7 to 12.

17. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 12 when executed by a processor.

18. A computer program product, characterized in that The method comprises computer-executable instructions, which, when executed by a processor, enable the method according to any one of claims 1 to 12 to be performed.

Images