Downlink data processing methods, devices, systems, equipment, storage media and products

Abstract

The present disclosure provides a downlink data processing method and device, system, equipment, storage medium and product. The present disclosure can obtain first information through an IMS data channel (which can be referred to as IMS DC) for a terminal with IMS capability, so as to obtain an optimized processing mode of downlink data. In this way, when the downlink data is received, the downlink data can be optimized and processed based on the target optimized mode adapted thereto, and rendered and displayed. In summary, the technical solution provided by the present disclosure can improve the display effect of downlink data to a certain extent.

Description

Technical Field

[0001] This disclosure relates to the field of communication technology, and in particular to a downlink data processing method, apparatus, system, device, storage medium, and product. Background Technology

[0002] The Internet Protocol Multimedia Subsystem (IMS) technology aims to provide an efficient and reliable data transmission channel, also known as a data channel (DC). Currently, an increasing number of terminals support IMS technology.

[0003] In existing technologies, operator IMS networks support video calls. For terminals, they can receive downlink video data from remote locations (base stations or other terminals) and display it directly. However, due to network complexity and resource limitations, directly playing downlink data like video may result in low video quality and poor display effects. For example, if the terminal receives a 480P video due to network factors, even if the terminal's IMS network supports 720P 30FPS video, the terminal will still display the video at 480P, leading to poor display quality that fails to meet the display requirements of real-world scenarios. Summary of the Invention

[0004] This disclosure provides a downlink data processing method, apparatus, system, device, storage medium, and product to improve the display effect of downlink data to a certain extent.

[0005] In a first aspect, this disclosure provides a downlink data processing method applied to a terminal, the terminal having Internet Protocol Multimedia System (IMS) capability, the method comprising:

[0006] First information is obtained using the IMS data channel, and the first information is used to indicate the optimized processing method for downlink data.

[0007] When downlink data is received, the downlink data is optimized using a target optimization method to obtain target data; wherein, the target optimization method is at least one of the optimization processing methods;

[0008] Render and display the target data.

[0009] Secondly, this disclosure provides a downlink data processing method applied to an IMS platform, the method comprising:

[0010] Establish an IMS data channel with the terminal;

[0011] Using the IMS data channel, first information is sent to the terminal, which indicates the optimized processing method for downlink data.

[0012] Thirdly, this disclosure provides a downlink data processing apparatus, including:

[0013] The acquisition unit is used to acquire first information using the IMS data channel, the first information being used to indicate the optimized processing method for downlink data;

[0014] An optimization unit is configured to optimize downlink data using a target optimization method when downlink data is received, to obtain target data; wherein the target optimization method is at least one of the optimization methods.

[0015] The display unit is used to render and display the target data.

[0016] Fourthly, this disclosure provides a downlink data processing apparatus, comprising:

[0017] Establishment unit, used to establish an IMS data channel with the terminal;

[0018] The sending unit is used to send first information to the terminal using the IMS data channel, the first information being used to indicate the optimized processing method for downlink data.

[0019] Fifthly, this disclosure provides a downlink data processing system, including:

[0020] A terminal for performing the method as described in any of the first aspects;

[0021] The IMS platform is used to execute the methods described in the second aspect.

[0022] In a sixth aspect, this disclosure provides an electronic device, including: a memory for storing computer-readable instructions; and a processor for executing the computer-readable instructions, causing the electronic device to perform the method as described in any embodiment of the first or second aspect.

[0023] In a seventh aspect, this disclosure provides a non-transitory computer-readable storage medium for storing computer-readable instructions that, when executed by a processor, cause the processor to perform the method as described in any embodiment of the first or second aspect.

[0024] Eighthly, this disclosure provides a computer program product, including a computer program that, when executed by a processor, implements the method as described in any embodiment of the first or second aspect.

[0025] This disclosure provides a downlink data processing method, apparatus, system, device, storage medium, and product. For terminals with IMS capabilities, this disclosure allows the acquisition of first information via the IMS data channel (hereinafter referred to as IMSDC) to obtain an optimized processing method for downlink data. Upon receiving downlink data, the data can be optimized based on a suitable target optimization method and then rendered and displayed. This disclosure does not directly render and display downlink data; instead, it optimizes the data based on the first information obtained from the IMSDC before rendering and displaying it. This solves the problem of poor display effects in existing technologies and allows for the addition of special effects or other custom effects to the downlink data based on actual scenarios or business needs, meeting customized display requirements. Furthermore, this disclosure does not require complex hardware modifications to the terminal; instead, it fully utilizes the bidirectional connectivity and flexible control capabilities of the IMSDC to achieve flexible control of the terminal. This also means that the IMSDC and the downlink data channel are no longer completely independent, but rather collaborate to upgrade the display effect. In summary, the technical solution provided by this disclosure can improve the display effect of downlink data to a certain extent.

[0026] It should be understood that both the foregoing general description and the following detailed description are exemplary and intended to provide further illustration of the claimed technology. Attached Figure Description

[0027] The above and other objects, features, and advantages of this disclosure will become more apparent from the more detailed description of the embodiments thereof in conjunction with the accompanying drawings. The drawings are provided to further illustrate the embodiments of this disclosure and form part of the specification. They are used together with the embodiments of this disclosure to explain the disclosure and do not constitute a limitation thereof. In the drawings, the same reference numerals generally represent the same components or steps.

[0028] Figure 1 A flowchart illustrating a downlink data processing method provided in an embodiment of this disclosure;

[0029] Figure 2 This is a schematic diagram of the playback process of downlink video data in the existing technology;

[0030] Figure 3 A schematic diagram illustrating the playback process of the downlink video data provided in this disclosure;

[0031] Figure 4 A schematic diagram of the interactive flow of a downlink video stream processing method provided in an embodiment of this disclosure;

[0032] Figure 5 A structural block diagram of a downlink data processing apparatus provided in an embodiment of this disclosure;

[0033] Figure 6 A structural block diagram of another downlink data processing apparatus provided in this disclosure embodiment;

[0034] Figure 7 A structural block diagram of a downlink data processing system provided in this embodiment of the disclosure;

[0035] Figure 8 A hardware block diagram of an electronic device provided in an embodiment of this disclosure;

[0036] Figure 9 This is a schematic diagram of a computer-readable storage medium provided in an embodiment of this disclosure. Detailed Implementation

[0037] To make the objectives, technical solutions, and advantages of this disclosure more apparent, exemplary embodiments according to this disclosure will now be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this disclosure, and not all embodiments of this disclosure. It should be understood that this disclosure is not limited to the exemplary embodiments described herein.

[0038] This disclosure applies to downlink data display scenarios. Downlink data refers to data sent from the network side (e.g., base stations, servers, etc.) to the terminal. Since downlink data display is involved, the downlink data involved in this disclosure includes at least image data. Further, downlink data can specifically include, but is not limited to, images, videos, real-time video streams, etc., without exhaustive list. Any downlink data involving image display can be implemented using this disclosure to display downlink data.

[0039] For example, this disclosure can be applied to scenarios where a ringback tone video (or video ringback tone) is displayed when making a phone call; or, for example, this disclosure can be applied to scenarios where the other party's video is displayed during a video call; or, for example, this disclosure can be applied to scenarios where an image-attached SMS message is received from a base station or server and the image therein is displayed; or, for example, this disclosure can be applied to scenarios where real-time downlink video streams (such as live streams of sports games or sales events) are played and displayed. This is not an exhaustive list.

[0040] This disclosure does not impose any particular restrictions on the network-side equipment in this communication scenario; as mentioned above, it can be a base station or a server, etc. This disclosure also does not impose any particular restrictions on the type of terminal equipment. A terminal, also referred to as a terminal device, user equipment (UE), mobile station, mobile terminal, etc., is capable of communicating with network-side equipment. Specifically, terminals can be widely used in various scenarios, such as device-to-device (D2D), vehicle-to-everything (V2X) communication, machine-type communication (MTC), Internet of Things (IoT), virtual reality, augmented reality, industrial control, autonomous driving, telemedicine, smart grids, smart furniture, smart offices, smart wearables, smart transportation, smart cities, etc. Based on this, a terminal can be, but is not limited to: mobile phones, tablets, computers with wireless transceiver capabilities, wearable devices, vehicles, drones, helicopters, airplanes, ships, robots, robotic arms, smart home devices, etc. The embodiments of this application do not impose any particular restrictions on the specific technology or device form used in the terminal.

[0041] As described in the background section, existing technologies, regardless of the video quality supported by the IMS network, directly render and display the received video. This results in poor display quality of downlink data and fails to fully utilize the advantages of IMS technology. To address this, this disclosure provides a novel design concept: utilizing the bidirectional connection and control capabilities of the IMS DC to instruct the terminal on optimized processing methods for downlink data. Thus, the terminal optimizes the received downlink data accordingly before rendering and displaying it, thereby improving the display quality of the downlink data.

[0042] Based on this, this disclosure provides a downlink data processing method applied to a terminal, wherein the terminal possesses Internet Protocol Multimedia System (IMS) capabilities. In other words, the terminal itself has IMS hardware and software configurations; therefore, this disclosure does not require complex modifications to the terminal, but can directly utilize the terminal's IMS capabilities to implement this solution. The following is combined with… Figure 1 Detailed explanation.

[0043] Please refer to Figure 1 , Figure 1 This is a flowchart illustrating a downlink data processing method provided in an embodiment of this disclosure. Figure 1 As shown, the method includes:

[0044] S102, First information is obtained using the IMS data channel. The first information is used to indicate the optimized processing method for downlink data.

[0045] Specifically, the IMS data channel is the data channel between the IMS platform and the terminal, used to instruct the terminal on the optimized processing method for downlink data.

[0046] In this disclosure, the IMS data channel can be a permanent channel or a short-term channel established based on preset establishment conditions under different business scenarios and released based on the end of the business or other preset release conditions, in order to save communication resources. It should be understood that the establishment and release conditions of IMSDC can be customized, and this disclosure does not impose any special restrictions on them. Examples of video call scenarios will be used to illustrate this later.

[0047] It should be noted that in any business scenario (such as during a video call), the number of times S102 is executed can be once (for example, the first information is obtained in real time for each video call) or multiple times (for example, the first information can be sent multiple times during a video call to indicate the downlink data optimization processing method under the current situation, that is, multiple different methods are allowed to be used to optimize the downlink data in one scenario), or even 0 times (for example, the first information is obtained only once, and the subsequent video call process directly uses the first information of this time to optimize the downlink data without obtaining the first information again).

[0048] In this disclosure, the optimization processing method indicated by the first information can be customized and configured by the IMS platform, and this disclosure does not impose any particular restrictions on it. For example, when the downstream data is at least image data, any scheme that can be used for image optimization processing or video optimization processing in the actual scenario is acceptable.

[0049] In one exemplary embodiment, when the downlink data includes at least image data, the types of optimization processing methods involved in this disclosure may include, but are not limited to, at least one of the following: 3D special effects display processing, video super-resolution processing, and special effects compositing processing. Specifically, 3D special effects display processing refers to applying 3D special effects processing to the downlink data. For example, in a video call scenario, the received face image of the other user can be processed into a 3D head effect for display. Video super-resolution processing refers to processing the downlink data to enable it to be displayed in super-resolution, which helps improve the display quality and effect of the downlink data. Special effects compositing processing refers to compositing special effects based on the downlink data. For example, combining downlink data with big head effects, cartoon effects, etc., for composite display.

[0050] The above is a specific explanation using image data as an example. It should be understood that when the downstream data also includes other data, there can be other targeted optimization processing methods. For example, when the downstream data includes at least audio data, the types of optimization processing methods include, but are not limited to, at least one of the following: timbre adjustment processing, noise reduction processing, voice changing processing, etc., without exhaustive list.

[0051] Specifically, any of the above-mentioned optimization processing methods can be implemented through different means. In one exemplary embodiment, the optimization processing methods (i.e., specific implementation methods) involved in this disclosure include at least one of the following: AI model processing, algorithm processing, and rule processing. Here, AI model refers to a machine learning model built based on artificial intelligence (AI) technology. For example, generative large models can be used to perform special effects display processing and video super-resolution processing on downlink data, etc., without exhaustive list. Algorithm processing refers to processing downlink data according to the basic logic of an algorithm to specifically implement video super-resolution processing, special effects compositing, etc. Rule processing refers to processing downlink data according to preset rules.

[0052] It should be understood that regardless of the specific implementation method or the type of optimization processing, the first information can provide customized instructions and interact with the terminal through IMSDC to obtain relevant information.

[0053] The first information can be specifically indicated by carrying relevant instruction information. In one exemplary embodiment, the information carried by the first information includes: service type, rendering task type, function type, and model identifier. In specific implementation, the first information can indicate the optimization processing method through a set of strings. For example, the first information can carry the following string: {"buss":"crbt","type":"SR","function":"cmd","model":"001-ncnn-light"}. Here, "buss" represents the service type, "crbt" represents the video call service; "type" represents the task type, "SR" represents video super-resolution processing; "function" represents the function type, "cmd" represents the command function; "model" indicates that the optimization processing method is a model, here referring to the model identifier, and "001-ncnn-light" is the identifier of the model used to specifically implement the optimization processing, referring to a convolutional neural network (CNN). Thus, the first information is specifically used to instruct the terminal to use CNN 001 to perform real-time super-resolution processing on the video.

[0054] Furthermore, it's important to note that for specific optimization methods, if the terminal pre-stores various optimization methods, the first information only needs to identify them; if the terminal does not store relevant data, the first information can also carry information related to the specific optimization method. Taking the aforementioned AI model as an example, if the terminal stores multiple AI models, the IMS platform only needs to use the first information to indicate the identifier of a specific AI model; alternatively, the IMS platform can use the first information to carry specific AI model parameters so that the terminal can obtain the specific optimization method after receiving the first information.

[0055] S104, when receiving downlink data, optimize the downlink data using a target optimization method to obtain target data; wherein, the target optimization method is at least one of the optimization processing methods.

[0056] As mentioned above, the downlink data involved in this disclosure refers to any data sent from the network side to the terminal, received and displayed by the terminal. This disclosure does not limit the data type of downlink data. Specifically, the types of downlink data involved in this disclosure may include, but are not limited to, at least one of the following: image data, audio data, and video data, without exhaustive list.

[0057] In addition, downlink data can be a real-time downlink data stream, such as a real-time received downlink video stream, or a real-time received call video; or, downlink data can be a specific file. Taking video comparison as an example, downlink data can be a specific video file, such as a ringback tone video sent by the base station to the terminal. This ringback tone video does not need to be sent in the form of a real-time video stream.

[0058] For example, in a video call scenario, two types of downlink data may be involved: ringback tone video and call video. For example, when the first terminal (as the caller) makes a video call to the second terminal (the called party), the first terminal can receive and display downlink data: ringback tone video; when the second terminal answers the video call, the first terminal can receive and display downlink data: call video (including at least the video data of the second terminal). In this process, for the second terminal, the downlink data involved includes at least the call video of the first terminal. In other words, in a video call scenario, downlink data may include, but is not limited to, at least one of the following: ringback tone video and call video. For example, it may also include: music ringback tones, etc., without exhaustive listing.

[0059] For any terminal, upon receiving downlink data, it no longer renders and displays it directly. Instead, it optimizes the downlink data based on a target optimization method before rendering and displaying it. Here, the target optimization method is related to the first information and can specifically be at least one of the optimization methods indicated by the first information. In other words, the target optimization method can be a single optimization method, which involves less processing and is more efficient, thus reducing the display latency of the real-time downlink data stream; or, the target optimization method can be a combination of multiple optimization methods. For example, if the first information carries three optimization methods, these three methods can be used sequentially to optimize the downlink data, ultimately obtaining the target data, which is then rendered and displayed.

[0060] In this disclosure, the first information can be used to indicate an optimization processing method, which is then the target optimization method. Alternatively, the first information can also be used to indicate multiple optimization processing methods; in this case, it is necessary to determine the target optimization method among the multiple optimization processing methods. There are various ways to determine the target optimization method among the multiple optimization processing methods; for example, it can be randomly selected; for example, it can be determined based on data type; for example, it can be determined based on business type; for example, it can be determined based on other custom conditions or rules, without exhaustive enumeration.

[0061] In one exemplary embodiment, the first information may carry the target optimization method. Alternatively, in another exemplary embodiment, the first information carries optimization processing methods for multiple types of downlink data; the target optimization method is the optimization processing method corresponding to the type of downlink data. For example, the first information may carry three optimization processing methods, corresponding to downlink data of type A, type B, and type C, respectively. Then, if the subsequently received downlink data is of type A, the optimization processing method corresponding to type A can be determined as the target optimization method. The same applies to types B and C, and will not be elaborated further.

[0062] S106, render and display the target data.

[0063] In summary, the technical solution provided in this disclosure, for terminals with IMS capabilities, can obtain first information through the IMS data channel (hereinafter referred to as IMSDC) to obtain the optimized processing method for downlink data. Thus, upon receiving downlink data, it can be optimized and rendered based on the appropriate target optimization method. Therefore, this disclosure does not directly render and display downlink data, but optimizes it based on the first information obtained from IMSDC before rendering and displaying it. This not only solves the problem of poor display effects in existing technologies, but also allows for the addition of special effects or other custom effects to downlink data based on actual scenarios or business needs, meeting customized display requirements. Furthermore, this disclosure does not require complex hardware modifications to the terminal, but fully utilizes the bidirectional connectivity and flexible control capabilities of IMSDC to achieve flexible control of the terminal. This also means that IMSDC and the downlink data channel are no longer completely independent, but rather cooperate to upgrade the display effect. In conclusion, the technical solution provided in this disclosure can improve the display effect of downlink data to a certain extent.

[0064] The specific implementation of S102 is described below. In one exemplary embodiment, S102 can be implemented through the following steps:

[0065] Establish the IMS data channel with the IMS platform;

[0066] The first information is received from the IMS platform using the IMS data channel.

[0067] In other words, before S104, an IMS data channel needs to be established to receive the first information. During this process, for the terminal, it only needs to receive the first information based on the IMS data channel; for the IMS platform, the IMS platform can automatically or based on user operation (or other user instruction) use the IMS data channel to send the first information to the terminal.

[0068] For the IMS platform, the IMS data channel can be established during any downlink data reception process, or before downlink data reception. Apart from this, this disclosure has no particular restrictions. Taking a video call scenario as an example, IMSDC can be established when the video call is initiated (triggered by the terminal), or it can be established when the terminal and / or IMS platform resources are idle; or it can be automatically established at the start of a service scenario; this is not exhaustive.

[0069] The data transmission process of the IMS data channel will occupy certain communication resources. To avoid resource waste, the IMSDC can be released after the relevant control commands (such as the first and second information of this disclosure) are sent. This disclosure does not impose any special restrictions on the release conditions of the IMSDC. For example, the IMSDC can be released after a preset time interval or immediately after the relevant control commands (such as the first and second information of this disclosure) are sent; or the IMSDC can be released after the relevant service is completed; no exhaustive list is provided.

[0070] In one exemplary embodiment, in a video call scenario, the step of establishing an IMS data channel in S102 can be triggered when the video call is initiated, or it can be released when the video call is ended. In this case, S102 includes: when the video call is initiated, obtaining first information using the Internet Protocol Multimedia System (IMS) data channel; and the method further includes: S108 (…). Figure 1 (Not shown), when the video call is ended, the IMS data channel is released. This ensures flexible processing of downlink data by the IMS platform throughout the video call, while also effectively conserving IMS communication resources.

[0071] In this embodiment, the IMS data channel remains continuous during the video call. The IMS platform can send one or more first messages to the terminal during the video call to achieve flexible processing of downlink data. For example, the IMS platform can send the first message for the ringback tone video when the video call is made, and it can also send the first message for the call video when the video call is connected. It can also send the first message again during the video call to change the optimized processing method for the downlink call video, and it can even send a second message to turn off the optimized processing (described in detail below).

[0072] In one exemplary embodiment, in a video call scenario, this disclosure can be implemented as follows:

[0073] When a video call is initiated, the ringback tone video is received, and the ringback tone video is optimized using the first processing method;

[0074] When the video call is connected, the video of the call is received, and the video of the call is optimized using the second processing method;

[0075] The first processing method may be the same as or different from the second processing method.

[0076] It should be understood that the first processing method and the second processing method are the target processing methods corresponding to different data types. The task types and specific processing methods involved can be referred to the preceding text and will not be repeated here. In this embodiment, as... Figure 1 The downlink data processing method shown (or steps S104 and S106 therein) can be executed multiple times to achieve flexible adjustment of the downlink data. Furthermore, during this process, different optimization processing methods can be adopted for different types of downlink data, or the same processing method can be adopted. This can be achieved based on the instructions of the first information issued by the IMS platform, and will not be elaborated further.

[0077] Furthermore, as mentioned above, in addition to using the first information to indicate different optimization processing methods, this function can also be disabled if this solution is not desired for optimizing downlink data in certain scenarios. Therefore, this disclosure further provides a method for disabling this optimization processing method.

[0078] For example, the method provided in this disclosure may further include the following steps:

[0079] The second information is obtained using the IMS data channel, and the second information is used to indicate the closure of the optimization processing of downlink data;

[0080] When downlink data is received, the downlink data is rendered and displayed.

[0081] It should be understood that the second message is still a control command issued by the IMS platform to the terminal, and its transmission is achieved through the IMSDC. Therefore, when the IMSDC is released only after the service ends, such as when a video call is disconnected, the second message and the first message can be transmitted using the same IMSDC. Alternatively, if the IMSDC is released immediately after the control command is sent, the IMS platform needs to establish the IMSDC before sending the second message to enable its transmission.

[0082] Similar to the first information, the second information can also indicate the disabling of the optimization processing method through the carried indication information. In an exemplary embodiment, the information carried by the first information includes: service type, rendering task type, function type, and enable type. In specific implementation, the second information can also indicate the optimization processing method through a set of strings, for example, {"buss":"crbt","type":"SR","function":"cmd","enable":"false"}. Here, enable indicates the enable type, and false indicates disabling. Thus, the second information can be specifically used to instruct the terminal to disable real-time super-resolution processing of ringback tone videos.

[0083] For the terminal, when the second information is received, the aforementioned optimization processing capability is turned off. At this time, existing technology solutions or other solutions can be adopted to render and display the received downlink data.

[0084] In addition to the solution implemented on the terminal side, this disclosure also provides another downlink data processing method applied to the IMS platform, which includes:

[0085] Establish an IMS data channel with the terminal;

[0086] Using the IMS data channel, first information is sent to the terminal, which indicates the optimized processing method for downlink data.

[0087] For details not covered, please refer to the previous text; further explanation is not required here.

[0088] To better understand this solution, the following explanation uses a video call scenario as an example. Please compare and refer to the example. Figure 2 and Figure 3 ,in, Figure 2 This is a schematic diagram of the playback process of downlink video data in existing technology. Figure 3 This is a schematic diagram of the playback process of the downlink video data provided in this disclosure.

[0089] like Figure 2As shown, the terminal system (acting as the dialer, i.e., the initiator of the video call) actually processes the data in two main parts: the data receiving part (implemented using the basic functions of the terminal), Figure 2 The part in the middle represents the terminal) and the data display part (the application layer deployed on the terminal, which can be specifically the Dialer application). Figure 2 (This is represented as a dialer application). The data receiving section includes: a modem, a codec (or MediaCodec), a Real-Time Transport Protocol Stack (RTP Stack), and a Video Call Engine (VCE). The data display section includes: an image display and an image acquisition device. The image acquisition device (e.g., a camera) is not discussed in this disclosure. The image display is used to implement downlink video display and can specifically be a Texture View. Figure 2 The red part in the image indicates the data flow, and the double-headed arrows indicate that there is an interaction between two executing entities to achieve the corresponding capabilities.

[0090] In specific implementation, such as Figure 2 As shown, after receiving the downlink video stream via the Modem, the terminal sends it to the VCE. The VCE interacts with the RTP Stack, calling the RTP protocol stack to unpack the downlink video stream. Then, the VCE interacts with the Codec to separate and decode the audio and video. The VCE then transmits the decoded video data to the Texture View in the data display section, where it is rendered and displayed. Audio data is output through an audio device (image data is used as an example here; this will not be discussed further, but in real-world scenarios, this solution can also be used to optimize and output audio).

[0091] Based on such Figure 2 The downlink data stream shown is rendered directly after basic decoding of the downlink data. This processing method cannot meet users' needs for clarity and video call entertainment, resulting in poor display quality and effect.

[0092] In comparison, you can refer to Figure 3 The process shown is as follows: Figure 3 Infrastructure and Figure 2 The same, in Figure 2 Based on the processing method shown, additional processing steps have been added, including interaction with the IMS platform and optimization of the downlink video stream. Figure 3 The data in the red section are... Figure 2 The same applies, so I won't repeat it. Figure 3The green arrows indicate newly added data processing flows; the blue arrows indicate interactions between the terminal and the IMS platform. Furthermore, in Figure 2 Based on the architecture shown, Figure 3 The illustrated embodiment also includes an IMSDC control module, which can also be referred to as a downlink data processing device or a downlink video processing module, used to implement the methods provided in this disclosure, for example, to implement... Figure 1 The downlink data processing method is shown. Furthermore, Figure 3 The document also includes an additional re-rendering display module, which refers to rendering the target data after target optimization. In practice, this part can be implemented using the existing image display (such as Texture View) in the application layer Dialer (i.e., the dialer application).

[0093] like Figure 3 In a specific implementation of the illustrated embodiment, it is possible to... Figure 2 Based on the illustrated process, each frame of image or texture to be rendered and displayed on the original image display is acquired. Then, based on the instructions of the first information, the video stream is optimized using an AI model or other optimization methods. Finally, the processed content (i.e., the target data) is rendered and displayed. During this process, the IMS platform can instruct the terminal to select an appropriate AI model or other optimization method based on the content or type of the video stream or other custom methods.

[0094] based on Figure 3 This disclosure further provides, as follows Figure 4 The interactive diagram shown is as follows: Figure 4 This is a schematic diagram of the interactive flow of a downlink video stream processing method provided in an embodiment of this disclosure. Figure 4 As shown, the method includes:

[0095] Step 1: The terminal (i.e. the calling terminal) initiates a video call, and the terminal and the IMS platform establish an IMS DC.

[0096] like Figure 4 As shown, the terminal is specifically divided into a dialer application and a downlink video processing module (i.e., the specific downlink video optimization processing module). Specifically, considering that the ADC (Application DC) can be used to transmit network control commands to the terminal, such as AI algorithm switching commands, it can also be used to send first information, second information, etc.

[0097] Step 2: The terminal plays the ringback tone video. At this time, the called terminal starts ringing.

[0098] Step 3: The IMS platform selects an appropriate optimization method and sends the first information to the terminal.

[0099] For example, the first information, also known as a DC control command, is used to instruct the terminal on the downlink video processing method. The optimized processing method indicated by the first information can be determined based on the ringback tone content or other custom methods. For example, the first information can carry parameters such as service type, task type, function type, and model identifier (index ID). For example, {“buss”:”crbt”,”type”:”SR”,”function”:”cmd”,”model”:”001-ncnn-light”}. In this case, the first information instructs the terminal to use a convolutional neural network (CNN) to perform real-time super-resolution processing on the ringback tone video.

[0100] Step 4: Based on the first information, the terminal calls the downlink video processing module to select the target optimization method.

[0101] The downlink video processing module can be a different processing module, for example, it can be a specific AI algorithm module, used to determine a suitable AI model as the target optimization method based on the first information.

[0102] Step 5: The downlink video processing module obtains the ringback tone video.

[0103] Step 6: Based on the method indicated by the first information, perform target optimization processing on the ringback tone video. If necessary, the effects optimization processing can also be turned off using the second information.

[0104] In practice, the texture ID (TexutreId) for rendering the ringback tone video can be obtained from the ringback tone playback control module. The content associated with this texture ID can be optimized for the target, and the processed new texture (i.e., target data) can be output, rendered into the output control (or playback control), and the screen can be updated in real time.

[0105] For example, the terminal effects display service can be turned off using {"buss":"crbt","type":"SR","function":"cmd","enable":"false"}.

[0106] Step 7: Render and display the optimized video stream in real time.

[0107] Step 8: When the video call is connected, the terminal and the network side form a two-way video stream. At this time, the downlink video stream received from the called terminal side can also be optimized.

[0108] Step 9: After the video call is connected, the IMS platform can switch the optimization processing method. The switching method can be to resend the first information (used to switch the optimization processing method for downlink data).

[0109] It should be understood that when a video call is connected, the terminal and network switch to two-way video. This solution is applicable to downlink data processing, meaning it can be applied to processing the downlink video stream on the called terminal side. Specifically, the optimized processing method can be switched by resending the first information via IMSDC. When the first information is resent, the original optimization method is considered invalid. For example, the first information could be {"buss":"crbt","type":"SR","function":"cmd","model":"002-GAN-light"}, in which case it instructs the terminal to use CNN 002 for real-time super-resolution processing of the video.

[0110] Step 10: Notify the downlink video processing module (AI algorithm module) to switch the processing method (e.g., switch the corresponding AI algorithm). The rest of the process is the same as steps 4-7.

[0111] In summary, the technical solution provided in this disclosure can fully utilize the terminal's computing power for video rendering and AI processing, free up network resources, and also fully utilize the flexibility of the operator's IMSDC, thereby enabling flexible control for different services or data types.

[0112] This disclosure also provides a downlink data processing apparatus. Figure 5 A structural block diagram of a downlink data processing apparatus provided in an embodiment of this disclosure, such as... Figure 5 As shown, the downlink data processing device 500 includes:

[0113] The acquisition unit 510 is used to acquire first information using the IMS data channel, the first information being used to indicate the optimized processing method for downlink data;

[0114] The optimization unit 520 is configured to optimize the downlink data using a target optimization method when downlink data is received, to obtain target data; wherein the target optimization method is at least one of the optimization processing methods.

[0115] Display unit 530 is used to render and display the target data.

[0116] In one exemplary embodiment, the acquisition unit 510 is specifically used for:

[0117] Establish the IMS data channel with the IMS platform;

[0118] The first information is received from the IMS platform using the IMS data channel.

[0119] In one exemplary embodiment, the acquisition unit 510 is specifically used for:

[0120] When a video call is initiated, the first information is obtained using the Internet Protocol Multimedia System (IMS) data channel.

[0121] The acquisition unit 510 is further configured to: release the IMS data channel when the video call is disconnected.

[0122] In one exemplary embodiment, the downlink data includes at least one of the following types: image data, audio data, and video data;

[0123] In a video call scenario, the downlink data includes at least one of the following: ringback tone video and call video.

[0124] In one exemplary embodiment, the first information carries the target optimization method; or, the first information carries optimization processing methods for multiple types of downlink data; the target optimization method is an optimization processing method corresponding to the type of downlink data.

[0125] In one exemplary embodiment, the type of optimization processing method includes at least one of the following: 3D special effects display processing, video super-resolution processing, and special effects compositing processing;

[0126] The optimization processing methods include at least one of the following: AI model processing, algorithm processing, and rule processing.

[0127] In one exemplary embodiment, the information carried by the first information includes: business type, rendering task type, function type, and model identifier.

[0128] In one exemplary embodiment, the optimization unit 520 is specifically used for:

[0129] When a video call is initiated, the ringback tone video is received, and the ringback tone video is optimized using the first processing method;

[0130] When the video call is connected, the video of the call is received, and the video of the call is optimized using the second processing method;

[0131] The first processing method may be the same as or different from the second processing method.

[0132] In one exemplary embodiment,

[0133] The acquisition unit 510 is further configured to: acquire second information using the IMS data channel, the second information being used to indicate the closure of optimization processing for downlink data;

[0134] The display unit 530 is also configured to: render and display the downlink data when it receives downlink data.

[0135] This disclosure also provides a downlink data processing apparatus. Figure 6 A structural block diagram of another downlink data processing apparatus provided in this disclosure embodiment, such as... Figure 6 As shown, the downlink data processing device 600 includes:

[0136] Establishment unit 610 is used to establish an IMS data channel with the terminal;

[0137] The sending unit 620 is used to send first information to the terminal using the IMS data channel. The first information is used to indicate the optimized processing method for downlink data.

[0138] This disclosure also provides a downlink data processing system. Figure 7 A structural block diagram of a downlink data processing system provided in this disclosure embodiment is shown below. Figure 7 As shown, the downlink data processing system 700 includes:

[0139] Terminal 710 is used to execute the method executed on the terminal side of any of the above embodiments;

[0140] IMS platform 720 is used to execute the methods executed on the IMS platform side (or network side) of any of the above embodiments.

[0141] For any parts not detailed, please refer to the relevant instructions in the method section.

[0142] Figure 8 This is a hardware block diagram of an electronic device provided according to an embodiment of the present disclosure. The electronic device 800 according to an embodiment of the present disclosure includes at least a processor and a memory for storing computer-readable instructions. When the computer-readable instructions are loaded and executed by the processor, the processor performs the downlink data processing method described in any of the preceding embodiments of the present disclosure.

[0143] Figure 8 The illustrated electronic device 800 specifically includes a central processing unit (CPU) 801, a graphics processing unit (GPU) 802, and a memory 803. These units are interconnected via a bus 804. The CPU 801 and / or GPU 802 can function as the aforementioned processor, and the memory 803 can function as the aforementioned memory storing computer-readable instructions. Furthermore, the electronic device 800 may also include a communication unit 805, a storage unit 806, an output unit 807, an input unit 808, and an external device 809, all of which are also connected to the bus 804.

[0144] Figure 9 This is a schematic diagram of a computer-readable storage medium provided in an embodiment of this disclosure. (As shown...) Figure 9As shown, a computer-readable storage medium 900 according to an embodiment of the present disclosure stores computer-readable instructions 901 thereon. When the computer-readable instructions 901 are executed by a processor, the downlink data processing method described with reference to the above figures according to any embodiment of the present disclosure is performed. The computer-readable storage medium includes, but is not limited to, volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, optical disk, magnetic disk, etc.

[0145] This disclosure further provides a computer program product, including a computer program that, when executed by a processor, implements the downlink data processing method described in any of the preceding embodiments of this disclosure.

[0146] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this disclosure.

[0147] The basic principles of this disclosure have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.

[0148] The block diagrams of devices, apparatuses, devices, and systems disclosed herein are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0149] Additionally, as used herein, the “or” used in a list of items beginning with “at least one” indicates a separate list, such that a list of, for example, “at least one of A, B, or C” means A or B or C, or AB or AC or BC, or ABC (i.e., A and B and C). Furthermore, the word “exemplary” does not imply that the described example is preferred or better than other examples.

[0150] It should also be noted that in the systems and methods of this disclosure, the components or steps can be decomposed and / or recombined. These decompositions and / or recombinations should be considered as equivalent solutions to this disclosure.

[0151] Various changes, substitutions, and modifications can be made to the technology described herein without departing from the teachings defined by the appended claims. Furthermore, the scope of the claims of this disclosure is not limited to the specific aspects of the processes, machines, manufactures, events, means, methods, and actions described above. Currently existing or later-developed processes, machines, manufactures, events, means, methods, or actions that perform substantially the same function or achieve substantially the same result as the corresponding aspects described herein can be utilized. Therefore, the appended claims include such processes, machines, manufactures, events, means, methods, or actions within their scope.

[0152] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.

[0153] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations therein.

Claims

1. A downlink data processing method, characterized by, The method is applied to a terminal with Internet Protocol Multimedia System (IMS) capability, and comprises the following steps: acquiring first information by using an IMS data channel, the first information being used to indicate an optimization processing mode of downlink data; when receiving the downlink data, performing optimization processing on the downlink data by using a target optimization mode to obtain target data, wherein the target optimization mode is at least one of the optimization processing modes; rendering and displaying the target data.

2. The method of claim 1, wherein, The method comprises the following steps: establishing the IMS data channel between the terminal and an IMS platform; receiving the first information from the IMS platform by using the IMS data channel.

3. The method according to claim 1 or 2, characterized in that, The method comprises the following steps: when a video call is initiated, acquiring first information by using an Internet Protocol Multimedia System (IMS) data channel; the method further comprises the following step:

4. The method according to any one of claims 1 to 3, characterized in that, when the video call is hung up, releasing the IMS data channel. The type of the downlink data comprises at least one of the following: image data, audio data, and video data. In a video call scenario, the downlink data comprises at least one of the following: ringtone video and call video.

5. The method of any one of claims 1-3, wherein: the first information carries the target optimization mode; or, 6. The method according to any one of claims 1 to 3, characterized in that, the first information carries optimization processing modes of multiple types of downlink data, and the target optimization mode is an optimization processing mode corresponding to the type of the downlink data. The type of the optimization processing mode comprises at least one of the following: three-dimensional special effect display processing, video super-resolution processing, and special effect synthesis processing.

7. The method of claim 6, wherein, The optimization processing mode comprises at least one of the following: AI model processing, algorithm processing, and rule processing.

8. The method according to any one of claims 1 to 3, characterized in that, The information carried by the first information comprises the following: service type, rendering task type, function type, and model identifier. The method further comprises the following steps: when the video call is initiated, receiving ringtone video and performing optimization processing on the ringtone video by using a first processing mode; when the video call is connected, receiving call video and performing optimization processing on the call video by using a second processing mode; 9. The method according to any one of claims 1 to 8, characterized in that, wherein the first processing mode is the same as or different from the second processing mode. The method further comprises the following steps: acquiring second information by using the IMS data channel, the second information being used to indicate that optimization processing on downlink data is closed; 10. A downlink data processing method, characterized by, when receiving the downlink data, rendering and displaying the downlink data. The method is applied to an IMS platform, and comprises the following steps: establishing an IMS data channel between the terminal and the IMS platform; 11. A downlink data processing apparatus, characterized by comprising: sending first information to the terminal by using the IMS data channel, the first information being used to indicate an optimization processing mode of downlink data. The method comprises the following steps: an acquiring unit is configured to acquire first information by using an IMS data channel, the first information being used to indicate an optimization processing mode of downlink data. An optimization unit is configured to perform optimization processing on the downlink data according to a target optimization manner to obtain target data when the downlink data is received, wherein the target optimization manner is at least one of the optimization manners. A display unit is configured to render and display the target data.

12. A downlink data processing apparatus, comprising: The method comprises the following steps: An establishment unit is configured to establish an IMS data channel with the terminal. A sending unit is configured to send first information to the terminal via the IMS data channel, wherein the first information is used to indicate an optimization manner of the downlink data.

13. A downlink data processing system, characterized by comprising: The method comprises the following steps: The terminal is configured to perform the method according to any one of claims 1-9. The IMS platform is configured to perform the method according to claim 10.

14. An electronic device, comprising: The method comprises the following steps: A memory is configured to store computer readable instructions. And A processor is configured to run the computer readable instructions, so that the electronic device performs the method according to any one of claims 1-10.

15. A non-transitory computer-readable storage medium storing computer-readable instructions, the computer-readable instructions comprising: When the computer readable instructions are executed by the processor, the processor performs the method according to any one of claims 1-10.

16. A computer program product, characterised in that, The computer program is executed by the processor to implement the method according to any one of claims 1-10.

Images