Data processing method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses a data processing method and device, equipment and a storage medium. The method comprises the steps that when a multimedia data request is received, redundancy indication information is obtained, the redundancy indication information is determined based on the network state between communication equipment and a receiving party of multimedia data, correction data of the multimedia data are configured according to the redundancy indication information, the multimedia data carrying the correction data are obtained, and the multimedia data are transmitted to the communication equipment through the communication equipment. And returning the multimedia data carrying the correction data to the receiving party of the multimedia data, so that the receiving party of the multimedia data restores the multimedia data based on the multimedia data carrying the correction data. Therefore, after the multimedia data provider obtains the multimedia data request, the data volume of the correction data is dynamically determined through the network state, and the relation between the data volume of the multimedia data and the data integrity can be balanced.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data processing method, a data processing device, a computer equipment and a computer-readable storage medium. Background Art

[0002] With the advancement of scientific and technological research, a huge amount of multimedia data has emerged on the Internet. Research has found that in the process of multimedia data transmission, if only multimedia data is transmitted, some data will be lost and the receiver will not obtain complete multimedia data; if additional correction data is added, the overall data volume will be too large and a large amount of transmission resources will be wasted. How to balance the relationship between the amount of multimedia data and data integrity during the transmission of multimedia data has become a hot research issue. Summary of the invention

[0003] The embodiments of the present application provide a data processing method, apparatus, device, and computer-readable storage medium that can balance the relationship between the data volume and data integrity of multimedia data.

[0004] On the one hand, an embodiment of the present application provides a data processing method, including:

[0005] When receiving a multimedia data request, obtaining redundancy indication information, the redundancy indication information being determined based on a network state between the communication device and a recipient of the multimedia data, the redundancy indication information being used to indicate an amount of redundant data associated with the multimedia data, the multimedia data corresponding to the multimedia data request;

[0006] According to the redundant indication information, correction data of the multimedia data is configured to obtain multimedia data carrying the correction data, where the correction data is used to detect and correct the multimedia data;

[0007] The multimedia data carrying the correction data is returned to a receiver of the multimedia data through the communication device, so that the receiver of the multimedia data can restore the multimedia data based on the multimedia data carrying the correction data.

[0008] In an embodiment of the present application, when a multimedia data request is received, redundant indication information is obtained, the redundant indication information is determined based on the network status between the communication device and the receiver of the multimedia data, correction data of the multimedia data is configured according to the redundant indication information, multimedia data carrying the correction data is obtained, and the multimedia data carrying the correction data is returned to the receiver of the multimedia data through the communication device, so that the receiver of the multimedia data restores the multimedia data based on the multimedia data carrying the correction data. It can be seen that after obtaining the multimedia data request, the provider of the multimedia data can dynamically determine the amount of the correction data through the network status, and can balance the relationship between the amount of the multimedia data and the data integrity.

[0009] On the one hand, an embodiment of the present application provides a data processing method, including:

[0010] When a multimedia service request is received, network status information is obtained, the network status information being used to indicate a network status between a receiver of multimedia data and a communication device, the multimedia data corresponding to the multimedia service request;

[0011] Based on the network status information, generating redundancy indication information, the redundancy indication information is used to indicate the amount of redundant data associated with the multimedia data;

[0012] Response information of the multimedia service request is returned to the sender of the multimedia service request, so that the sender of the multimedia service request configures correction data of the multimedia data based on the response information, and the response information includes redundancy indication information.

[0013] In the embodiment of the present application, when a multimedia service request is received, network status information is obtained, the network status information is used to indicate the network status between the receiver of the multimedia data and the communication device, and based on the network status information, redundant indication information is generated, and response information of the multimedia service request is returned to the sender of the multimedia service request, so that the sender of the multimedia service request configures the correction data of the multimedia data based on the response information. It can be seen that after receiving the multimedia service request, the service provider of the multimedia service generates redundant indication information through the network status, and returns the redundant indication information to the sender of the multimedia service request, and assists the sender of the multimedia service request to balance the relationship between the data volume and data integrity of the multimedia data through the redundant indication information.

[0014] On the one hand, an embodiment of the present application provides a data processing device, the data processing device comprising:

[0015] an acquisition unit, configured to acquire redundancy indication information when receiving a multimedia data request, the redundancy indication information being determined based on a network state between the communication device and a receiver of the multimedia data, the redundancy indication information being used to indicate an amount of redundant data associated with the multimedia data, the multimedia data corresponding to the multimedia data request;

[0016] A processing unit, configured to configure correction data of the multimedia data according to the redundant indication information, and obtain multimedia data carrying the correction data, wherein the correction data is used to detect and correct the multimedia data;

[0017] The sending unit is used to return the multimedia data carrying the correction data to the receiver of the multimedia data through the communication device, so that the receiver of the multimedia data can restore the multimedia data based on the multimedia data carrying the correction data.

[0018] In one implementation, the correction data is a redundant frame, and the multimedia data includes a set of M protocol data units, where M is an integer greater than 1; the processing unit is used to configure the correction data of the multimedia data according to the redundant indication information to obtain the multimedia data carrying the correction data, specifically for:

[0019] Filtering out N target protocol data unit sets from the M protocol data unit sets, wherein the N target protocol data unit sets all contain an instant decoding refresh frame, and N is a positive integer less than or equal to M;

[0020] According to the redundancy indication information, redundant frames of a set of N target protocol data units are configured to obtain multimedia data carrying the redundant frames;

[0021] The number of redundant frames of each target protocol data unit set is determined based on the redundant indication information.

[0022] In one implementation, the processing unit is used to configure redundant frames of a set of N target protocol data units according to the redundant indication information to obtain multimedia data carrying the redundant frames, specifically for:

[0023] Determine the number of redundant frames of each target protocol data unit set according to the redundancy indication information and the data volume of each target protocol data unit set, wherein the number of redundant frames of any target protocol data unit set is proportional to the data volume of the target protocol data unit set;

[0024] Based on the number of redundant frames of each target protocol data unit set, redundant frames are added to the N target protocol data unit sets respectively to obtain multimedia data carrying redundant frames.

[0025] In one implementation, the acquiring unit is used to, when receiving a multimedia data request, acquire the redundancy indication information, specifically for:

[0026] When receiving a multimedia data request, a multimedia service request is sent to the core network through the sending unit 703, and the multimedia service request carries the identity information of the sender of the multimedia service request;

[0027] Obtaining response information returned by the core network, where the response information includes at least one of redundancy indication information and network status information;

[0028] The network status information is used to indicate the network status between the communication device and the receiver of the multimedia data; the response information is returned after the identity information is verified.

[0029] In one embodiment, the network status information includes at least one of the following: signal strength, packet loss rate, and delay; when the response information does not include redundant indication information, the processing unit is further configured to:

[0030] If the network status information indicates that the network status is better than the status threshold, redundant indication information is generated based on the relationship between the network status information and the amount of redundant data; wherein the signal strength is inversely proportional to the amount of redundant data, the packet loss rate is proportional to the amount of redundant data, and the delay is proportional to the amount of redundant data;

[0031] If the network status information indicates that the network status is not better than the status threshold, the redundant indication information is set to a preset value.

[0032] In one embodiment, the processing unit is further configured to:

[0033] Acquiring network status confirmation information, the network status confirmation information including a target network status, the target network status being confirmed by at least one of a receiver of the multimedia data and a communication device;

[0034] Based on the target network status, determine the redundant data volume interval;

[0035] If the redundant data amount indicated by the redundant indication information belongs to the redundant data amount interval, the step of configuring the correction data of the multimedia data according to the redundant indication information to obtain the multimedia data carrying the correction data is continued.

[0036] In one embodiment, the processing unit is further configured to:

[0037] If the redundant data amount indicated by the redundant indication information does not belong to the redundant data amount interval, the redundant indication information is updated.

[0038] On the one hand, an embodiment of the present application provides a data processing device, the data processing device comprising:

[0039] an acquisition unit, configured to acquire network status information when receiving a multimedia service request, the network status information being used to indicate a network status between a receiver of multimedia data and a communication device, the multimedia data corresponding to the multimedia service request;

[0040] A processing unit, configured to generate redundancy indication information based on the network status information, wherein the redundancy indication information is used to indicate an amount of redundant data associated with the multimedia data;

[0041] The sending unit is used to return response information of the multimedia service request to the sender of the multimedia service request, so that the sender of the multimedia service request configures correction data of the multimedia data based on the response information, and the response information includes redundancy indication information.

[0042] In one embodiment, the processing unit is further configured to:

[0043] Acquiring network status confirmation information, the network status confirmation information including a target network status, the target network status being confirmed by at least one of a receiver of the multimedia data and a communication device;

[0044] Based on the target network status, determine the redundant data volume interval;

[0045] If the redundant data amount indicated by the redundant indication information belongs to the redundant data amount interval, then continue to execute the step of returning the response information of the multimedia service request to the sender of the multimedia service request;

[0046] If the redundant data amount indicated by the redundant indication information does not belong to the redundant data amount interval, the redundant indication information is updated.

[0047] In one implementation, the multimedia service request carries the identity information of the sender of the multimedia service request, and the processing unit is further configured to:

[0048] Verifying whether the sender of the multimedia service request has multimedia service request authority based on the identity information of the sender of the multimedia service request;

[0049] If the sender of the multimedia service request has the multimedia service request authority, then continue to execute the step of obtaining the network status information;

[0050] If the sender of the multimedia service request does not have the multimedia service request authority, the multimedia service request is rejected.

[0051] Accordingly, the present application provides a computer device, the computer device comprising:

[0052] a memory, wherein a computer program is stored in the memory;

[0053] The processor is used to load the computer program to implement the above data processing method.

[0054] Accordingly, the present application provides a computer-readable storage medium, which stores a computer program, and the computer program is suitable for being loaded by a processor and executing the above-mentioned data processing method.

[0055] Accordingly, the present application provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the above-mentioned data processing method.

[0056] In an embodiment of the present application, when a multimedia data request is received, a multimedia service request is sent to a service provider of the multimedia service, the service provider of the multimedia service obtains network status information, and based on the network status information, generates redundant indication information, the network status information is used to indicate the network status between the receiver of the multimedia data and the communication device; the sender of the multimedia service request obtains the redundant indication information, configures the correction data of the multimedia data according to the redundant indication information, obtains the multimedia data carrying the correction data, and returns the multimedia data carrying the correction data to the receiver of the multimedia data through the communication device, so that the receiver of the multimedia data can restore the multimedia data based on the multimedia data carrying the correction data. It can be seen that after obtaining the multimedia data request, the provider of the multimedia data dynamically determines the amount of the correction data through the network status, and can balance the relationship between the amount of the multimedia data and the data integrity. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0058] Figure 1 A schematic diagram of a network architecture provided for an embodiment of the present application;

[0059] Figure 2 A flowchart of a data processing method provided in an embodiment of the present application;

[0060] Figure 3 A flowchart of another data processing method provided in an embodiment of the present application;

[0061] Figure 4a A schematic diagram of a redundant frame configuration provided in an embodiment of the present application;

[0062] Figure 4b A data interaction flow chart provided for an embodiment of the present application;

[0063] Figure 5 A flowchart of another data processing method provided in an embodiment of the present application;

[0064] Figure 6 Another data interaction flow chart provided for an embodiment of the present application;

[0065] Figure 7 A schematic diagram of the structure of a data processing device provided in an embodiment of the present application;

[0066] Figure 8 A schematic diagram of the structure of another data processing device provided in an embodiment of the present application;

[0067] Fig. 9 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0068] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0069] This application involves technologies related to artificial intelligence. The following is a brief introduction to the related technologies involved:

[0070] Artificial Intelligence (AI): AI is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that the machines have the functions of perception, reasoning and decision-making. The embodiments of the present application mainly involve predicting the network status at the next moment based on input data (such as the current network status, historical data, etc.) through a network status prediction model.

[0071] AI technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level and software-level technologies. The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, pre-trained model technology, operation / interaction systems, mechatronics, etc. Among them, the pre-trained model is also called a large model or a basic model. After fine-tuning, it can be widely used in downstream tasks in various major directions of artificial intelligence. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0072] Machine Learning (ML) is a multi-disciplinary interdisciplinary subject involving probability theory, statistics, approximation theory, convex analysis, algorithmic complexity theory and other disciplines. It specializes in how computers simulate or implement human learning behavior to acquire new knowledge or skills and reorganize existing knowledge structures to continuously improve their performance. Machine learning is the core of artificial intelligence and the fundamental way to make computers intelligent. Its applications are spread across all areas of artificial intelligence. Machine learning and deep learning usually include artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and teaching learning. The pre-trained model is the latest development in deep learning, which integrates the above technologies. The embodiment of the present application mainly involves training a network state prediction model based on a training data set to further improve the prediction accuracy of the network state prediction model.

[0073] Based on the above-mentioned artificial intelligence-related technologies, an embodiment of the present application provides a data processing solution that can balance the relationship between the data volume and data integrity of multimedia data. Figure 1 A schematic diagram of a network architecture provided in an embodiment of the present application is shown as follows: Figure 1As shown, the network architecture provided by the present application includes a terminal device 101, a network status server 102, an extended reality and multimedia service (XRand multi-media service, XRM) server 103 and an application function (Application Function, AF) network element 104. The data processing solution provided by the present application can be executed by the core network or the application function network element 104. Among them, the terminal devices involved may include but are not limited to: smart phones (such as Android phones, IOS phones, etc.), tablet computers, portable personal computers, mobile Internet devices (Mobile Internet Devices, referred to as MID), intelligent voice interaction devices, smart home appliances, vehicle terminals, aircraft, wearable devices, etc., and the embodiments of the present application are not limited to this; the server involved may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network, content distribution network), and basic cloud computing services such as big data and artificial intelligence platforms, and the embodiments of the present application are not limited to this.

[0074] The core network includes a session management function (SMF) network element, a policy control function (PCF) network element, a network exposure function (NEF) network element, an authentication management function (AMF) network element, an application function (AF) network element or an application service (AS) network element; among them, the AF network element can implement the control plane function of a third-party application server and interact through AF-NEF-PCF or AF-PCF. The AS network element can implement the user plane function of a third-party application server and interact through the AS-IP transmission network-UPF. The NEF network element is located between the (5G) core network and the external third-party AF network element or AS network element, and is responsible for managing the externally open network data, that is, external third-party applications that want to access the internal data of the (5G) core network need to go through the NEF network element. The network status server 102 is responsible for detecting the network status between the terminal device 101 and the communication device, and the XRM service server 103 is responsible for processing the received multimedia service data packets and serving the terminal device 101. also, Figure 1The communication device in the example is a node for providing 5G wireless network (New Radio, NR) user plane and control plane protocols to the terminal device 101. The communication device is connected to the (5G) core network via the NG interface. The communication device can be a base station, a road side unit (Road Side Unit, RSU), a wireless local area network (Wi-Fi) device, etc.

[0075] It should be noted that Figure 1 The number of terminal devices 101, network status servers 102, extended reality and multimedia service servers 103, and application function network elements 104 is only used as an example and does not constitute an actual limitation of this application. The application function network element 104 can be included in the core network or can be independent of the core network, and this application does not limit this. The terminal device 101, the network status server 102, the extended reality and multimedia service server 103, and the application function network element 104 can be connected by wire or wirelessly, and this application does not limit this.

[0076] The general process of the data processing solution provided by this application is as follows:

[0077] (1) When the application function network element 104 receives the multimedia data request sent by the terminal device 101, the application function network element 104 sends a multimedia service request to the core network (network open function network element in the core network) to obtain related services of extended reality and multimedia services, which can be provided by the XRM service server 103. In one embodiment, the terminal device 101 establishes a protocol data unit (PDU) session with the application function network element 104 through the core network. After the terminal device 101 successfully establishes the PDU session with the application function network element 104, the terminal device 101 can send a multimedia data request to the application function network element 104 to obtain corresponding multimedia data (such as multimedia data of extended reality (XR)).

[0078] (2) When receiving a multimedia service request, the core network obtains network status information. The network status information is used to indicate the network status between the terminal device 101 (i.e., the recipient of the multimedia data) and the communication device. The network status information can be obtained by the network status server 102 periodically detecting the network status between the terminal device 101 and the communication device. In one embodiment, the multimedia service request includes the identity information of the sender of the multimedia service request. After receiving the multimedia service request, the core network will verify the identity information carried therein to determine whether the sender of the multimedia service request has the authority to obtain the related services of extended reality and multimedia services. After the identity information of the sender of the multimedia service request is verified, the core network provides the related services of extended reality and multimedia services (through the XRM service server 103) on the one hand, and obtains the network status information from the network status server 102 on the other hand, and continues to execute (3).

[0079] (3) The core network generates redundant indication information based on the network status information. The redundant indication information is used to indicate the amount of redundant data associated with the multimedia data, and the multimedia data corresponds to the multimedia data request (multimedia service request). In one embodiment, the network status information includes at least one of the following: signal strength, packet loss rate, and delay. If the network status information indicates that the network status is better than the status threshold, the core network generates redundant indication information based on the relationship between the network status information and the amount of redundant data; wherein the signal strength is inversely proportional to the amount of redundant data, the packet loss rate is proportional to the amount of redundant data, and the delay is proportional to the amount of redundant data. Correspondingly, if the network status information indicates that the network status is not better than the status threshold, the core network sets the redundant indication information to a preset value (such as an upper limit value of the amount of redundant data). After generating the redundant indication information, the core network may return the redundant indication information to the application function network element 104 as response information to the multimedia service request.

[0080] (4) The application function network element 104 obtains the redundant indication information, and configures the correction data of the multimedia data according to the redundant indication information, and obtains the multimedia data carrying the correction data. The correction data is used to detect and correct the multimedia data; specifically, the correction data can be used to verify whether there are errors in the multimedia data on the one hand, and on the other hand, when it is determined that there are errors in the multimedia data, the errors in the multimedia data can be corrected. The correction data is generated based on an error correction mechanism, and the error correction mechanism may include but is not limited to: forward error correction mechanism (Forward Error Correction, FEC) or hybrid error correction mechanism (Hybrid Error Correction, HEC).

[0081] In one embodiment, the correction data is a redundant frame, and the multimedia data includes M PDU sets, where M is an integer greater than 1. The application function network element 104 selects N target protocol data unit sets from the M protocol data unit sets, and the N target protocol data unit sets all include an instantaneous decoder refresh frame (IDR), where N is a positive integer less than or equal to M. The application function network element 104 configures the redundant frames of the N target protocol data unit sets according to the redundant indication information to obtain multimedia data carrying redundant frames; wherein the number of redundant frames of each target protocol data unit set is determined based on the redundant indication information.

[0082] (5) The application function network element 104 returns the multimedia data carrying the correction data to the terminal device 101 through the communication device. After receiving the multimedia data carrying the correction data, the terminal device 101 detects the multimedia data based on the correction data. If an error is detected in the received multimedia data, the terminal device 101 can correct the error in the multimedia data using the correction data carried by the multimedia data, without requesting the application function network element 104 to resend the multimedia data.

[0083] In an embodiment of the present application, when a multimedia data request is received, a multimedia service request is sent to a service provider of the multimedia service, the service provider of the multimedia service obtains network status information, and based on the network status information, generates redundant indication information, the network status information is used to indicate the network status between the receiver of the multimedia data and the communication device; the sender of the multimedia service request obtains the redundant indication information, configures the correction data of the multimedia data according to the redundant indication information, obtains the multimedia data carrying the correction data, and returns the multimedia data carrying the correction data to the receiver of the multimedia data through the communication device, so that the receiver of the multimedia data can restore the multimedia data based on the multimedia data carrying the correction data. It can be seen that after obtaining the multimedia data request, the provider of the multimedia data dynamically determines the amount of the correction data through the network status, and can balance the relationship between the amount of the multimedia data and the data integrity.

[0084] Based on the above data processing scheme, the embodiment of the present application proposes a more detailed data processing method. The data processing method proposed in the embodiment of the present application will be described in detail below in conjunction with the accompanying drawings.

[0085] See also Figure 2 , Figure 2 A flowchart of a data processing method provided in an embodiment of the present application, the data processing method can be executed by a computer device; the computer device can specifically be Figure 1 The application function network element 104 is shown. Figure 2As shown, the data processing method may include but is not limited to S201-S203:

[0086] S201. When a multimedia data request is received, obtain redundant indication information.

[0087] The redundancy indication information is determined based on a network state between the communication device and a receiver of the multimedia data. The redundancy indication information is used to indicate an amount of redundant data associated with the multimedia data. The multimedia data corresponds to a multimedia data request. The communication device is used to transmit data (such as a PDU set) between a computer device (a provider of multimedia data) and a receiver of the multimedia data (such as a user equipment (UE)).

[0088] In one implementation, when receiving a multimedia data request, the computer device sends a multimedia service request to the core network, and the multimedia service request may carry the identity information of the computer device (i.e., the sender of the multimedia service request). The computer device obtains the response information returned by the core network, and the response information includes at least one of redundant indication information and network status information; wherein the network status information is used to indicate the network status between the communication device and the recipient of the multimedia data, and the response information may be returned after the identity information of the computer device is verified.

[0089] In one embodiment, the network status information includes at least one of the following: signal strength, packet loss rate, and delay. When the response information does not include redundant indication information (i.e., the response information only includes network status information), if the network status information indicates that the network status is better than the status threshold, the computer device generates redundant indication information based on the relationship between the network status information and the amount of redundant data; wherein the signal strength is inversely proportional to the amount of redundant data, the packet loss rate is proportional to the amount of redundant data, and the delay is proportional to the amount of redundant data. Accordingly, if the network status information indicates that the network status is not better than the status threshold, the computer device sets the redundant indication information to a preset value (such as an upper limit value of the amount of redundant data).

[0090] For example, assuming that the network status information includes a packet loss rate, the status threshold is 30%, and the preset value is 10 frames (i.e., the number of redundant frames), when the network status information indicates that the packet loss rate is 10%, the computer device configures the redundant indication information (the number of redundant frames) to 3 frames; when the network status information indicates that the packet loss rate is 25%, the computer device configures the redundant indication information (the number of redundant frames) to 8 frames; when the network status information indicates that the packet loss rate is greater than 30%, the computer device configures the redundant indication information (the number of redundant frames) to 10 frames.

[0091] S202: configure correction data of the multimedia data according to the redundancy indication information to obtain multimedia data carrying the correction data.

[0092] The correction data is used to detect and correct the multimedia data; specifically, the correction data can be used to check whether there are errors in the multimedia data on the one hand, and on the other hand, when it is determined that there are errors in the multimedia data, the errors in the multimedia data can be corrected. The correction data is generated based on an error correction mechanism, which may include but is not limited to: forward error correction mechanism (Forward Error Correction, FEC) or hybrid error correction mechanism (Hybrid Error Correction, HEC).

[0093] In one embodiment, the correction data is a redundant frame, and the multimedia data includes M PDU sets, where M is an integer greater than 1. The computer device selects N target protocol data unit sets from the M protocol data unit sets, and the N target protocol data unit sets all include an instantaneous decoder refresh frame (IDR), where N is a positive integer less than or equal to M. The computer device configures the redundant frames of the N target protocol data unit sets according to the redundant indication information to obtain multimedia data carrying redundant frames; wherein the number of redundant frames of each target protocol data unit set is determined based on the redundant indication information.

[0094] In one embodiment, the computer device determines the number of redundant frames of each target protocol data unit set according to the redundant indication information and the data volume (the number of frames included) of each target protocol data unit set, and the number of redundant frames of any target protocol data unit set is proportional to the data volume of the target protocol data unit set. After determining the number of redundant frames of each target protocol data unit set, the computer device adds redundant frames to N target protocol data unit sets (such as the tail of the target protocol data unit set) based on the number of redundant frames of each target protocol data unit set, and obtains multimedia data carrying redundant frames.

[0095] For example, assuming that the number of target protocol data unit sets is 3, the redundancy indication information indicates that the total number of redundant frames is 10 frames, the length of target protocol data unit set 1 is 5, and the lengths of target protocol data unit set 2 and target protocol data unit set 3 are both 10, then the computer device determines that the number of redundant frames of target protocol data unit set 1 is 2, and the number of redundant frames of target protocol data unit set 2 and target protocol data unit set 3 are both 4.

[0096] In another embodiment, the correction data is a redundant frame, and the multimedia data includes M PDU sets, where M is an integer greater than 1. The computer device configures redundant frames of the M PDU sets based on the data volume of each PDU set to obtain multimedia data carrying redundant frames.

[0097] In another embodiment, the correction data is a redundant frame, and the multimedia data includes M PDU sets, where M is an integer greater than 1. The computer device selects N target protocol data unit sets from the M protocol data unit sets, and the N target protocol data unit sets all include I frames (Intra-coded frames), where N is a positive integer less than or equal to M. The computer device configures the redundant frames of the N target protocol data unit sets according to the redundant indication information to obtain multimedia data carrying redundant frames; wherein the number of redundant frames of each target protocol data unit set is determined based on the redundant indication information.

[0098] S203: Return the multimedia data carrying the correction data to a receiver of the multimedia data via the communication device.

[0099] The computer device returns the multimedia data carrying the correction data to the receiver of the multimedia data through the communication device, so that the receiver of the multimedia data can restore the multimedia data based on the multimedia data carrying the correction data. Specifically, after receiving the multimedia data carrying the correction data, the receiver of the multimedia data can detect the multimedia data based on the correction data. If an error is detected in the received multimedia data, the receiver of the multimedia data can correct the error in the multimedia data through the correction data carried by the multimedia data, without requesting the computer device to resend the multimedia data.

[0100] In an embodiment of the present application, when a multimedia data request is received, redundant indication information is obtained, the redundant indication information is determined based on the network status between the communication device and the receiver of the multimedia data, correction data of the multimedia data is configured according to the redundant indication information, multimedia data carrying the correction data is obtained, and the multimedia data carrying the correction data is returned to the receiver of the multimedia data through the communication device, so that the receiver of the multimedia data restores the multimedia data based on the multimedia data carrying the correction data. It can be seen that after obtaining the multimedia data request, the provider of the multimedia data can dynamically determine the amount of the correction data through the network status, and can balance the relationship between the amount of the multimedia data and the data integrity.

[0101] See also Figure 3 , Figure 3 A flowchart of another data processing method provided in an embodiment of the present application. The data processing method can be executed by a computer device, and the computer device can specifically be Figure 1The application function network element 104 is shown. Figure 3 As shown, the data processing method may include but is not limited to S301-S308:

[0102] S301: Establish a protocol data unit session with a user equipment.

[0103] In one embodiment, the process of establishing a PDU session between a user equipment (UE) and a computer device is as follows: ① The UE sends a Radio Resource Control (RRC) connection request to the core network to establish a connection with the core network. The connection request may include at least one of the following: the identity information of the UE, and the protocol version supported by the UE. ② The UE sends a PDU session request to the core network. The PDU request includes communication-related information between the UE and the computer device (i.e., the target terminal). The PDU session request includes at least one of the following: an identifier of the computer device (such as identity information), a data type of interactive data, etc. ③ After receiving the PDU session request, the core network sends a PDU session request to the computer device based on the identifier of the computer device. ④ After receiving the PDU session request sent by the core network, the computer device returns a response message of the PDU session request to the core network. The response message of the PDU session request is used to confirm whether to establish a PDU session with the UE. ⑤ The UE sends a PDU session confirmation message to the core network, and the confirmation message is used to confirm whether to establish a PDU session with the computer device. ⑥ When both the computer device and the UE confirm to establish a PDU session connection with each other, a PDU session between the computer device and the UE is established; in addition, the core network can also send a notification of successful PDU session establishment to the UE and the computer device.

[0104] S302: When a multimedia data request is received, a multimedia service request is sent to a core network.

[0105] After the UE establishes a PDU session with the computer device, it can obtain the corresponding multimedia data (such as multimedia data of extended reality) by sending a multimedia data request to the computer device. After receiving the multimedia data request, the computer device sends a multimedia service request to the core network to obtain related services of extended reality and multimedia services.

[0106] In one implementation, the multimedia service request carries the identity information of the computer device (i.e., the sender of the multimedia service request). The core network can verify the identity and related permissions of the computer device (such as whether it has the permission to obtain services related to extended reality and multimedia services) through the identity information, and return the response information of the multimedia service request to the computer device based on the verification result.

[0107] S303. Obtain response information returned by the core network.

[0108] If the identity information of the computer device passes the verification, the response information of the multimedia service request includes at least one of the redundant indication information and the network status information; wherein the network status information is used to indicate the network status between the communication device and the UE (i.e., the receiver of the multimedia data), and the redundant indication information is used to indicate the amount of redundant data associated with the multimedia data. It can be understood that in the specific implementation process, the redundant indication information can indicate the amount of redundant data associated with the multimedia data by indicating the size of the data packet, the number of data packets, etc., and this application does not limit this.

[0109] In one embodiment, the network state indicated by the network state information is: a predicted network state when sending required multimedia data to a UE (i.e., a recipient of the media data). In another embodiment, the network state indicated by the network state information is: obtained by the core network periodically detecting the network state between the communication device and the UE through a network state server.

[0110] In another embodiment, the network status information includes at least one of the following: signal strength, packet loss rate, delay. When the response information includes redundant indication information, the computer device continues to execute S304. When the response information does not include redundant indication information, the computer device determines the redundant indication information based on the network status information. Specifically, if the network status information indicates that the network status is better than the status threshold, the computer device generates redundant indication information based on the relationship between the network status information and the amount of redundant data; wherein the signal strength is inversely proportional to the amount of redundant data, the packet loss rate is proportional to the amount of redundant data, and the delay is proportional to the amount of redundant data. Accordingly, if the network status information indicates that the network status is not better than the status threshold, the computer device sets the redundant indication information to a preset value.

[0111] S304: Obtain network status confirmation information.

[0112] The network status confirmation information includes a target network status, where the target network status is used to indicate a network status between the communication device and the UE at a current moment, and the target network status is confirmed by at least one of the UE and the communication device.

[0113] In one implementation, the UE and the communication device may confirm the target network status through data packet interaction, and (either the UE or the communication device) generate network status confirmation information based on the confirmation result.

[0114] S305: Determine a redundant data volume interval based on the target network status.

[0115] In one embodiment, different network status intervals correspond to different redundant data volume intervals. The worse the network status, the larger the corresponding redundant data volume. When the target network status is not better than the status threshold, the corresponding redundant data volume is a preset value (such as the upper limit of the redundant data volume). After obtaining the target network status, the computer device determines the network status interval to which the target network status belongs, and then determines the redundant data volume interval corresponding to the target network status through the mapping relationship between the network status interval and the redundant data volume interval.

[0116] Further, after determining the redundant data volume interval corresponding to the target network state, the computer device detects whether the redundant data volume indicated by the redundant indication information belongs to the redundant data volume interval corresponding to the target network state. If the redundant data volume indicated by the redundant indication information belongs to the redundant data volume interval, then continue to execute S306; accordingly, if the redundant data volume indicated by the redundant indication information does not belong to the redundant data volume interval, then update the redundant indication information; for example, the computer device can update the redundant indication information based on the target network state; for another example, the computer device can obtain the updated redundant indication information from the core network according to the methods in S302 and S303.

[0117] It can be seen that by detecting redundant indication information through redundant data volume intervals, the accuracy of the redundant indication information can be improved, and the adverse effects of inaccurate redundant indication information on multimedia data transmission (such as causing the multimedia data to carry too much redundant data, or the correction data cannot correct the multimedia data, etc.) can be reduced.

[0118] S306: Filter out N target protocol data unit sets from the M protocol data unit sets.

[0119] The multimedia data consists of a set of M protocol data units, where M is an integer greater than 1.

[0120] In one embodiment, the computer device selects a protocol data unit set carrying an IDR frame from a set of M protocol data units as a target protocol data unit set. The IDR frame can be understood as a special I frame, that is, the IDR frame is included in the I frame. In another embodiment, the computer device selects a protocol data unit set carrying an I frame from a set of M protocol data units as a target protocol data unit set. In yet another embodiment, the computer device selects a protocol data unit set having a data volume greater than a data volume threshold from a set of M protocol data units as a target protocol data unit set.

[0121] S307: Configure redundant frames of a set of N target protocol data units according to the redundant indication information to obtain multimedia data carrying the redundant frames.

[0122] In one embodiment, the computer device determines the number of redundant frames of each target protocol data unit set according to the redundancy indication information and the data volume of each target protocol data unit set, and the number of redundant frames of any target protocol data unit set is proportional to the data volume of the target protocol data unit set. After determining the number of redundant frames of each target protocol data unit set, the computer device adds redundant frames to the N target protocol data unit sets respectively based on the number of redundant frames of each target protocol data unit set to obtain multimedia data carrying redundant frames.

[0123] Figure 4a A schematic diagram of a redundant frame configuration provided by an embodiment of the present application. Figure 4a As shown, the multimedia data includes protocol data unit set 1-protocol data unit set 3; wherein, protocol data unit set 1 and protocol data unit set 3 contain IDR frames. The computer device adds a corresponding number of redundant frames at the end of protocol data unit set 1 and protocol data unit set 3 respectively according to the redundant indication information and the data volume of the protocol data unit set, and keeps protocol data unit set 2 unchanged, thereby obtaining multimedia data carrying redundant frames. IDR frame (Instantaneous Decoder Refreshframe) is a special I frame (Intra-coded frame) in video coding, also known as key frame. In video coding, each I frame is independently encoded, while P frame (Predictive-coded frame) and B frame (Bidirectionally Predictive-coded frame) are obtained by predictive coding the previous frame. The difference between IDR frame and ordinary I frame is that IDR frame can be used as a reset point for the decoder, that is, when the decoder is decoding, if some frames after the IDR frame are lost, the decoder can restore the normal playback of the video by re-decoding the IDR frame.

[0124] S308. Return the multimedia data carrying the correction data to the receiver of the multimedia data through the communication device.

[0125] For the specific implementation of S308, please refer to Figure 2 The implementation of S203 is not described here in detail. In one embodiment, the correction data carried by the multimedia data is generated based on the forward error correction mechanism, and the multimedia data carrying the correction data sent by the computer device to the receiver of the multimedia data is a one-way transmission (that is, the receiver of the multimedia data does not need to return an acknowledgment character (Acknowledgment)), and there is no need to carry additional transmission information of the control channel, which can effectively reduce the end-to-end transmission delay.

[0126] Figure 4bA data interaction flow chart provided in an embodiment of the present application. Figure 4b As shown, the user equipment and the application function network element first establish a PDU session through the core network. After the PDU session is established, when the application function network element receives the multimedia data request sent by the user equipment, it sends a multimedia service request to the core network to obtain the related services of the extended reality and multimedia services. If the core network agrees to provide the related services of the extended reality and multimedia services, the network status between the communication device and the user equipment is periodically detected in the process of providing the related services of the extended reality and multimedia services, and the response information is returned to the application function network element. In one embodiment, the core network can determine the redundant indication information based on the network status information (used to indicate the network status between the communication device and the user equipment), and add the redundant indication to the response information and send it to the application function network element. Accordingly, the application function network element can directly obtain the redundant indication information from the response information. Optionally, the application function network element can obtain the network status confirmation information, and detect the redundant indication information based on the network status confirmation information (confirming accuracy). The specific implementation method can refer to the implementation methods in S304 and S305, which will not be repeated here. In another implementation method, the core network can directly add the network status information to the response information and send it to the application function network element. After obtaining the response information, the application function network element determines the redundant indication information through the network status information (since the network status information is obtained by periodic detection of the core network, the application function network element can also detect the redundant indication information after determining the redundant indication information). After confirming the redundant indication information, the application function network element generates multimedia data carrying redundant frames according to the redundant indication information. The specific implementation method can refer to the implementation method in S306 and S307, which will not be repeated here. The application function network element returns the multimedia data carrying redundant frames to the user equipment as the response information of the multimedia data request (through the communication device).

[0127] In the embodiment of the present application, when a multimedia data request is received, redundant indication information is obtained, the redundant indication information is determined based on the network status between the communication device and the receiver of the multimedia data, the correction data of the multimedia data is configured according to the redundant indication information, the multimedia data carrying the correction data is obtained, and the multimedia data carrying the correction data is returned to the receiver of the multimedia data through the communication device, so that the receiver of the multimedia data restores the multimedia data based on the multimedia data carrying the correction data. It can be seen that after obtaining the multimedia data request, the provider of the multimedia data dynamically determines the amount of correction data through the network status, which can balance the relationship between the amount of multimedia data and the data integrity. In addition, by detecting the redundant indication information through the redundant data amount interval, the accuracy of the redundant indication information can be improved, and the adverse effects of inaccurate redundant indication information on the transmission of multimedia data (such as causing the multimedia data to carry too much redundant data, or the correction data cannot correct the multimedia data, etc.) can be reduced; by unidirectionally transmitting the multimedia data carrying the correction data, the multimedia data receiver does not need to return the confirmation character, nor does it need to carry the transmission information of the control channel additionally, which can effectively reduce the end-to-end transmission delay.

[0128] See also Figure 5 , Figure 5 A flowchart of another data processing method provided in an embodiment of the present application, the data processing method can be executed by a computer device, and the computer device can specifically be Figure 1 The core network shown in Figure 1. Figure 5 As shown, the data processing method may include but is not limited to S501-S503:

[0129] S501. When a multimedia service request is received, network status information is obtained.

[0130] The network status information is used to indicate the network status between the receiver of multimedia data and the communication device. The multimedia data corresponds to the multimedia service request. The communication device is used to transmit data (such as a PDU set) between the provider of multimedia data and the receiver of multimedia data (such as a user device).

[0131] In one implementation, the multimedia service request carries the identity information of the sender of the multimedia service request. After receiving the multimedia service request, the computer device verifies whether the sender of the multimedia service request has the multimedia service request authority based on the identity information of the sender of the multimedia service request. If the sender of the multimedia service request has the multimedia service request authority, the computer device obtains the network status information. Correspondingly, if the sender of the multimedia service request does not have the multimedia service request authority, the computer device may reject the multimedia service request.

[0132] In another implementation, the core network includes a network exposure function (NEF) network element, a policy control function (PCF) network element and a session management function (SMF) network element. Before receiving a multimedia service request, the core network (computer device) can assist the multimedia data provider and the multimedia data receiver in establishing a PDU session connection. For specific implementations, please refer to Figure 3 The implementation method of S301 will not be repeated here. After the auxiliary multimedia data provider and the multimedia data receiver establish a PDU session connection, the process of the computer device obtaining the network status information is as follows: ① The NEF network element obtains the XRM service request initiated by the multimedia data provider, and the XRM service request can be recorded as NEF_Create request. ② The NEF network element authenticates the sender of the XRM service request. After the sender of the XRM service request passes the identity authentication, on the one hand, the sender of the XRM service request is authorized (that is, it agrees to provide the sender of the XRM service request with related services of extended reality and multimedia services); on the other hand, in the process of providing related services of extended reality and multimedia services, the core network can (such as through a network status server) periodically detect the network status between the communication device and the multimedia data receiver. ③ After authorizing the sender of the XRM service request, the NEF initiates a policy authorization request to the PCF, and the policy authorization request can be recorded as PCF_Policy Create request. ④After receiving the PCF_Policy Create request, PCF initiates a message session policy control update request to SMF to maintain the PDU session status of the current XRM service. The message session policy control update request can be recorded as SMPolicyControl_UpdateNotify request. ⑤After receiving the SMPolicyControl_UpdateNotify request from PCF, SMF can obtain the network status information and add the network status information to the feedback information of SMPolicyControl_UpdateNotify request. The feedback information can be recorded as SMPolicyControl_UpdateNotify response.

[0133] S502: Generate redundant indication information based on network status information.

[0134] The redundancy indication information is used to indicate the amount of redundant data associated with the multimedia data.

[0135] In one embodiment, the network status information includes at least one of the following: signal strength, packet loss rate, and delay. If the network status information indicates that the network status is better than the status threshold, the computer device generates redundancy indication information based on the relationship between the network status information and the amount of redundant data; wherein the signal strength is inversely proportional to the amount of redundant data, the packet loss rate is proportional to the amount of redundant data, and the delay is proportional to the amount of redundant data. Accordingly, if the network status information indicates that the network status is not better than the status threshold, the computer device sets the redundancy indication information to a preset value.

[0136] In another embodiment, after generating the redundant indication information, the computer device may also obtain network status confirmation information, the network status confirmation information including the target network status, the target network status is used to indicate the network status between the communication device and the UE at the current moment, and the target network status is confirmed by at least one of the UE and the communication device. The computer device determines the redundant data volume interval based on the target network status. After determining the redundant data volume interval corresponding to the target network status, the computer device detects whether the redundant data volume indicated by the redundant indication information belongs to the redundant data volume interval corresponding to the target network status. If the redundant data volume indicated by the redundant indication information belongs to the redundant data volume interval, S503 is continued to be executed; accordingly, if the redundant data volume indicated by the redundant indication information does not belong to the redundant data volume interval, the redundant indication information is updated; for example, the computer device may update the redundant indication information based on the target network status; for another example, the computer device may obtain the updated network status information according to the method in S501, and generate new redundant indication information based on the updated network status information.

[0137] S503: Return response information of the multimedia service request to the sender of the multimedia service request.

[0138] The response information includes redundant indication information. The computer device returns the response information of the multimedia service request to the sender of the multimedia service request, so that the sender of the multimedia service request configures the correction data of the multimedia data based on the response information. In one embodiment, the core network includes a network exposure function (Network Exposure Function, NEF) network element, a policy control function (Policy Control Function, PCF) network element and a session management function (Session Management Function, SMF) network element; the response information of the multimedia service request is generated by the PCF network element based on the network status information. The specific implementation method of the core network returning the response information of the multimedia service request to the sender of the multimedia service request is: the PCF network element returns the response information of the multimedia service request to the sender of the multimedia service request through the NEF network element, that is, the PCF network element first sends the response information of the multimedia service request to the NEF network element, and after receiving the response information of the multimedia service request, the NEF network element forwards it to the sender of the multimedia service request.

[0139] Figure 6 Another data interaction flow chart provided in the embodiment of the present application. Figure 6As shown, the application function network element and the user equipment first establish a PDU session. For specific implementation methods, please refer to the implementation methods in S301, which will not be repeated here. After the PDU session is established, (the network status server) periodically detects the network status between the user equipment and the communication equipment, and sends the detection results to the policy control function at a certain frequency. When the application function network element receives a multimedia service request sent by the user equipment, it sends a multimedia service request (XRM service request) to the network open function network element, and the multimedia service request can be recorded as NEF_Create request. The network open function network element authenticates the sender of the XRM service request. After the sender of the XRM service request passes the identity authentication, the sender of the XRM service request is authorized (that is, it agrees to provide the sender of the XRM service request with related services of extended reality and multimedia services). After authorizing the sender of the XRM service request, the network open function network element initiates a policy authorization request to the policy control function network element, and the policy authorization request can be recorded as PCF_Policy Create request. After receiving the policy authorization request, the policy control function network element initiates a message session policy control update request to the session management function network element to maintain the PDU session state of the current XRM service. The message session policy control update request can be recorded as SMPolicyControl_UpdateNotify request. After receiving the session policy control update request, the session management function network element maintains the PDU session state of the current XRM service and replies feedback information to the policy control function network element. The feedback information can be recorded as SMPolicyControl_UpdateNotifyresponse. The policy control function network element obtains the latest network status information and determines the redundant indication information based on the network status information. After obtaining the redundant indication information, the policy control function network element can also detect the redundant indication information based on the network status confirmation information. The specific implementation method can refer to the implementation method in S502, which will not be repeated here. The policy control function network element adds the obtained redundant indication information to the response information and returns the response information to the application function network element through the network open function network element. The network open function network element generates multimedia data carrying the correction data based on the redundancy indication information carried in the response information, and sends the multimedia data carrying the correction data to the user equipment (through the communication device).

[0140] In the embodiment of the present application, when a multimedia service request is received, network status information is obtained, the network status information is used to indicate the network status between the receiver of the multimedia data and the communication device, and based on the network status information, redundant indication information is generated, and response information of the multimedia service request is returned to the sender of the multimedia service request, so that the sender of the multimedia service request configures the correction data of the multimedia data based on the response information. It can be seen that after receiving the multimedia service request, the service provider of the multimedia service dynamically generates redundant indication information through the network status, and returns the redundant indication information to the sender of the multimedia service request. Through the redundant indication information, the sender of the multimedia service request is assisted to balance the relationship between the data volume and data integrity of the multimedia data, so that the transmitted multimedia data is more adapted to the real-time status of the network.

[0141] The method of the embodiment of the present application is described in detail above. In order to facilitate better implementation of the above scheme of the embodiment of the present application, the device of the embodiment of the present application is provided below accordingly.

[0142] See also Figure 7 , Figure 7 A schematic diagram of the structure of a data processing device provided in an embodiment of the present application, the device can be mounted on a computer device, and the computer device can specifically be Figure 1 The application function network element 104 is shown. Figure 7 The data processing device shown can be used to perform the above Figure 2 and Figure 3 Some or all of the functions of the described method embodiments. Figure 7 , the detailed description of each unit is as follows:

[0143] an acquiring unit 701, configured to acquire redundancy indication information when receiving a multimedia data request, the redundancy indication information being determined based on a network state between the communication device and a receiver of the multimedia data, the redundancy indication information being used to indicate an amount of redundant data associated with the multimedia data, the multimedia data corresponding to the multimedia data request;

[0144] A processing unit 702, configured to configure correction data of the multimedia data according to the redundancy indication information, and obtain multimedia data carrying the correction data, where the correction data is used to detect and correct the multimedia data;

[0145] The sending unit 703 is used to return the multimedia data carrying the correction data to the receiver of the multimedia data through the communication device, so that the receiver of the multimedia data can restore the multimedia data based on the multimedia data carrying the correction data.

[0146] In one implementation, the correction data is a redundant frame, and the multimedia data includes a set of M protocol data units, where M is an integer greater than 1; the processing unit 702 is used to configure the correction data of the multimedia data according to the redundant indication information to obtain the multimedia data carrying the correction data, specifically for:

[0147] Filtering out N target protocol data unit sets from the M protocol data unit sets, wherein the N target protocol data unit sets all contain an instant decoding refresh frame, and N is a positive integer less than or equal to M;

[0148] According to the redundancy indication information, redundant frames of a set of N target protocol data units are configured to obtain multimedia data carrying the redundant frames;

[0149] The number of redundant frames of each target protocol data unit set is determined based on the redundant indication information.

[0150] In one implementation, the processing unit 702 is configured to configure redundant frames of a set of N target protocol data units according to the redundant indication information to obtain multimedia data carrying the redundant frames, specifically for:

[0151] Determine the number of redundant frames of each target protocol data unit set according to the redundancy indication information and the data volume of each target protocol data unit set, wherein the number of redundant frames of any target protocol data unit set is proportional to the data volume of the target protocol data unit set;

[0152] Based on the number of redundant frames of each target protocol data unit set, redundant frames are added to the N target protocol data unit sets respectively to obtain multimedia data carrying redundant frames.

[0153] In one implementation, the acquisition unit 701 is used to, when receiving a multimedia data request, acquire redundancy indication information, specifically for:

[0154] When receiving a multimedia data request, a multimedia service request is sent to the core network through the sending unit 703, and the multimedia service request carries the identity information of the sender of the multimedia service request;

[0155] Obtaining response information returned by the core network, where the response information includes at least one of redundancy indication information and network status information;

[0156] The network status information is used to indicate the network status between the communication device and the receiver of the multimedia data; the response information is returned after the identity information is verified.

[0157] In one implementation, the network status information includes at least one of the following: signal strength, packet loss rate, and delay; when the response information does not include redundant indication information, the processing unit 702 is further configured to:

[0158] If the network status information indicates that the network status is better than the status threshold, redundant indication information is generated based on the relationship between the network status information and the amount of redundant data; wherein the signal strength is inversely proportional to the amount of redundant data, the packet loss rate is proportional to the amount of redundant data, and the delay is proportional to the amount of redundant data;

[0159] If the network status information indicates that the network status is not better than the status threshold, the redundant indication information is set to a preset value.

[0160] In one implementation, the processing unit 702 is further configured to:

[0161] Acquiring network status confirmation information, the network status confirmation information including a target network status, the target network status being confirmed by at least one of a receiver of the multimedia data and a communication device;

[0162] Based on the target network status, determine the redundant data volume interval;

[0163] If the redundant data amount indicated by the redundant indication information belongs to the redundant data amount interval, the step of configuring the correction data of the multimedia data according to the redundant indication information to obtain the multimedia data carrying the correction data is continued.

[0164] In one implementation, the processing unit 702 is further configured to:

[0165] If the redundant data amount indicated by the redundant indication information does not belong to the redundant data amount interval, the redundant indication information is updated.

[0166] According to one embodiment of the present application, Figure 2 and Figure 3 Some of the steps involved in the data processing method shown can be represented by Figure 7 The data processing device shown in the figure is executed by each unit. For example, Figure 2 The S201 shown in FIG. Figure 7 The acquisition unit 701 shown in FIG. 1 is executed, and S202 can be performed by Figure 7 The processing unit 702 shown in FIG. 1 is executed, and S203 may be performed by Figure 7 The sending unit 703 is shown to execute. Figure 3 S303 and S304 shown in FIG. Figure 7 The acquisition unit 701 shown in FIG. 1 is executed, and S301 and S305-S307 can be performed by Figure 7 The processing unit 702 shown in FIG. 1 is executed, and S302 and S308 can be performed by Figure 7 The sending unit 703 is shown to execute. Figure 7 The various units in the data processing device shown can be respectively or all combined into one or several other units to constitute, or some of the units (some) can also be split into multiple smaller units in function to constitute, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In practical applications, the function of a unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of the present application, the data processing device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.

[0167] According to another embodiment of the present application, the program can be executed by running on a general computing device such as a computer including a central processing unit (CPU), a random access memory medium (RAM), a read-only memory medium (ROM) and other processing elements and storage elements. Figure 2 and Figure 3 A computer program (including program code) for each step involved in the corresponding method shown in Figure 7 The data processing device shown in and the data processing method of the embodiment of the present application are implemented. The computer program can be recorded on, for example, a computer readable recording medium, and loaded into the above-mentioned computing device through the computer readable recording medium and run therein.

[0168] Based on the same inventive concept, the principles and beneficial effects of solving the problems by the data processing device provided in the embodiment of the present application are similar to the principles and beneficial effects of solving the problems by the data processing method in the method embodiment of the present application. Please refer to the principles and beneficial effects of the implementation of the method. For the sake of concise description, they will not be repeated here.

[0169] See also Figure 8 , Figure 8 A schematic diagram of the structure of a data processing device provided in an embodiment of the present application, the device can be mounted on a computer device, and the computer device can specifically be Figure 1 The core network shown. Figure 8 The data processing device shown can be used to perform the above Figure 5 Some or all of the functions of the described method embodiments. Figure 8 , the detailed description of each unit is as follows:

[0170] The acquisition unit 801 is used to acquire network status information when receiving a multimedia service request, the network status information is used to indicate the network status between the receiver of the multimedia data and the communication device, and the multimedia data corresponds to the multimedia service request;

[0171] The processing unit 802 is used to generate redundancy indication information based on the network state information, where the redundancy indication information is used to indicate the amount of redundant data associated with the multimedia data;

[0172] The sending unit 803 is used to return response information of the multimedia service request to the sender of the multimedia service request, so that the sender of the multimedia service request configures correction data of the multimedia data based on the response information, and the response information includes redundancy indication information.

[0173] In one implementation, the processing unit 802 is further configured to:

[0174] Acquiring network status confirmation information, the network status confirmation information including a target network status, the target network status being confirmed by at least one of a receiver of the multimedia data and a communication device;

[0175] Based on the target network status, determine the redundant data volume interval;

[0176] If the redundant data amount indicated by the redundant indication information belongs to the redundant data amount interval, then continue to execute the step of returning the response information of the multimedia service request to the sender of the multimedia service request;

[0177] If the redundant data amount indicated by the redundant indication information does not belong to the redundant data amount interval, the redundant indication information is updated.

[0178] In one implementation, the multimedia service request carries the identity information of the sender of the multimedia service request, and the processing unit 802 is further configured to:

[0179] Verifying whether the sender of the multimedia service request has multimedia service request authority based on the identity information of the sender of the multimedia service request;

[0180] If the sender of the multimedia service request has the multimedia service request authority, then continue to execute the step of obtaining the network status information;

[0181] If the sender of the multimedia service request does not have the multimedia service request authority, the multimedia service request is rejected.

[0182] According to one embodiment of the present application, Figure 5 Some of the steps involved in the data processing method shown can be represented by Figure 8 The data processing device shown in the figure is executed by each unit. For example, Figure 5 The S501 shown in FIG. Figure 8 The acquisition unit 801 shown in FIG. 8 is executed, and S502 can be performed by Figure 8 The processing unit 802 shown in FIG. 8 is executed, and S503 may be performed by Figure 8 The sending unit 803 is shown to execute. Figure 8The various units in the data processing device shown can be respectively or all combined into one or several other units to constitute, or some of the units (some) can also be split into multiple smaller units in function to constitute, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In practical applications, the function of a unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of the present application, the data processing device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.

[0183] According to another embodiment of the present application, the program can be executed by running on a general computing device such as a computer including a central processing unit (CPU), a random access memory medium (RAM), a read-only memory medium (ROM) and other processing elements and storage elements. Figure 5 A computer program (including program code) for each step involved in the corresponding method shown in Figure 8 The data processing device shown in and the data processing method of the embodiment of the present application are implemented. The computer program can be recorded on, for example, a computer readable recording medium, and loaded into the above-mentioned computing device through the computer readable recording medium and run therein.

[0184] Based on the same inventive concept, the principles and beneficial effects of solving the problems by the data processing device provided in the embodiment of the present application are similar to the principles and beneficial effects of solving the problems by the data processing method in the method embodiment of the present application. Please refer to the principles and beneficial effects of the implementation of the method. For the sake of concise description, they will not be repeated here.

[0185] See also Fig. 9 , Fig. 9 A schematic diagram of the structure of a computer device provided in an embodiment of the present application is shown in FIG. Fig. 9As shown, the computer device at least includes a processor 901, a communication interface 902 and a memory 903. Among them, the processor 901, the communication interface 902 and the memory 903 can be connected via a bus or other means. The processor 901 (or central processing unit (CPU)) is the computing core and control core of the computer device, which can parse various instructions in the computer device and process various data of the computer device. For example, the CPU can be used to parse the power on and off instructions sent by the user to the computer device, and control the computer device to perform power on and off operations; for example, the CPU can transmit various interactive data between the internal structures of the computer device, and so on. The communication interface 902 can optionally include a standard wired interface, a wireless interface (such as WI-FI, a mobile communication interface, etc.), which can be used to send and receive data under the control of the processor 901; the communication interface 902 can also be used for the transmission and interaction of data within the computer device. The memory 903 (Memory) is a memory device in the computer device, which is used to store programs and data. It can be understood that the memory 903 here can include both the built-in memory of the computer device and the extended memory supported by the computer device. The memory 903 provides a storage space, which stores the operating system of the computer device, including but not limited to: Android system, iOS system, Windows Phone system, etc., which is not limited in this application.

[0186] The embodiment of the present application also provides a computer-readable storage medium (Memory), which is a memory device in a computer device for storing programs and data. It is understandable that the computer-readable storage medium here can include both built-in storage media in the computer device and, of course, extended storage media supported by the computer device. The computer-readable storage medium provides a storage space that stores the processing system of the computer device. In addition, one or more instructions suitable for being loaded and executed by the processor 901 are also stored in the storage space, and these instructions can be one or more computer programs (including program codes). It should be noted that the computer-readable storage medium here can be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk storage; optionally, it can also be at least one computer-readable storage medium located away from the aforementioned processor.

[0187] In one embodiment, the computer device may specifically be Figure 1 The application function network element 104 shown. The processor 901 performs the following operations by running the executable program code in the memory 903:

[0188] When receiving a multimedia data request, obtaining redundancy indication information, the redundancy indication information being determined based on a network state between the communication device and a recipient of the multimedia data, the redundancy indication information being used to indicate an amount of redundant data associated with the multimedia data, the multimedia data corresponding to the multimedia data request;

[0189] According to the redundant indication information, correction data of the multimedia data is configured to obtain multimedia data carrying the correction data, where the correction data is used to detect and correct the multimedia data;

[0190] The multimedia data carrying the correction data is returned to a receiver of the multimedia data through the communication device, so that the receiver of the multimedia data can restore the multimedia data based on the multimedia data carrying the correction data.

[0191] As an optional embodiment, the correction data is a redundant frame, and the multimedia data includes a set of M protocol data units, where M is an integer greater than 1; the processor 901 configures the correction data of the multimedia data according to the redundant indication information, and obtains a specific embodiment of the multimedia data carrying the correction data:

[0192] Filtering out N target protocol data unit sets from the M protocol data unit sets, wherein the N target protocol data unit sets all contain an instant decoding refresh frame, and N is a positive integer less than or equal to M;

[0193] According to the redundancy indication information, redundant frames of a set of N target protocol data units are configured to obtain multimedia data carrying the redundant frames;

[0194] The number of redundant frames of each target protocol data unit set is determined based on the redundant indication information.

[0195] As an optional embodiment, the processor 901 configures redundant frames of N target protocol data unit sets according to the redundant indication information, and obtains a specific embodiment of multimedia data carrying redundant frames:

[0196] Determine the number of redundant frames of each target protocol data unit set according to the redundancy indication information and the data volume of each target protocol data unit set, wherein the number of redundant frames of any target protocol data unit set is proportional to the data volume of the target protocol data unit set;

[0197] Based on the number of redundant frames of each target protocol data unit set, redundant frames are added to the N target protocol data unit sets respectively to obtain multimedia data carrying redundant frames.

[0198] As an optional embodiment, when receiving a multimedia data request, the processor 901 obtains the redundancy indication information in a specific embodiment as follows:

[0199] When receiving a multimedia data request, sending a multimedia service request to the core network, the multimedia service request carries the identity information of the sender of the multimedia service request;

[0200] Obtaining response information returned by the core network, where the response information includes at least one of redundancy indication information and network status information;

[0201] The network status information is used to indicate the network status between the communication device and the receiver of the multimedia data; the response information is returned after the identity information is verified.

[0202] As an optional embodiment, the network status information includes at least one of the following: signal strength, packet loss rate, and delay; when the response information does not include redundant indication information, the processor 901 further performs the following operations by running the executable program code in the memory 903:

[0203] If the network status information indicates that the network status is better than the status threshold, redundant indication information is generated based on the relationship between the network status information and the amount of redundant data; wherein the signal strength is inversely proportional to the amount of redundant data, the packet loss rate is proportional to the amount of redundant data, and the delay is proportional to the amount of redundant data;

[0204] If the network status information indicates that the network status is not better than the status threshold, the redundant indication information is set to a preset value.

[0205] As an optional embodiment, the processor 901 further performs the following operations by running the executable program code in the memory 903:

[0206] Acquiring network status confirmation information, the network status confirmation information including a target network status, the target network status being confirmed by at least one of a receiver of the multimedia data and a communication device;

[0207] Based on the target network status, determine the redundant data volume interval;

[0208] If the redundant data amount indicated by the redundant indication information belongs to the redundant data amount interval, the step of configuring the correction data of the multimedia data according to the redundant indication information to obtain the multimedia data carrying the correction data is continued.

[0209] As an optional embodiment, the processor 901 further performs the following operations by running the executable program code in the memory 903:

[0210] If the redundant data amount indicated by the redundant indication information does not belong to the redundant data amount interval, the redundant indication information is updated.

[0211] In another embodiment, the computer device may specifically be Figure 1The processor 901 performs the following operations by running the executable program code in the memory 903:

[0212] When a multimedia service request is received, network status information is obtained, the network status information being used to indicate a network status between a receiver of multimedia data and a communication device, the multimedia data corresponding to the multimedia service request;

[0213] Based on the network status information, generating redundancy indication information, the redundancy indication information is used to indicate the amount of redundant data associated with the multimedia data;

[0214] Response information of the multimedia service request is returned to the sender of the multimedia service request, so that the sender of the multimedia service request configures correction data of the multimedia data based on the response information, and the response information includes redundancy indication information.

[0215] As an optional embodiment, the processor 901 further performs the following operations by running the executable program code in the memory 903:

[0216] Acquiring network status confirmation information, the network status confirmation information including a target network status, the target network status being confirmed by at least one of a receiver of the multimedia data and a communication device;

[0217] Based on the target network status, determine the redundant data volume interval;

[0218] If the redundant data amount indicated by the redundant indication information belongs to the redundant data amount interval, then continue to execute the step of returning the response information of the multimedia service request to the sender of the multimedia service request;

[0219] If the redundant data amount indicated by the redundant indication information does not belong to the redundant data amount interval, the redundant indication information is updated.

[0220] As an optional embodiment, the multimedia service request carries the identity information of the sender of the multimedia service request, and the processor 901 further performs the following operations by running the executable program code in the memory 903:

[0221] Verifying whether the sender of the multimedia service request has multimedia service request authority based on the identity information of the sender of the multimedia service request;

[0222] If the sender of the multimedia service request has the multimedia service request authority, then continue to execute the step of obtaining the network status information;

[0223] If the sender of the multimedia service request does not have the multimedia service request authority, the multimedia service request is rejected.

[0224] Based on the same inventive concept, the principles and beneficial effects of solving the problems provided by the computer device in the embodiment of the present application are similar to the principles and beneficial effects of solving the problems provided by the data processing method in the method embodiment of the present application. Please refer to the principles and beneficial effects of the implementation of the method. For the sake of concise description, they will not be repeated here.

[0225] An embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored. The computer program is suitable for being loaded by a processor and executing the data processing method of the above method embodiment.

[0226] The embodiment of the present application also provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the above-mentioned data processing method.

[0227] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0228] The modules in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0229] In the embodiments of the present application, the "module" or "unit" involved refers to a computer program or a part of a computer program with a predetermined function, and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0230] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the readable storage medium can include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0231] What is disclosed above is only a preferred embodiment of the present application, and it certainly cannot be used to limit the scope of rights of the present application. Ordinary technicians in this field can understand that all or part of the processes of implementing the above embodiment and equivalent changes made according to the claims of the present application are still within the scope covered by the application.

Claims

1. A data processing method, It is characterized in that The method comprises: When receiving a multimedia data request, obtaining redundancy indication information, the redundancy indication information being determined based on a network state between the communication device and a recipient of the multimedia data, the redundancy indication information being used to indicate an amount of redundant data associated with the multimedia data, the multimedia data corresponding to the multimedia data request; configuring correction data of the multimedia data according to the redundant indication information to obtain multimedia data carrying the correction data, wherein the correction data is used to detect and correct the multimedia data; The multimedia data carrying the correction data is returned to the receiver of the multimedia data through the communication device, so that the receiver of the multimedia data can restore the multimedia data based on the multimedia data carrying the correction data.

2. The method according to claim 1, It is characterized in that The correction data is a redundant frame, the multimedia data includes a set of M protocol data units, where M is an integer greater than 1; and configuring the correction data of the multimedia data according to the redundant indication information to obtain the multimedia data carrying the correction data includes: Filtering out N target protocol data unit sets from the M protocol data unit sets, wherein the N target protocol data unit sets all contain an instant decoding refresh frame, and N is a positive integer less than or equal to M; According to the redundancy indication information, redundant frames of the N target protocol data unit sets are configured to obtain multimedia data carrying redundant frames; The number of redundant frames of each target protocol data unit set is determined based on the redundant indication information.

3. The method according to claim 2, It is characterized in that The configuring redundant frames of the N target protocol data unit sets according to the redundant indication information to obtain multimedia data carrying redundant frames includes: Determine the number of redundant frames of each target protocol data unit set according to the redundancy indication information and the data volume of each target protocol data unit set, wherein the number of redundant frames of any target protocol data unit set is proportional to the data volume of the target protocol data unit set; Based on the number of redundant frames of each target protocol data unit set, redundant frames are respectively added to the N target protocol data unit sets to obtain multimedia data carrying redundant frames.

4. The method according to claim 1, It is characterized in that The step of obtaining redundant indication information when a multimedia data request is received includes: When receiving a multimedia data request, sending a multimedia service request to the core network, the multimedia service request carrying the identity information of the sender of the multimedia service request; Acquire response information returned by the core network, where the response information includes at least one of redundancy indication information and network status information; The network status information is used to indicate the network status between the communication device and the recipient of the multimedia data; and the response information is returned after the identity information is verified.

5. The method according to claim 4, It is characterized in that The network status information includes at least one of the following: signal strength, packet loss rate, and delay; when the response information does not include the redundant indication information, the method further includes: If the network status information indicates that the network status is better than the status threshold, redundancy indication information is generated based on the relationship between the network status information and the amount of redundant data; wherein the signal strength is inversely proportional to the amount of redundant data, the packet loss rate is proportional to the amount of redundant data, and the delay is proportional to the amount of redundant data; If the network status information indicates that the network status is not better than the status threshold, the redundant indication information is set to a preset value.

6. The method according to claim 1, It is characterized in that The method further comprises: Acquire network status confirmation information, the network status confirmation information including a target network status, the target network status being confirmed by at least one of a receiver of the multimedia data and the communication device; Determining a redundant data volume interval based on the target network state; If the redundant data amount indicated by the redundant indication information belongs to the redundant data amount range, the step of configuring the correction data of the multimedia data according to the redundant indication information to obtain the multimedia data carrying the correction data is continued.

7. The method according to claim 6, It is characterized in that The method further comprises: If the redundant data amount indicated by the redundant indication information does not belong to the redundant data amount interval, the redundant indication information is updated.

8. A data processing method, It is characterized in that The method comprises: When a multimedia service request is received, obtaining network status information, the network status information being used to indicate a network status between a recipient of multimedia data and a communication device, the multimedia data corresponding to the multimedia service request; Based on the network status information, generating redundancy indication information, the redundancy indication information is used to indicate the amount of redundant data associated with the multimedia data; Returning response information of the multimedia service request to the sender of the multimedia service request, so that the sender of the multimedia service request configures correction data of the multimedia data based on the response information, wherein the response information includes the redundancy indication information.

9. The method according to claim 8, It is characterized in that The method further comprises: Acquire network status confirmation information, the network status confirmation information including a target network status, the target network status being confirmed by at least one of a receiver of the multimedia data and the communication device; Determining a redundant data volume interval based on the target network state; If the redundant data amount indicated by the redundant indication information belongs to the redundant data amount interval, continuing to execute the step of returning the response information of the multimedia service request to the sender of the multimedia service request; If the redundant data amount indicated by the redundant indication information does not belong to the redundant data amount interval, the redundant indication information is updated.

10. The method according to claim 8, It is characterized in that The multimedia service request carries identity information of a sender of the multimedia service request, and the method further includes: Verifying, based on the identity information of the sender of the multimedia service request, whether the sender of the multimedia service request has multimedia service request authority; If the sender of the multimedia service request has the multimedia service request authority, then continue to execute the step of obtaining the network status information; If the sender of the multimedia service request does not have the multimedia service request authority, the multimedia service request is rejected.

11. A data processing device, It is characterized in that The data processing device comprises: an acquiring unit, configured to acquire redundancy indication information when receiving a multimedia data request, the redundancy indication information being determined based on a network state between the communication device and a receiver of the multimedia data, the redundancy indication information being used to indicate an amount of redundant data associated with the multimedia data, the multimedia data corresponding to the multimedia data request; a processing unit, configured to configure correction data of the multimedia data according to the redundant indication information, and obtain multimedia data carrying the correction data, wherein the correction data is used to detect and correct the multimedia data; The sending unit is used to return the multimedia data carrying the correction data to the receiver of the multimedia data through the communication device, so that the receiver of the multimedia data can restore the multimedia data based on the multimedia data carrying the correction data.

12. A data processing device, It is characterized in that The data processing device comprises: an acquiring unit, configured to acquire network status information when receiving a multimedia service request, the network status information being used to indicate a network status between a receiver of multimedia data and a communication device, the multimedia data corresponding to the multimedia service request; a processing unit, configured to generate redundancy indication information based on the network status information, wherein the redundancy indication information is used to indicate an amount of redundant data associated with the multimedia data; The sending unit is used to return the response information of the multimedia service request to the sender of the multimedia service request, so that the sender of the multimedia service request configures the correction data of the multimedia data based on the response information, and the response information includes the redundancy indication information.

13. A computer device, It is characterized in that include: a memory, wherein a computer program is stored in the memory; A processor, used to load the computer program to implement the data processing method according to any one of claims 1 to 7; or used to load the computer program to implement the data processing method according to any one of claims 8 to 10.

14. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, which is suitable for being loaded by a processor and executing the data processing method as described in any one of claims 1-7; or is suitable for being loaded by a processor and executing the data processing method as described in any one of claims 8-10.

Images