Communication processing method and device, equipment and readable storage medium

Abstract

The invention discloses a communication processing method and device, equipment and a readable storage medium, and the method comprises the steps that a transmitting end transmits a plurality of streams or a plurality of packets, and the plurality of streams or the plurality of packets meet a synchronization demand or a coordination demand.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to a communication processing method, device, equipment and readable storage medium. Background Art

[0002] Existing extended reality (XR) or cloud gaming (CG) services include multiple packets or multiple streams. Since the Quality of Service (QoS) requirements and operations between each packet or stream are independent, problems such as lag, dizziness, and inconsistency between images or audio may occur in XR or CG services, affecting user service experience. Summary of the invention

[0003] The embodiments of the present application provide a communication processing method, apparatus, device and readable storage medium to solve the problem of how to improve user service experience.

[0004] In a first aspect, a communication processing method is provided, comprising:

[0005] The sending end sends multiple streams or multiple packets, and the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0006] In a second aspect, a communication processing method is provided, including:

[0007] The receiving end receives multiple streams or multiple packets, and the multiple different streams or multiple packets meet synchronization requirements or coordination requirements.

[0008] In a third aspect, a communication processing device is provided, including:

[0009] The sending module is used to send multiple streams or multiple packets, and the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0010] In a fourth aspect, a communication processing device is provided, including:

[0011] The receiving module is used to receive multiple streams or multiple packets, where the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0012] In a fifth aspect, a communication device is provided, comprising: a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect or the second aspect.

[0013] In a sixth aspect, a readable storage medium is provided, on which a program or instruction is stored. When the program or instruction is executed by a processor of a sending end, the steps of the method described in the first aspect are implemented, or when the program or instruction is executed by a processor of a receiving end, the steps of the method described in the second aspect are implemented.

[0014] In the seventh aspect, a chip is provided, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the steps of the method described in the first aspect or the second aspect.

[0015] In an eighth aspect, a computer program / program product is provided, wherein the computer program / program product is stored in a non-volatile storage medium, and the program / program product is executed by at least one processor to implement the steps of the method described in the first aspect or the second aspect.

[0016] In a ninth aspect, a communication system is provided, the communication system comprising a transmitting end and a receiving end, the transmitting end is used to execute the steps of the method described in the first aspect, and the receiving end is used to execute the steps of the method described in the second aspect.

[0017] In an embodiment of the present application, the multiple streams or multiple packets sent by the sending end meet the synchronization requirements or coordination requirements, avoiding the freeze and dizziness caused by the asynchrony between the multiple streams or multiple packets, or the incoordination between the picture or audio, thereby improving the user's service experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a schematic diagram of XR business;

[0019] Figure 2 This is a schematic diagram of the interactions and operations in XR services.

[0020] Figure 3 It is a schematic diagram of 5G architecture;

[0021] Figure 4 A schematic diagram of the architecture of a wireless communication system according to an embodiment of the present application;

[0022] Figure 5 One of the flowcharts of a communication processing method provided in an embodiment of the present application;

[0023] Figure 6 This is a second flowchart of a communication processing method provided in an embodiment of the present application;

[0024] Figure 7 One of the schematic diagrams of a communication processing device provided in an embodiment of the present application;

[0025] Figure 8The second schematic diagram of a communication processing device provided by an embodiment of the present application;

[0026] Figure 9 The schematic diagram of a terminal provided by an embodiment of the present application;

[0027] Figure 10 The schematic diagram of a network-side device provided by an embodiment of the present application;

[0028] Figure 11 The schematic diagram of a communication device provided by an embodiment of the present application. Specific embodiments

[0029] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0030] The terms "first", "second", etc. in the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such terms can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are usually of the same type, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "or" in the present application means at least one of the connected objects. For example, "A or B" covers three scenarios, namely, Scenario 1: including A and not including B; Scenario 2: including B and not including A; Scenario 3: including both A and B. The character " / " generally indicates that the related objects before and after are in an "or" relationship.

[0031] The term "indicate" in the present application can be either a direct indication (or an explicit indication) or an indirect indication (or an implicit indication). Among them, a direct indication can be understood as that the sender clearly tells the receiver specific information, operations to be performed, or request results, etc. in the sent indication; an indirect indication can be understood as that the receiver determines the corresponding information according to the indication sent by the sender, or makes a judgment and determines the operations to be performed or request results, etc. according to the judgment result.

[0032] It should be noted that the technology described in the embodiments of this application is not limited to Long Term Evolution (LTE) / LTE-Advanced (LTE-A) systems, and can also be used in other wireless communication systems, such as Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Frequency Division Multiple Access (FDMA), Orthogonal Frequency Division Multiple Access (OFDMA), Single-carrier Frequency Division Multiple Access (SC-FDMA), or other systems. The terms "system" and "network" in this application are often used interchangeably, and the described technology can be used in the above-mentioned systems and radio technologies, as well as in other systems and radio technologies. The following description describes the New Radio (NR) system for example purposes, and the NR term is used in most of the following descriptions, but these technologies can also be applied to systems other than NR system applications, such as the 6th th Generation (6G) communication system.

[0033] To facilitate the understanding of the embodiments of this application, the following technical points will be introduced first:

[0034] 1. Extended reality (XR) services

[0035] XR refers to all real and virtual combined environments and human-computer interactions generated by computer technology and wearable devices. As Figure 1 shown, XR includes representative forms such as Augmented Reality (AR), Mixed Reality (MR), Virtual Reality (VR), etc., as well as the cross fields between them. The level of the virtual world ranges from partial sensory input to fully immersive virtual reality. A key aspect of XR is the extension of human experience, especially the experience related to presence (represented by VR) and cognitive acquisition (represented by AR).

[0036] For VR services, the uplink mainly transmits relatively dense small data packets, which can carry information such as gestures and controls, serving as the input and reference for the downlink presentation data; the downlink mainly transmits multimedia data such as video and audio. Through the timely reception and presentation of this multimedia data, an immersive experience is provided to the user. Taking the downlink video data as an example, the data packets arrive periodically or quasi-periodically, with a data rate reaching dozens or even hundreds of Megabits PerSecond (Mbps). The typical value of the frame rate (Frames per second, FPS) is 60 or 120, and the interval between adjacent data packets is approximately 1 / FPS seconds. These data generally need to be successfully transmitted within 10 ms over the air interface, and the transmission success rate requirement is not less than 99% or even 99.9%.

[0037] For AR services, in addition to the above-mentioned dense small data packet transmission, multimedia data such as video and audio may also be transmitted. Its service characteristics are similar to those of the downlink, usually with a relatively low data rate, for example, up to dozens of Mbps at most, and the time limit for air interface transmission can also be relaxed, for example, it generally needs to be successfully transmitted within 60 ms; the downlink data transmission characteristics are basically the same as those of VR services.

[0038] Users hope to interact and operate in extended reality, such as Figure 2 shown. Actions and interactions include movements, gestures, and body reactions. Therefore, Degrees of Freedom (DoF) describes the number of independent parameters used to define the movement of the viewport in 3D space.

[0039] In the application scenario of XR, users can obtain information on new viewing angles through actions such as turning their heads during a virtual reality experience. At this time, the XR user's head-turning action can be notified to the base station by sending an uplink signal. After receiving the uplink signal, the base station will schedule the required downlink data for the XR user for use.

[0040] XR services mainly include video data, audio data, as well as some control signaling and special data with control functions. In a wireless network, the transmission of XR services mainly involves the uplink and downlink video / audio data transmission and interaction between the User Equipment (UE) and the radio through a new network (such as Long Term Evolution (LTE) / New Radio (NR), etc.). Among them, while transmitting video and audio data itself, the UE needs to transmit some control signaling and special data with control functions through the wireless network uplink to generate, process, and downlink the video and audio service data in the XR services sent by the control network to the UE.

[0041] These control information and special data with control functions include some service control data generated by the UE XR application encoder and the control data information included in the service transmission protocol. For example:

[0042] A. At the application layer, it can include but is not limited to:

[0043] (1) I-frames or non-Field of View (non-FOV) frames generated by the video encoder;

[0044] (2) User behavior data collected by sensors, such as pose / control data, etc. The network can judge user behavior through the reception of these data. For example, actions such as the user turning their head can be detected, and then the content of the transmitted video data can be adjusted accordingly.

[0045] B. At the transmission protocol layer, it can include:

[0046] (1) Transmission Control Protocol Acknowledgment (TCP ACK) signaling (TCP feedback) for downlink audio / video service transmission. The network needs to decide whether to continue sending subsequent frames based on whether the corresponding video / audio frames have been acknowledged by the UE.

[0047] (2) Real-time Transport Control Protocol Acknowledgment (RTCP ACK) signaling, which is a control signaling for controlling the real-time transmission of data, and is used to confirm the real-time requirements and time synchronization of service data transmission.

[0048] The network usually needs to receive these control signaling and special data with control functions from the UE in a timely and reliable manner to obtain the current transmission status of the service and relevant necessary control information. The application server needs to further generate the subsequent required video and audio service data based on this information, and submit it to the wireless network for processing and transmission, and finally send these service data downlink to the UE.

[0049] 2. Packet Data Convergence Protocol (PDCP) layer and radio bearer.

[0050] The service data generated by the application layer (APP) of the UE is classified into different service data streams according to their corresponding Quality-of-Service (QoS) requirements, and each service data stream corresponds to the same or similar QoS requirements. In the NR system, the service data stream corresponds to a QoS flow, while in the LTE system, the service data stream corresponds to an Evolved Packet System (EPS) bearer.

[0051] The service data is delivered to the Access Stratum (AS) layer in the form of packets, and in the AS layer, it is further mapped to a Radio Bearer according to the corresponding QoS flow (NR) or EPS bearer (LTE). A Radio Bearer includes a PDCP entity (PDCP protocol layer processing entity), a Radio Link Control (RLC) entity (PDCP protocol layer processing entity), and the corresponding logical channel (located at the Medium Access Control (MAC) protocol layer).

[0052] When a data packet delivered to the AS layer is mapped to a radio bearer, it will be delivered to the corresponding PDCP entity for processing in the form of a PDCP service data unit (SDU). The PDCP entity will generate a corresponding PDCP protocol data unit (PDU) for each arriving PDCP SDU and set a PDCP sequence number (SN) to indicate the transmission order corresponding to each PDCP SDU and its corresponding PDCP PDU in the PDCP entity. Among them, the value of the PDCP SN is set according to the order in which the PDCP SDUs are delivered to the PDCP entity. The earlier the PDCP SDU arrives at the PDCP entity, the earlier its transmission order. Specifically, the PDCP entity will maintain an internal variable, TX_NEXT, which represents the total number of PDCP PDUs transmitted by the PDCP entity and is used to set the value of the PDCP SN. When the PDCP entity is established, it is initialized to 0. After each PDCP SDU is delivered from the upper layers to the corresponding PDCP entity, the PDCP entity will set the SN of the PDCP PDU corresponding to the PDCP SDU to TX_NEXT and increment TX_NEXT by 1. Subsequently, the PDCP entity will add a header file to each PDCP SDU to generate the corresponding PDCP PDU, which contains the SN value set for the PDCP PDU. The PDCP entity usually delivers the PDCP PDUs to the lower protocol layer (RLC) in the order of the SNs contained in the PDCP PDUs for subsequent processing and transmission. Among them, the SN is an ordinal number indicating which one the PDCP SDU is in terms of transmission order.

[0053] The general principle is that the earlier the PDCP SDU arrives at the PDCP entity, the smaller the SN value and the earlier the transmission.

[0054] 3. 5G Architecture

[0055] See Figure 3 , The 5G system consists of an access network (AN) and a 5G core network (5GC). If considering the non-standalone architecture (NSA) scenario, the network elements of the fourth-generation mobile communication technology (4G) also need to be considered.

[0056] There are two types of ANs:

[0057] (1) Next Generation NodeB (gNB) provides the protocol endpoints of the NR user plane and control plane for the UE.

[0058] (2) New Generation Enhanced NodeB (ng-eNB) provides the protocol endpoints of the user plane and control plane of the Evolved Universal Terrestrial Radio Access (E-UTRA) for the UE.

[0059] Figure 4 The block diagram of a wireless communication system to which the embodiments of the present application can be applied is shown. The wireless communication system includes a terminal 41 and a network-side device 42.

[0060] Among them, the terminal 41 can be a mobile phone, a tablet personal computer, a laptop computer, a notebook computer, a personal digital assistant (PDA), a handheld computer, a netbook, an ultra-mobile personal computer (UMPC), a mobile internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, a flight vehicle, a vehicle user equipment (VUE), a shipborne device, a pedestrian user equipment (PUE), a smart home (home appliances with wireless communication functions, such as refrigerators, TVs, washing machines or furniture, etc.), a game console, a personal computer (PC), a teller machine or a self-service machine, etc., which are terminal-side devices. Wearable devices include: smart watches, smart bracelets, smart earphones, smart glasses, smart jewelry (such as smart bracelets, smart bracelets, smart rings, smart necklaces, smart anklets, smart ankle chains, etc.), smart wristbands, smart clothing, etc. Among them, the vehicle user equipment can also be referred to as a vehicle terminal, a vehicle controller, a vehicle module, a vehicle component, a vehicle chip or a vehicle unit, etc. In addition to the above terminal devices, the terminal involved in this application can also be a chip inside the terminal, such as a modem chip or a system on chip (SoC). It should be noted that the specific type of the terminal 41 is not limited in the embodiments of this application.

[0061] The network-side device 42 may include an access network device or a core network device. Among them, the access network device may also be referred to as a radio access network device, a radio access network (RAN), a radio access network function, or a radio access network unit. The access network device may include a base station, a wireless local area network (WLAN) access point (AP), or a wireless fidelity (WiFi) node, etc. The base station may be referred to as Node B (NB), evolved Node B (eNB), next generation Node B (gNB), New Radio Node B (NR Node B), access point, relay base station (RBS), serving base station (SBS), base transceiver station (BTS), radio base station, radio transceiver, basic service set (BSS), extended service set (ESS), home Node B (HNB), home evolved Node B, transmission reception point (TRP), or some other suitable term in the art. As long as the same technical effect is achieved, the base station is not limited to a specific technical term. It should be noted that in the embodiments of this application, only the base station in the NR system is taken as an example for introduction, and the specific type of the base station is not limited.

[0062] The core network device may include, but is not limited to, at least one of the following: core network node, core network function, Mobility Management Entity (MME), Access and Mobility Management Function (AMF), Session Management Function (SMF), User Plane Function (UPF), Policy Control Function (PCF), Policy and Charging Rules Function (PCRF), Edge Application Server Discovery Function (EASDF), Unified Data Management (UDM), Unified Data Repository (UDR), Home Subscriber Server (HSS), Centralized network configuration (CNC), Network Repository Function (NRF), Network Exposure Function (NEF), Local NEF (L-NEF), Binding Support Function (BSF), etc. It should be noted that in the embodiments of this application, only the core network devices in the NR system are taken as examples for introduction, and the specific types of core network devices are not limited.

[0063] The following will, with reference to the accompanying drawings, describe in detail the communication processing method, apparatus, communication device, and readable storage medium provided by the embodiments of this application through some embodiments and their application scenarios.

[0064] See Figure 5 , the embodiments of this application provide a communication processing method, which is executed by a sending end. For example, the sending end may be a terminal, a network-side device, a device corresponding to a core network node, or a server-side device. The specific steps include: Step 501.

[0065] Step 501: The sending end sends multiple streams or multiple packets, and the multiple streams or multiple packets meet the synchronization requirements or coordination requirements.

[0066] In this application, meeting the synchronization requirements among multiple packets (per-Packet) or among multiple streams (per-Stream / Per-QoS) can be understood as at least one of the following: (1) maintaining a certain synchronization relationship among multiple packets or multiple streams at the sending end, that is, meeting the synchronization requirements. For example, the sending times of multiple packets or multiple streams at the sending end are close or they are sent simultaneously at the sending end, etc. (2) maintaining a certain synchronization relationship in the buffers of the multiple packets or multiple streams at the sending end, that is, meeting the synchronization requirements or coordination requirements. For example, the buffer times of multiple packets or multiple streams at the sending end are close or they are at the same time, etc.

[0067] Meeting the coordination requirements among multiple packets or multiple streams can be understood as at least one of the following: (1) multiple packets or multiple streams maintain a synchronization relationship through coordination at the sending end, enabling the sending times of multiple packets or multiple streams at the sending end to be close or sent simultaneously. (2) the buffers of multiple packets or multiple streams at the sending end maintain a synchronization relationship through coordination, enabling the buffer times of multiple packets or multiple streams at the sending end to be close or at the same time, thereby enhancing the user's service experience.

[0068] Optionally, the buffer in this application includes at least one of, but is not limited to, a display buffer, a presentation buffer, a rendering buffer, and a processing buffer.

[0069] In the embodiments of this application, multiple packets include at least one of the following:

[0070] (1) Multiple packets of the same user;

[0071] (2) Multiple packets of different users;

[0072] For example, different users include different users under the same base station or cell (Cell) or distributed unit (Distributed Unit, DU) or centralized unit (Centralized Unit, CU) or core network (Core Network, CN) or radio access network (Radio Acess Network, RAN) or public land mobile network (Public Land Mobile Network, PLMN) or network, or different users under different base stations or cells or DUs or CUs or CNs or RANs or PLMNs or networks.

[0073] (3) Multiple packets of the same UE;

[0074] (4) Multiple packets of different UEs;

[0075] For example, different UEs include different UEs of the same user (such as different UEs of the same user, including but not limited to at least one of the following: watch, glove, headset, helmet, glasses, mobile phone, AR / VR device), or different UEs of different users.

[0076] (5) Multiple packets of the same stream;

[0077] (6) Multiple packets of different streams;

[0078] For example, different streams include different streams of the same UE, or different streams of different UEs.

[0079] (7) Multiple packets of the same Quality of Service (QoS) flow;

[0080] (8) Multiple packets of different QoS flows;

[0081] For example, different QoS flows include different QoS flows of the same UE, or different QoS flows of different UEs. Alternatively, different QoS flows include different QoS flows of the same stream, or different QoS flows of different streams.

[0082] (9) Multiple packets in the same Internet Protocol (IP) or User Datagram Protocol (UDP) packet;

[0083] (10) Multiple packets in different IP or UDP packets;

[0084] For example, different IP or UDP packets include different IP or UDP packets of the same UE or stream, or different IP or UDP packets of different UEs or streams.

[0085] (11) Multiple packets in the same burst;

[0086] (12) Multiple packets in different bursts;

[0087] For example, different bursts include different bursts of the same stream or IP or UDP packet or QoS flow, or different bursts of different streams or IP or UDP packets or QoS flows.

[0088] (13) Multiple packets in the same bearer;

[0089] (14) Multiple packets in different Bearers;

[0090] (15) Multiple packets in the same PDU session;

[0091] (16) Multiple packets in different PDU sessions;

[0092] (17) Multiple packets in the same PDU set;

[0093] (18) Multiple packets in different PDU sets;

[0094] For example, different PDU sets include different PDU sets of the same stream or IP or UDP packet or QoS flow, or different PDU sets of different streams or IP or UDP packets or QoS flows.

[0095] (19) Multiple packets in the same PDU;

[0096] (20) Multiple packets in different PDUs;

[0097] (21) Multiple packets in the same Data Radio Bearer (DRB);

[0098] (22) Multiple packets in different DRBs;

[0099] For example, different DBRs include different DBRs of the same stream or IP or UDP packet or QoS flow, or different DBRs of different streams or IP or UDP packets or QoS flows.

[0100] (23) Multiple packets in the same service;

[0101] (24) Multiple packets in different services.

[0102] Among them, the above packets can be at least one of the following: Packet, Burst, PDU set, PDU, Service Data Unit (SDU), DRB, Transport Block (TB). The packets can be at least one of the following: Burst, PDU set, PDU, SDU, DRB, TB. For example, one Packet includes multiple Bursts, one Burst includes multiple PDU sets, one PDU set includes multiple PDUs, etc.

[0103] Among them, the multiple packets include: two or more packets.

[0104] In one implementation of the present application, the multiple packets satisfying a synchronization requirement or a coordination requirement include: a delay difference between the multiple packets is less than or equal to a first preset threshold.

[0105] Optionally, the delay difference includes one of the following: latency, delay gap, and difference.

[0106] Optionally, the first preset threshold value may be defined by a protocol, or configured by a server, a core network, a base station or an application layer.

[0107] In this embodiment, the synchronization requirement or coordination requirement can be implicitly met by the delay requirement of the packet or stream with synchronization requirement or coordination requirement, that is, if a packet or stream with synchronization requirement or coordination requirement has synchronization requirement or coordination requirement, the delay requirement of the packet or stream needs to be met. For example, the delay requirement means that the delay difference between multiple packets is less than or equal to the first preset threshold.

[0108] In one embodiment of the present application, the delay difference between the multiple packets includes at least one of the following:

[0109] (1) The delay difference between multiple packets received at the receiving end;

[0110] In one embodiment, the delay difference between multiple packets received at the receiving end represents the maximum synchronization error allowed for the multiple packets at the receiving end. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the multiple packets to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0111] (2) Delay difference between multiple packets sent at the sending end; in one embodiment, the delay difference between multiple packets sent at the sending end represents the maximum synchronization error allowed for multiple packets at the sending end. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between multiple packets to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0112] (3) The delay difference between one or more packets received at the receiving end and other packets sent at the sending end;

[0113] In one embodiment, the delay difference between one or more packets received at the receiving end and other packets sent at the sending end represents the maximum synchronization error allowed between "one or more packets" and "other packets" (between multiple packets). Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between multiple packets to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0114] For example, the delay difference between packet A received at the receiving end and packet B sent at the sending end can be the maximum allowable synchronization error. If the synchronization is not possible beyond this maximum allowable value, it means that packet A and packet B do not meet the synchronization or coordination relationship. (4) The delay difference between one or more packets sent at the sending end and other packets received at the receiving end;

[0115] In one embodiment, the delay difference between one or more packets sent at the transmitting end and other packets received at the receiving end represents the maximum synchronization error allowed between "one or more packets" and "other packets" (between multiple packets). Once the delay difference is exceeded, it may cause the synchronization or coordination requirements to be unable to be met between multiple packets, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0116] For example, the delay difference between packet C sent at the transmitting end and packet D received at the receiving end may be the maximum allowable synchronization error. If synchronization is not possible beyond this maximum allowable error, it means that packet C and packet D do not satisfy the synchronization or coordination relationship.

[0117] (5) The delay difference between multiple packets in the buffer;

[0118] It should be noted that the delay difference of a packet in the cache refers to the time difference between the time when the packet is stored in the cache and the time when it is used. In one embodiment, the delay difference of multiple packets in the cache represents the maximum synchronization error allowed for multiple packets in the cache. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between multiple packets to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0119] (6) The delay difference of multiple packets arriving at the cache.

[0120] It should be noted that the delay difference of packets arriving at the cache refers to the time difference between the ideal time for packets to arrive at the cache and the time when they actually arrive at the cache. In one embodiment, the delay difference of multiple packets arriving at the cache represents the maximum synchronization error allowed for multiple packets in the cache. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between multiple packets to fail, thereby causing service freezes, dizziness, or incoordination between images or audio.

[0121] In one embodiment of the present application, when the packet includes multiple packets, the delay difference between the multiple packets includes at least one of the following:

[0122] (1) a delay difference between first packets respectively included in the plurality of packets;

[0123] In one embodiment, the delay difference between the first groups of multiple packets represents the maximum synchronization error allowed between the first groups of multiple packets. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the first groups of multiple packets to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0124] (2) The delay difference between the last packets included in multiple packets;

[0125] In one embodiment, the delay difference between the last groups of multiple packets represents the maximum synchronization error allowed between the last groups of multiple packets. Once the delay difference is exceeded, the synchronization or coordination requirements between the last groups of multiple packets may not be met, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0126] (3) a delay difference between a first packet of a first packet and a last packet of a last packet of the plurality of packets;

[0127] In one embodiment, the delay difference between the first group and the last group of multiple packets represents the maximum synchronization error allowed between the first group and the last group of multiple packets. Once the delay difference is exceeded, the synchronization or coordination requirements between the first group and the last group of multiple packets may not be met, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0128] (4) a delay difference between the last packet of the first packet of the plurality of packets and the first packet of the last packet;

[0129] In one embodiment, the delay difference between the first group and the last group of multiple packets represents the maximum synchronization error allowed between the first group and the last group of multiple packets. Once the delay difference is exceeded, the synchronization or coordination requirements between the first group and the last group of multiple packets may not be met, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0130] (5) the delay difference between the average time or average delay of the first preset packets respectively included in the multiple packets being sent from the transmitting end;

[0131] For example, the average time or average delay of the first preset packet of packet A being sent from the sending end is X, and the average time or average time of the first preset packet of packet B being sent from the sending end is Y, then the delay difference is XY, or YX.

[0132] In one embodiment, once the maximum synchronization error between the average time or average delay of the first preset groups of multiple packets sent at the sending end exceeds the delay difference, it may cause the average time or average delay of the first preset groups of multiple packets sent at the sending end to fail to meet the synchronization or coordination requirements, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0133] (6) a delay difference between the maximum delays of the second preset packets respectively included in the plurality of packets being sent from the transmitting end;

[0134] For example, the maximum delay of the second preset packet of packet A sent from the sending end is X, and the maximum delay of the second preset packet of packet B sent from the sending end is Y, then the delay difference is XY, or YX.

[0135] In one embodiment, once the maximum synchronization error between the maximum delays of the second preset groups of multiple packets sent at the sending end exceeds the delay difference, it may cause the second preset groups of multiple packets to be unable to meet the synchronization or coordination requirements between the maximum delays of the second preset groups of multiple packets sent at the sending end, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0136] (7) The delay difference between the maximum delay and the minimum delay of the third preset packets respectively included in the multiple packets when sent from the transmitting end.

[0137] For example, the maximum delay of the third preset packet of packet A being sent from the sending end is X, and the minimum delay of the third preset packet of packet B being sent from the sending end is Y, then the delay difference is XY.

[0138] In one embodiment, once the maximum synchronization error between the maximum delay and the minimum delay of the third preset group of multiple packets sent from the sending end exceeds the delay difference, it may cause the maximum delay and the minimum delay of the third preset group of multiple packets sent from the sending end to fail to meet the synchronization or coordination requirements, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0139] (8) the average time or average delay of the fourth preset packets respectively included in the plurality of packets reaching the receiving end;

[0140] For example, the average time or average delay for the fourth preset packet of packet A to arrive at the receiving end is X, and the average time or average time for the fourth preset packet of packet B to arrive at the receiving end is Y, then the delay difference is XY, or YX.

[0141] In one embodiment, once the maximum synchronization error between the average time or average delay for the fourth preset grouping of multiple packets to arrive at the receiving end exceeds the delay difference, it may cause the average time or average delay for the fourth preset grouping of multiple packets to arrive at the receiving end to fail to meet the synchronization or coordination requirements, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0142] (9) a delay difference between the maximum delays of the fifth preset packets respectively included in the plurality of packets reaching the receiving end;

[0143] For example, the maximum delay for the fifth preset packet of packet A to reach the receiving end is X, and the maximum delay for the fifth preset packet of packet B to reach the receiving end is Y, then the delay difference is XY, or YX.

[0144] In one embodiment, once the maximum synchronization error between the maximum delays for the fifth preset groups of multiple packets to arrive at the receiving end exceeds the delay difference, it may cause the maximum delays for the fifth preset groups of multiple packets to arrive at the receiving end to fail to meet the synchronization or coordination requirements, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0145] (10) The delay difference between the maximum delay and the minimum delay for the sixth preset packets respectively included in the multiple packets to reach the receiving end.

[0146] For example, the maximum delay for the sixth preset packet of packet A to reach the receiving end is X, and the minimum delay for the sixth preset packet of packet B to reach the receiving end is Y, then the delay difference is XY.

[0147] In one embodiment, the maximum synchronization error between the maximum delay and the minimum delay for the sixth preset group of multiple packets to arrive at the receiving end, once it exceeds the delay difference, may cause the maximum delay and the minimum delay for the sixth preset group of multiple packets to arrive at the receiving end to fail to meet the synchronization or coordination requirements, thereby causing service freezes, dizziness, or incoordination between pictures or audios.

[0148] In one implementation of the present application, the first packet includes a first packet in the first time information, and the first packet includes one of the following:

[0149] (1) The first-ranked package;

[0150] (2) The first packet sent from the sender;

[0151] (3) The first packet to arrive at the cache;

[0152] (4) The first packet to arrive at the receiving end.

[0153] In an implementation of the present application, the last packet includes a second packet within the second time information, and the second packet includes one of the following:

[0154] (1) The packet sorted last;

[0155] (2) The last packet sent from the sending end;

[0156] (3) The last packet arriving at the buffer;

[0157] (4) The last packet arriving at the receiving end.

[0158] In an implementation of the present application, the first preset grouping or the second preset grouping or the third preset grouping or the fourth preset grouping or the fifth preset grouping or the sixth preset grouping includes one of the following:

[0159] (1) All the groupings within the packet;

[0160] (2) A preset proportion of the groupings within the packet;

[0161] (3) A preset number of the groupings within the packet;

[0162] (4) The first grouping;

[0163] (5) The last grouping;

[0164] (6) The groupings within the packet with a delay not exceeding the second preset threshold;

[0165] (7) The groupings within the packet with a delay not less than the third preset threshold.

[0166] Optionally, the second preset threshold value and the third preset threshold can be defined by the protocol or configured through a server, a core network, a base station, or an application layer, etc.

[0167] In an implementation of the present application, the first grouping includes one of the following:

[0168] (1) The first sorted grouping among multiple groupings within the packet, that is, the grouping with the first number;

[0169] (2) The first packet sent from the sending end;

[0170] (3) The first packet arriving at the buffer;

[0171] (4) The first packet arriving at the receiving end.

[0172] In an implementation of the present application, the last grouping includes one of the following:

[0173] (1) The last sorted grouping among multiple groupings within the packet;

[0174] (2) The last packet sent from the sending end;

[0175] (3) The last packet reaching the buffer;

[0176] (4) The last packet reaching the receiving end.

[0177] In an implementation manner of the present application, the delay difference preset thresholds corresponding to any two of the first preset packet, the second preset packet, the third preset packet, the fourth preset packet, the fifth preset packet, and the sixth preset packet are the same or different.

[0178] In an implementation manner of the present application, the satisfaction of the synchronization requirement or the coordination requirement among the multiple flows includes:

[0179] The delay difference among the multiple flows is less than or equal to the fourth preset threshold.

[0180] Among them, the delay difference among the multiple flows being less than or equal to the fourth preset threshold indicates that the transmission speeds or traveling speeds of the multiple flows are close.

[0181] Among them, the multiple flows include: two or more flows.

[0182] Optionally, the fourth preset threshold value can be defined by the protocol or configured through a server, a core network, a base station, or an application layer, etc.

[0183] In an implementation manner of the present application, the delay difference among the multiple flows includes: the difference between the average delay of the first preset packets in one or more first flows within the third time information and the average delay of the second preset packets in one or more second flows within the fourth time information;

[0184] Among them, the first flow is one of the multiple flows, and the second flow is the other flow among the multiple flows except the first flow.

[0185] If there is a difference between the average delay of the first preset packets in one or more first flows within the third time information and the average delay of the second preset packets in one or more second flows within the fourth time information, then the one or more first flows and the one or more second flows satisfy the synchronization requirement or the coordination requirement.

[0186] Statistically calculating the average delay of the first preset packets in the first flow within the third time information can represent the transmission speed or traveling speed of the multiple first flows, and statistically calculating the average delay of the second preset packets in the second flow within the fourth time information can represent the transmission service speed or traveling speed of the multiple second flows.

[0187] Optionally, the third time information and the fourth time information can be defined by the protocol or configured through a server, a core network, a base station, or an application layer, etc.

[0188] Optionally, the third time information is the same as or different from the fourth time information.

[0189] In an implementation manner of the present application, the first preset packet includes at least one of the following:

[0190] (1) All packets in the first stream within the third time information;

[0191] (2) Packets corresponding to I frames in the first stream within the third time information;

[0192] (3) Packets with high importance in the first stream within the third time information;

[0193] For example, packets with high PDU set importance (PSI) in the first stream within the third time information;

[0194] (4) Packets in the first stream within the third time information with importance higher than a first preset value;

[0195] For example, packets with PDU importance higher than the first preset value in the first stream within the third time information;

[0196] (5) Packets in the first stream within the third time information with delay requirements, synchronization requirements, or coordination requirements;

[0197] (6) Packets in the first stream within the third time information on which the decoding or demodulation of other packets depends.

[0198] For example, if the decoding or demodulation of packet A depends on packet B, the first preset packet is packet B.

[0199] In an implementation manner of the present application, the second preset packet includes at least one of the following:

[0200] (1) All packets in the second stream within the fourth time information;

[0201] (2) Packets corresponding to I frames in the second stream within the fourth time information;

[0202] (3) Packets with high importance in the second stream within the fourth time information;

[0203] For example, packets with high PDU importance in the second stream within the fourth time information;

[0204] (4) Packets in the second stream within the fourth time information with importance higher than a second preset value;

[0205] For example, a packet whose importance of the PDU in the second flow in the fourth time information is higher than the second preset value;

[0206] (5) There are packets with delay requirements, synchronization requirements or coordination requirements in the second stream in the fourth time information;

[0207] (6) There are packets in the second stream within the fourth time information on which decoding or demodulation of other packets depends.

[0208] For example, if the decoding or demodulation of packet A depends on packet B, the second preset packet is packet B.

[0209] In one embodiment of the present application, the difference between the average delay of the first preset packet in one or more first streams in the third time information and the average delay of the second preset packet in one or more second streams in the fourth time information includes at least one of the following:

[0210] (1) the difference between the average delay of sending the first preset packet in the first stream at the sending end and the average delay of sending the second preset packet in the second stream at the sending end;

[0211] (2) the average delay between the first preset packet in the first stream being received at the receiving end and the second preset packet in the second stream being sent at the sending end;

[0212] (3) the average delay between the first preset packet in the first stream being sent by the sending end and the second preset packet in the second stream being received by the receiving end;

[0213] (4) a difference between an average delay of a first preset packet in the first stream in the cache and an average delay of a second preset packet in the second stream in the cache;

[0214] (5) The difference between the average delay of the first preset packet in the first stream reaching the cache and the average delay of the second preset packet in the second stream reaching the cache.

[0215] In one embodiment of the present application, the delay difference between the multiple streams includes at least one of the following:

[0216] (1) The delay difference between multiple streams sent at the sending end;

[0217] In one embodiment, the delay difference between multiple streams sent at the sending end represents the maximum synchronization error allowed for the multiple streams at the sending end. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the multiple streams to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0218] (2) The delay difference between the reception delay of one or more streams at the receiving end and the transmission delay of other streams at the sending end;

[0219] In one embodiment, the delay difference between one or more streams received at the receiving end and other streams sent at the sending end represents the maximum synchronization error allowed between multiple streams ("one or more streams" and "other streams"). Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the multiple streams to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0220] (3) The delay difference between the sending delay of one or more streams at the sending end and the receiving delay of other streams at the receiving end;

[0221] In one embodiment, the delay difference between one or more streams sent at the transmitting end and other streams received at the receiving end represents the maximum synchronization error allowed between "one or more streams" and "other streams" ("one or more streams" and "other streams"). Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between multiple streams to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0222] (4) The delay difference between multiple flows in the cache;

[0223] In one embodiment, the delay difference between multiple streams in the cache represents the maximum synchronization error allowed for the multiple streams in the cache. Once the delay difference is exceeded, the synchronization or coordination requirements between the multiple streams may not be met, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0224] (5) The delay difference between multiple flows reaching the cache;

[0225] In one embodiment, the delay difference of multiple streams reaching the cache represents the maximum synchronization error allowed for the multiple streams in the cache. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the multiple streams to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0226] (6) The delay difference of multiple streams received at the receiving end.

[0227] In one embodiment, the delay difference between multiple streams received at the receiving end represents the maximum synchronization error allowed for the multiple streams at the receiving end. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the multiple streams to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0228] In one embodiment of the present application, the synchronization requirement or coordination requirement between the multiple streams includes:

[0229] The third preset packets of the multiple streams within the fifth time information meet the synchronization requirement or coordination requirement between the packets.

[0230] In an implementation of the present application, the third preset packet includes one of the following:

[0231] (1) All packets within the fifth time information;

[0232] (2) Packets corresponding to I-frames within the fifth time information;

[0233] (3) Packets with high importance within the fifth time information

[0234] For example, packets with high PDU importance within the fifth time information;

[0235] (4) Packets with importance higher than the third preset value within the fifth time information;

[0236] For example, packets with PDU importance higher than the third preset value within the fifth time information;

[0237] (5) Packets with delay requirements, synchronization requirements, or coordination requirements within the fifth time information;

[0238] (6) Packets on which the decoding or demodulation of other packets depends within the fifth time information.

[0239] For example, if the decoding or demodulation of packet A depends on packet B, the third preset packet is packet B.

[0240] Exemplarily, if the packet delay budgets (PDB) or PDU set delay budgets (PSDB) corresponding to multiple streams all meet within the fifth time information, it means that the multiple streams meet the synchronization requirements or coordination requirements.

[0241] In this embodiment, the synchronization requirements or coordination requirements between multiple streams are judged by satisfying the existing delay requirements, such as PDB or PSDB.

[0242] Exemplarily, the difference between the packet delay budgets (PDB) or PDU set delay budgets (PSDB) corresponding to two or more streams is less than the fifth preset threshold.

[0243] Optionally, the fifth preset threshold can be defined by the protocol or configured through a server, core network, base station, or application layer, etc.

[0244] In this embodiment, by comparing the differences in existing latency requirements, such as the differences in PDB or PSDB, and determining that they are less than a fifth preset threshold, the synchronization or coordination requirements between multiple streams are judged. In this embodiment, the first time information may be a first preset window, a first duration range, or a first period; the second time information may be a second preset window, a second duration range, or a second period; the third time information may be a third preset window, a third duration range, or a third period; the fourth time information may be a fourth preset window, a fourth duration range, or a fourth period; the fifth time information may be a fifth preset window, a fifth duration range, or a fifth period.

[0245] Optionally, in an implementation manner of this application, the synchronization or coordination requirements between multiple packets and multiple streams are met through at least one of the following operations:

[0246] 1) Map a stream to a corresponding Quality of Service (QoS) flow;

[0247] Specifically, by controlling the mapping of the stream to the QoS flow, the synchronization or coordination requirements between different streams or different packets are met.

[0248] 2) Map the stream or QoS flow to a corresponding Data Radio Bearer (DRB);

[0249] Specifically, by controlling the mapping of the stream or QoS flow to the DRB, the synchronization or coordination requirements between different streams or different packets are met.

[0250] 3) Map the stream or QoS flow or DRB to a corresponding Bearer;

[0251] Specifically, by controlling the mapping of the stream or QoS flow or DRB to the bearer, the synchronization or coordination requirements between different streams or packets of different streams are met.

[0252] 4) Map the stream or QoS flow or DRB or Bearer to a corresponding Logic Channel Group (LCG);

[0253] Specifically, by controlling the mapping of the stream or QoS flow or DRB or Bearer to the LCG, the synchronization or coordination requirements between different streams or packets of different streams are met.

[0254] 5) Map the stream or QoS flow or DRB or Bearer to the corresponding logical channel priority (LogicChannel Prioritization, LCP);

[0255] Specifically, by controlling the mapping of stream or QoS flow or DRB or Bearer to LCP, synchronization requirements or coordination requirements can be met between different flows or packets of different flows.

[0256] 6) Map the stream or QoS flow or DRB or Bearer to the corresponding logical channel (Logic Channel, LCH);

[0257] For example, by controlling the mapping of stream or QoS flow or DRB or Bearer to LCH, synchronization requirements or coordination requirements can be met between different flows or packets of different flows.

[0258] 7) Apply the corresponding discard timer (discardTimer);

[0259] Specifically, by setting different discardTimer controls for different packets or packets of different streams, synchronization requirements or coordination requirements can be met between different streams or packets of different streams. In an embodiment of the present application, synchronization requirements or coordination requirements are met between multiple streams or multiple packets sent by the sender, avoiding freezes and dizziness caused by asynchrony between multiple streams or multiple packets, or incoordination between images or audio, and improving the user's service experience.

[0260] See also Figure 6 The embodiment of the present application provides a communication processing method, which is executed by a receiving end. For example, the receiving end may be a terminal or a network side device or a device corresponding to a core network node or a server-side device. The specific steps include:

[0261] Step 601: The receiving end receives multiple streams or multiple packets, and the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0262] In the present application, satisfying the synchronization requirement between multiple packets (per-Packet) or multiple streams (per-Stream / Per-QoS) can be understood as at least one of the following: (1) multiple packets or multiple streams maintain a certain synchronization relationship at the receiving end, that is, the synchronization requirement is met, for example, multiple packets or multiple streams are received at the receiving end at a close time or at the same time; (2) multiple packets or multiple streams are cached at the receiving end to maintain a certain synchronization relationship, that is, the synchronization requirement or coordination requirement is met, for example, multiple packets or multiple streams are cached at the receiving end at a close time or at the same time, etc.

[0263] Meeting the coordination requirements among multiple packets or multiple streams can be understood as at least one of the following: (1) Multiple packets or multiple streams achieve close or simultaneous reception times at the receiving end through coordination; (2) Multiple packets or multiple streams achieve close or simultaneous caching times at the receiving end through coordination, thereby enhancing the user's service experience.

[0264] In an embodiment of the present application, meeting the synchronization requirements or coordination requirements among multiple packets includes: the delay difference among multiple packets is less than or equal to.

[0265] In an embodiment of the present application, the delay difference among the multiple packets includes at least one of the following:

[0266] (1) The delay difference of multiple packets received at the receiving end;

[0267] (2) The delay difference between the reception of one or more packets at the receiving end and the transmission of other packets at the sending end;

[0268] (3) The delay difference between the transmission of one or more packets at the sending end and the reception of other packets at the receiving end;

[0269] (4) The delay difference of multiple packets in the cache;

[0270] (5) The delay difference of multiple packets arriving at the cache;

[0271] (6) The delay difference of multiple packets transmitted at the sending end.

[0272] In an embodiment of the present application, when the packet includes multiple packets, the delay difference among the multiple packets includes at least one of the following:

[0273] (1) The delay difference between the first packets included in multiple packets;

[0274] (2) The delay difference between the last packets included in multiple packets;

[0275] (3) The delay difference between the first packet of the first packet and the last packet of the last packet among the multiple packets;

[0276] (4) The delay difference between the last packet of the first packet and the first packet of the last packet among the multiple packets;

[0277] (5) The delay difference between the average time or average delay of the first preset packets included in multiple packets transmitted from the sending end;

[0278] For example, if the average time or average delay of the first preset packet of packet A transmitted from the sending end is X, and the average time or average time of the first preset packet of packet B transmitted from the sending end is Y, then the delay difference is X - Y, or Y - X.

[0279] (6) The delay difference between the maximum delays at which the second preset packets respectively included in the multiple packets are sent from the sending end;

[0280] For example, if the maximum delay at which the second preset packet of packet A is sent from the sending end is X, and the maximum delay at which the second preset packet of packet B is sent from the sending end is Y, then the delay difference is X - Y, or Y - X.

[0281] (7) The delay difference between the maximum delay and the minimum delay at which the third preset packets respectively included in the multiple packets are sent from the sending end.

[0282] For example, if the maximum delay at which the third preset packet of packet A is sent from the sending end is X, and the minimum delay at which the third preset packet of packet B is sent from the sending end is Y, then the delay difference is X - Y.

[0283] (8) The delay difference between the average times or average delays at which the fourth preset packets respectively included in the multiple packets reach the receiving end;

[0284] For example, if the average time or average delay at which the fourth preset packet of packet A reaches the receiving end is X, and the average time or average time at which the fourth preset packet of packet B reaches the receiving end is Y, then the delay difference is X - Y, or Y - X.

[0285] (9) The delay difference between the maximum delays at which the fifth preset packets respectively included in the multiple packets reach the receiving end;

[0286] For example, if the maximum delay at which the fifth preset packet of packet A reaches the receiving end is X, and the maximum delay at which the fifth preset packet of packet B reaches the receiving end is Y, then the delay difference is X - Y, or Y - X.

[0287] (10) The delay difference between the maximum delay and the minimum delay at which the sixth preset packets respectively included in the multiple packets reach the receiving end.

[0288] For example, if the maximum delay at which the sixth preset packet of packet A reaches the receiving end is X, and the minimum delay at which the sixth preset packet of packet B reaches the receiving end is Y, then the delay difference is X - Y.

[0289] In an implementation manner of the present application, the first packet includes a first packet within the first time information, and the first packet includes one of the following:

[0290] (1) The packet sorted first;

[0291] (2) The first packet that reaches the receiving end;

[0292] (3) The first packet that reaches the buffer;

[0293] (4) The first packet that is sent from the sending end.

[0294] In one embodiment of the present application, the last packet includes a second packet within the second time information, and the second packet includes one of the following:

[0295] (1) The packet sorted last;

[0296] (2) The packet that last arrives at the receiving end;

[0297] (3) The packet that last arrives at the cache;

[0298] (4) The packet that is last sent from the sending end.

[0299] In one embodiment of the present application, the first preset packet group, or the second preset packet group, or the third preset packet group, or the fourth preset packet group, or the fifth preset packet group, or the sixth preset packet group includes one of the following:

[0300] (1) All packets within the packet;

[0301] (2) A preset proportion of packets within the packet;

[0302] (3) A preset number of packets within the packet;

[0303] (4) The first packet;

[0304] (5) The last packet;

[0305] (6) Packets within the packet with a delay not exceeding the second preset threshold;

[0306] (7) Packets within the packet with a delay not less than the third preset threshold.

[0307] Optionally, the second preset threshold value and the third preset threshold can be defined by the protocol or configured by a server, a core network, a base station, or an application layer, etc.

[0308] In one embodiment of the present application, the first packet includes one of the following:

[0309] (1) The packet sorted first among multiple packets, that is, the packet with the first number;

[0310] (2) The packet that first arrives at the receiving end;

[0311] (3) The packet that first arrives at the cache;

[0312] (4) The packet that is first sent from the sending end.

[0313] In one embodiment of the present application, the last packet includes one of the following:

[0314] (1) The last group among multiple groups in the packet;

[0315] (2) The last packet to reach the receiving end;

[0316] (3) The last packet to reach the cache;

[0317] (4) The last packet sent from the sending end.

[0318] In an implementation manner of the present application, the delay difference preset thresholds corresponding to any two of the first preset packet, the second preset packet, the third preset packet, the fourth preset packet, the fifth preset packet, and the sixth preset packet are the same or different.

[0319] In an implementation manner of the present application, the satisfaction of the synchronization requirement or the coordination requirement among multiple streams includes:

[0320] The delay difference among multiple streams is less than or equal to the fourth preset threshold.

[0321] Optionally, the fourth preset threshold value can be defined by the protocol or configured by a server, a core network, a base station, an application layer, etc.

[0322] In an implementation manner of the present application, the delay difference among multiple streams includes: the difference between the average delay of the first preset packets in one or more first streams within the third time information and the average delay of the second preset packets in one or more second streams within the fourth time information;

[0323] Wherein, the first stream is one of the multiple streams, and the second stream is the other streams except the first stream among the multiple streams.

[0324] In an implementation manner of the present application, the third time information and the fourth time information are the same or different.

[0325] Optionally, the third time information and the fourth time information can be defined by the protocol or configured by a server, a core network, a base station, an application layer, etc.

[0326] In an implementation manner of the present application, the first preset packet includes at least one of the following:

[0327] (1) All packets in the first stream within the third time information;

[0328] (2) Packets corresponding to I-frames in the first stream within the third time information;

[0329] (3) Packets with high importance in the first stream within the third time information.

[0330] For example, packets with high PDU set importance (PSI) within the first stream during the third time information;

[0331] (4) Packets within the first stream during the third time information with importance higher than a first preset value;

[0332] For example, packets within the first stream during the third time information with PDU importance higher than a first preset value;

[0333] (5) Packets within the first stream during the third time information with delay requirements, synchronization requirements, or coordination requirements;

[0334] (6) Packets within the first stream during the third time information on which the decoding or demodulation of other packets depends.

[0335] For example, if the decoding or demodulation of packet A depends on packet B, then the first preset packet is packet B.

[0336] In an implementation manner of the present application, the second preset packet includes at least one of the following:

[0337] (1) All packets within the second stream during the fourth time information;

[0338] (2) Packets corresponding to I-frames within the second stream during the fourth time information;

[0339] (3) Packets with high importance within the second stream during the fourth time information;

[0340] For example, packets with high PDU importance within the second stream during the fourth time information;

[0341] (4) Packets within the second stream during the fourth time information with importance higher than a second preset value;

[0342] For example, packets with PDU importance higher than a second preset value within the second stream during the fourth time information;

[0343] (5) Packets within the second stream during the fourth time information with delay requirements, synchronization requirements, or coordination requirements;

[0344] (6) Packets within the second stream during the fourth time information on which the decoding or demodulation of other packets depends.

[0345] For example, if the decoding or demodulation of packet A depends on packet B, then the second preset packet is packet B.

[0346] In an implementation manner of the present application, the difference between the average delay of the first preset packets in one or more first streams within the third time information and the average delay of the second preset packets in one or more second streams within the fourth time information includes at least one of the following:

[0347] (1) The difference between the average delay of the first preset packets in the first stream when sent at the sending end and the average delay of the second preset packets in the second stream when sent at the sending end;

[0348] (2) The average delay of the first preset packets in the first stream when received at the receiving end and the second preset packets in the second stream when sent at the sending end;

[0349] (3) The average delay of the first preset packets in the first stream when sent at the sending end and the second preset packets in the second stream when received at the receiving end;

[0350] (4) The difference between the average delay of the first preset packets in the first stream in the cache and the average delay of the second preset packets in the second stream in the cache;

[0351] (5) The difference between the average delay of the first preset packets in the first stream reaching the cache and the average delay of the second preset packets in the second stream reaching the cache.

[0352] In an implementation manner of the present application, the delay difference between multiple streams includes at least one of the following:

[0353] (1) The delay difference of multiple streams when received at the receiving end;

[0354] (2) The delay difference between the receiving delay of one or more streams at the receiving end and the sending delay of other streams at the sending end;

[0355] (3) The delay difference between the sending delay of one or more streams at the sending end and the receiving delay of other streams at the receiving end;

[0356] (4) The delay difference of multiple streams in the cache;

[0357] (5) The delay difference of multiple streams reaching the cache;

[0358] (6) The delay difference of multiple streams when sent at the sending end.

[0359] In an implementation manner of the present application, multiple streams meeting the synchronization requirement or coordination requirement includes:

[0360] The third preset packets of multiple streams within the fifth time information meet the synchronization requirement or coordination requirement between the packets.

[0361] In an implementation manner of the present application, the third preset packet includes one of the following:

[0362] (1) All packets within the fifth time information;

[0363] (2) the packet corresponding to the I frame in the fifth time information;

[0364] (3) The most important packet in the fifth time information

[0365] For example, a packet with high PDU importance in the fifth time information;

[0366] (4) a packet in the fifth time information whose importance is higher than the third preset value;

[0367] For example, a packet whose PDU importance in the fifth time information is higher than the third preset value;

[0368] (5) The fifth time information contains packets with delay requirements, synchronization requirements, or coordination requirements;

[0369] (6) The fifth time information contains packets that the decoding or demodulation of other packets depends on.

[0370] For example, if the decoding or demodulation of packet A depends on packet B, the third preset packet is packet B.

[0371] Exemplarily, a difference between packet delay budgets (PDB) or PDU set delay budgets (PSDB) corresponding to two or more flows is smaller than a fifth preset threshold.

[0372] Optionally, the fifth preset threshold may be defined by a protocol, or configured by a server, a core network, a base station or an application layer.

[0373] In this embodiment, the first time information may be the first preset window, the first time range or the first period; the second time information may be the second preset window, the second time range or the second period; the third time information may be the third preset window, the third time range or the third period; the fourth time information may be the fourth preset window, the fourth time range or the fourth period; the fifth time information may be the fifth preset window, the fifth time range or the fifth period.

[0374] In an embodiment of the present application, the multiple streams or multiple packets received by the receiving end meet the synchronization requirements or coordination requirements, avoiding the freeze and dizziness caused by the asynchrony between the multiple streams or multiple packets, or the incoordination between the pictures or audios, thereby improving the user's service experience.

[0375] See also Figure 7 The embodiment of the present application provides a communication processing device, which is applied to a transmitting end. The device 700 includes:

[0376] The sending module 701 is used to send multiple streams or multiple packets, where the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0377] In embodiments of the present application, the multiple packets include at least one of the following:

[0378] (1) Multiple packets of the same user;

[0379] (2) Multiple packets of different users;

[0380] (3) Multiple packets of the same UE;

[0381] (4) Multiple packets of different UEs;

[0382] (5) Multiple packets of the same stream;

[0383] (6) Multiple packets of different streams;

[0384] For example, different streams include different streams of the same UE or different streams of different UEs.

[0385] (7) Multiple packets of the same Quality of Service flow (QoS flow);

[0386] (8) Multiple packets of different QoS flows;

[0387] (9) Multiple packets in the same Internet Protocol (IP) or User Datagram Protocol (UDP) packet;

[0388] (10) Multiple packets in different IP or UDP packets;

[0389] (11) Multiple packets in the same burst;

[0390] (12) Multiple packets in different bursts;

[0391] (13) Multiple packets in the same bearer;

[0392] (14) Multiple packets in different bearers;

[0393] (15) Multiple packets in the same PDU session;

[0394] (16) Multiple packets in different PDU sessions;

[0395] (17) Multiple packets in the same PDU set;

[0396] (18) Multiple packets in different PDU sets;

[0397] (19)Multiple packets in the same PDU;

[0398] (20)Multiple packets in different PDUs;

[0399] (21)Multiple packets in the same Data Radio Bearer (DRB);

[0400] (22)Multiple packets in different DRBs;

[0401] (23)Multiple packets in the same service;

[0402] (24)Multiple packets in different services.

[0403] In an embodiment of the present application, that the multiple packets meet the synchronization requirement or coordination requirement includes: the delay difference between the multiple packets is less than or equal to a first preset threshold.

[0404] In an embodiment of the present application, the delay difference between the multiple packets includes at least one of the following:

[0405] (1)The delay difference of the multiple packets received at the receiving end;

[0406] (2)The delay difference of the multiple packets sent at the sending end;

[0407] (3)The delay difference between the reception of one or more packets at the receiving end and the transmission of other packets at the sending end;

[0408] (4)The delay difference between the transmission of one or more packets at the sending end and the reception of other packets at the receiving end;

[0409] (5)The delay difference of the multiple packets in a buffer;

[0410] (6)The delay difference of the multiple packets arriving at the buffer.

[0411] In an embodiment of the present application, when the packet includes multiple packets, the delay difference between the multiple packets includes at least one of the following:

[0412] (1)The delay difference between the first packets included in the multiple packets;

[0413] (2)The delay difference between the last packets included in the multiple packets;

[0414] (3)The delay difference between the first packet of the first packet and the last packet of the last packet of the multiple packets;

[0415] (4)The delay difference between the last packet of the first packet and the first packet of the last packet of the multiple packets;

[0416] (5) The delay difference between the average time or average latency of the first preset group included in each of the multiple packets when sent from the sending end;

[0417] (6) The delay difference between the maximum latencies of the second preset group included in each of the multiple packets when sent from the sending end;

[0418] (7) The delay difference between the maximum latency and the minimum latency of the third preset group included in each of the multiple packets when sent from the sending end.

[0419] (8) The delay difference between the average time or average latency of the fourth preset group included in each of the multiple packets when arriving at the receiving end;

[0420] (9) The delay difference between the maximum latencies of the fifth preset group included in each of the multiple packets when arriving at the receiving end;

[0421] (10) The delay difference between the maximum latency and the minimum latency of the sixth preset group included in each of the multiple packets when arriving at the receiving end.

[0422] In one embodiment of the present application, the first packet includes a first packet within the first time information, and the first packet includes one of the following:

[0423] (1) The packet ranked first;

[0424] (2) The first packet sent from the sending end;

[0425] (3) The first packet arriving at the buffer;

[0426] (4) The first packet arriving at the receiving end.

[0427] In one embodiment of the present application, the last packet includes a second packet within the second time information, and the second packet includes one of the following:

[0428] (1) The packet ranked last;

[0429] (2) The last packet sent from the sending end;

[0430] (3) The last packet arriving at the buffer;

[0431] (4) The last packet arriving at the receiving end.

[0432] In one embodiment of the present application, the first preset group or the second preset group or the third preset group or the fourth preset group or the fifth preset group or the sixth preset group includes one of the following:

[0433] (1) All the packets within the packet;

[0434] (2) A preset proportion of the packets within the packet;

[0435] (3) Preset number of groupings within the packet;

[0436] (4) The first grouping;

[0437] (5) The last grouping;

[0438] (6) Groupings within the packet with a delay not exceeding a second preset threshold;

[0439] (7) Groupings within the packet with a delay not less than a third preset threshold.

[0440] In one embodiment of the present application, the first grouping includes one of the following:

[0441] (1) The grouping ranked first among multiple groupings within the packet, i.e., the grouping with the first number;

[0442] (2) The first grouping sent from the sending end;

[0443] (3) The first grouping reaching the buffer;

[0444] (4) The first grouping reaching the receiving end.

[0445] In one embodiment of the present application, the last grouping includes one of the following:

[0446] (1) The grouping ranked last among multiple groupings within the packet;

[0447] (2) The last grouping sent from the sending end;

[0448] (3) The last grouping reaching the buffer;

[0449] (4) The last grouping reaching the receiving end.

[0450] In one embodiment of the present application, the preset delay difference threshold between any two of the first preset grouping, the second preset grouping, the third preset grouping, the fourth preset grouping, the fifth preset grouping, and the sixth preset grouping is the same or different.

[0451] In one embodiment of the present application, the satisfaction of the synchronization requirement or the coordination requirement among the multiple streams includes:

[0452] The delay difference between the multiple streams is less than or equal to a fourth preset threshold.

[0453] In one embodiment of the present application, the delay difference between the multiple streams includes: the difference between the average delay of the first preset packets in one or more first streams within the third time information and the average delay of the second preset packets in one or more second streams within the fourth time information;

[0454] Wherein, the first stream is one of a plurality of streams, and the second stream is the other streams among the plurality of streams except the first stream.

[0455] Optionally, the third time information is the same as or different from the fourth time information.

[0456] In an embodiment of the present application, the first preset packet includes at least one of the following:

[0457] (1) All packets in the first stream within the third time information;

[0458] (2) Packets corresponding to I-frames in the first stream within the third time information;

[0459] (3) Packets with high importance in the first stream within the third time information;

[0460] (4) Packets in the first stream within the third time information with importance higher than a first preset value;

[0461] (5) Packets in the first stream within the third time information with delay requirements, synchronization requirements, or coordination requirements;

[0462] (6) Packets in the first stream within the third time information on which the decoding or demodulation of other packets depends.

[0463] In an embodiment of the present application, the second preset packet includes at least one of the following:

[0464] (1) All packets in the second stream within the fourth time information;

[0465] (2) Packets corresponding to I-frames in the second stream within the fourth time information;

[0466] (3) Packets with high importance in the second stream within the fourth time information;

[0467] (4) Packets in the second stream within the fourth time information with importance higher than a second preset value;

[0468] (5) Packets in the second stream within the fourth time information with delay requirements, synchronization requirements, or coordination requirements;

[0469] (6) Packets in the second stream within the fourth time information on which the decoding or demodulation of other packets depends.

[0470] In an embodiment of the present application, the difference between the average delay of the first preset packets in one or more first streams within the third time information and the average delay of the second preset packets in one or more second streams within the fourth time information includes at least one of the following:

[0471] (1) The difference between the average delay of the first preset packet in the first stream when sent at the sending end and the average delay of the second preset packet in the second stream when sent at the sending end;

[0472] (2) The average delay of the first preset packet in the first stream when received at the receiving end and the second preset packet in the second stream when sent at the sending end;

[0473] (3) The average delay of the first preset packet in the first stream when sent at the sending end and the second preset packet in the second stream when received at the receiving end;

[0474] (4) The difference between the average delay of the first preset packet in the first stream in the buffer and the average delay of the second preset packet in the second stream in the buffer;

[0475] (5) The difference between the average delay of the first preset packet in the first stream reaching the buffer and the average delay of the second preset packet in the second stream reaching the buffer.

[0476] In an implementation manner of the present application, the delay differences between the multiple streams include at least one of the following:

[0477] (1) The delay difference of the multiple streams when sent at the sending end;

[0478] (2) The delay difference between the receiving delay of one or more streams at the receiving end and the sending delay of other streams at the sending end;

[0479] (3) The delay difference between the sending delay of one or more streams at the sending end and the receiving delay of other streams at the receiving end;

[0480] (4) The delay difference of the multiple streams in the buffer;

[0481] (5) The delay difference of the multiple streams reaching the buffer;

[0482] (6) The delay difference of the multiple streams when received at the receiving end.

[0483] In an implementation manner of the present application, the multiple streams meeting the synchronization requirement or coordination requirement includes:

[0484] The third preset packets of the multiple streams within the fifth time information meet the synchronization requirement or coordination requirement between the packets.

[0485] In an implementation manner of the present application, the third preset packet includes one of the following:

[0486] (1) All packets within the fifth time information;

[0487] (2) Packets corresponding to I-frames within the fifth time information;

[0488] (3) Packets with high importance within the fifth time information;

[0489] (4) Packets with importance higher than the third preset value within the fifth time information;

[0490] (5) Packets with delay requirements, synchronization requirements, or coordination requirements within the fifth time information;

[0491] (6) Packets on which the decoding or demodulation of other packets depends within the fifth time information.

[0492] The device provided by the embodiments of the present application can implement Figure 5 the various processes implemented by the method embodiments, and achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0493] See Figure 8 , the embodiments of the present application provide a communication processing device, which is applied to the receiving end. The device 800 includes:

[0494] A receiving module 801, configured to receive multiple streams or multiple packets, and the multiple streams or multiple packets satisfy synchronization requirements or coordination requirements.

[0495] In an implementation manner of the present application, that the multiple packets satisfy synchronization requirements or coordination requirements includes: the delay difference between the multiple packets is less than or equal to.

[0496] In an implementation manner of the present application, the delay difference between the multiple packets includes at least one of the following:

[0497] (1) The delay difference of multiple packets received at the receiving end;

[0498] (2) The delay difference between the reception of one or more packets at the receiving end and the transmission of other packets at the sending end;

[0499] (3) The delay difference between the transmission of one or more packets at the sending end and the reception of other packets at the receiving end;

[0500] (4) The delay difference of multiple packets in the cache;

[0501] (5) The delay difference of multiple packets arriving at the cache;

[0502] (6) The delay difference of multiple packets transmitted at the sending end.

[0503] In an implementation manner of the present application, when the packet includes multiple packets, the delay difference between the multiple packets includes at least one of the following:

[0504] (1) The delay difference between the first packets included in the multiple packets respectively;

[0505] (2) The delay difference between the last packets included in the multiple packets respectively;

[0506] (3) The delay difference between the first packet of the first of the multiple packets and the last packet of the last of the multiple packets;

[0507] (4) The delay difference between the last packet of the first of the multiple packets and the first packet of the last of the multiple packets;

[0508] (5) The delay difference between the average time or average delay of the first preset packets respectively included in the multiple packets when sent from the sending end;

[0509] (6) The delay difference between the maximum delays of the second preset packets respectively included in the multiple packets when sent from the sending end;

[0510] (7) The delay difference between the maximum delay and the minimum delay of the third preset packets respectively included in the multiple packets when sent from the sending end.

[0511] (8) The delay difference between the average time or average delay of the fourth preset packets respectively included in the multiple packets when arriving at the receiving end;

[0512] (9) The delay difference between the maximum delays of the fifth preset packets respectively included in the multiple packets when arriving at the receiving end;

[0513] (10) The delay difference between the maximum delay and the minimum delay of the sixth preset packets respectively included in the multiple packets when arriving at the receiving end.

[0514] In an implementation manner of the present application, the first packet includes a first packet within a first time information, and the first packet includes one of the following:

[0515] (1) The packet ranked first;

[0516] (2) The first packet arriving at the receiving end;

[0517] (3) The first packet arriving at the buffer;

[0518] (4) The first packet sent from the sending end.

[0519] In an implementation manner of the present application, the last packet includes a second packet within a second time information, and the second packet includes one of the following:

[0520] (1) The packet ranked last;

[0521] (2) The last packet arriving at the receiving end;

[0522] (3) The last packet arriving at the buffer;

[0523] (4) The last packet sent from the sending end.

[0524] In an embodiment of the present application, the first preset group, the second preset group, the third preset group, the fourth preset group, the fifth preset group, or the sixth preset group includes one of the following:

[0525] (1) All groups within the packet;

[0526] (2) A preset proportion of groups within the packet;

[0527] (3) A preset number of groups within the packet;

[0528] (4) The first group;

[0529] (5) The last group;

[0530] (6) Groups within the packet with a delay not exceeding the second preset threshold;

[0531] (7) Groups within the packet with a delay not less than the third preset threshold.

[0532] In an embodiment of the present application, the first group includes one of the following:

[0533] (1) The group ranked first among multiple groups, that is, the group with the first number;

[0534] (2) The first group to reach the receiving end;

[0535] (3) The first group to reach the buffer;

[0536] (4) The first group to be sent from the sending end.

[0537] In an embodiment of the present application, the last group includes one of the following:

[0538] (1) The group ranked last among multiple groups within the packet;

[0539] (2) The last group to reach the receiving end;

[0540] (3) The last group to reach the buffer;

[0541] (4) The last group to be sent from the sending end.

[0542] In an embodiment of the present application, the delay difference preset thresholds corresponding to any two of the first preset group, the second preset group, the third preset group, the fourth preset group, the fifth preset group, and the sixth preset group are the same or different.

[0543] In an embodiment of the present application, the satisfaction of the synchronization requirement or the coordination requirement among the multiple streams includes:

[0544] The delay difference between multiple streams is less than or equal to a fourth preset threshold.

[0545] Optionally, the fourth preset threshold value can be defined by a protocol or configured through a server, a core network, a base station, an application layer, or the like.

[0546] In an implementation manner of the present application, the delay difference between multiple streams includes: the difference between the average delay of first preset packets in one or more first streams within third time information and the average delay of second preset packets in one or more second streams within fourth time information;

[0547] Wherein, the first stream is one of the multiple streams, and the second stream is the other streams except the first stream among the multiple streams.

[0548] In an implementation manner of the present application, the third time information and the fourth time information are the same or different.

[0549] Optionally, the third time information and the fourth time information can be defined by a protocol or configured through a server, a core network, a base station, an application layer, or the like.

[0550] In an implementation manner of the present application, the first preset packet includes at least one of the following:

[0551] (1) All packets in the first stream within the third time information;

[0552] (2) Packets corresponding to I frames in the first stream within the third time information;

[0553] (3) Packets with high importance in the first stream within the third time information;

[0554] (4) Packets with importance higher than a first preset value in the first stream within the third time information;

[0555] (5) Packets with delay requirements, synchronization requirements, or coordination requirements in the first stream within the third time information;

[0556] (6) Packets on which the decoding or demodulation of other packets in the first stream within the third time information depends.

[0557] In an implementation manner of the present application, the second preset packet includes at least one of the following:

[0558] (1) All packets in the second stream within the fourth time information;

[0559] (2) Packets corresponding to I frames in the second stream within the fourth time information;

[0560] (3) Packets with high importance in the second stream within the fourth time information;

[0561] (4) Packets with importance higher than a second preset value within the second stream in the fourth time information;

[0562] (5) Packets with delay requirements, synchronization requirements, or coordination requirements within the second stream in the fourth time information;

[0563] (6) Packets on which the decoding or demodulation of other packets within the second stream in the fourth time information depends.

[0564] In an implementation manner of the present application, the difference between the average delay of one or more first preset packets in one or more first streams in the third time information and the average delay of one or more second preset packets in one or more second streams in the fourth time information includes at least one of the following:

[0565] (1) The difference between the average delay of the first preset packets in the first stream when sent at the sending end and the average delay of the second preset packets in the second stream when sent at the sending end;

[0566] (2) The average delay of the first preset packets in the first stream when received at the receiving end and the average delay of the second preset packets in the second stream when sent at the sending end;

[0567] (3) The average delay of the first preset packets in the first stream when sent at the sending end and the average delay of the second preset packets in the second stream when received at the receiving end;

[0568] (4) The difference between the average delay of the first preset packets in the first stream in the cache and the average delay of the second preset packets in the second stream in the cache;

[0569] (5) The difference between the average delay of the first preset packets in the first stream when reaching the cache and the average delay of the second preset packets in the second stream when reaching the cache.

[0570] In an implementation manner of the present application, the delay difference between multiple streams includes at least one of the following:

[0571] (1) The delay difference of multiple streams when received at the receiving end;

[0572] (2) The delay difference between the receiving delay of one or more streams at the receiving end and the sending delay of other streams at the sending end;

[0573] (3) The delay difference between the sending delay of one or more streams at the sending end and the receiving delay of other streams at the receiving end;

[0574] (4) The delay difference of multiple streams in the cache;

[0575] (5) The delay difference of multiple streams when reaching the cache;

[0576] (6) The delay difference of multiple streams when sent at the sending end.

[0577] In an implementation manner of the present application, that multiple streams meet the synchronization requirement or coordination requirement includes:

[0578] The third preset packets of multiple streams within the fifth time information meet the synchronization requirement or coordination requirement between the packets.

[0579] In an implementation manner of the present application, the third preset packet includes one of the following:

[0580] (1) All packets within the fifth time information;

[0581] (2) Packets corresponding to I-frames within the fifth time information;

[0582] (3) Packets with high importance within the fifth time information

[0583] (4) Packets with importance higher than the third preset value within the fifth time information;

[0584] (5) Packets with delay requirements, synchronization requirements, or coordination requirements within the fifth time information;

[0585] (6) Packets on which the decoding or demodulation of other packets within the fifth time information depends.

[0586] The device provided by the embodiments of the present application can implement Figure 6 each process implemented by the method embodiments, and achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0587] Figure 9 FIG. is a schematic diagram of the hardware structure of a terminal for implementing an embodiment of the present application. The terminal 900 includes, but is not limited to, at least some components such as a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 906, a display unit 905, a user input unit 907, an interface unit 908, a memory 909, and a processor 910.

[0588] Those skilled in the art can understand that the terminal 900 may further include a power supply (such as a battery) for supplying power to each component. The power supply can be logically connected to the processor 910 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 9 The terminal structure shown in does not limit the terminal. The terminal may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0589] It should be understood that in the embodiments of the present application, the input unit 904 may include a Graphics Processing Unit (GPU) 9041 and a microphone 9042. The graphics processor 9041 processes the image data of static pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 905 may include a display panel 9051, and the display panel 9051 may be configured in the form of, for example, a liquid crystal display, an organic light emitting diode, etc. The user input unit 907 includes at least one of a touch panel 9071 and other input devices 9072. The touch panel 9071 is also referred to as a touch screen. The touch panel 9071 may include two parts: a touch detection device and a touch controller. The other input devices 9032 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated herein.

[0590] In the embodiments of the present application, after receiving downlink data from a network-side device, the radio frequency unit 901 may transmit it to the processor 910 for processing; in addition, the radio frequency unit 901 may send uplink data to the network-side device. Generally, the radio frequency unit 901 includes, but is not limited to, an antenna, an amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, etc.

[0591] The memory 909 can be used to store software programs or instructions and various data. The memory 909 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area may store an operating system, application programs or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 909 may include a volatile memory or a non-volatile memory, or alternatively, the memory 909 may include a non-transitory memory. Among them, the non-volatile memory or the non-transitory memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (Synchronous DRAM, SDRAM), a double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR SDRAM), an enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), a synchronous link dynamic random access memory (Synch link DRAM, SLDRAM), and a direct rambus random access memory (Direct Rambus RAM, DRRAM). The memory 909 in the embodiments of the present application includes but is not limited to these and any other suitable types of memories.

[0592] The processor 910 may include one or more processing units; optionally, the processor 910 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above modem processor may not be integrated into the processor 910 either.

[0593] The terminal provided by the embodiments of the present application can implement Figure 5 or Figure 6 each process implemented by the method embodiments of

[0594] Please refer to Figure 10 , Figure 10 which is a structural diagram of a network-side device to which the embodiments of the present invention are applied. AsFigure 10 As shown in Figure 10 , the network-side device 1000 includes: a processor 1001, a transceiver 1002, a memory 1003, and a bus interface. Among them, the processor 1001 can be responsible for managing the bus architecture and general processing. The memory 1003 can store the data used by the processor 1001 when executing operations.

[0595] In an embodiment of the present invention, the network-side device 1000 further includes: a program stored in the memory 1003 and executable on the processor 1001. When the program is executed by the processor 1001, it implements the above Figure 5 or Figure 6 the steps in the method shown.

[0596] In Figure 10 , the bus architecture can include any number of interconnected buses and bridges, specifically, various circuits represented by one or more processors represented by the processor 1001 and the memory represented by the memory 1003 are linked together. The bus architecture can also link together various other circuits such as peripheral devices, voltage regulators, and power management circuits, which are well known in the art. Therefore, they will not be further described herein. The bus interface provides an interface. The transceiver 1002 can be multiple components, that is, including a transmitter and a receiver, and provides a unit for communicating with various other devices on the transmission medium.

[0597] Please refer to Figure 11 , Figure 11 which is a structural diagram of a communication device to which the embodiments of the present invention are applied. The communication device can be a sending end or a receiving end.

[0598] As Figure 11 shown, an embodiment of the present application further provides a communication device 1100, including a processor 1101 and a memory 1302. A program or instruction executable on the processor 1101 is stored on the memory 1102. For example, when the communication device 1100 is a sending end, when the program or instruction is executed by the processor 1101, it implements the above Figure 5 steps of the method embodiment. When the communication device 1100 is a receiving end, when the program or instruction is executed by the processor 1101, it implements the above Figure 6 steps of the method embodiment and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0599] An embodiment of the present application further provides a readable storage medium. A program or instruction is stored on the readable storage medium. When the program or instruction is executed by a processor, it implements Figure 5 or Figure 6 the method and the various processes of the above-mentioned embodiments, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0600] Among them, the processor is the processor in the terminal or network-side device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory ROM, random access memory RAM, magnetic disks, or optical discs, etc. In some examples, the readable storage medium may be a non-transitory readable storage medium.

[0601] Another embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement Figure 5 or Figure 6 each process shown in and the above various method embodiments, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0602] It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, system chip, chip system, or system-on-chip, etc.

[0603] Another embodiment of the present application provides a computer program / program product. The computer program / program product is stored in a storage medium, and the computer program / program product is executed by at least one processor to implement Figure 5 or Figure 6 each process shown in and the above various method embodiments, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0604] The embodiments of the present application further provide a communication system, which includes a terminal and a network-side device. The terminal is used to execute, such as Figure 5 and each process of the above various method embodiments, and the network-side device is used to execute, such as Figure 6 and each process of the above various method embodiments, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0605] It should be noted that in this text, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or apparatus comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or elements inherent to such process, method, article or apparatus. Without further limitation, an element defined by the phrase "comprising a..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising such element. In addition, it should be pointed out that the scope of the methods and apparatuses in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0606] From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of a computer software product plus a necessary general hardware platform, and of course, can also be implemented by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.) and includes several instructions for causing a terminal or a network-side device to execute the methods described in the various embodiments of the present application.

[0607] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms of embodiments without departing from the purpose of the present application and the scope protected by the claims. These embodiments are all within the protection scope of the present application.

Claims

1. A communication processing method, characterized in that, Including: The sending end sends multiple streams or multiple packets, and the multiple streams or multiple packets meet the synchronization requirements or coordination requirements.

2. The method according to claim 1, wherein That the multiple packets meet the synchronization requirements or coordination requirements includes: the delay difference between the multiple packets is less than or equal to a first preset threshold.

3. The method according to claim 2, wherein The delay difference between the multiple packets includes at least one of the following: The delay difference when the multiple packets are sent at the sending end; The delay difference between the reception of one or more packets at the receiving end and the sending of other packets at the sending end; The delay difference between the sending of one or more packets at the sending end and the reception of other packets at the receiving end; The delay difference of the multiple packets in the buffer; The delay difference when the multiple packets reach the buffer.

4. The method according to claim 2, characterized in that In the case where the packet includes multiple packets, the delay difference between the multiple packets includes at least one of the following: The delay difference between the first packets included in the multiple packets respectively; The delay difference between the last packets included in the multiple packets respectively; The delay difference between the first packet of the first packet among the multiple packets and the last packet of the last packet; The delay difference between the last packet of the first packet among the multiple packets and the first packet of the last packet; The delay difference between the average time or average delay of the first preset packets sent from the sending end by the multiple packets respectively; The delay difference between the maximum delays of the second preset packets sent from the sending end by the multiple packets respectively; The delay difference between the maximum delay and the minimum delay of the third preset packets sent from the sending end by the multiple packets respectively.

5. The method according to claim 4, wherein The first packet includes the first packet within the first time information, and the first packet includes one of the following: The packet sorted first; The first packet sent from the sending end; The first packet reaching the buffer.

6. The method according to claim 4, characterized in that, The last packet includes the second packet within the second time information, and the second packet includes one of the following: The packet sorted last; The last packet sent from the sending end; The last packet reaching the buffer.

7. The method according to claim 4, wherein The first preset packet or the second preset packet or the third preset packet includes one of the following: All the packets within the packet; Preset proportion of the packets within the packet; Preset number of the packets within the packet; The first packet; The last packet; The packets within the packet with a delay not exceeding the second preset threshold; The packets within the packet with a delay not less than the third preset threshold.

8. The method according to claim 4 or 7, characterized in that, The first packet includes one of the following: The packet sorted first among the multiple packets within the packet; The first packet sent from the sending end; The first packet reaching the buffer.

9. The method according to claim 4 or 7, characterized in that, The last packet includes one of the following: The packet sorted last among the multiple packets within the packet; The last packet sent from the sending end; The last packet reaching the buffer.

10. The method according to claim 4, characterized in that, The delay difference preset thresholds corresponding to any two of the first preset packet, the second preset packet, and the third preset packet are the same or different.

11. The method according to claim 1, characterized in that, That the multiple streams meet the synchronization requirements or coordination requirements includes: The delay difference between the multiple streams is less than or equal to a fourth preset threshold.

12. The method according to claim 11, wherein The delay difference between the multiple streams includes: The difference between the average delay of the first preset packets in one or more first streams within the third time information and the average delay of the second preset packets in one or more second streams within the fourth time information; Wherein, the first stream is one of the multiple streams, and the second stream is other streams among the multiple streams except the first stream.

13. The method according to claim 12, characterized in that, The third time information is the same as or different from the fourth time information.

14. The method according to claim 12, wherein The first preset packet includes at least one of the following: All packets in the first stream within the third time information; Packets corresponding to I frames in the first stream within the third time information; Packets with high importance in the first stream within the third time information; Packets with importance higher than a first preset value in the first stream within the third time information; Packets with delay requirements, synchronization requirements, or coordination requirements in the first stream within the third time information; Packets on which the decoding or demodulation of other packets in the first stream within the third time information depends; Or The second preset packet includes at least one of the following: All packets in the second stream within the fourth time information; Packets corresponding to I frames in the second stream within the fourth time information; Packets with high importance in the second stream within the fourth time information; Packets with importance higher than a second preset value in the second stream within the fourth time information; Packets with delay requirements, synchronization requirements, or coordination requirements in the second stream within the fourth time information; Packets on which the decoding or demodulation of other packets in the second stream within the fourth time information depends.

15. The method according to claim 12, wherein The difference between the average delay of the first preset packets in one or more first streams within the third time information and the average delay of the second preset packets in one or more second streams within the fourth time information includes at least one of the following: The difference between the average delay of the first preset packets in the first stream when sent at the sending end and the average delay of the second preset packets in the second stream when sent at the sending end; The average delay of the first preset packets in the first stream when received at the receiving end and the average delay of the second preset packets in the second stream when sent at the sending end; The average delay of the first preset packets in the first stream when sent at the sending end and the average delay of the second preset packets in the second stream when received at the receiving end; The difference between the average delay of the first preset packets in the first stream in the buffer and the average delay of the second preset packets in the second stream in the buffer; The difference between the average delay of the first preset packets in the first stream reaching the buffer and the average delay of the second preset packets in the second stream reaching the buffer.

16. The method according to claim 11, wherein The delay difference between the multiple streams includes at least one of the following: The delay difference of multiple streams when sent at the sending end; The delay difference between the receiving delay of one or more streams at the receiving end and the sending delay of other streams at the sending end; The delay difference between the sending delay of one or more streams at the sending end and the receiving delay of other streams at the receiving end; The delay difference of multiple streams in the buffer; The delay difference of multiple streams reaching the buffer.

17. The method according to claim 11, wherein The multiple streams meeting the synchronization requirements or coordination requirements includes: The third preset packets of multiple streams within the fifth time information meet the synchronization requirements or coordination requirements between packets.

18. The method according to claim 17, wherein The third preset packet includes one of the following: All packets within the fifth time information; Packets corresponding to I frames within the fifth time information; Packets with high importance within the fifth time information; Packets with importance higher than a third preset value within the fifth time information; Packets with delay requirements, synchronization requirements, or coordination requirements within the fifth time information; Packets on which the decoding or demodulation of other packets within the fifth time information depends.

19. The method according to any one of claims 1 to 4, characterized in that, The multiple packets include: Multiple packets of the same user; Multiple packets of different users; Multiple packets of the same terminal; Multiple packets of different terminals; Multiple packets of the same stream; Multiple packets of different streams; Multiple packets of the same Quality of Service (QoS) flow; Multiple packets of different QoS flows; Multiple packets within the same Internet Protocol (IP) or User Datagram Protocol (UDP) packet; Multiple packets in different IP or UDP packets; Multiple packets within the same burst; Multiple packets in different bursts; Multiple packets within the same bearer; Multiple packets in different bearers; Multiple packets within the same Protocol Data Unit (PDU) session; Multiple packets in different PDU sessions; Multiple packets within the same PDU Set; Multiple packets in different PDU Sets; Multiple packets within the same PDU; Multiple packets in different PDUs; Multiple packets within the same Data Radio Bearer (DRB); Multiple packets in different DRBs; Multiple packets within the same service; Multiple packets in different services.

20. The method according to claim 1 or 11 or 12, characterized in that The stream includes at least one of the following: QoS flow, Stream, IP data stream, UDP data stream.

21. A communication processing method, characterized in that, Includes: The receiving end receives multiple streams or multiple packets, and the multiple streams or multiple packets meet the synchronization requirement or coordination requirement.

22. The method according to claim 21, wherein That the multiple packets meet the synchronization requirement or coordination requirement includes: the delay difference between the multiple packets is less than or equal to a first preset threshold.

23. The method according to claim 22, wherein The delay difference between the multiple packets includes at least one of the following: The delay difference when the multiple packets are received at the receiving end; The delay difference between when one or more packets are received at the receiving end and when other packets are sent at the sending end; The delay difference between when one or more packets are sent at the sending end and when other packets are received at the receiving end; The delay difference of the multiple packets in the buffer; The delay difference when the multiple packets arrive at the buffer.

24. The method according to claim 22, wherein In the case where the packet includes multiple packets, the delay difference between the multiple packets includes at least one of the following: The delay difference between the first packets included in the multiple packets The delay difference between the last packets included in the multiple packets; The delay difference between the first packet of the first packet of the multiple packets and the last packet of the last packet; The delay difference between the last packet of the first packet of the multiple packets and the first packet of the last packet; The delay difference between the average time or average delay when the fourth preset packets included in the multiple packets arrive at the receiving end; The delay difference between the maximum delays when the fifth preset packets included in the multiple packets arrive at the receiving end; The delay difference between the maximum delay and the minimum delay when the sixth preset packets included in the multiple packets arrive at the receiving end.

25. The method according to claim 24, characterized in that, The first packet includes a first packet within the first time information, and the first packet includes one of the following: The packet with the first sort; The first packet to arrive at the receiving end; The first packet to arrive at the buffer.

26. The method according to claim 24, wherein The last packet includes a second packet within the second time information, and the second packet includes one of the following: The packet with the last sort; The last packet to arrive at the receiving end; The last packet to arrive at the buffer.

27. The method according to claim 24, characterized in that, The fourth preset packet or the fifth preset packet or the sixth preset packet includes one of the following: All the packets within the packet; A preset proportion of the packets within the packet; A preset number of the packets within the packet; The first packet; The last packet; Packets with in-packet delay not exceeding a second preset threshold; Packets with in-packet delay not less than a third preset threshold.

28. The method according to claim 24 or 27, characterized in that The first group includes one of the following: The packet ranked first among multiple packets in a packet; The first packet to reach the receiving end; The first packet to reach the buffer.

29. The method according to claim 24 or 27, characterized in that, The last packet includes one of the following: The packet ranked last among multiple packets in a packet; The last packet to reach the receiving end; The last packet to reach the buffer.

30. The method according to claim 24, wherein The delay difference preset thresholds corresponding to any two of the fourth preset packet, the fifth preset packet, and the sixth preset packet are the same or different.

31. The method according to claim 21, wherein The satisfaction of the synchronization requirement or coordination requirement among the multiple streams includes: The delay difference among the multiple streams is less than or equal to a fourth preset threshold.

32. The method according to claim 31, characterized in that, The delay difference among the multiple streams includes: The difference between the average delay of first preset packets in one or more first streams within a third time information and the average delay of second preset packets in one or more second streams within a fourth time information; Wherein, the first stream is one of the multiple streams, and the second stream is the other streams except the first stream among the multiple streams.

33. The method according to claim 32, characterized in that, The third time information is the same as or different from the fourth time information.

34. The method according to claim 32, wherein, The first preset packet includes at least one of the following: All packets in the first stream within the third time information; Packets corresponding to I-frames in the first stream within the third time information; Packets with high importance in the first stream within the third time information; Packets with importance higher than a first preset value in the first stream within the third time information; Packets with delay requirements, synchronization requirements, or coordination requirements in the first stream within the third time information; Packets on which the decoding or demodulation of other packets in the first stream within the third time information depends; Or, The second preset packet includes at least one of the following: All packets in the second stream within the fourth time information; Packets corresponding to I-frames in the second stream within the fourth time information; Packets with high importance in the second stream within the fourth time information; Packets with importance higher than a second preset value in the second stream within the fourth time information; Packets with delay requirements, synchronization requirements, or coordination requirements in the second stream within the fourth time information; Packets on which the decoding or demodulation of other packets in the second stream within the fourth time information depends.

35. The method according to claim 32, wherein The difference between the average delay of first preset packets in one or more first streams within the third time information and the average delay of second preset packets in one or more second streams within the fourth time information includes at least one of the following: The difference between the average delay of first preset packets in the first stream at the sending end and the average delay of second preset packets in the second stream at the sending end; The average delay of receiving first preset packets in the first stream and the average delay of sending second preset packets in the second stream at the sending end; The average delay of sending first preset packets in the first stream and the average delay of receiving second preset packets in the second stream at the receiving end; The difference between the average delay of first preset packets in the first stream in the buffer and the average delay of second preset packets in the second stream in the buffer; The difference between the average delay of the first preset packet in the first stream reaching the buffer and the average delay of the second preset packet in the second stream reaching the buffer.

36. The method according to claim 31, characterized in that, The delay differences between multiple streams include at least one of the following: The delay differences of multiple streams received at the receiving end; The delay differences between the receiving delay of one or more streams at the receiving end and the sending delay of other streams at the sending end; The delay differences between the sending delay of one or more streams at the sending end and the receiving delay of other streams at the receiving end; The delay differences of multiple streams in the buffer; The delay differences of multiple streams reaching the buffer.

37. The method according to claim 21, wherein Meeting the synchronization requirements or coordination requirements among multiple includes: The third preset packets of multiple streams within the fifth time information meet the synchronization requirements or coordination requirements among the packets.

38. The method according to claim 37, wherein The third preset packet includes one of the following: All the packets within the fifth time information; The packets corresponding to the I-frames within the fifth time information; The packets with high importance within the fifth time information; The packets with importance higher than the third preset value within the fifth time information; The packets with delay requirements, synchronization requirements, or coordination requirements within the fifth time information; The packets on which the decoding or demodulation of other packets within the fifth time information depends.

39. The method according to any one of claims 21 to 24, characterized in that, The multiple packets include: Multiple packets of the same user; Multiple packets of different users; Multiple packets of the same terminal; Multiple packets of different terminals; Multiple packets of the same stream; Multiple packets of different streams; Multiple packets of the same QoS flow; Multiple packets of different QoS flows; Multiple packets within the same IP or UDP packet; Multiple packets in different IP or UDP packets; Multiple packets within the same burst; Multiple packets in different bursts; Multiple packets within the same bearer; Multiple packets in different bearers; Multiple packets within the same PDU session; Multiple packets in different PDU sessions; Multiple packets within the same PDU set; Multiple packets in different PDU sets; Multiple packets within the same PDU; Multiple packets in different PDUs; Multiple packets within the same DRB; Multiple packets in different DRBs; Multiple packets within the same service; Multiple packets in different services.

40. The method according to claim 21, 31 or 32, characterized in that, The stream includes at least one of the following: QoS flow, Stream, IP data stream, UDP data stream.

41. A communication processing device, characterized in that, Includes: A sending module for sending multiple streams or multiple packets, where the multiple streams or multiple packets meet the synchronization requirements or coordination requirements.

42. The device according to claim 41, characterized in that, Meeting the synchronization requirements or coordination requirements among the multiple packets includes: the delay difference among the multiple packets is less than or equal to a first preset threshold.

43. The device according to claim 42, characterized in that, The delay difference among the multiple packets includes at least one of the following: The delay difference of multiple packets sent at the sending end; The delay difference between the reception of one or more packets at the receiving end and the transmission of other packets at the sending end; The delay difference between the transmission of one or more packets at the sending end and the reception of other packets at the receiving end; The delay difference of multiple packets in the buffer; The delay difference of multiple packets reaching the buffer.

44. A communication processing device, characterized in that, Includes: A receiving module for receiving multiple streams or multiple packets, where the multiple streams or multiple packets meet the synchronization requirements or coordination requirements.

45. The device according to claim 44, characterized in that, Meeting the synchronization requirements or coordination requirements among the multiple packets includes: the delay difference among the multiple packets is less than or equal to a first preset threshold.

46. The device according to claim 45, characterized in that, The delay difference among the multiple packets includes at least one of the following: The delay difference of multiple packets received at the receiving end; One or more packets receive a delay difference at the receiving end from that of other packets sent at the sending end; One or more packets have a delay difference when sent at the sending end from that of other packets received at the receiving end; The delay differences of multiple packets in the buffer; The delay differences of multiple packets arriving at the buffer.

47. A communication device, characterized in that, Comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the steps of the method according to any one of claims 1 to 40 are implemented when the program or instructions are executed by the processor.

48. A readable storage medium, characterized in that, A program or instructions are stored on the readable storage medium, and the steps of the method according to any one of claims 1 to 40 are implemented when the program or instructions are executed by the processor of the terminal.

Images