Communication processing method and apparatus, device, and readable storage medium

Abstract

The present application belongs to the field of communication technology and discloses a communication processing method and apparatus, a device, and a readable storage medium. The method comprises: a sending end sends a plurality of streams or a plurality of packets, where a synchronization requirement or a coordination requirement is satisfied between the plurality of streams or the plurality of packets.

Description

Communication processing method, device, equipment and readable storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application No. 202311773179.X filed in China on December 21, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present application belongs to the field of communication technology, and specifically relates to a communication processing method, apparatus, device and readable storage medium. Background Art

[0004] Existing extended reality (XR) or cloud gaming (CG) services include multiple packets or multiple streams. Since the Quality of Service (QoS) requirements and operations of each packet or stream are independent, problems such as lag, dizziness, and inconsistency between images or audio may occur in XR or CG services, affecting the user service experience. Summary of the Invention

[0005] The embodiments of the present application provide a communication processing method, apparatus, device, and readable storage medium to solve the problem of how to improve user service experience.

[0006] In a first aspect, a communication processing method is provided, comprising:

[0007] The sending end sends multiple streams or multiple packets, and the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0008] In a second aspect, a communication processing method is provided, comprising:

[0009] The receiving end receives multiple streams or multiple packets, and the multiple different streams or multiple packets meet synchronization requirements or coordination requirements.

[0010] According to a third aspect, a communication processing device is provided, including:

[0011] The sending module is used to send multiple streams or multiple packets, where the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0012] According to a fourth aspect, a communication processing device is provided, including:

[0013] The receiving module is configured to receive multiple streams or multiple packets, where the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0014] In a fifth aspect, a communication device is provided, comprising: a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect or the second aspect.

[0015] In the sixth aspect, a readable storage medium is provided, on which a program or instruction is stored. When the program or instruction is executed by the processor of the sending end, the steps of the method described in the first aspect are implemented, or when the program or instruction is executed by the processor of the receiving end, the steps of the method described in the second aspect are implemented.

[0016] In the seventh aspect, a chip is provided, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the method described in the first aspect or the second aspect.

[0017] In an eighth aspect, a computer program / program product is provided, wherein the computer program / program product is stored in a non-volatile storage medium, and the program / program product is executed by at least one processor to implement the steps of the method described in the first aspect or the second aspect.

[0018] In a ninth aspect, a communication system is provided, comprising a transmitting end and a receiving end, wherein the transmitting end is used to execute the steps of the method described in the first aspect, and the receiving end is used to execute the steps of the method described in the second aspect.

[0019] In an embodiment of the present application, the multiple streams or multiple packets sent by the sending end meet the synchronization requirements or coordination requirements, avoiding the freeze and dizziness caused by the asynchrony between the multiple streams or multiple packets, or the incoordination between the pictures or audio, thereby improving the user's service experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 is a schematic diagram of XR services;

[0021] Figure 2 is a schematic diagram of interactions and operations in XR services.

[0022] Figure 3 is a schematic diagram of the 5G architecture;

[0023] FIG4 is a schematic diagram of the architecture of a wireless communication system according to an embodiment of the present application;

[0024] FIG5 is a flowchart of a communication processing method according to an embodiment of the present application;

[0025] FIG6 is a second flowchart of a communication processing method provided in an embodiment of the present application;

[0026] FIG7 is a schematic diagram of a communication processing device according to an embodiment of the present application;

[0027] FIG8 is a second schematic diagram of a communication processing device provided in an embodiment of the present application;

[0028] FIG9 is a schematic diagram of a terminal provided in an embodiment of the present application;

[0029] FIG10 is a schematic diagram of a network-side device provided in an embodiment of the present application;

[0030] FIG11 is a schematic diagram of a communication device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The following will be combined with the accompanying drawings in the embodiments of this application to clearly describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0032] The terms "first", "second", etc. in this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same type, and do not limit the number of objects, for example, the first object can be one or more. In addition, "or" in this application represents at least one of the connected objects. For example, "A or B" covers three options, namely, Option 1: including A but not including B; Option 2: including B but not including A; Option 3: including both A and B. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0033] The term "indication" in this application can be either a direct indication (or explicit indication) or an indirect indication (or implicit indication). A direct indication can be understood as the sender explicitly informing the receiver of specific information, the operation to be performed, or the requested result, etc. in the instruction sent; an indirect indication can be understood as the receiver determining the corresponding information based on the instruction sent by the sender, or making a judgment and determining the operation to be performed or the requested result, etc. based on the judgment result.

[0034] It is worth noting that the technology described in the embodiments of the present application is not limited to the Long Term Evolution (LTE) / LTE-Advanced (LTE-A) system, but can also be used in other wireless communication systems, such as Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Frequency Division Multiple Access (FDMA), Orthogonal Frequency Division Multiple Access (OFDMA), Single-carrier Frequency Division Multiple Access (SC-FDMA) or other systems. The terms "system" and "network" in this application are often used interchangeably, and the technology described can be used for the systems and radio technologies mentioned above, as well as for other systems and radio technologies. The following description describes a New Radio (NR) system for example purposes, and NR terminology is used in most of the following description, but these technologies can also be applied to systems other than NR system applications, such as 6th generation (6G) systems. th Generation, 6G) communication system.

[0035] To facilitate understanding of the embodiments of the present application, the following technical points are first introduced below:

[0036] 1. Extended Reality (XR)

[0037] XR refers to all combined real and virtual environments and human-computer interactions generated by computer technology and wearable devices. As shown in Figure 1, XR includes representative forms such as augmented reality (AR), mixed reality (MR), virtual reality (VR), and their intersections. The levels of virtual worlds range from partial sensory input to fully immersive virtual reality. A key aspect of XR is the expansion of human experience, especially those related to presence (represented by VR) and cognitive learning (represented by AR).

[0038] For VR services, the uplink primarily transmits relatively dense small data packets. These small packets can carry information such as gestures and controls, serving as input and reference for downlink presentation data. The downlink primarily transmits multimedia data such as video and audio, providing users with an immersive experience through the timely reception and presentation of this multimedia data. For example, downlink video data arrives periodically or quasi-periodically, with data rates reaching tens or even hundreds of megabits per second (Mbps). The frame rate (FPS) is typically 60 or 120, and the interval between adjacent data packets is roughly 1 / FPS second. This data must typically be successfully transmitted over the air interface within 10ms, with a transmission success rate of at least 99% or even 99.9%.

[0039] For AR services, in addition to the above-mentioned intensive transmission of small data packets, uplink may also transmit multimedia data such as video and audio. Its service characteristics are similar to those of downlink. The data rate is usually relatively low, for example, at most tens of Mbps, and the time limit for air interface transmission can be relaxed. For example, successful transmission generally requires within 60ms. The downlink data transmission characteristics are basically the same as those of VR services.

[0040] Users want to interact and manipulate in extended reality, as shown in Figure 2. Actions and interactions include movements, gestures, and body reactions. Therefore, the degrees of freedom (DoF) describe the number of independent parameters used to define the movement of the viewport in 3D space.

[0041] In XR applications, users can gain information about new perspectives by turning their heads during a virtual reality experience. This head-turning action can be communicated to the base station via an uplink signal. Upon receiving the uplink signal, the base station dispatches the required downlink data for the XR user.

[0042] XR services mainly include video data, audio data, and some control signaling and special data with control functions. In wireless networks, XR service transmission mainly involves uplink and downlink video / audio data transmission and interaction between user terminals (User Equipment, UE) and wireless new networks (such as Long Term Evolution (LTE) / New Radio (NR), etc.). Among them, while transmitting the video and audio data itself, the UE needs to uplink transmit some control signaling and special data with control functions through the wireless network to control the generation, processing and downlink wireless transmission of video and audio service data in the XR service sent by the control network to the UE.

[0043] These control information and special data with control functions include some service control data generated by the UE XR application encoder and control data information included in the service transmission protocol, such as:

[0044] A. From the application level, it can include but not be limited to:

[0045] (1) I-frames or non-Field of View (non-FOV) frames generated by the video encoder;

[0046] (2) User behavior data collected by sensors, such as pose and control data; the network can receive this data to determine user behavior, such as the user turning their head, and then adjust the content of the video data sent;

[0047] B. From the transmission protocol level, it can include:

[0048] (1) Transmission Control Protocol Acknowledgment (TCP ACK) signaling (TCP feedback) for downlink audio / video service transmission: the network needs to decide whether to continue sending subsequent frames based on whether the corresponding video / audio frame has been acknowledged by the UE;

[0049] (2) Real-time Transport Control Protocol Acknowledgment (RTCP ACK) signaling is used to control the real-time transmission of data and confirm the real-time requirements and time synchronization of business data transmission.

[0050] The network usually needs to receive these control signaling and special data with control functions from the UE in a timely and reliable manner to obtain the transmission status of the current service and related necessary control information. Based on this information, the application server needs to further generate the video and audio service data required for subsequent transmission, submit it to the wireless network for processing and transmission, and finally send this service data downlink to the UE.

[0051] 2. Packet Data Convergence Protocol (PDCP) layer and radio bearer.

[0052] The service data generated by the UE's application layer (APP) is classified into different service data flows according to their corresponding Quality of Service (QoS) requirements. Each service data flow corresponds to the same or similar QoS requirements. In the NR system, the service data flow corresponds to a QoS flow, while in the LTE system, the service data flow corresponds to an Evolved Packet System (EPS) bearer.

[0053] Service data is delivered to the access stratum (AS) in the form of packets. At the AS, it is mapped to a radio bearer (RB) based on the corresponding QoS flow (NR) or EPS bearer (LTE). A RB consists of a PDCP entity (PDCP protocol layer processing entity), a radio link control (RLC) entity (PDCP protocol layer processing entity), and the corresponding logical channel (located in the media access control (MAC) protocol layer).

[0054] When a data packet delivered to the AS layer is mapped to a radio bearer, it will be delivered to the corresponding PDCP entity for processing in the form of a PDCP service data unit (SDU). The PDCP entity will generate a corresponding PDCP protocol data unit (PDU) for each arriving PDCP SDU and set a PDCP sequence number (SN) to indicate the transmission order of each PDCP SDU and its corresponding PDCP PDU in the PDCP entity; the value of the PDCP SN is set according to the order in which the PDCP SDU is delivered to the PDCP entity. The PDCP SDU that arrives first will be transmitted first, and the PDCP SDU that is delivered later will be transmitted later. Specifically, the PDCP entity maintains an internal variable, TX_NEXT, which represents the total number of PDCP PDUs transmitted by the PDCP entity and is used to set the value of the PDCP SN. It is initialized to 0 when the PDCP entity is established. Each time a PDCP SDU is delivered from the upper layers to the corresponding PDCP entity, the PDCP entity sets the SN of the PDCP PDU corresponding to the PDCP SDU to TX_NEXT and adds 1 to TX NEXT. Afterwards, the PDCP entity adds a header file to each PDCP SDU and generates a corresponding PDCP PDU, which contains the SN value set for the PDCP PDU. The PDCP entity usually delivers the PDCP PDUs to the lower protocol layer (RLC) in sequence for subsequent processing and transmission according to the order of the SNs contained in the PDCP PDU. SN is a sequence number that indicates the number of each PDCP SDU transmitted.

[0055] The general principle is that the earlier the PDCP SDU arrives at the PDCP entity, the smaller the SN value, and the earlier it is transmitted.

[0056] 3. 5G Architecture

[0057] See Figure 3, the 5th generation (5 th The 5G system consists of the access network (AN) and the fifth generation mobile communication technology core network (5G Core Network, 5GC). If the non-standalone architecture (NSA) scenario is considered, the 4G (4 th Generation, 4G) network elements.

[0058] There are two types of ANs:

[0059] (1) Next Generation NodeB (gNB), which provides NR user plane and control plane protocol termination points for UE.

[0060] (2) New Generation Enhanced NodeB (ng-eNB), which provides the termination point of the user plane and control plane protocols of Evolved Universal Terrestrial Radio Access (E-UTRA) for UE.

[0061] FIG4 shows a block diagram of a wireless communication system applicable to embodiments of the present application. The wireless communication system includes a terminal 41 and a network-side device 42 .

[0062] The terminal 41 may be a mobile phone, tablet computer, laptop computer, notebook computer, personal digital assistant (PDA), handheld computer, netbook, ultra-mobile personal computer (UMPC), mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, flight vehicle, vehicle user equipment (VUE), shipborne equipment, pedestrian user equipment (PUE), smart home (home appliances with wireless communication capabilities, such as refrigerators, televisions, washing machines, or furniture), game console, personal computer (PC), ATM or self-service machine, etc. Wearable devices include: smart watches, smart bracelets, smart headphones, smart glasses, smart jewelry (smart bracelets, smart bracelets, smart rings, smart necklaces, smart anklets, smart anklets, etc.), smart wristbands, smart clothing, etc. Among them, the vehicle-mounted device can also be called a vehicle-mounted terminal, a vehicle-mounted controller, a vehicle-mounted module, a vehicle-mounted component, a vehicle-mounted chip, or a vehicle-mounted unit, etc. In addition to the above-mentioned terminal devices, the terminal involved in this application can also be a chip within the terminal, such as a modem chip or a system-on-chip (SoC). It should be noted that the specific type of the terminal 41 is not limited in the embodiments of this application.

[0063] The network-side device 42 may include an access network device or a core network device, wherein the access network device may also be referred to as a radio access network device, a radio access network (RAN), a radio access network function, or a radio access network unit. The access network device may include a base station, a wireless local area network (WLAN) access point (AS), or a wireless fidelity (WiFi) node. A base station may be referred to as a Node B (NB), an evolved Node B (eNB), the next generation Node B (gNB), a New Radio Node B (NR Node B), an access point, a Relay Base Station (RBS), a Serving Base Station (SBS), a Base Transceiver Station (BTS), a radio base station, a radio transceiver, a Basic Service Set (BSS), an Extended Service Set (ESS), a Home Node B (HNB), a Home Evolved Node B, a Transmission Reception Point (TRP), or other appropriate terms in the field. As long as the same technical effect is achieved, the base station is not limited to a specific technical vocabulary. It should be noted that in the embodiment of the present application, only the base station in the NR system is used as an example for introduction, and the specific type of the base station is not limited.

[0064] The core network equipment may include but is not limited to at least one of the following: core network node, core network function, Mobility Management Entity (MME), Access and Mobility Management Function (AMF), Session Management Function (SMF), User Plane Function (UPF), Policy Control Function (PCF), Policy and Charging Rules Function (PCRF), Edge Application Server Discovery Function (EASDF), Unified Data Management (UDM), Unified Data Repository (UDR), Home Subscriber Server (HSS), Centralized Network Configuration (CNC), Network Repository Function (NRF), Network Exposure Function (NEF), Local NEF (L-NEF), Binding Support Function (BSF), etc. It should be noted that in the embodiments of this application, only the core network equipment in the NR system is introduced as an example, and the specific type of the core network equipment is not limited.

[0065] The communication processing method, apparatus, communication device, and readable storage medium provided in the embodiments of the present application are described in detail below with reference to some embodiments and their application scenarios in conjunction with the accompanying drawings.

[0066] Referring to Figure 5, an embodiment of the present application provides a communication processing method, which is executed by a sending end. For example, the sending end can be a terminal or a network side device or a device corresponding to a core network node or a server-side device. The specific steps include: Step 501.

[0067] Step 501: The sending end sends multiple streams or multiple packets, and the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0068] In the present application, satisfying the synchronization requirement between multiple packets (per-Packet) or multiple streams (per-Stream / Per-QoS) can be understood as at least one of the following: (1) multiple packets or multiple streams maintain a certain synchronization relationship at the sending end, that is, the synchronization requirement is satisfied, for example, the sending time of multiple packets or multiple streams at the sending end is close or they are sent at the same time at the sending end, etc.; (2) the cache of the multiple packets or multiple streams at the sending end maintains a certain synchronization relationship, that is, the synchronization requirement or coordination requirement is satisfied, for example, the cache time of multiple packets or multiple streams at the sending end is close or at the same time, etc.

[0069] Meeting the coordination requirements between multiple packets or multiple flows can be understood as at least one of the following: (1) multiple packets or multiple flows maintain a synchronization relationship at the sending end through coordination, so that the sending time of multiple packets or multiple flows at the sending end is close or simultaneous; (2) multiple packets or multiple flows are cached at the sending end through coordination to maintain a synchronization relationship, so that the caching time of multiple packets or multiple flows at the sending end is close or simultaneous, thereby improving the user's service experience.

[0070] Optionally, the cache in this application includes but is not limited to at least one of a display buffer, a presentation cache, a rendering cache, and a processing cache.

[0071] In an embodiment of the present application, the plurality of packages include at least one of the following:

[0072] (1) Multiple packages from the same user;

[0073] (2) Multiple packages from different users;

[0074] For example, different users include different users under the same base station or cell (Cell) or distributed unit (Distributed Unit, DU) or centralized unit (Centralized Unit, CU) or core network (Core Network, CN) or radio access network (Radio Acess Network, RAN) or public land mobile network (Public Land Mobile Network, PLMN) or network, or different users under different base stations or cells or DUs or CUs or CNs or RANs or PLMNs or networks.

[0075] (3) Multiple packets from the same UE;

[0076] (4) Multiple packets from different UEs;

[0077] For example, different UEs include different UEs of the same user (such as different UEs of the same user, including but not limited to at least one of the following: watches, gloves, head displays, helmets, glasses, mobile phones, AR / VR devices), or different UEs of different users.

[0078] (5) Multiple packets of the same stream;

[0079] (6) Multiple packets from different streams;

[0080] For example, different streams include different streams of the same UE, or different streams of different UEs.

[0081] (7) Multiple packets of the same QoS flow;

[0082] (8) Multiple packets with different QoS flows;

[0083] For example, different QoS flows include different QoS flows of the same UE, or different QoS flows of different UEs, or different QoS flows include different QoS flows of the same stream, or different QoS flows of different streams.

[0084] (9) Multiple packets in the same IP or User Datagram Protocol (UDP) packet;

[0085] (10) Multiple packets in different IP or UDP packets;

[0086] For example, different IP or UDP packets include different IP or UDP packets of the same UE or stream, or different IP or UDP packets of different UEs or streams.

[0087] (11) Multiple packets in the same burst;

[0088] (12) Multiple packets in different bursts;

[0089] For example, different bursts include different bursts of the same stream, IP, UDP packet, or QoS flow, or different bursts of different streams, IP, UDP packets, or QoS flows.

[0090] (13) Multiple packets in the same bearer;

[0091] (14) Multiple packages in different Bearers;

[0092] (15) Multiple packets in the same PDU session;

[0093] (16) Multiple packets in different PDU sessions;

[0094] (17) Multiple packets in the same PDU set;

[0095] (18) Multiple packets in different PDU sets;

[0096] For example, different PDU sets include different PDU sets of the same stream or IP or UDP packet or QoS flow, or different PDU sets of different streams or IP or UDP packets or QoS flows.

[0097] (19) Multiple packets in the same PDU;

[0098] (20) Multiple packets in different PDUs;

[0099] (21) Multiple packets in the same Data Radio Bearer (DRB);

[0100] (22) Multiple packets in different DRBs;

[0101] For example, different DBRs include different DBRs for the same stream or IP or UDP packet or QoS flow, or different DBRs for different streams or IP or UDP packets or QoS flows.

[0102] (23) Multiple packages in the same business;

[0103] (24) Multiple packages in different services.

[0104] The packet can be at least one of the following: packet, burst, PDU set, PDU, service data unit (SDU), DRB, or transport block (TB). A group can be at least one of the following: burst, PDU set, PDU, SDU, DRB, or TB. For example, a packet can include multiple bursts, a burst can include multiple PDU sets, and a PDU set can include multiple PDUs.

[0105] The multiple packages include: two or more packages.

[0106] In one embodiment of the present application, the multiple packets satisfying a synchronization requirement or a coordination requirement include: a delay difference between the multiple packets is less than or equal to a first preset threshold.

[0107] Optionally, the delay difference includes one of the following: latency, delay gap, and difference.

[0108] Optionally, the first preset threshold value may be defined by a protocol, or configured by a server, a core network, a base station, or an application layer.

[0109] In this embodiment, the synchronization requirement or coordination requirement can be implicitly met by the delay requirement of the packet or stream with synchronization requirement or coordination requirement, that is, if the packet or stream with synchronization requirement or coordination requirement has synchronization requirement or coordination requirement, the delay requirement of the packet or stream needs to be met. For example, the delay requirement means that the delay difference between multiple packets is less than or equal to the first preset threshold.

[0110] In one embodiment of the present application, the delay difference between the multiple packets includes at least one of the following:

[0111] (1) The delay difference between multiple packets received at the receiving end;

[0112] In one embodiment, the delay difference between multiple packets received at the receiving end represents the maximum synchronization error allowed for the multiple packets at the receiving end. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the multiple packets to be unable to be met, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0113] (2) The delay difference between multiple packets sent at the sending end; in one embodiment, the delay difference between multiple packets sent at the sending end represents the maximum synchronization error allowed for multiple packets at the sending end. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between multiple packets to be unable to be met, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0114] (3) The delay difference between the reception of one or more packets at the receiving end and the transmission of other packets at the sending end;

[0115] In one embodiment, the delay difference between one or more packets received at the receiving end and other packets sent at the sending end represents the maximum synchronization error allowed between "one or more packets" and "other packets" (between multiple packets). Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between multiple packets to be unable to be met, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0116] For example, the delay difference between packet A received at the receiving end and packet B sent at the sending end can be the maximum allowable synchronization error. If synchronization is not possible beyond this maximum allowable value, it means that packet A and packet B do not meet the synchronization or coordination relationship. (4) The delay difference between one or more packets sent at the sending end and other packets received at the receiving end;

[0117] In one embodiment, the delay difference between one or more packets sent at the transmitting end and other packets received at the receiving end represents the maximum synchronization error allowed between "one or more packets" and "other packets" (between multiple packets). Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between multiple packets to fail to meet, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0118] For example, the delay difference between packet C sent at the sending end and packet D received at the receiving end may be the maximum allowable synchronization error. If synchronization fails beyond this maximum allowable error, it means that packet C and packet D do not meet the synchronization or coordination relationship.

[0119] (5) The delay difference between multiple packets in the buffer;

[0120] It should be noted that the delay difference of a packet in the cache refers to the time difference between the time the packet is stored in the cache and the time it is used. In one embodiment, the delay difference of multiple packets in the cache represents the maximum synchronization error allowed for multiple packets in the cache. If this delay difference is exceeded, synchronization or coordination requirements between multiple packets may not be met, resulting in service lag, dizziness, or inconsistency between the picture or audio.

[0121] (6) The delay difference between multiple packets arriving at the cache.

[0122] It should be noted that the delay difference between packets arriving at the cache refers to the time difference between the ideal arrival time and the actual arrival time of the packets. In one embodiment, the delay difference between multiple packets arriving at the cache represents the maximum synchronization error allowed for multiple packets in the cache. If this delay difference is exceeded, synchronization or coordination requirements between multiple packets may not be met, resulting in service lag, dizziness, or inconsistency between the picture or audio.

[0123] In one embodiment of the present application, when the packet includes multiple packets, the delay difference between the multiple packets includes at least one of the following:

[0124] (1) a delay difference between the first packets included in the plurality of packets;

[0125] In one embodiment, the delay difference between the first groups of multiple packets represents the maximum synchronization error allowed between the first groups of multiple packets. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the first groups of multiple packets to be unable to be met, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0126] (2) The delay difference between the last packets included in multiple packets;

[0127] In one embodiment, the delay difference between the last groups of multiple packets represents the maximum synchronization error allowed between the last groups of multiple packets. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the last groups of multiple packets to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0128] (3) a delay difference between the first packet of the first packet and the last packet of the last packet of the plurality of packets;

[0129] In one embodiment, the delay difference between the first group and the last group of multiple packets represents the maximum synchronization error allowed between the first group and the last group of multiple packets. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the first group and the last group of multiple packets to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0130] (4) a delay difference between the last packet of the first packet and the first packet of the last packet of the plurality of packets;

[0131] In one embodiment, the delay difference between the first group and the last group of multiple packets represents the maximum synchronization error allowed between the first group and the last group of multiple packets. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the first group and the last group of multiple packets to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0132] (5) the average time or average delay difference between the first preset packets respectively included in the plurality of packets and sent from the transmitting end;

[0133] For example, if the average time or average delay for sending the first preset group of packet A from the sending end is X, and the average time or average delay for sending the first preset group of packet B from the sending end is Y, then the delay difference is XY, or YX.

[0134] In one embodiment, the maximum synchronization error between the average time or average delay of sending the first preset group of multiple packets at the sending end, once it exceeds the delay difference, may cause the average time or average delay of sending the first preset group of multiple packets at the sending end to fail to meet the synchronization or coordination requirements, thereby causing service freezes, dizziness, or incoordination between pictures or audio and other problems.

[0135] (6) a delay difference between the maximum delays of the second preset packets respectively included in the plurality of packets being sent from the transmitting end;

[0136] For example, the maximum delay of sending the second preset packet of packet A from the sending end is X, and the maximum delay of sending the second preset packet of packet B from the sending end is Y, then the delay difference is XY, or YX.

[0137] In one embodiment, once the maximum synchronization error between the maximum delays of the second preset groups of multiple packets sent at the sending end exceeds the delay difference, it may cause the second preset groups of multiple packets to be unable to meet the synchronization or coordination requirements between the maximum delays of the second preset groups of multiple packets sent at the sending end, thereby causing service freezes, dizziness, or incoordination between pictures or audio and other problems.

[0138] (7) The delay difference between the maximum delay and the minimum delay of the third preset packets respectively included in the multiple packets when sent from the sending end.

[0139] For example, the maximum delay of the third preset group of packet A from the sending end is X, and the minimum delay of the third preset group of packet B from the sending end is Y, then the delay difference is XY.

[0140] In one embodiment, the maximum synchronization error between the maximum delay and the minimum delay of the third preset group of multiple packets sent from the sending end, once exceeds the delay difference, may cause the maximum delay and the minimum delay of the third preset group of multiple packets sent from the sending end to fail to meet the synchronization or coordination requirements, thereby causing service freezes, dizziness, or incoordination between pictures or audio and other problems.

[0141] (8) the average time or average delay difference between the fourth preset packets respectively included in the plurality of packets and arriving at the receiving end;

[0142] For example, the average time or average delay for the fourth preset group of packet A to reach the receiving end is X, and the average time or average delay for the fourth preset group of packet B to reach the receiving end is Y, then the delay difference is XY, or YX.

[0143] In one embodiment, once the maximum synchronization error between the average time or average delay for the fourth preset grouping of multiple packets to arrive at the receiving end exceeds the delay difference, it may cause the average time or average delay for the fourth preset grouping of multiple packets to arrive at the receiving end to fail to meet the synchronization or coordination requirements, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0144] (9) the delay difference between the maximum delays of the fifth preset packets respectively included in the plurality of packets reaching the receiving end;

[0145] For example, the maximum delay for the fifth preset group of packet A to reach the receiving end is X, and the maximum delay for the fifth preset group of packet B to reach the receiving end is Y, then the delay difference is XY, or YX.

[0146] In one embodiment, once the maximum synchronization error between the maximum delays for the fifth preset groups of multiple packets to arrive at the receiving end exceeds the delay difference, it may cause the maximum delays for the fifth preset groups of multiple packets to arrive at the receiving end to fail to meet the synchronization or coordination requirements, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0147] (10) The delay difference between the maximum delay and the minimum delay of the sixth preset packets respectively included in the multiple packets reaching the receiving end.

[0148] For example, the maximum delay for the sixth preset packet of packet A to reach the receiving end is X, and the minimum delay for the sixth preset packet of packet B to reach the receiving end is Y, then the delay difference is XY.

[0149] In one embodiment, the maximum synchronization error between the maximum delay and the minimum delay for the sixth preset group of multiple packets to arrive at the receiving end, once exceeds the delay difference, may cause the maximum delay and the minimum delay for the sixth preset group of multiple packets to arrive at the receiving end to fail to meet the synchronization or coordination requirements, thereby causing service freezes, dizziness, or incoordination between pictures or audio and other problems.

[0150] In one embodiment of the present application, the first packet includes a first packet in the first time information, and the first packet includes one of the following:

[0151] (1) The first-ranked package;

[0152] (2) The first packet sent from the sender;

[0153] (3) The first packet to arrive at the cache;

[0154] (4) The first packet to arrive at the receiving end.

[0155] In one embodiment of the present application, the last packet includes a second packet in the second time information, and the second packet includes one of the following:

[0156] (1) Sort the last packet;

[0157] (2) The last packet sent from the sender;

[0158] (3) The last packet to arrive at the cache;

[0159] (4) The last packet to arrive at the receiving end.

[0160] In one embodiment of the present application, the first preset group, the second preset group, the third preset group, the fourth preset group, the fifth preset group, or the sixth preset group includes one of the following:

[0161] (1) All packets in the package;

[0162] (2) grouping with a preset ratio within the package;

[0163] (3) a grouping of a preset number of items within a package;

[0164] (4) first group;

[0165] (5) The last group;

[0166] (6) packets whose intra-packet delay does not exceed a second preset threshold;

[0167] (7) Packets whose intra-packet delay is not less than the third preset threshold.

[0168] Optionally, the second preset threshold value and the third preset threshold value may be defined by a protocol, or configured by a server, a core network, a base station, or an application layer.

[0169] In one embodiment of the present application, the first group includes one of the following:

[0170] (1) The first group in the order of multiple groups in the packet, that is, the group with the first number;

[0171] (2) The first packet sent from the sender;

[0172] (3) The first packet to arrive at the cache;

[0173] (4) The first packet to arrive at the receiving end.

[0174] In one embodiment of the present application, the last group includes one of the following:

[0175] (1) The last group in the order of multiple groups in the packet;

[0176] (2) The last packet sent from the sender;

[0177] (3) The last packet to arrive at the cache;

[0178] (4) The last packet to arrive at the receiving end.

[0179] In one embodiment of the present application, the delay difference preset thresholds corresponding to any two preset groups among the first preset group, the second preset group, the third preset group, the fourth preset group, the fifth preset group and the sixth preset group are the same or different.

[0180] In one embodiment of the present application, the synchronization requirements or coordination requirements between the multiple streams include:

[0181] The delay difference between the multiple streams is less than or equal to a fourth preset threshold.

[0182] The delay difference between the multiple flows being less than or equal to the fourth preset threshold indicates that the transmission speeds or travel speeds of the multiple flows are close.

[0183] The multiple flows include: two or more flows.

[0184] Optionally, the fourth preset threshold value may be defined by a protocol, or configured by a server, a core network, a base station, or an application layer.

[0185] In one embodiment of the present application, the delay difference between the multiple streams includes: a difference between an average delay of first preset packets in one or more first streams within the third time information and an average delay of second preset packets in one or more second streams within the fourth time information;

[0186] The first stream is one of the multiple streams, and the second stream is another stream among the multiple streams except the first stream.

[0187] If the difference between the average delay of the first preset packet in one or more first streams within the third time information and the average delay of the second preset packet in one or more second streams within the fourth time information, the synchronization requirement or coordination requirement is met between the one or more first streams and the one or more second streams.

[0188] The average delay of the first preset packet in the first stream counted within the third time information can represent the transmission speed or travel speed of multiple first streams, and the average delay of the second preset packet in the second stream counted within the fourth time information can represent the transmission service speed or travel speed of multiple second streams.

[0189] Optionally, the third time information and the fourth time information may be defined by a protocol, or configured by a server, a core network, a base station or an application layer.

[0190] Optionally, the third time information is the same as or different from the fourth time information.

[0191] In one embodiment of the present application, the first preset package includes at least one of the following:

[0192] (1) all packets in the first stream within the third time information;

[0193] (2) a packet corresponding to an I frame in the first stream within the third time information;

[0194] (3) a packet of high importance in the first stream within the third time information;

[0195] For example, a packet with high PDU set importance (PSI) in the first flow within the third time information;

[0196] (4) a packet in the first stream within the third time information whose importance is higher than a first preset value;

[0197] For example, a packet whose importance of the PDU in the first flow within the third time information is higher than a first preset value;

[0198] (5) There are packets with delay requirements, synchronization requirements, or coordination requirements in the first stream within the third time information;

[0199] (6) There are packets in the first stream within the third time information that are dependent on the decoding or demodulation of other packets.

[0200] For example, if the decoding or demodulation of packet A depends on packet B, the first preset packet is packet B.

[0201] In one embodiment of the present application, the second preset package includes at least one of the following:

[0202] (1) all packets in the second stream within the fourth time information;

[0203] (2) a packet corresponding to an I frame in the second stream within the fourth time information;

[0204] (3) a packet of high importance in the second stream within the fourth time information;

[0205] For example, a packet with a high PDU importance in the second flow within the fourth time information;

[0206] (4) a packet in the second stream within the fourth time information whose importance is higher than a second preset value;

[0207] For example, a packet whose importance of the PDU in the second flow within the fourth time information is higher than a second preset value;

[0208] (5) There are packets with delay requirements, synchronization requirements, or coordination requirements in the second stream within the fourth time information;

[0209] (6) The second stream within the fourth time information contains packets on which decoding or demodulation of other packets depends.

[0210] For example, if the decoding or demodulation of packet A depends on packet B, the second preset packet is packet B.

[0211] In one embodiment of the present application, the difference between the average delay of the first preset packets in one or more first streams in the third time information and the average delay of the second preset packets in one or more second streams in the fourth time information includes at least one of the following:

[0212] (1) the difference between the average delay of the first preset packet in the first stream at the transmitting end and the average delay of the second preset packet in the second stream at the transmitting end;

[0213] (2) the average delay between the first preset packet in the first stream being received at the receiving end and the second preset packet in the second stream being sent at the sending end;

[0214] (3) the average delay between the first preset packet in the first stream being sent at the transmitting end and the second preset packet in the second stream being received at the receiving end;

[0215] (4) the difference between the average delay of the first preset packet in the first stream in the cache and the average delay of the second preset packet in the second stream in the cache;

[0216] (5) The difference between the average delay of the first preset packet in the first stream reaching the cache and the average delay of the second preset packet in the second stream reaching the cache.

[0217] In one embodiment of the present application, the delay difference between the multiple streams includes at least one of the following:

[0218] (1) The delay difference between multiple streams sent at the sending end;

[0219] In one embodiment, the delay difference between multiple streams sent at the sending end represents the maximum synchronization error allowed for the multiple streams at the sending end. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the multiple streams to be unable to be met, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0220] (2) The delay difference between the reception delay of one or more streams at the receiving end and the transmission delay of other streams at the sending end;

[0221] In one embodiment, the delay difference between one or more streams received at the receiving end and other streams sent at the transmitting end represents the maximum synchronization error allowed between multiple streams ("one or more streams" and "other streams"). Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between multiple streams to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0222] (3) The delay difference between the sending delay of one or more streams at the sending end and the receiving delay of other streams at the receiving end;

[0223] In one embodiment, the delay difference between one or more streams sent at the transmitting end and other streams received at the receiving end represents the maximum synchronization error allowed between "one or more streams" and "other streams" ("one or more streams" and "other streams"). Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between multiple streams to fail, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0224] (4) The delay difference between multiple flows in the cache;

[0225] In one embodiment, the delay difference between multiple streams in the cache represents the maximum synchronization error allowed for the multiple streams in the cache. Once the delay difference is exceeded, the synchronization or coordination requirements between the multiple streams may not be met, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0226] (5) The delay difference between multiple flows reaching the cache;

[0227] In one embodiment, the delay difference between multiple streams reaching the cache represents the maximum synchronization error allowed for the multiple streams in the cache. Once the delay difference is exceeded, the synchronization or coordination requirements between the multiple streams may not be met, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0228] (6) The delay difference between multiple streams received at the receiving end.

[0229] In one embodiment, the delay difference between multiple streams received at the receiving end represents the maximum synchronization error allowed for the multiple streams at the receiving end. Once the delay difference is exceeded, it may cause the synchronization or coordination requirements between the multiple streams to be unable to be met, thereby causing service freezes, dizziness, or incoordination between pictures or audio.

[0230] In one embodiment of the present application, the synchronization requirements or coordination requirements between the multiple streams include:

[0231] The third preset packets of the multiple streams within the fifth time information meet the synchronization requirement or coordination requirement between the packets.

[0232] In one embodiment of the present application, the third preset package includes one of the following:

[0233] (1) All packets within the fifth time information;

[0234] (2) the packet corresponding to the I frame in the fifth time information;

[0235] (3) The most important packet in the fifth time information

[0236] For example, the packet with high PDU importance in the fifth time information;

[0237] (4) a packet in the fifth time information whose importance is higher than the third preset value;

[0238] For example, the importance of the PDU in the fifth time information is higher than the third preset value;

[0239] (5) The fifth time information contains packets with delay requirements, synchronization requirements, or coordination requirements;

[0240] (6) The fifth time information contains packets that are dependent on the decoding or demodulation of other packets.

[0241] For example, if the decoding or demodulation of packet A depends on packet B, the third preset packet is packet B.

[0242] Exemplarily, if packet delay budgets (PDB) or PDU set delay budgets (PSDB) corresponding to the multiple flows are all satisfied within the fifth time information, then the synchronization requirement or coordination requirement is satisfied between the multiple flows.

[0243] In this embodiment, the synchronization requirement or coordination requirement among multiple streams is determined by satisfying existing delay requirements, such as PDB or PSDB.

[0244] Exemplarily, a difference between packet delay budgets (PDB) or PDU set delay budgets (PSDB) corresponding to two or more flows is smaller than a fifth preset threshold.

[0245] Optionally, the fifth preset threshold may be defined by a protocol, or configured by a server, a core network, a base station, or an application layer.

[0246] In this embodiment, the synchronization requirement or coordination requirement between multiple streams is determined by determining whether the difference in existing delay requirements, such as the difference in PDB or PSDB, meets a fifth preset threshold. In this embodiment, the first time information may be a first preset window, a first duration range, or a first cycle; the second time information may be a second preset window, a second duration range, or a second cycle; the third time information may be a third preset window, a third duration range, or a third cycle; the fourth time information may be a fourth preset window, a fourth duration range, or a fourth cycle; and the fifth time information may be a fifth preset window, a fifth duration range, or a fifth cycle.

[0247] Optionally, in one embodiment of the present application, synchronization requirements or coordination requirements are met between multiple packets and multiple flows by performing at least one of the following operations:

[0248] 1) Map the stream to the corresponding QoS flow;

[0249] Specifically, by controlling the mapping of flows to QoS flows, synchronization requirements or coordination requirements can be met between different flows or different packets.

[0250] 2) Map the stream or QoS flow to the corresponding Data Radio Bearer (DRB);

[0251] Specifically, by controlling the mapping of streams or QoS flows to DRBs, synchronization requirements or coordination requirements can be met between different flows or different packets.

[0252] 3) Map the stream or QoS flow or DRB to the corresponding radio bearer;

[0253] Specifically, by controlling the mapping of streams or QoS flows or DRBs to bearers, synchronization requirements or coordination requirements can be met between different flows or packets of different flows.

[0254] 4) Map the stream or QoS flow or DRB or Bearer to the corresponding logical channel group (LCG);

[0255] Specifically, by controlling the mapping of streams or QoS flows or DRBs or Bearers to LCGs, synchronization requirements or coordination requirements can be met between different flows or packets of different flows.

[0256] 5) Map the stream or QoS flow or DRB or Bearer to the corresponding logical channel priority (LCP);

[0257] Specifically, by controlling the mapping of streams or QoS flows or DRBs or Bearers to LCPs, synchronization requirements or coordination requirements can be met between different flows or packets of different flows.

[0258] 6) Map the stream or QoS flow or DRB or Bearer to the corresponding logical channel (Logic Channel, LCH);

[0259] For example, by controlling the mapping of streams or QoS flows or DRBs or Bearers to LCHs, synchronization requirements or coordination requirements can be met between different flows or packets of different flows.

[0260] 7) Apply the corresponding discard timer (discardTimer);

[0261] Specifically, by setting different discardTimer controls for different packets or packets of different streams, synchronization requirements or coordination requirements can be met between different streams or packets of different streams. In an embodiment of the present application, the synchronization requirements or coordination requirements are met between multiple streams or multiple packets sent by the sending end, avoiding the freeze and dizziness caused by the asynchrony between multiple streams or multiple packets, or the incoordination between pictures or audio, thereby improving the user's service experience.

[0262] 6 , an embodiment of the present application provides a communication processing method, which is performed by a receiving end. For example, the receiving end may be a terminal, a network-side device, a device corresponding to a core network node, or a server-side device. The specific steps include:

[0263] Step 601: A receiving end receives multiple streams or multiple packets, and the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0264] In this application, satisfying the synchronization requirement between multiple packets (per-Packet) or multiple streams (per-Stream / Per-QoS) can be understood as at least one of the following: (1) multiple packets or multiple streams maintain a certain synchronization relationship at the receiving end, that is, satisfying the synchronization requirement, for example, multiple packets or multiple streams are received at the receiving end at a close time or at the same time; (2) multiple packets or multiple streams maintain a certain synchronization relationship in the cache at the receiving end, that is, satisfying the synchronization requirement or coordination requirement, for example, multiple packets or multiple streams are cached at the receiving end at a close time or at the same time, etc.

[0265] Meeting the coordination requirements between multiple packets or multiple streams can be understood as at least one of the following: (1) multiple packets or multiple streams are coordinated at the receiving end to achieve close or simultaneous reception time, (2) multiple packets or multiple streams are coordinated at the receiving end to achieve close or simultaneous caching time, thereby improving the user's service experience.

[0266] In one embodiment of the present application, multiple packets satisfying a synchronization requirement or a coordination requirement includes: a delay difference between the multiple packets is less than or equal to.

[0267] In one embodiment of the present application, the delay difference between the multiple packets includes at least one of the following:

[0268] (1) The delay difference between multiple packets received at the receiving end;

[0269] (2) The delay difference between one or more packets received at the receiving end and other packets sent at the sending end;

[0270] (3) The delay difference between one or more packets sent at the sender and other packets received at the receiver;

[0271] (4) The delay difference of multiple packets in the cache;

[0272] (5) The delay difference between multiple packets reaching the cache;

[0273] (6) The delay difference between multiple packets sent at the sending end.

[0274] In one embodiment of the present application, when the packet includes multiple packets, the delay difference between the multiple packets includes at least one of the following:

[0275] (1) a delay difference between the first packets included in the plurality of packets;

[0276] (2) The delay difference between the last packets included in multiple packets;

[0277] (3) a delay difference between the first packet of the first packet and the last packet of the last packet of the plurality of packets;

[0278] (4) a delay difference between the last packet of the first packet and the first packet of the last packet of the plurality of packets;

[0279] (5) the average time or average delay difference between the first preset packets respectively included in the plurality of packets and sent from the transmitting end;

[0280] For example, if the average time or average delay for sending the first preset group of packet A from the sending end is X, and the average time or average delay for sending the first preset group of packet B from the sending end is Y, then the delay difference is XY, or YX.

[0281] (6) a delay difference between the maximum delays of the second preset packets respectively included in the plurality of packets being sent from the transmitting end;

[0282] For example, the maximum delay of sending the second preset packet of packet A from the sending end is X, and the maximum delay of sending the second preset packet of packet B from the sending end is Y, then the delay difference is XY, or YX.

[0283] (7) The delay difference between the maximum delay and the minimum delay of the third preset packets respectively included in the multiple packets when sent from the sending end.

[0284] For example, the maximum delay of the third preset group of packet A from the sending end is X, and the minimum delay of the third preset group of packet B from the sending end is Y, then the delay difference is XY.

[0285] (8) the average time or average delay difference between the fourth preset packets respectively included in the plurality of packets and arriving at the receiving end;

[0286] For example, the average time or average delay for the fourth preset group of packet A to reach the receiving end is X, and the average time or average delay for the fourth preset group of packet B to reach the receiving end is Y, then the delay difference is XY, or YX.

[0287] (9) the delay difference between the maximum delays of the fifth preset packets respectively included in the plurality of packets reaching the receiving end;

[0288] For example, the maximum delay for the fifth preset group of packet A to reach the receiving end is X, and the maximum delay for the fifth preset group of packet B to reach the receiving end is Y, then the delay difference is XY, or YX.

[0289] (10) The delay difference between the maximum delay and the minimum delay of the sixth preset packets respectively included in the multiple packets reaching the receiving end.

[0290] For example, the maximum delay for the sixth preset packet of packet A to reach the receiving end is X, and the minimum delay for the sixth preset packet of packet B to reach the receiving end is Y, then the delay difference is XY.

[0291] In one embodiment of the present application, the first packet includes a first packet in the first time information, and the first packet includes one of the following:

[0292] (1) The first-ranked package;

[0293] (2) The first packet to arrive at the receiving end;

[0294] (3) The first packet to arrive at the cache;

[0295] (4) The first packet sent from the sender.

[0296] In one embodiment of the present application, the last packet includes a second packet in the second time information, and the second packet includes one of the following:

[0297] (1) Sort the last packet;

[0298] (2) The last packet to arrive at the receiving end;

[0299] (3) The last packet to arrive at the cache;

[0300] (4) The last packet sent from the sender.

[0301] In one embodiment of the present application, the first preset group or the second preset group or the third preset group or the fourth preset group or the fifth preset group or the sixth preset group includes one of the following:

[0302] (1) All packets in the package;

[0303] (2) grouping with a preset ratio within the package;

[0304] (3) a grouping of a preset number of items within a package;

[0305] (4) first group;

[0306] (5) The last group;

[0307] (6) packets whose intra-packet delay does not exceed a second preset threshold;

[0308] (7) Packets whose intra-packet delay is not less than the third preset threshold.

[0309] Optionally, the second preset threshold value and the third preset threshold value may be defined by a protocol, or configured by a server, a core network, a base station, or an application layer.

[0310] In one embodiment of the present application, the first group includes one of the following:

[0311] (1) The group that ranks first among multiple groups, that is, the group that ranks first in number;

[0312] (2) The first packet to arrive at the receiving end;

[0313] (3) The first packet to arrive at the cache;

[0314] (4) The first packet sent from the sender.

[0315] In one embodiment of the present application, the last group includes one of the following:

[0316] (1) The last group in the order of multiple groups in the packet;

[0317] (2) The last packet to arrive at the receiving end;

[0318] (3) The last packet to arrive at the cache;

[0319] (4) The last packet sent from the sender.

[0320] In one embodiment of the present application, the delay difference preset thresholds corresponding to any two preset groups among the first preset group, the second preset group, the third preset group, the fourth preset group, the fifth preset group and the sixth preset group are the same or different.

[0321] In one embodiment of the present application, the synchronization requirements or coordination requirements between the multiple streams include:

[0322] The delay difference between the multiple streams is less than or equal to a fourth preset threshold.

[0323] Optionally, the fourth preset threshold value may be defined by a protocol, or configured by a server, a core network, a base station, or an application layer.

[0324] In one embodiment of the present application, the delay difference between the multiple streams includes: a difference between an average delay of first preset packets in one or more first streams within the third time information and an average delay of second preset packets in one or more second streams within the fourth time information;

[0325] The first stream is one of the multiple streams, and the second stream is another stream among the multiple streams except the first stream.

[0326] In one embodiment of the present application, the third time information is the same as or different from the fourth time information.

[0327] Optionally, the third time information and the fourth time information may be defined by a protocol, or configured by a server, a core network, a base station or an application layer.

[0328] In one embodiment of the present application, the first preset package includes at least one of the following:

[0329] (1) all packets in the first stream within the third time information;

[0330] (2) a packet corresponding to an I frame in the first stream within the third time information;

[0331] (3) a packet of high importance in the first stream within the third time information;

[0332] For example, a packet with high PDU set importance (PSI) in the first flow within the third time information;

[0333] (4) a packet in the first stream within the third time information whose importance is higher than a first preset value;

[0334] For example, a packet whose importance of the PDU in the first flow within the third time information is higher than a first preset value;

[0335] (5) There are packets with delay requirements, synchronization requirements, or coordination requirements in the first stream within the third time information;

[0336] (6) There are packets in the first stream within the third time information that are dependent on the decoding or demodulation of other packets.

[0337] For example, if the decoding or demodulation of packet A depends on packet B, the first preset packet is packet B.

[0338] In one embodiment of the present application, the second preset package includes at least one of the following:

[0339] (1) all packets in the second stream within the fourth time information;

[0340] (2) a packet corresponding to an I frame in the second stream within the fourth time information;

[0341] (3) a packet of high importance in the second stream within the fourth time information;

[0342] For example, a packet with a high PDU importance in the second flow within the fourth time information;

[0343] (4) a packet in the second stream within the fourth time information whose importance is higher than a second preset value;

[0344] For example, a packet whose importance of the PDU in the second flow within the fourth time information is higher than a second preset value;

[0345] (5) There are packets with delay requirements, synchronization requirements, or coordination requirements in the second stream within the fourth time information;

[0346] (6) The second stream within the fourth time information contains packets on which decoding or demodulation of other packets depends.

[0347] For example, if the decoding or demodulation of packet A depends on packet B, the second preset packet is packet B.

[0348] In one embodiment of the present application, the difference between the average delay of the first preset packets in one or more first streams in the third time information and the average delay of the second preset packets in one or more second streams in the fourth time information includes at least one of the following:

[0349] (1) the difference between the average delay of the first preset packet in the first stream at the transmitting end and the average delay of the second preset packet in the second stream at the transmitting end;

[0350] (2) the average delay between the first preset packet in the first stream being received at the receiving end and the second preset packet in the second stream being sent at the sending end;

[0351] (3) the average delay between the first preset packet in the first stream being sent at the transmitting end and the second preset packet in the second stream being received at the receiving end;

[0352] (4) the difference between the average delay of the first preset packet in the first stream in the cache and the average delay of the second preset packet in the second stream in the cache;

[0353] (5) The difference between the average delay of the first preset packet in the first stream reaching the cache and the average delay of the second preset packet in the second stream reaching the cache.

[0354] In one embodiment of the present application, the delay difference between multiple streams includes at least one of the following:

[0355] (1) The delay difference between multiple streams received at the receiving end;

[0356] (2) The delay difference between the reception delay of one or more streams at the receiving end and the transmission delay of other streams at the sending end;

[0357] (3) The delay difference between the sending delay of one or more streams at the sending end and the receiving delay of other streams at the receiving end;

[0358] (4) The delay difference between multiple flows in the cache;

[0359] (5) The delay difference between multiple flows reaching the cache;

[0360] (6) The delay difference between multiple streams sent at the sending end.

[0361] In one embodiment of the present application, satisfying synchronization requirements or coordination requirements between multiple streams includes:

[0362] The third preset packets of the multiple streams within the fifth time information meet the synchronization requirement or coordination requirement between the packets.

[0363] In one embodiment of the present application, the third preset package includes one of the following:

[0364] (1) All packets within the fifth time information;

[0365] (2) the packet corresponding to the I frame in the fifth time information;

[0366] (3) The most important packet in the fifth time information

[0367] For example, the packet with high PDU importance in the fifth time information;

[0368] (4) a packet in the fifth time information whose importance is higher than the third preset value;

[0369] For example, the importance of the PDU in the fifth time information is higher than the third preset value;

[0370] (5) The fifth time information contains packets with delay requirements, synchronization requirements, or coordination requirements;

[0371] (6) The fifth time information contains packets that are dependent on the decoding or demodulation of other packets.

[0372] For example, if the decoding or demodulation of packet A depends on packet B, the third preset packet is packet B.

[0373] Exemplarily, a difference between packet delay budgets (PDB) or PDU set delay budgets (PSDB) corresponding to two or more flows is smaller than a fifth preset threshold.

[0374] Optionally, the fifth preset threshold may be defined by a protocol, or configured by a server, a core network, a base station, or an application layer.

[0375] In this embodiment, the first time information may be the first preset window, the first time range or the first period; the second time information may be the second preset window, the second time range or the second period; the third time information may be the third preset window, the third time range or the third period; the fourth time information may be the fourth preset window, the fourth time range or the fourth period; the fifth time information may be the fifth preset window, the fifth time range or the fifth period.

[0376] In an embodiment of the present application, the multiple streams or multiple packets received by the receiving end meet the synchronization requirements or coordination requirements, avoiding the freeze and dizziness caused by the asynchrony between the multiple streams or multiple packets, or the incoordination between the pictures or audio, thereby improving the user's service experience.

[0377] 7 , an embodiment of the present application provides a communication processing device, which is applied to a transmitting end. The device 700 includes:

[0378] The sending module 701 is configured to send multiple streams or multiple packets, where the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0379] In an embodiment of the present application, the plurality of packages include at least one of the following:

[0380] (1) Multiple packages from the same user;

[0381] (2) Multiple packages from different users;

[0382] (3) Multiple packets from the same UE;

[0383] (4) Multiple packets from different UEs;

[0384] (5) Multiple packets of the same stream;

[0385] (6) Multiple packets from different streams;

[0386] For example, different streams include different streams of the same UE, or different streams of different UEs.

[0387] (7) Multiple packets of the same QoS flow;

[0388] (8) Multiple packets with different QoS flows;

[0389] (9) Multiple packets in the same IP or User Datagram Protocol (UDP) packet;

[0390] (10) Multiple packets in different IP or UDP packets;

[0391] (11) Multiple packets in the same burst;

[0392] (12) Multiple packets in different bursts;

[0393] (13) Multiple packets in the same bearer;

[0394] (14) Multiple packages in different Bearers;

[0395] (15) Multiple packets in the same PDU session;

[0396] (16) Multiple packets in different PDU sessions;

[0397] (17) Multiple packets in the same PDU set;

[0398] (18) Multiple packets in different PDU sets;

[0399] (19) Multiple packets in the same PDU;

[0400] (20) Multiple packets in different PDUs;

[0401] (21) Multiple packets in the same Data Radio Bearer (DRB);

[0402] (22) Multiple packets in different DRBs;

[0403] (23) Multiple packages in the same business;

[0404] (24) Multiple packages in different services.

[0405] In one embodiment of the present application, the multiple packets satisfying a synchronization requirement or a coordination requirement include: a delay difference between the multiple packets is less than or equal to a first preset threshold.

[0406] In one embodiment of the present application, the delay difference between the multiple packets includes at least one of the following:

[0407] (1) The delay difference between multiple packets received at the receiving end;

[0408] (2) The delay difference between multiple packets sent at the sending end;

[0409] (3) The delay difference between the reception of one or more packets at the receiving end and the transmission of other packets at the sending end;

[0410] (4) The delay difference between one or more packets sent at the sending end and other packets received at the receiving end;

[0411] (5) The delay difference between multiple packets in the buffer;

[0412] (6) The delay difference between multiple packets arriving at the cache.

[0413] In one embodiment of the present application, when the packet includes multiple packets, the delay difference between the multiple packets includes at least one of the following:

[0414] (1) a delay difference between the first packets included in the plurality of packets;

[0415] (2) The delay difference between the last packets included in multiple packets;

[0416] (3) a delay difference between the first packet of the first packet and the last packet of the last packet of the plurality of packets;

[0417] (4) a delay difference between the last packet of the first packet and the first packet of the last packet of the plurality of packets;

[0418] (5) the average time or average delay difference between the first preset packets respectively included in the plurality of packets and sent from the transmitting end;

[0419] (6) a delay difference between the maximum delays of the second preset packets respectively included in the plurality of packets being sent from the transmitting end;

[0420] (7) The delay difference between the maximum delay and the minimum delay of the third preset packets respectively included in the multiple packets when sent from the sending end.

[0421] (8) the average time or average delay difference between the fourth preset packets respectively included in the plurality of packets and arriving at the receiving end;

[0422] (9) the delay difference between the maximum delays of the fifth preset packets respectively included in the plurality of packets reaching the receiving end;

[0423] (10) The delay difference between the maximum delay and the minimum delay of the sixth preset packets respectively included in the multiple packets reaching the receiving end.

[0424] In one embodiment of the present application, the first packet includes a first packet in the first time information, and the first packet includes one of the following:

[0425] (1) The first-ranked package;

[0426] (2) The first packet sent from the sender;

[0427] (3) The first packet to arrive at the cache;

[0428] (4) The first packet to arrive at the receiving end.

[0429] In one embodiment of the present application, the last packet includes a second packet in the second time information, and the second packet includes one of the following:

[0430] (1) Sort the last packet;

[0431] (2) The last packet sent from the sender;

[0432] (3) The last packet to arrive at the cache;

[0433] (4) The last packet to arrive at the receiving end.

[0434] In one embodiment of the present application, the first preset group, the second preset group, the third preset group, the fourth preset group, the fifth preset group, or the sixth preset group includes one of the following:

[0435] (1) All packets in the package;

[0436] (2) grouping with a preset ratio within the package;

[0437] (3) a grouping of a preset number of items within a package;

[0438] (4) first group;

[0439] (5) The last group;

[0440] (6) packets whose intra-packet delay does not exceed a second preset threshold;

[0441] (7) Packets whose intra-packet delay is not less than the third preset threshold.

[0442] In one embodiment of the present application, the first group includes one of the following:

[0443] (1) The first group in the order of multiple groups in the packet, that is, the group with the first number;

[0444] (2) The first packet sent from the sender;

[0445] (3) The first packet to arrive at the cache;

[0446] (4) The first packet to arrive at the receiving end.

[0447] In one embodiment of the present application, the last group includes one of the following:

[0448] (1) The last group in the order of multiple groups in the packet;

[0449] (2) The last packet sent from the sender;

[0450] (3) The last packet to arrive at the cache;

[0451] (4) The last packet to arrive at the receiving end.

[0452] In one embodiment of the present application, the delay difference preset thresholds corresponding to any two preset groups among the first preset group, the second preset group, the third preset group, the fourth preset group, the fifth preset group and the sixth preset group are the same or different.

[0453] In one embodiment of the present application, the synchronization requirements or coordination requirements between the multiple streams include:

[0454] The delay difference between the multiple streams is less than or equal to a fourth preset threshold.

[0455] In one embodiment of the present application, the delay difference between the multiple streams includes: a difference between an average delay of first preset packets in one or more first streams within the third time information and an average delay of second preset packets in one or more second streams within the fourth time information;

[0456] The first stream is one of the multiple streams, and the second stream is another stream among the multiple streams except the first stream.

[0457] Optionally, the third time information is the same as or different from the fourth time information.

[0458] In one embodiment of the present application, the first preset package includes at least one of the following:

[0459] (1) all packets in the first stream within the third time information;

[0460] (2) a packet corresponding to an I frame in the first stream within the third time information;

[0461] (3) a packet of high importance in the first stream within the third time information;

[0462] (4) a packet in the first stream within the third time information whose importance is higher than a first preset value;

[0463] (5) There are packets with delay requirements, synchronization requirements, or coordination requirements in the first stream within the third time information;

[0464] (6) There are packets in the first stream within the third time information that are dependent on the decoding or demodulation of other packets.

[0465] In one embodiment of the present application, the second preset package includes at least one of the following:

[0466] (1) all packets in the second stream within the fourth time information;

[0467] (2) a packet corresponding to an I frame in the second stream within the fourth time information;

[0468] (3) a packet of high importance in the second stream within the fourth time information;

[0469] (4) a packet in the second stream within the fourth time information whose importance is higher than a second preset value;

[0470] (5) There are packets with delay requirements, synchronization requirements, or coordination requirements in the second stream within the fourth time information;

[0471] (6) The second stream within the fourth time information contains packets on which decoding or demodulation of other packets depends.

[0472] In one embodiment of the present application, the difference between the average delay of the first preset packets in one or more first streams in the third time information and the average delay of the second preset packets in one or more second streams in the fourth time information includes at least one of the following:

[0473] (1) the difference between the average delay of the first preset packet in the first stream at the transmitting end and the average delay of the second preset packet in the second stream at the transmitting end;

[0474] (2) the average delay between the first preset packet in the first stream being received at the receiving end and the second preset packet in the second stream being sent at the sending end;

[0475] (3) the average delay between the first preset packet in the first stream being sent at the transmitting end and the second preset packet in the second stream being received at the receiving end;

[0476] (4) the difference between the average delay of the first preset packet in the first stream in the cache and the average delay of the second preset packet in the second stream in the cache;

[0477] (5) The difference between the average delay of the first preset packet in the first stream reaching the cache and the average delay of the second preset packet in the second stream reaching the cache.

[0478] In one embodiment of the present application, the delay difference between the multiple streams includes at least one of the following:

[0479] (1) The delay difference between multiple streams sent at the sending end;

[0480] (2) The delay difference between the reception delay of one or more streams at the receiving end and the transmission delay of other streams at the sending end;

[0481] (3) The delay difference between the sending delay of one or more streams at the sending end and the receiving delay of other streams at the receiving end;

[0482] (4) The delay difference between multiple flows in the cache;

[0483] (5) The delay difference between multiple flows reaching the cache;

[0484] (6) The delay difference between multiple streams received at the receiving end.

[0485] In one embodiment of the present application, the synchronization requirements or coordination requirements between the multiple streams include:

[0486] The third preset packets of the multiple streams within the fifth time information meet the synchronization requirement or coordination requirement between the packets.

[0487] In one embodiment of the present application, the third preset package includes one of the following:

[0488] (1) All packets within the fifth time information;

[0489] (2) the packet corresponding to the I frame in the fifth time information;

[0490] (3) packets with high importance in the fifth time information;

[0491] (4) a packet in the fifth time information whose importance is higher than the third preset value;

[0492] (5) The fifth time information contains packets with delay requirements, synchronization requirements, or coordination requirements;

[0493] (6) The fifth time information contains packets that are dependent on the decoding or demodulation of other packets.

[0494] The device provided in the embodiment of the present application can implement each process implemented in the method embodiment of Figure 5 and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0495] 8 , an embodiment of the present application provides a communication processing device, which is applied to a receiving end. The device 800 includes:

[0496] The receiving module 801 is configured to receive multiple streams or multiple packets, where the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

[0497] In one embodiment of the present application, multiple packets satisfying a synchronization requirement or a coordination requirement includes: a delay difference between the multiple packets is less than or equal to.

[0498] In one embodiment of the present application, the delay difference between the multiple packets includes at least one of the following:

[0499] (1) The delay difference between multiple packets received at the receiving end;

[0500] (2) The delay difference between one or more packets received at the receiving end and other packets sent at the sending end;

[0501] (3) The delay difference between one or more packets sent at the sender and other packets received at the receiver;

[0502] (4) The delay difference of multiple packets in the cache;

[0503] (5) The delay difference between multiple packets reaching the cache;

[0504] (6) The delay difference between multiple packets sent at the sending end.

[0505] In one embodiment of the present application, when the packet includes multiple packets, the delay difference between the multiple packets includes at least one of the following:

[0506] (1) a delay difference between the first packets included in the plurality of packets;

[0507] (2) The delay difference between the last packets included in multiple packets;

[0508] (3) a delay difference between the first packet of the first packet and the last packet of the last packet of the plurality of packets;

[0509] (4) a delay difference between the last packet of the first packet and the first packet of the last packet of the plurality of packets;

[0510] (5) the average time or average delay difference between the first preset packets respectively included in the plurality of packets and sent from the transmitting end;

[0511] (6) a delay difference between the maximum delays of the second preset packets respectively included in the plurality of packets being sent from the transmitting end;

[0512] (7) The delay difference between the maximum delay and the minimum delay of the third preset packets respectively included in the multiple packets when sent from the sending end.

[0513] (8) the average time or average delay difference between the fourth preset packets respectively included in the plurality of packets and arriving at the receiving end;

[0514] (9) the delay difference between the maximum delays of the fifth preset packets respectively included in the plurality of packets reaching the receiving end;

[0515] (10) The delay difference between the maximum delay and the minimum delay of the sixth preset packets respectively included in the multiple packets reaching the receiving end.

[0516] In one embodiment of the present application, the first packet includes a first packet in the first time information, and the first packet includes one of the following:

[0517] (1) The first-ranked package;

[0518] (2) The first packet to arrive at the receiving end;

[0519] (3) The first packet to arrive at the cache;

[0520] (4) The first packet sent from the sender.

[0521] In one embodiment of the present application, the last packet includes a second packet in the second time information, and the second packet includes one of the following:

[0522] (1) Sort the last packet;

[0523] (2) The last packet to arrive at the receiving end;

[0524] (3) The last packet to arrive at the cache;

[0525] (4) The last packet sent from the sender.

[0526] In one embodiment of the present application, the first preset group or the second preset group or the third preset group or the fourth preset group or the fifth preset group or the sixth preset group includes one of the following:

[0527] (1) All packets in the package;

[0528] (2) grouping with a preset ratio within the package;

[0529] (3) a grouping of a preset number of items within a package;

[0530] (4) first group;

[0531] (5) The last group;

[0532] (6) packets whose intra-packet delay does not exceed a second preset threshold;

[0533] (7) Packets whose intra-packet delay is not less than the third preset threshold.

[0534] In one embodiment of the present application, the first group includes one of the following:

[0535] (1) The group that ranks first among multiple groups, that is, the group that ranks first in number;

[0536] (2) The first packet to arrive at the receiving end;

[0537] (3) The first packet to arrive at the cache;

[0538] (4) The first packet sent from the sender.

[0539] In one embodiment of the present application, the last group includes one of the following:

[0540] (1) The last group in the order of multiple groups in the packet;

[0541] (2) The last packet to arrive at the receiving end;

[0542] (3) The last packet to arrive at the cache;

[0543] (4) The last packet sent from the sender.

[0544] In one embodiment of the present application, the delay difference preset thresholds corresponding to any two preset groups among the first preset group, the second preset group, the third preset group, the fourth preset group, the fifth preset group and the sixth preset group are the same or different.

[0545] In one embodiment of the present application, the synchronization requirements or coordination requirements between the multiple streams include:

[0546] The delay difference between the multiple streams is less than or equal to a fourth preset threshold.

[0547] Optionally, the fourth preset threshold value may be defined by a protocol, or configured by a server, a core network, a base station, or an application layer.

[0548] In one embodiment of the present application, the delay difference between the multiple streams includes: a difference between an average delay of first preset packets in one or more first streams within the third time information and an average delay of second preset packets in one or more second streams within the fourth time information;

[0549] The first stream is one of the multiple streams, and the second stream is another stream among the multiple streams except the first stream.

[0550] In one embodiment of the present application, the third time information is the same as or different from the fourth time information.

[0551] Optionally, the third time information and the fourth time information may be defined by a protocol, or configured by a server, a core network, a base station or an application layer.

[0552] In one embodiment of the present application, the first preset package includes at least one of the following:

[0553] (1) all packets in the first stream within the third time information;

[0554] (2) a packet corresponding to an I frame in the first stream within the third time information;

[0555] (3) a packet of high importance in the first stream within the third time information;

[0556] (4) a packet in the first stream within the third time information whose importance is higher than a first preset value;

[0557] (5) There are packets with delay requirements, synchronization requirements, or coordination requirements in the first stream within the third time information;

[0558] (6) There are packets in the first stream within the third time information that are dependent on the decoding or demodulation of other packets.

[0559] In one embodiment of the present application, the second preset package includes at least one of the following:

[0560] (1) all packets in the second stream within the fourth time information;

[0561] (2) a packet corresponding to an I frame in the second stream within the fourth time information;

[0562] (3) a packet of high importance in the second stream within the fourth time information;

[0563] (4) a packet in the second stream within the fourth time information whose importance is higher than a second preset value;

[0564] (5) There are packets with delay requirements, synchronization requirements, or coordination requirements in the second stream within the fourth time information;

[0565] (6) The second stream within the fourth time information contains packets on which decoding or demodulation of other packets depends.

[0566] In one embodiment of the present application, the difference between the average delay of the first preset packets in one or more first streams in the third time information and the average delay of the second preset packets in one or more second streams in the fourth time information includes at least one of the following:

[0567] (1) the difference between the average delay of the first preset packet in the first stream at the transmitting end and the average delay of the second preset packet in the second stream at the transmitting end;

[0568] (2) the average delay between the first preset packet in the first stream being received at the receiving end and the second preset packet in the second stream being sent at the sending end;

[0569] (3) the average delay between the first preset packet in the first stream being sent at the transmitting end and the second preset packet in the second stream being received at the receiving end;

[0570] (4) the difference between the average delay of the first preset packet in the first stream in the cache and the average delay of the second preset packet in the second stream in the cache;

[0571] (5) The difference between the average delay of the first preset packet in the first stream reaching the cache and the average delay of the second preset packet in the second stream reaching the cache.

[0572] In one embodiment of the present application, the delay difference between multiple streams includes at least one of the following:

[0573] (1) The delay difference between multiple streams received at the receiving end;

[0574] (2) The delay difference between the reception delay of one or more streams at the receiving end and the transmission delay of other streams at the sending end;

[0575] (3) The delay difference between the sending delay of one or more streams at the sending end and the receiving delay of other streams at the receiving end;

[0576] (4) The delay difference between multiple flows in the cache;

[0577] (5) The delay difference between multiple flows reaching the cache;

[0578] (6) The delay difference between multiple streams sent at the sending end.

[0579] In one embodiment of the present application, satisfying synchronization requirements or coordination requirements between multiple streams includes:

[0580] The third preset packets of the multiple streams within the fifth time information meet the synchronization requirement or coordination requirement between the packets.

[0581] In one embodiment of the present application, the third preset package includes one of the following:

[0582] (1) All packets within the fifth time information;

[0583] (2) the packet corresponding to the I frame in the fifth time information;

[0584] (3) The most important packet in the fifth time information

[0585] (4) a packet in the fifth time information whose importance is higher than the third preset value;

[0586] (5) The fifth time information contains packets with delay requirements, synchronization requirements, or coordination requirements;

[0587] (6) The fifth time information contains packets that are dependent on the decoding or demodulation of other packets.

[0588] The device provided in the embodiment of the present application can implement each process implemented in the method embodiment of Figure 6 and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0589] Figure 9 is a schematic diagram of the hardware structure of a terminal implementing an embodiment of the present application. The terminal 900 includes, but is not limited to, at least some of the components including a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 906, a display unit 905, a user input unit 907, an interface unit 908, a memory 909, and a processor 910.

[0590] Those skilled in the art will appreciate that the terminal 900 may further include a power source (such as a battery) for powering various components. The power source may be logically connected to the processor 910 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The terminal structure shown in FIG9 does not limit the terminal. The terminal may include more or fewer components than shown, or may combine certain components, or have different component arrangements, which will not be described in detail here.

[0591] It should be understood that in an embodiment of the present application, the input unit 904 may include a graphics processing unit (GPU) 9041 and a microphone 9042, and the graphics processor 9041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 905 may include a display panel 9051, and the display panel 9051 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 907 includes a touch panel 9071 and at least one of other input devices 9072. The touch panel 9071 is also called a touch screen. The touch panel 9071 may include two parts: a touch detection device and a touch controller. Other input devices 9032 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an operating stick, which will not be repeated here.

[0592] In the embodiment of the present application, after receiving downlink data from a network-side device, the RF unit 901 may transmit the data to the processor 910 for processing. Furthermore, the RF unit 901 may send uplink data to the network-side device. Typically, the RF unit 901 includes, but is not limited to, an antenna, an amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and the like.

[0593] The memory 909 can be used to store software programs or instructions and various data. The memory 909 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instruction required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 909 may include a volatile memory or a non-volatile memory, or the memory 909 may include a non-transient memory. Among them, the non-volatile memory or non-transient memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 909 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0594] Processor 910 may include one or more processing units. Optionally, processor 910 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 910.

[0595] The terminal provided in the embodiment of the present application can implement each process implemented in the method embodiment of Figure 5 or Figure 6 and achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0596] Please refer to Figure 10, which is a block diagram of a network-side device used in an embodiment of the present invention. As shown in Figure 10, network-side device 1000 includes a processor 1001, a transceiver 1002, a memory 1003, and a bus interface. Processor 1001 may be responsible for managing the bus architecture and general processing. Memory 1003 may store data used by processor 1001 when performing operations.

[0597] In one embodiment of the present invention, the network side device 1000 further includes: a program stored in the memory 1003 and executable on the processor 1001 , which implements the steps of the method shown in FIG. 5 or FIG. 6 when executed by the processor 1001 .

[0598] In Figure 10 , the bus architecture can include any number of interconnected buses and bridges, specifically linking various circuits such as one or more processors represented by processor 1001 and memory represented by memory 1003. The bus architecture can also link various other circuits such as peripherals, voltage regulators, and power management circuits, all of which are well known in the art and are not further described herein. The bus interface provides an interface. The transceiver 1002 can be multiple components, including a transmitter and a receiver, providing a means for communicating with various other devices over a transmission medium.

[0599] Please refer to FIG. 11 , which is a structural diagram of a communication device applied in an embodiment of the present invention. The communication device may be a transmitting end or a receiving end.

[0600] As shown in Figure 11, an embodiment of the present application also provides a communication device 1100, including a processor 1101 and a memory 1302, and the memory 1102 stores programs or instructions that can be run on the processor 1101. For example, when the communication device 1100 is a transmitting end, the program or instruction is executed by the processor 1101 to implement the various steps of the method embodiment of Figure 5 above. When the communication device 1100 is a receiving end, the program or instruction is executed by the processor 1101 to implement the various steps of the method embodiment of Figure 6 above and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0601] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the method of Figure 5 or Figure 6 and the various processes of the above-mentioned embodiments are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0602] The processor is the processor in the terminal or network-side device described in the above embodiments. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk. In some examples, the readable storage medium may be a non-transitory readable storage medium.

[0603] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes shown in Figure 5 or Figure 6 and the various method embodiments mentioned above, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0604] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0605] An embodiment of the present application further provides a computer program / program product, which is stored in a storage medium and is executed by at least one processor to implement the various processes shown in Figure 5 or Figure 6 and the various method embodiments described above, and can achieve the same technical effects. To avoid repetition, they are not described here.

[0606] An embodiment of the present application also provides a communication system, which includes a terminal and a network-side device. The terminal is used to execute the various processes shown in Figure 5 and the above-mentioned method embodiments, and the network-side device is used to execute the various processes shown in Figure 6 and the above-mentioned method embodiments, and can achieve the same technical effects. To avoid repetition, they will not be repeated here.

[0607] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0608] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of a computer software product plus a necessary general-purpose hardware platform, or of course, by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, magnetic disk, optical disk, etc.) and includes a number of instructions for enabling a terminal or network-side device to execute the methods described in each embodiment of the present application.

[0609] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms of implementation methods without departing from the purpose of this application and the scope of protection of the claims. These implementation methods are all within the protection of this application.

Claims

1. A communication processing method, comprising: The sending end sends multiple streams or multiple packets, and the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

2. The method according to claim 1, wherein: The multiple packets satisfying synchronization requirements or coordination requirements include: the delay difference between the multiple packets is less than or equal to a first preset threshold.

3. The method according to claim 2, wherein: The delay difference between the multiple packets includes at least one of the following: The delay difference between multiple packets sent at the sending end; The delay difference between one or more packets received at the receiving end and other packets sent at the sending end; The delay difference between one or more packets sent at the sender and other packets received at the receiver; The delay difference of multiple packets in the cache; The delay difference between multiple packets arriving at the cache.

4. The method according to claim 2, wherein: In the case where the packet includes multiple packets, the delay difference between the multiple packets includes at least one of the following: The delay difference between the first packets respectively included in the plurality of packets; The delay difference between the last packets respectively included in the plurality of packets; A delay difference between a first packet of a first packet and a last packet of a last packet of the plurality of packets; A delay difference between a last packet of a first packet of the plurality of packets and a first packet of a last packet; The delay difference between the average time or average delay of the first preset packets respectively included in the multiple packets being sent from the sending end; The delay difference between the maximum delays of the second preset packets respectively included in the multiple packets being sent from the transmitting end; The multiple packets respectively include a delay difference between a maximum delay and a minimum delay of a third preset packet sent from a transmitting end.

5. The method according to claim 4, wherein: The first packet includes a first packet in the first time information, and the first packet includes one of the following: The first-ranked package; The first packet sent from the sender; The first packet to arrive in the cache.

6. The method according to claim 4, wherein: The last packet includes a second packet in the second time information, and the second packet includes one of the following: Sort the last package; The last packet sent from the sender; The last packet to arrive in the cache.

7. The method according to claim 4, wherein: The first preset group, the second preset group, or the third preset group includes one of the following: All groups in the package; Grouping of preset proportions within the package; A preset number of groups in a package; First group; The last grouping; The intra-packet delay of the packet does not exceed the second preset threshold; Packets whose intra-packet delay is not less than the third preset threshold.

8. The method according to claim 4 or 7, wherein: The first group includes one of the following: The first group in the order of multiple groups in the package; The first packet sent from the sender; The first packet to arrive in the cache.

9. The method according to claim 4 or 7, wherein: The last grouping includes one of the following: The last group in the order of multiple groups in the package; The last packet sent from the sender; The last packet to arrive in the cache.

10. The method according to claim 4, wherein: The delay difference preset thresholds corresponding to any two preset groups among the first preset group, the second preset group, and the third preset group are the same or different.

11. The method according to claim 1, wherein: The synchronization requirements or coordination requirements between the multiple streams include: The delay difference between the multiple streams is less than or equal to a fourth preset threshold.

12. The method according to claim 11, wherein: The delay differences between the multiple streams include: a difference between an average delay of first preset packets in one or more first streams in the third time information and an average delay of second preset packets in one or more second streams in the fourth time information; The first stream is one of the multiple streams, and the second stream is another stream among the multiple streams except the first stream.

13. The method according to claim 12, wherein: The third time information is the same as or different from the fourth time information.

14. The method according to claim 12, wherein: The first preset package includes at least one of the following: all packets in the first stream within a third time information; a packet corresponding to an I frame in the first stream within third time information; A packet of high importance in the first stream within third time information; a packet in the first flow within the third time information whose importance is higher than a first preset value; There are packets with delay requirements, synchronization requirements or coordination requirements in the first stream in the third time information; There are packets in the first stream within the third time information on which decoding or demodulation of other packets depends; or, The second preset package includes at least one of the following: all packets in said second stream within a fourth time information; a packet corresponding to an I frame in the second stream in fourth time information; a packet of high importance in the second stream in fourth time information; a packet in the second stream within the fourth time information whose importance is higher than a second preset value; There are packets with delay requirements, synchronization requirements or coordination requirements in the second stream in the fourth time information; The second stream in the fourth time information contains packets on which decoding or demodulation of other packets depends.

15. The method according to claim 12, wherein: The difference between the average delay of the first preset packets in one or more first streams in the third time information and the average delay of the second preset packets in one or more second streams in the fourth time information includes at least one of the following: The difference between the average delay of sending the first preset packet in the first stream at the sending end and the average delay of sending the second preset packet in the second stream at the sending end; An average delay between the first preset packet in the first stream being received at the receiving end and the second preset packet in the second stream being sent at the sending end; An average delay between sending a first preset packet in the first stream at a sending end and receiving a second preset packet in the second stream at a receiving end; a difference between an average delay of a first preset packet in the first stream in the cache and an average delay of a second preset packet in the second stream in the cache; The difference between the average delay of the first preset packets in the first stream reaching the cache and the average delay of the second preset packets in the second stream reaching the cache.

16. The method according to claim 11, wherein: The delay difference between the multiple streams includes at least one of the following: The delay difference between multiple streams sent at the sending end; The delay difference between the reception delay of one or more streams at the receiving end and the transmission delay of other streams at the sending end; The difference between the delay of one or more streams being sent at the sender and the delay of other streams being received at the receiver; The delay difference of multiple flows in the cache; The delay difference between multiple flows reaching the cache.

17. The method according to claim 11, wherein: The synchronization requirements or coordination requirements between the multiple streams include: The third preset packets of the multiple streams within the fifth time information meet the synchronization requirement or coordination requirement between the packets.

18. The method according to claim 17, wherein: The third preset package includes one of the following: All packages in the fifth time message; The packet corresponding to the I frame in the fifth time information; The fifth time information contains a high-importance package; A packet in the fifth time information whose importance is higher than the third preset value; Fifth, packets with delay requirements, synchronization requirements, or coordination requirements in the time information; The fifth time information contains packets that the decoding or demodulation of other packets depends on.

19. The method according to any one of claims 1 to 4, wherein: The plurality of packages include: Multiple packages for the same user; Multiple packages for different users; Multiple packages for the same terminal; Multiple packages for different terminals; Multiple packets of the same stream; Multiple packages in different streams; Multiple packets of the same QoS flow; Multiple packets with different QoS flows; Multiple packets in the same IP or UDP packet; Multiple packets in different IP or UDP packets; Multiple packets in the same burst; Multiple packets in different bursts; Multiple packets in the same bearer; Multiple packets in different bearers; Multiple packets in the same protocol data unit (PDU) session; Multiple packets in different PDU sessions; Multiple packets in the same PDU Set; Multiple packets in different PDU Sets; Multiple packets in the same PDU; Multiple packets in different PDUs; Multiple packets in the same data radio bearer DRB; Multiple packets in different DRBs; Multiple packages in the same business; Multiple packages in different businesses.

20. The method according to claim 1 or 11 or 12, wherein: The flow includes at least one of the following: QoS flow, Stream, IP data flow, UDP data flow.

21. A communication processing method, comprising: The receiving end receives multiple streams or multiple packets, and the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

22. The method according to claim 21, wherein: Meeting the synchronization requirement or coordination requirement between the multiple packets includes: the delay difference between the multiple packets is less than or equal to a first preset threshold.

23. The method according to claim 22, wherein: The delay difference between the multiple packets includes at least one of the following: The delay difference of multiple packets received at the receiving end; The delay difference between one or more packets received at the receiving end and other packets sent at the sending end; The delay difference between one or more packets sent at the sender and other packets received at the receiver; The delay difference of multiple packets in the cache; The delay difference between multiple packets arriving at the cache.

24. The method according to claim 22, wherein: In the case where the packet includes a plurality of packets, the delay difference between the plurality of packets includes at least one of the following: The delay difference between the first packets included in the multiple packets The delay difference between the last packets included in the multiple packets; A delay difference between a first packet of a first packet and a last packet of a last packet of the plurality of packets; A delay difference between a last packet of a first packet of the plurality of packets and a first packet of a last packet; The delay difference between the average time or average delay of the fourth preset packets respectively included in the multiple packets reaching the receiving end; The delay difference between the maximum delays of the fifth preset packets respectively included in the multiple packets reaching the receiving end; The multiple packets respectively include a delay difference between a maximum delay and a minimum delay for a sixth preset packet to reach a receiving end.

25. The method according to claim 24, wherein: The first packet includes a first packet in the first time information, and the first packet includes one of the following: The first-ranked package; The first packet to arrive at the receiver; The first packet to arrive in the cache.

26. The method according to claim 24, wherein: The last packet includes a second packet in the second time information, and the second packet includes one of the following: Sort the last package; The last packet to arrive at the receiver; The last packet to arrive in the cache.

27. The method according to claim 24, wherein: The fourth preset group or the fifth preset group or the sixth preset group includes one of the following: All groups in the package; Grouping of preset proportions within the package; A preset number of groups in a package; First group; The last grouping; The intra-packet delay of the packet does not exceed the second preset threshold; Packets whose intra-packet delay is not less than the third preset threshold.

28. The method according to claim 24 or 27, wherein: The first group includes one of the following: The first group in the order of multiple groups in the package; The first packet to arrive at the receiving end; The first packet to arrive in the cache.

29. The method according to claim 24 or 27, wherein: The last grouping includes one of the following: The last group in the order of multiple groups in the package; The last packet to arrive at the receiving end; The last packet to arrive in the cache.

30. The method of claim 24, wherein: The delay difference preset thresholds corresponding to any two preset groups among the fourth preset group, the fifth preset group and the sixth preset group are the same or different.

31. The method of claim 21, wherein: The synchronization requirements or coordination requirements between the multiple streams include: The delay difference between the multiple streams is less than or equal to a fourth preset threshold.

32. The method according to claim 31, wherein: The delay differences between multiple streams include: a difference between an average delay of first preset packets in one or more first streams in the third time information and an average delay of second preset packets in one or more second streams in the fourth time information; The first stream is one of the multiple streams, and the second stream is another stream among the multiple streams except the first stream.

33. The method of claim 32, wherein: The third time information is the same as or different from the fourth time information.

34. The method of claim 32, wherein: The first preset package includes at least one of the following: all packets in the first stream within a third time information; a packet corresponding to an I frame in the first stream within third time information; A packet of high importance in the first stream within third time information; a packet in the first flow within the third time information whose importance is higher than a first preset value; There are packets with delay requirements, synchronization requirements or coordination requirements in the first stream in the third time information; There are packets in the first stream within the third time information on which decoding or demodulation of other packets depends; or, The second preset package includes at least one of the following: all packets in said second stream within a fourth time information; a packet corresponding to an I frame in the second stream in fourth time information; a packet of high importance in the second stream in fourth time information; a packet in the second stream within the fourth time information whose importance is higher than a second preset value; There are packets with delay requirements, synchronization requirements or coordination requirements in the second stream in the fourth time information; The second stream in the fourth time information contains packets on which decoding or demodulation of other packets depends.

35. The method of claim 32, wherein: The difference between the average delay of the first preset packets in one or more first streams in the third time information and the average delay of the second preset packets in one or more second streams in the fourth time information includes at least one of the following: The difference between the average delay of sending the first preset packet in the first stream at the sending end and the average delay of sending the second preset packet in the second stream at the sending end; An average delay between the first preset packet in the first stream being received at the receiving end and the second preset packet in the second stream being sent at the sending end; An average delay between sending a first preset packet in the first stream at a sending end and receiving a second preset packet in the second stream at a receiving end; a difference between an average delay of a first preset packet in the first stream in the cache and an average delay of a second preset packet in the second stream in the cache; The difference between the average delay of the first preset packets in the first stream reaching the cache and the average delay of the second preset packets in the second stream reaching the cache.

36. The method of claim 31, wherein: The delay difference between multiple streams includes at least one of the following: The delay difference of multiple streams received at the receiving end; The delay difference between the reception delay of one or more streams at the receiving end and the transmission delay of other streams at the sending end; The difference between the delay of one or more streams being sent at the sender and the delay of other streams being received at the receiver; The delay difference of multiple flows in the cache; The delay difference between multiple flows reaching the cache.

37. The method of claim 21, wherein: The synchronization or coordination requirements between multiple parties include: The third preset packets of the multiple streams within the fifth time information meet the synchronization requirement or coordination requirement between the packets.

38. The method of claim 37, wherein: The third preset package includes one of the following: All packages in the fifth time message; The packet corresponding to the I frame in the fifth time information; The fifth time information contains a high-importance package; A packet in the fifth time information whose importance is higher than the third preset value; Fifth, packets with delay requirements, synchronization requirements, or coordination requirements in the time information; The fifth time information contains packets that the decoding or demodulation of other packets depends on.

39. The method according to any one of claims 21 to 24, wherein: The plurality of packages include: Multiple packages for the same user; Multiple packages for different users; Multiple packages for the same terminal; Multiple packages for different terminals; Multiple packets of the same stream; Multiple packages in different streams; Multiple packets of the same QoS flow; Multiple packets with different QoS flows; Multiple packets in the same IP or UDP packet; Multiple packets in different IP or UDP packets; Multiple packets in the same burst; Multiple packets in different bursts; Multiple packets in the same bearer; Multiple packets in different bearers; Multiple packets in the same PDU session; Multiple packets in different PDU sessions; Multiple packets in the same PDU set; Multiple packets in different PDU sets; Multiple packets in the same PDU; Multiple packets in different PDUs; Multiple packets in the same DRB; Multiple packets in different DRBs; Multiple packages in the same business; Multiple packages in different businesses.

40. The method of claim 21, 31 or 32, wherein: The flow includes at least one of the following: QoS flow, Stream, IP data flow, UDP data flow.

41. A communication processing device, comprising: The sending module is used to send multiple streams or multiple packets, and the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

42. The device according to claim 41, wherein The multiple packets satisfying synchronization requirements or coordination requirements include: the delay difference between the multiple packets is less than or equal to a first preset threshold.

43. The device according to claim 42, wherein: The delay difference between the multiple packets includes at least one of the following: The delay difference between multiple packets sent at the sending end; The delay difference between one or more packets received at the receiving end and other packets sent at the sending end; The delay difference between one or more packets sent at the sender and other packets received at the receiver; The delay difference of multiple packets in the cache; The delay difference between multiple packets arriving at the cache.

44. A communication processing device, comprising: The receiving module is used to receive multiple streams or multiple packets, where the multiple streams or multiple packets meet synchronization requirements or coordination requirements.

45. The device according to claim 44, wherein Meeting the synchronization requirement or coordination requirement between the multiple packets includes: the delay difference between the multiple packets is less than or equal to a first preset threshold.

46. ​​The device according to claim 45, wherein The delay difference between the multiple packets includes at least one of the following: The delay difference of multiple packets received at the receiving end; The delay difference between one or more packets received at the receiving end and other packets sent at the sending end; The delay difference between one or more packets sent at the sender and other packets received at the receiver; The delay difference of multiple packets in the cache; The delay difference between multiple packets arriving at the cache.

47. A communication device, comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method as claimed in any one of claims 1 to 40.

48. A readable storage medium storing a program or instruction, wherein the program or instruction, when executed by a processor of a terminal, implements the steps of the method as claimed in any one of claims 1 to 40.

Images