Multimodal data transmission method and apparatus

By using a timer mechanism on the terminal side to report the remaining synchronization duration and data volume of the second modality data in a timely manner, the synchronization problem in multimodal data transmission is solved, improving the synchronization performance of data transmission and user experience.

CN118250265BActive Publication Date: 2025-12-12HUAWEI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410224279.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-02-28
Publication Date
2025-12-12
Estimated Expiration
2044-02-28

AI Technical Summary

Technical Problem

In multimodal data transmission, existing technologies struggle to guarantee synchronization between different modalities, impacting user experience.

Method used

By using a timer mechanism on the terminal side, when the first modal data arrives, the timer for the second modal, which has a synchronization relationship with it, is started. If the remaining duration is less than or equal to a specific duration, the terminal promptly reports the remaining synchronization duration and data volume of the second modal data to the network device so that the network device can prioritize the scheduling of transmission resources.

Benefits of technology

It improves the synchronization performance between different modalities of data, ensures timely data transmission, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118250265B_ABST
    Figure CN118250265B_ABST
Patent Text Reader

Abstract

A multi-modal data transmission method and device, the method comprising: when first data of a first mode arrives, starting a first timer by a first terminal; and if a first condition is met, sending first information. The first timer corresponds to a second mode having a synchronization relationship with the first mode. The first condition comprises at least one of the following conditions: a remaining time length of the first timer is less than or equal to a first time length, and second data of the second mode arrives. The first information indicates at least one of the following: a remaining synchronization time length corresponding to the second data, and a data amount of the second data. The method can improve the synchronization performance between data from different modes.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of communication, and in particular to a multi-modal data transmission method and device. BACKGROUND

[0002] Currently, a device can transmit multi-modal data of a service such as extended reality (XR), such as video data, audio data, haptic data, etc. In this scenario, the synchronization between different modal data should be ensured to ensure the experience of the user for the XR service. SUMMARY

[0003] The present application provides a multi-modal data transmission method and device for improving the synchronization performance between data from different modalities.

[0004] To achieve the above object, the present application adopts the following technical solutions:

[0005] In a first aspect, the present application provides a multi-modal data transmission method, which can be applied to a terminal side, such as a terminal or a communication module in the terminal, or a circuit or chip responsible for communication functions in the terminal (such as a modem chip, also known as a baseband chip, or a system on chip (SoC) chip or system in package (SIP) chip containing a modem core). Taking the case where the method is applied to a first terminal, in the method, when first data of a first modality arrives, the first terminal starts a first timer, and if a first condition is met, the first terminal sends first information. The first timer corresponds to a second modality that has a synchronization relationship with the first modality. The first condition includes at least one of the following conditions: the remaining time of the first timer is less than or equal to a first time length, and second data of the second modality arrives. The first information indicates at least one of the following: a remaining synchronization time length corresponding to the second data, and a data amount of the second data.

[0006] With this method, before the first timer expires, the first terminal can timely report the remaining synchronization time length corresponding to the second data, and / or the data amount of the second data to the network device when the first condition is met, so that the network device can prioritize the scheduling of the second data, thereby ensuring the synchronization between the first data and the second data.

[0007] In a possible design, the remaining synchronization time length corresponding to the second data indicates the remaining synchronization time length of the second data, or the remaining synchronization time length of a logical channel group in which the second data is located. The remaining synchronization time length of the second data is related to the remaining time of the first timer.

[0008] In a possible design, the second data is multiple; and the first information indicates at least one of: a remaining synchronization duration corresponding to the second data, a data amount of the second data, including:

[0009] The first information preferentially indicates at least one of: a remaining synchronization duration corresponding to the second data with the highest priority among the multiple second data, a data amount of the second data with the highest priority among the multiple second data.

[0010] Or the first information preferentially indicates at least one of: a remaining synchronization duration corresponding to the second data with the most urgent synchronization demand among the multiple second data, a data amount of the second data with the most urgent synchronization demand among the multiple second data.

[0011] By using this method, the first terminal preferentially indicates, in the first information, the remaining synchronization duration and / or the data amount corresponding to the second data with the more urgent synchronization demand, thereby ensuring that the resource can be preferentially requested for the data with the urgent synchronization demand. Alternatively, the first information preferentially indicates the first information of the second data with the higher priority, thereby ensuring that the high-priority data is timely scheduled, and the synchronization performance between the high-priority data and the first data is improved.

[0012] In a possible design, the first condition further includes that the second data has a synchronization relationship with the first data.

[0013] By using this method, the first terminal needs to confirm whether each data arriving at the second modality is associated with the first data, so as to accurately report the first information of the second data having the association relationship. The accuracy of synchronization can be improved, and in some cases, the reporting overhead can also be reduced.

[0014] In a possible design, the first modality includes a third modality and a fourth modality; and the first timer includes a second timer and a third timer.

[0015] When the first data of the first modality arrives, the first terminal starts the first timer, including:

[0016] When the first data of the third modality arrives, the second timer corresponding to the second modality is started.

[0017] When the first data of the fourth modality arrives, the third timer corresponding to the second modality is started.

[0018] The remaining duration of the first timer being less than or equal to the first duration includes: a first remaining duration being less than or equal to the first duration; and the first remaining duration being the minimum remaining duration of a remaining duration of the second timer and a remaining duration of the third timer.

[0019] When there are multiple first modalities or multiple first data of the first modality, and the second data has a synchronization relationship with the multiple first modalities or the multiple first data, the first terminal can start a timer when the multiple first data arrives, and determine the remaining synchronization time length of the second data according to the remaining synchronization time lengths of the multiple timers, so as to send the second data in time before the corresponding timer expires.

[0020] In a possible design, the method further includes:

[0021] sending second information, the second information including at least one of the following: a synchronization relationship between multiple modalities, a synchronization relationship between multiple quality of services (Qos), a synchronization relationship between multiple Qos flows, and a synchronization relationship of one or more data radio bearers (DRB);

[0022] The multiple modalities include the first modality and the second modality, the multiple Qos are Qos corresponding to the multiple modalities, the multiple Qos flows are Qos flows corresponding to the multiple modalities, and the one or more DRB are DRB corresponding to the multiple modalities.

[0023] In a possible design, the method further includes:

[0024] obtaining third information, the third information being used to indicate the first time length and / or a time length of the first timer;

[0025] The first time length is configured based on each terminal in the multiple terminals; the multiple terminals include the first terminal; in this way, each terminal has its respective applicable first time length, avoiding that all terminals use the same first time length and affecting the synchronization effect of services.

[0026] Alternatively, the first time length is configured based on each DRB in the one or more DRB; in this way, each DRB has its applicable first time length, and different DRBs carry services with different characteristics, thus avoiding that all DRBs use the same first time length and affecting the synchronization effect of services.

[0027] Alternatively, the first time length is configured based on each modality in the multiple modalities; in this way, each modality has its applicable first time length, and different modalities carry services with different characteristics, thus avoiding that all modalities use the same first time length and affecting the synchronization effect of services.

[0028] Alternatively, the first time length is configured based on each Qos flow in the multiple Qos flows; in this way, each Qos flow has its applicable first time length, and different Qos flows carry services with different characteristics, thus avoiding that all Qos flows use the same first time length and affecting the synchronization effect of services.

[0029] Or, the first duration is configured based on each Qos in the plurality of Qos. In this way, each Qos has its applicable first duration, and different Qos bear different characteristics of services, so as to avoid all Qos using the same first duration to affect the synchronization effect of services.

[0030] The duration of the first timer is configured based on each terminal in the plurality of terminals, so that each terminal has its respective applicable first timer duration, avoiding all terminals using the same first timer duration to affect the synchronization effect of their services.

[0031] Or, the duration of the first timer is configured based on each DRB in the one or more DRBs, so that each DRB has its applicable first timer duration, and different DRBs bear different characteristics of services, so as to avoid all DRBs using the same first timer duration to affect the synchronization effect of services.

[0032] Or, the duration of the first timer is configured based on each modality in the plurality of modalities, so as to avoid all modalities using the same first timer duration to affect the synchronization effect of services.

[0033] Or, the duration of the first timer is configured based on each Qos flow in the plurality of Qos flows, so as to avoid all Qos flows using the same first timer duration to affect the synchronization effect of services.

[0034] Or, the duration of the first timer is configured based on each Qos in the plurality of Qos, so as to avoid all Qos using the same first timer duration to affect the synchronization effect of services.

[0035] In a possible design, the first timer is a timer of a medium access control (MAC) layer, and if a first condition is met, first information is sent, including:

[0036] The first condition is met, and the first information is sent through the MAC layer.

[0037] In a possible design, the first timer is a timer of a first protocol layer, and the first protocol layer is a protocol layer above the MAC layer, and if a first condition is met, first information is sent, including:

[0038] The first condition is met, and indication information is sent to the MAC layer through the first protocol layer;

[0039] The first information is sent through the MAC layer based on the indication information.

[0040] In a possible design, the first information is carried in a first medium access control (MAC) control element (CE) or in a first delay status report (DSR) or in a first scheduling request (SR).

[0041] In a possible design, the first data is carried by a first data radio bearer (DRB) and the second data is carried by a second DRB. The first DRB and the second DRB can be the same or different.

[0042] In a second aspect, a device is provided, which includes function modules for performing the method in any possible design of any aspect of the method described above. The modules can be implemented by software or hardware, or by a combination of software and hardware. For example, the device includes a processing unit and a communication unit.

[0043] In a third aspect, a communication apparatus is provided, which includes a processor configured to perform the method in any design of any aspect described above.

[0044] Optionally, the apparatus further includes the memory and / or the communication interface.

[0045] The communication interface is coupled to the processor, and the communication interface is configured to input and / or output information.

[0046] The memory is configured to store a computer program, and the processor is configured to perform the method in any design of any aspect described above, and can be implemented as follows: the processor is configured to execute the computer program stored in the memory to perform the method in any design of any aspect described above.

[0047] Alternatively, the processor can also be a hardware-implemented circuit, such as an artificial intelligence (AI) processor, to improve the running speed. The present application does not limit the specific implementation manner of the processor.

[0048] Optionally, the communication apparatus can be a whole device or a module in the device, such as a chip.

[0049] In a fourth aspect, a computer readable storage medium is provided, which includes computer instructions. When the computer instructions run on a device, the device performs the method in any possible design of any aspect described above.

[0050] In a fifth aspect, a computer program product is provided, which includes computer instructions. When the computer program product runs on a device, the device performs the method in any possible design of any aspect described above. BRIEF DESCRIPTION OF DRAWINGS

[0051] Figure 1 The system provided by the embodiments of the present application is shown in the schematic diagram of the architecture of the system.

[0052] Figure 2 A flowchart of a multi-modal data transmission method provided by an embodiment of the present application is shown in FIG. 1.

[0053] Figures 3-7 A scenario diagram provided by an embodiment of the present application is shown in FIG. 2.

[0054] Figure 8 、 Figure 9 A structure diagram of a communication device provided by an embodiment of the present application is shown in FIG. 3. DETAILED DESCRIPTION

[0055] Currently, there are multi-modal data in some services, such as audio, video, haptic, and other modalities of data.

[0056] Taking an XR service as an example, during the process of playing an XR video by a terminal, when a user sees an image, the audio associated with the image should be played within a synchronization time range to ensure audio-visual synchronization, otherwise the user's experience will be affected.

[0057] Exemplarily, Table 1 shows the synchronization threshold between different modalities of data:

[0058] Table 1

[0059]

[0060] In Table 1, the auditory delay is 20 ms from the visual, which can be understood as that the terminal sends the visual data (such as video data) first, and the associated auditory data (such as audio data) needs to be transmitted within 20 ms. When it is later than the synchronization threshold of 20 ms, the user can perceive that the audio-visual is not synchronized, thereby reducing the viewing experience. Other similar thresholds can be derived in the same way, and will not be described in detail.

[0061] Therefore, an embodiment of the present application provides a multi-modal data transmission method. When first data of a first modality arrives, a first terminal starts a first timer. If a first condition is met, first information is sent. The first condition includes at least one of the following conditions: a remaining time length of the first timer is less than or equal to a first time length, second data arrives, and a remaining synchronization time length corresponding to the second data is less than or equal to the first time length. The first information indicates at least one of the following: the remaining synchronization time length corresponding to the second data, and a data amount of the second data. In this way, when there is a synchronization relationship between a second modality and the first modality, the terminal can timely report the remaining synchronization time length corresponding to the second data and / or the data amount of the second data to a network device before the first timer expires, so as to timely request transmission resources for the second data, thereby improving the probability of timely transmission of the second data.

[0062] Figure 1 A possible, non-limiting system diagram is shown in FIG. 4. As shown in FIG. 4, the system includes a terminal 400 and a network device 402.Figure 1 As shown, the communication system 10 includes a radio access network (RAN) 100 and a core network (CN) 200. RAN 100 includes at least one RAN node (e.g., ...). Figure 1 110a and 110b, collectively referred to as 110) and at least one terminal (such as Figure 1 RAN 100, denoted as RAN 120a-120j, is collectively referred to as RAN 120. RAN 100 may also include other RAN nodes, such as wireless relay equipment and / or wireless backhaul equipment. Figure 1 (Not shown in the image). Terminal 120 is connected to RAN node 110 wirelessly. RAN node 110 is connected to core network 200 wirelessly or via wired connection. The core network equipment in core network 200 and RAN node 110 in RAN 100 can be different physical devices, or they can be the same physical device integrating core network logical functions and radio access network logical functions.

[0063] Communication system 10 can be a cellular system related to the 3rd generation partnership project (3GPP), such as a 4G, 5G mobile communication system, or a future-oriented evolution system (such as a 6G mobile communication system). Communication system 10 can also be an open RAN (O-RAN or ORAN), a cloud radio access network (CRAN), or a wireless fidelity (WiFi) system. Communication system 10 can also be a communication system that integrates two or more of the above systems.

[0064] RAN node 110, sometimes also referred to as access network equipment, RAN entity, or access node, constitutes part of the communication system and is used to help terminals achieve wireless access. Multiple RAN nodes 110 in communication system 10 can be of the same type or different types. In some scenarios, the roles of RAN node 110 and terminal 120 are relative, for example... Figure 1 Network element 120i can be a helicopter or a drone, and it can be configured as a mobile base station. For terminals 120j that access RAN 100 through network element 120i, network element 120i is a base station; however, for base station 110a, network element 120i is a terminal. RAN node 110 and terminal 120 are sometimes referred to as communication devices, for example... Figure 1 Network elements 110a and 110b can be understood as communication devices with base station functions, while network elements 120a-120j can be understood as communication devices with terminal functions.

[0065] In a possible scenario, the RAN node can be a base station, an evolved Node B (eNodeB), an access point (AP), a transmission reception point (TRP), a next generation NodeB (gNB), a next generation base station in a 6th generation (6G) mobile communication system, a base station in a future mobile communication system, or an access node in a WiFi system, etc. The RAN node can be a macro base station (such as 110a in FIG. 1), a micro base station or an indoor station (such as 110b in FIG. 1), a relay node or a donor node, or a wireless controller in a CRAN scenario. Optionally, the RAN node can also be a server, a wearable device, a vehicle or a vehicle-mounted device, etc. For example, an access network device in a vehicle to everything (V2X) technology can be a road side unit (RSU). All or part of the functions of the RAN node in this application can also be implemented by software functions running on hardware, or by virtualized functions instantiated on a platform such as a cloud platform. The RAN node can also be provided with a communication module, circuit or chip for performing corresponding communication functions, and program instructions for performing corresponding communication functions. The RAN node in this application can also be a logical node, a logical module or software that can implement all or part of the functions of the RAN node. Figure 1 Figure 1 In another possible scenario, multiple RAN nodes cooperate to assist a terminal to implement wireless access, and different RAN nodes respectively implement part of the functions of a base station. For example, the RAN node can be a central unit (CU), a distributed unit (DU), a CU-control plane (CP), a CU-user plane (UP), or a radio unit (RU), etc. The CU and the DU can be separately arranged, or can be included in the same network element, such as a baseband unit (BBU). The RU can be included in a radio frequency device or a radio frequency unit, such as a remote radio unit (RRU), an active antenna processing unit (AAU), or a remote radio head (RRH).

[0066] In another possible scenario, multiple RAN nodes cooperate to assist a terminal to implement wireless access, and different RAN nodes respectively implement part of the functions of a base station. For example, the RAN node can be a central unit (CU), a distributed unit (DU), a CU-control plane (CP), a CU-user plane (UP), or a radio unit (RU), etc. The CU and the DU can be separately arranged, or can be included in the same network element, such as a baseband unit (BBU). The RU can be included in a radio frequency device or a radio frequency unit, such as a remote radio unit (RRU), an active antenna processing unit (AAU), or a remote radio head (RRH).​

[0067] In different systems, the CU (or CU-CP and CU-UP), DU or RU can also have different names, but those skilled in the art can understand their meanings. For example, in the ORAN system, the CU can also be referred to as O-CU (open CU), the DU can also be referred to as O-DU, the CU-CP can also be referred to as O-CU-CP, the CU-UP can also be referred to as O-CU-UP, and the RU can also be referred to as O-RU. For the convenience of description, the CU, CU-CP, CU-UP, DU and RU are taken as examples for description in this application. Any one of the CU (or CU-CP, CU-UP), DU and RU in this application can be implemented by a software module, a hardware module, or a combination of a software module and a hardware module.

[0068] A terminal can be a device or module with corresponding communication functions and can access the above communication system. The terminal can also be referred to as a terminal device, a user equipment (UE), a mobile station, a mobile terminal, etc. The terminal can be widely used in various scenarios, such as device-to-device (D2D) communication, vehicle-to-everything (V2X) communication, machine-type communication (MTC), internet of things (IOT), virtual reality, augmented reality, industrial control, autonomous driving, remote medical treatment, smart power grid, smart furniture, smart office, smart wear, smart transportation, smart city, etc. The terminal can be a mobile phone, a tablet computer, a computer with wireless transceiver function, a wearable device, a vehicle, a drone, a helicopter, an airplane, a ship, a robot, a mechanical arm, a smart home device, a wireless communication module, etc. Embodiments of the present application do not limit the device form of the terminal. The terminal usually has a communication module, circuit or chip for executing corresponding communication functions. The terminal also has program instructions for executing corresponding communication functions.

[0069] In this application, "sending information" can be understood as a device sending information to another device, or it can also be understood as a logical module in a device sending information to another logical module. For example, "the access network device sending information" can be understood as the access network device sending information to another device (such as a terminal), or it can be understood as a logical module 1 in the access network device sending information to a logical module 2 in the access network device.

[0070] In the present application, "receiving information" can be understood as a device receiving information from another device, or also can be understood as a logical module receiving information from another logical module within the device. For example, "the access network device receiving information" can be understood as the access network device receiving information from another device (such as a terminal), or can be understood as a logical module 1 in the access network device receiving information from a logical module 2 in the access network device.

[0071] In the present application, "sending information to (for example, a terminal)" or related illustrations in the drawings can be understood as that the destination of the information is the terminal. It can include directly or indirectly sending information to the terminal. "Receiving information from (for example, a terminal)" or "receiving information sent by (for example, a terminal)" or "receiving information from (for example, a terminal)" or related illustrations in the drawings can be understood as that the source of the information is the terminal, and can include directly or indirectly receiving information from the terminal. The information can be processed as necessary between the source and the destination of the information, such as format change, etc., but the destination can understand the valid information from the source. Similar expressions in the present application can be similarly understood, and will not be repeated here.

[0072] In the embodiments of the present application, the terms "system" and "network" can be used interchangeably. "At least one" means one or more, and "multiple" means two or more. "And / or" describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the cases of A alone, A and B together, and B alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects. "At least one of the following" or similar expressions means any combination of these items, including any combination of single item or multiple items. For example, "at least one of A, B or C" includes A, B, C, AB, AC, BC or ABC, and "at least one of A, B and C" can also be understood to include A, B, C, AB, AC, BC or ABC. In addition, unless otherwise specified, the ordinal numbers "first", "second", etc. mentioned in the embodiments of the present application are used to distinguish multiple objects, and are not used to limit the order, time sequence, priority or importance of the multiple objects. In addition, the numbering of steps in each embodiment introduced in the present application is only used to distinguish different steps, and is not used to limit the order of the steps. For example, S201 can occur before S202, or can occur after S202, or can occur simultaneously with S202.

[0073] The multi-modal data transmission method and device of the embodiments of the present application are further described below with reference to the accompanying drawings. It can be understood that the access network device and the first terminal are taken as an example to illustrate the execution subject of the interaction in the present application, but the present application does not limit the execution subject of the interaction. For example, the method executed by the access network device in the present application can also be implemented by a module (such as a circuit, a chip or a chip system, etc.) in the access network device, or a logical node, a logical module or software capable of implementing all or part of the functions of the access network device; the method executed by the terminal in the present application can also be implemented by a communication module in the terminal or a circuit or chip (such as a modem chip (also known as a baseband chip), or a SoC chip containing a modem core, or a SIP chip) responsible for communication functions in the terminal.

[0074] Figure 2 An example flow of the multi-modal data transmission method is shown, which can include:

[0075] S101, when the first data of the first mode arrives, the first terminal starts a first timer. Wherein, the first timer corresponds to the second mode. The second mode has a synchronization relationship with the first mode.

[0076] In one or more embodiments of the present application, the arrival of data, for example, the arrival of first data, can be understood as the arrival of first data of the terminal, or the terminal has a transmission demand for first data. Alternatively, the arrival of data can also be replaced by: the packet data convergence protocol (PDCP) entity of the terminal receives the data. For example, the PDCP entity of the terminal receives the data sent by the upper layer, and the upper layer is, for example, a service data adaptation protocol (SDAP) layer, etc.

[0077] For example, taking the first data of the first mode as haptic data and the second mode as an audio mode as an example, Figure 3 At time t1, the haptic data 1 on the data radio bearer (DRB) 2 arrives, and the first terminal starts a timer Timer1 (an example of the first timer) for the audio mode that needs to be synchronized, and the timing duration of Timer1 is T1.

[0078] In some embodiments, the first timer corresponding to the second modality can be understood as: the first timer is applied to synchronization at a radio bearer (RB) level, or at a quality of service (Qos) flow level, or at a Qos level. In such a synchronization manner, during the running of the first timer, the first terminal does not need to confirm whether each data arrived from the second modality is associated with the first data. For example, the first timer is directed to all data from the second modality within a period of time.

[0079] In some embodiments, the first timer corresponding to the second modality can be understood as: the first timer is applied to synchronization at a packet level. In such a synchronization manner, during the running of the first timer, the first terminal needs to confirm whether each data arrived from the second modality is associated with the first data. That is, the first timer is not directed to all data from the second modality, but is directed to data from the second modality that is associated with the first data. In embodiments of the present application, synchronization manners other than the packet level synchronization can be collectively referred to as non-packet level synchronization manners.

[0080] In some embodiments, the first timer corresponding to the second modality can be understood as: the first terminal starts the first timer for data from the second modality associated with the first modality. Optionally, such a synchronization manner can be referred to as modality level / granularity synchronization.

[0081] In some embodiments, the first timer corresponding to the second modality can also be understood as: the first terminal maintains the first timer for each other modality or data from each other modality that has a synchronization relationship with the first data, or for each modality pair or modality group, wherein the modality pair includes the modality to which the first data belongs and each other modality associated with the modality to which the first data belongs. For example, the first data is audio data, and the first modality is an audio modality. The first terminal can maintain a timer for a video modality that has a synchronization relationship with the audio modality, and the modality pair can be denoted as {audio, video} for example. The first terminal can also maintain a first timer for a haptic modality that has a synchronization relationship with the audio modality, and the modality pair can be denoted as {audio, haptic} for example.

[0082] In some embodiments, the first timer is started by the first terminal for data from the second modality associated with the first data, or for data from the second modality associated with the first modality corresponding to the first data, or for data from the second modality of a second RB associated with the first data of the first RB, or for data from the second modality of the second RB associated with the first modality corresponding to the first data of the first RB.

[0083] The timer maintained by the first terminal is not limited to this, and similarly, the corresponding modal pair is not limited to this, and is not limited. The manner in which the first terminal maintains the timer is not limited to the above-mentioned manner, and the first terminal can maintain the timer based on data granularity, modal granularity, modal pair granularity, Qos granularity, DRB granularity, or other granularity.

[0084] In one or more embodiments of the present application, "association" can be replaced by "synchronization requirement", "synchronization relationship", "correspondence" and the like. For example, the first data and the second data are associated, which means that the first data and the second data have a synchronization relationship and need to be synchronized.

[0085] The first terminal can know the above-mentioned association or synchronization relationship in advance, such as knowing that DRB2 is associated with DRB1, and again, the data on DRB2 is associated with the data on DRB1. Specifically, for example, the first terminal can know in advance which RB the first data corresponds to is associated with, or which data packet on which RB the first data is associated with. Optionally, the first terminal can know the above-mentioned association or synchronization relationship through the application layer or the non-access layer (non-access stratum, NAS).

[0086] Optionally, the second modal can be one or more. The second data can be one or more. In some embodiments, each second modal can correspond to a first timer.

[0087] For example, taking synchronization at the DRB granularity as an example, the first terminal knows in advance that the data associated with the haptic data 1 on DRB2 includes the data on DRB1, such as video data and audio data. For example, Figure 3 At t1, the haptic data 1 on DRB2 arrives, and the first terminal can start a first timer (timing duration T1) for the audio data 2 on DRB1 having a synchronization relationship with the haptic data 1, and start a first timer (timing duration T2) for the video data 3 on DRB1 having a synchronization relationship with the haptic data 1. Optionally, the timing durations of the first timer (timing duration T1) and the first timer (timing duration T2) can be different or the same.

[0088] Optionally, the first timer (timing duration T1) and the first timer (timing duration T2) are different timers, that is, the first timer (timing duration T1) is maintained by the first terminal for the audio modal, and the first timer (timing duration T2) is maintained by the first terminal for the video modal.

[0089] The above paragraph takes the first terminal maintaining different timers for different modal data on DRB1 as an example. In other embodiments, the first terminal can also maintain the same timer for different modal data on DRB1. For example, as shown in Table 1, the first terminal can maintain the same timer for different modal data on DRB1. Figure 3 When the haptic data 1 on DRB2 arrives, the first terminal starts a first timer for the data (such as audio and video data) on DRB1 that has a synchronization relationship with DRB2.

[0090] In one or more embodiments of the present application, the first data is carried by a first data radio bearer (DRB), and the second data is carried by a second DRB. Optionally, the first DRB and the second DRB can be the same or different. For example, different modal data is carried by different DRBs, such as DRB1 carrying audio data and DRB2 carrying video data. Alternatively, one DRB can carry multiple modal data.

[0091] As a possible implementation, the timing length of the first timer can be set according to different synchronization requirements. For example, the first terminal can set the timing length of the first timer according to the synchronization threshold shown in Table 1. For example, when the first data is video data and the second data is audio data that has a synchronization relationship with the video data, the timing length of the first timer can be set to a value less than 20 ms. In this way, the first terminal can send the first information within a time period less than 20 ms to ensure that the first terminal transmits the second data within 20 ms as much as possible.

[0092] S102, if the first condition is met, the first terminal sends the first information.

[0093] The first condition includes at least one of the following conditions: the remaining time of the first timer is less than or equal to a first time length, the second data arrives, and the remaining synchronization time corresponding to the second data is less than or equal to the first time length.

[0094] In various embodiments of the present application, the remaining synchronization time corresponding to the data can also be referred to as a synchronization remaining time or a synchronization time, without limitation.

[0095] The first information indicates at least one of the following: the remaining synchronization time corresponding to the second data and the data amount of the second data.

[0096] In some embodiments, the first terminal triggers the first information before the first terminal transmits the first information. That is, in the embodiments of the present application, if the first condition is met, the first terminal triggers the first information. Optionally, the first terminal triggering the first information in the embodiments of the present application can also be understood as the first terminal triggering the transmission of the first information, or triggering the reporting of the first information, or the process of the first terminal triggering the transmission of the first information, or the process of the first terminal triggering the reporting of the first information. Optionally, the process of transmitting or reporting the first information can include the first terminal transmitting the first information. Optionally, before the first terminal transmits the first information, the first terminal can first acquire the resource for transmitting the first information.

[0097] In some embodiments, the remaining synchronization duration indicates the remaining synchronization duration of the second data, or the remaining synchronization duration of a logical channel group (LCG) to which the second data belongs. In other words, the first terminal can report the remaining synchronization duration in data granularity, or report the remaining synchronization duration in logical channel group granularity.

[0098] The remaining synchronization duration of the second data is related to the remaining duration of the first timer. As a possible implementation, the remaining synchronization duration of the data can be the remaining duration of the timer corresponding to the data. Or it can be understood as the remaining duration of the timer started for the data.

[0099] For example, as Figure 4 At time t1, tactile data 1 arrives, and the timer Timer1 (timing duration T1) started by the first terminal for the audio data 2 having a synchronization relationship with the tactile data 1 arrives at time t3. At time t2, the remaining synchronization duration of the audio data 2, i.e., the remaining duration T1_rem of Timer1, is equal to the preset threshold value, i.e., the first duration. The shorter the remaining synchronization duration of the audio data 2, the more the terminal needs to transmit the audio data 2 in time, and the higher the urgency of the audio data 2.

[0100] At the time t2, the first terminal triggers the first information, the first information includes information for indicating the T1_rem, after the first terminal triggers the first information, the first terminal can also send the first information, for example, the first information is sent at the time t2 in the figure. By sending the first information to the access network device by the first terminal, after the access network device receives the first information, the access network device can know the remaining synchronization time length of the audio data 2 according to the first information. The access network device can know the urgency of the audio data 2 according to the remaining synchronization time length of the audio data 2, and can allocate the corresponding transmission resource for the audio data 2 according to the urgency. In this way, the terminal can use the transmission resource to transmit the urgent audio data 2 in time, and improve the synchronization performance between the audio data 2 and the tactile data 1. It can be seen that the terminal can indicate the remaining synchronization time length through the first information, so that the access network device can preferentially schedule the transmission of the audio data 2 to ensure the synchronization between the audio data 2 and the tactile data 1.

[0101] The remaining synchronization time length of the LCG to which the second data belongs can be the shortest remaining synchronization time length in the remaining synchronization time length corresponding to the data of the LCG. For example, the second data corresponds to the LCG1, or the logical channel corresponding to the second data is included in the LCG1, when the first information corresponding to the second data is triggered, the remaining synchronization time length of the second data is 1ms, the data on the other logical channels included in the LCG1, for example, the remaining synchronization time length of the third data is 0.5ms, 0.5ms is less than 1ms, and the first information includes the remaining synchronization time length 0.5ms of the third data, that is, the shortest remaining synchronization time length of the logical channel in the LCG1 corresponding to the second data.

[0102] In the non-packet level synchronization mode, the first condition includes the arrival of the second data. For example, the tactile data 1 is a gesture operation when the user wears a head-mounted device, and the audio data 2 is a sound emitted by the user at the same time as the gesture operation or an environmental sound, which is not limited. The terminal (such as a device such as a head-mounted device) collects the tactile data 1, such as Figure 3 , and starts the first timer Timer1 for synchronization at the time t1.

[0103] The terminal also collects the audio data 2. For example, Figure 3 , before the Timer1 (timing duration T1) expires, at the time t3, the audio data 2 (an example of the second data) arrives, which meets the first condition, which means that the terminal has a demand for transmitting the audio data 2. In this case, the terminal sends the first information to the access network device. For example, the first information can be used to request the transmission resource of the audio data 2. For example, the first information indicates the remaining synchronization time length of the audio data 2. For example, the first information indicates the data amount of the audio data 2, such as 100MB.

[0104] In some examples, the terminal also collects the video data 3, such asFigure 3 Before Timer2 (timing duration T2) expires, video data 3 arrives, satisfying the first condition. In this case, the terminal sends the first information to the access network device. For example, the first information indicates the remaining synchronization duration of the video data 3 and the data volume of the video data 3.

[0105] With this method, when the second data (such as audio data 2) of the second modality arrives, the terminal can timely report the first information to the access network device, which helps to timely obtain the transmission resource of the second data, so as to timely transmit the second data and improve the synchronization performance between the first data and the second data from different modalities. For example, in the example of Figure 3 , the terminal can transmit the audio data 2 within a short duration after transmitting the haptic data 1, avoiding the fragmentation of the haptic and audio experience and improving the experience of services such as XR.

[0106] For another example, the first condition includes the arrival of the second data, and the remaining synchronization duration of the second data is less than or equal to a threshold (such as the first duration), as shown in Figure 4 At time t3, the audio data 2 arrives, and at time t2, the remaining duration T1_rem of Timer1 is T1-T_t1-t2, where T_t1-t2 is the duration between time t1 and time t2. The remaining duration of Timer1 reaches the first duration, meaning that the remaining duration of Timer1 is short. In this case, the first terminal triggers the first information, so that the first terminal timely sends the first information to the access network device, improving the probability that the access network device timely schedules the transmission resource for the audio data 2. In this way, the haptic data of the first modality and the audio data of the second modality can be transmitted within a duration that meets the synchronization requirement, improving the synchronization effect between the haptic data and the audio data.

[0107] For another example, in some cases, multiple second data arrive before the first timer expires. For example, the DRB-granularity synchronization is taken as an example, as shown in Figure 4 Before Timer1 (timing duration T1) expires, two audio data (labeled as 2) arrive, and the first terminal triggers the first information (such as the remaining synchronization duration and the data volume) corresponding to the two audio data at time t2 (the remaining duration of Timer1 is less than or equal to the first duration). In this way, before the first timer expires, the first terminal can report the information of multiple second data that have arrived and need to be synchronized on DRB1 to the access network device, so as to improve the probability that the access network device timely schedules the second data.

[0108] With the scheme of the embodiments of the present application, when the second data of the second modality and the first data of the first modality have a synchronization relationship, the terminal can timely report the first information related to the second data to the access network device before the first timer expires, and then improve the probability that the second data is timely transmitted.

[0109] The above mainly uses DRB-level non-packet-level synchronization as an example. In other embodiments, non-packet-level synchronization can also be QoS-level synchronization. For example, there is a synchronization relationship between the first QoS and the second QoS. When the first data of the first QoS arrives, it triggers the first terminal to start a first timer (e.g., timer duration T1) for the second QoS. Before the first timer expires, if one or more second data of the second QoS arrive, the first terminal can send the first information corresponding to the one or more second data (such as the remaining synchronization duration and data volume) when a first condition is met.

[0110] The above example uses non-packet-level synchronization, where the first terminal does not need to confirm whether each arriving data from the second mode is associated with the first data. The following example illustrates packet-level synchronization. In packet-level synchronization, the first condition includes at least one of the following: the remaining duration of the first timer is less than or equal to the first duration, and the second data arrives. The first condition may also include: there is a synchronization relationship between the second data and the first data. In other words, in packet-level synchronization, the first terminal needs to confirm whether each arriving data from the second mode is associated with the first data. Only when at least one of the following conditions is met—the remaining duration of the first timer is less than or equal to the first duration, the second data arrives, and the second data is associated with the first data—is the first condition satisfied, and the first information is triggered.

[0111] For example, such as Figure 5 At time t1, haptic data 1 arrives. The first terminal starts Timer1 for the audio data associated with haptic data 1, with a length of T1. The first terminal also starts Timer2 for the video data associated with haptic data 1, with a length of T2. Before Timer2 expires, video data 3 arrives. The first terminal determines that video data 3 is not associated with haptic data 1, meaning there is no need to synchronize video data 3 with haptic data 1, and therefore no need to trigger the first information. Before Timer1 expires, audio data 2 arrives. The first terminal determines that audio data 2 is associated with haptic data 1, meaning there is a need to synchronize audio data 2 with haptic data 1, and therefore the first terminal triggers the first information, for example, when the remaining duration of Timer1 reaches a threshold (such as the first duration). Figure 3 Compared to the non-packet level synchronization shown, Figure 5In the illustrated example of packet-level synchronization, before Timer1 expires, the first information of the part of data (e.g., audio data 2 in audio data) on DRB1 that needs to be synchronized is reported; before Timer2 expires, the first information of the part of data (e.g., video data 3 in video data) on DRB1 is not reported. This can improve the accuracy of synchronization and in some cases can also reduce the reporting overhead.

[0112] In some embodiments, the first data and the second data are carried by the same DRB. For example, as Figure 7 , DRB1 carries audio data and video data. As Figure 7 , at time t1, audio data 1 arrives, and the first terminal starts a first timer Timer1 (with a timing duration T1). At time t2, video data 2 arrives, and the first terminal starts a first timer Timer2 (with a timing duration T2). Before Timer2 expires, if a first condition is met, such as audio data 3 arrives and the remaining duration of Timer2 reaches a threshold, the first terminal triggers the first information. The embodiments of the present application do not limit the DRB used to carry the first data and the second data, and the DRB used to carry the first data and the second data can be the same or different DRB, and the number of DRBs used to carry the first data and the second data can be the same or different.

[0113] In one or more embodiments of the present application, the function of the timer can be implemented in any possible protocol layer.

[0114] For example, the first timer is a timer of a medium access control (MAC) layer. In this case, triggering the first information can be implemented by the MAC layer triggering the first information; and sending the first information can be implemented by sending the first information through the MAC layer.

[0115] For another example, the first timer is a timer of a first protocol layer, and the first protocol layer is a protocol layer above the MAC layer. In this case, triggering the first information can be implemented by sending indication information to the MAC layer through the first protocol layer, and the MAC layer triggers the first information based on the indication information; and sending the first information can be implemented by sending the first information through the MAC layer, or by sending indication information to the MAC layer through the first protocol layer and sending the first information through the MAC layer based on the indication information.

[0116] Exemplarily, the first protocol layer comprises a radio resource control (RRC) layer, or a PDCP layer, or a radio link control (RLC) layer, or a service data adaptation protocol (SDAP) layer.

[0117] In one or more embodiments of the present application, the first information is carried in a first medium access control control element (MAC CE). Optionally, the first terminal triggers the first information, which is alternatively that the first terminal triggers the first MAC CE; or alternatively that the first terminal triggers the first MAC CE; or alternatively that the first terminal triggers a first process, and the first terminal reports the first MAC CE through the first process. Optionally, the first process can also be understood as a process in which the first terminal requests resources from the base station.

[0118] Optionally, the first MAC CE can be identified by a first logical channel identification (LCID) or a first extended logical channel identification (eLCID). In other words, the first MAC CE is identified by the first LCID or the first eLCID. For example, the value of the LCID field can be any one of integers from 38 to 42 and 47, and the value of the eLCID field can be any one of integers from 64 to 286. For example, when the LCID takes the value of 38, it indicates that the MAC CE is a MAC CE carrying the first information. For another example, when the eLCID takes the value of 64, it indicates that the MAC CE is a MAC CE carrying the first information.

[0119] Optionally, if the second data of the second mode of the first terminal is completed, the first terminal cancels the first MAC CE reporting, or the first terminal cancels the first information reporting. Alternatively, if the second data of the second mode corresponding to the first information is completed, the first terminal cancels the first MAC CE reporting, or the first terminal cancels the first information reporting.

[0120] Optionally, if the first terminal has no resource to transmit the first MAC CE, the first terminal can further trigger a first scheduling report (SR). The first terminal transmits the first MAC CE through the acquired resource by sending the SR. For example, if the first terminal has no resource to transmit the first MAC CE, the first terminal can trigger the SR. Optionally, the SR is a SR dedicated for reporting the first MAC CE. Or, the SR can have other functions in addition to reporting the first MAC CE. Optionally, if the second data of the second mode of the first terminal is transmitted or the first terminal has transmitted the first MAC CE, the first terminal cancels the SR.

[0121] In some embodiments, the first information can be carried in a first delay status reporting (DSR). Optionally, if the second data of the second mode corresponding to the first information is transmitted, the first terminal cancels the DSR reporting.

[0122] In some other embodiments, the first information is carried in the first SR. Optionally, if the second data of the second mode is transmitted, the first terminal cancels the SR reporting.

[0123] In one or more embodiments of the present application, the second data has at least one.

[0124] In some examples, the second data has multiple. For example, Figure 3 At t1, the haptic data 1 on DRB2 arrives, and the first terminal starts the first timer Timer1 and Timer2 for the audio data (e.g., audio data 2) and video data (e.g., video data 3) on DRB1 that need to be synchronized, respectively. The length of Timer1 is T1, and the length of Timer2 is T2. When the first condition is met, the first terminal triggers the first information. For example, during the running of the first timer Timer1 corresponding to the audio data 2, the audio data 2 arrives, and the first terminal triggers the first information when the remaining length of Timer1 reaches the first length. For another example, during the running of the first timer Timer2 corresponding to the video data 3, the video data 3 arrives, and the first terminal triggers the first information when the remaining length of Timer2 reaches the first length.

[0125] Optionally, the first length corresponding to Timer1 and the first length corresponding to Timer2 can be different or the same. For example, when the audio data 2 arrives, the first terminal triggers the first information when the remaining length of Timer1 reaches length A, when the video data 3 arrives, the first terminal triggers the first information when the remaining length of Timer2 reaches length B, and length A is less than length B. Here, length A and length B are only an example of the size relationship between length A and length B, and are not limited.

[0126] Optionally, the first information can carry information of the audio data 2 (remaining synchronization duration and / or data amount) and information of the video data 3 (remaining synchronization duration and / or data amount).

[0127] When the second data includes at least one data, optionally, the first information can indicate a remaining synchronization duration corresponding to the at least one second data, for example, a remaining synchronization duration of the second data of the second modality. Optionally, the first information can indicate a size (data amount) of a data packet corresponding to the at least one second data.

[0128] In some embodiments, for the case that the second data includes at least one data, for each second data, the first terminal can trigger the first information corresponding to the second data respectively when the first condition is met, and when the first information corresponding to multiple second data are triggered, the first terminal can report the first information corresponding to the multiple second data together, or in other words, the first information can indicate the remaining synchronization duration and / or data amount information of the multiple second data.

[0129] For the case that the second data includes at least one data, the first information indicates at least one of: a remaining synchronization duration corresponding to the second data, a data amount of the second data, including: preferentially indicating at least one of: a remaining synchronization duration corresponding to a data with the highest priority among the multiple second data, a data amount of the data with the highest priority among the multiple second data. Exemplarily, the priority can also be understood as a logical channel priority. Further exemplarily, the priority of the data is related to a service type corresponding to the data.

[0130] Alternatively, the first terminal preferentially indicates at least one of: a remaining synchronization duration corresponding to a data with the most urgent synchronization requirement among the multiple second data, a data amount of the data with the most urgent synchronization requirement among the multiple second data. In other words, the first terminal preferentially indicates the remaining synchronization duration and / or data amount corresponding to the second data with the more urgent synchronization requirement in the first information, so as to ensure that the data with the urgent synchronization requirement can be preferentially requested for resources, and ensure the synchronization between the first data and the second data with the urgent synchronization requirement. Wherein, the urgent synchronization requirement can be related to the remaining synchronization duration, for example, the shorter the remaining synchronization duration, the more urgent the synchronization requirement. Exemplarily, there are two second data that need to be synchronized, the remaining synchronization duration of data A is shorter than that of data B, and the first terminal preferentially includes the remaining synchronization duration and / or data amount corresponding to data A in the first MAC CE.

[0131] Optionally, the priority indication can be understood as follows: the first terminal generates the first information according to the available resource size, the first terminal preferentially includes the remaining synchronization duration and / or the data amount corresponding to the data with the highest priority in the first information, and then sequentially includes the remaining synchronization duration and / or the data amount corresponding to the data with the next priority, until the remaining synchronization duration and / or the data amount information corresponding to one or more data is suitable for the resource size.

[0132] For example, data A (an example of the first data) arrives, the first terminal starts the first timer, then data B1, B2 and B3 (examples of the second data) arrive, and data B1, B2 and B3 all satisfy the first condition. Among data B1-B3, data B2 has the highest priority and data B3 has the lowest priority, and the first terminal preferentially includes the remaining synchronization duration and / or the data amount corresponding to data B2 in the first MAC CE. In some examples, if the first MAC CE can also carry other information, for example, the first terminal determines that the first MAC CE can also carry other information according to the current available resource size, the first terminal can include the remaining synchronization duration and / or the data amount corresponding to data B1 in the first MAC CE. In some examples, if the first MAC CE can also carry other information, for example, the first terminal determines that the first MAC CE can also carry other information according to the current available resource size, the first terminal can further include the remaining synchronization duration and / or the data amount corresponding to data B3 in the first MAC CE.

[0133] For another example, data A arrives, the first terminal starts the first timer, then data B1, B2 and B3 arrive, and data B1, B2 and B3 all satisfy the first condition. Among data B1-B3, the logical channel where data B3 is located has the highest priority and the logical channel where data B2 is located has the lowest priority, and the first terminal preferentially includes the remaining synchronization duration and / or the data amount corresponding to data B3 in the first MAC CE. In some examples, if the first MAC CE cannot carry other information, for example, the first terminal determines that the first MAC CE cannot carry other information according to the current available resource size, the first terminal only includes the remaining synchronization duration and / or the data amount corresponding to data B3 in the first MAC CE.

[0134] In some examples, when there are multiple second data. The first terminal can include the remaining synchronization duration of as much data as possible in the first information. For example, data A arrives, the first terminal starts the first timer, then data B1, B2 and B3 arrive, and data B1, B2 and B3 all satisfy the first condition. Among data B1-B3, the logical channel where data B3 is located has the highest priority, and the logical channel where data B2 is located has the lowest priority, then the first terminal preferentially includes the remaining synchronization duration corresponding to data B3 in the first MAC CE. In some examples, if the first MAC CE can also carry other information, for example, the first terminal determines that the first MAC CE can also carry other information according to the current available resource size, then the first terminal can include the remaining synchronization duration corresponding to data B1 in the first MAC CE. In some examples, if the first MAC CE can also carry other information, for example, the first terminal determines that the first MAC CE can also carry other information according to the current available resource size, then the first terminal can continue to include the remaining synchronization duration corresponding to data B2 in the first MAC CE. In some examples, if the first MAC CE can also carry other information, for example, the first terminal determines that the first MAC CE can also carry other information according to the current available resource size, then the first terminal can include the data amount corresponding to data B3 in the first MAC CE. In some examples, if the first MAC CE can also carry other information, for example, the first terminal determines that the first MAC CE can also carry other information according to the current available resource size, then the first terminal can include the data amount corresponding to data B1 in the first MAC CE. In some examples, if the first MAC CE can also carry other information, for example, the first terminal determines that the first MAC CE can also carry other information according to the current available resource size, then the first terminal can include the data amount corresponding to data B2 in the first MAC CE.

[0135] In some examples, when there are multiple second data. The first terminal can include the data amount of as much data as possible in the first information.

[0136] In some examples, when there are multiple second data. The first terminal can preferentially include the remaining synchronization duration and the data amount of the data with the highest priority among the multiple second data in the first information. For example, among the multiple second data B1-B3, data B2 has the highest priority, and data B3 has the lowest priority, then the first terminal preferentially includes the remaining synchronization duration and the data amount corresponding to data B2 in the first MAC CE. In some examples, if the first MAC CE can also carry other information, then the remaining synchronization duration and / or the data amount corresponding to data B1 can be included in the first MAC CE. In some examples, if the first MAC CE can also carry other information, then the remaining synchronization duration and / or the data amount corresponding to data B3 can be included in the first MAC CE.

[0137] In one or more embodiments of the present application, optionally, if the second data of the second modality corresponding to the first timer is completed transmission, the first terminal cancels the first information reporting.

[0138] In some other embodiments, the first modality can also have multiple first modalities, or the data of the first modality can have multiple data. For example, the first modality includes a third modality and a fourth modality, and the first timer includes a second timer and a third timer.

[0139] When the first data of the first modality arrives, the first terminal starts the first timer, which can be implemented as: when the first data of the third modality arrives, start the second timer corresponding to the second modality; when the first data of the fourth modality arrives, start the third timer corresponding to the second modality. That is, every time a first data of a first modality arrives, it triggers the first terminal to start a timer for synchronizing the data of the second modality.

[0140] The modalities have a corresponding relationship with the DRBs. For example, the third modality and the fourth modality correspond to the first DRB, and the second modality corresponds to the second DRB; or the third modality corresponds to the first DRB, the fourth modality corresponds to the second DRB, and the second modality corresponds to the third DRB; or the third modality, the fourth modality, and the second modality all correspond to the first DRB.

[0141] The first terminal can pre-know the association or synchronization relationship between the modalities, for example, pre-know that the third modality is associated with the second modality, and the fourth modality is associated with the second modality; or the DRB corresponding to the third modality is associated with the DRB corresponding to the second modality, and the DRB corresponding to the fourth modality is associated with the DRB corresponding to the second modality; or the data carried by the DRB corresponding to the third modality is associated with the data carried by the DRB corresponding to the second modality, and the data carried by the DRB corresponding to the fourth modality is associated with the data carried by the DRB corresponding to the second modality.

[0142] For example, Figure 6 At time t1, the audio data (an example of the first data of the third modality) arrives, and the first terminal starts the second timer (timing duration Ta), which is used to synchronize the haptic data having a synchronization relationship with the audio modality. At time t2, the video data (an example of the first data of the fourth modality) arrives, and the first terminal starts the third timer (timing duration Tb), which is used to synchronize the haptic data having a synchronization relationship with the video modality.

[0143] Taking non-packet level synchronization as an example, assuming that the audio data and the video data are on DRB1, and the haptic data is on DRB2, before the second timer (Ta) and the third timer (Tb) expire, one or more haptic data arrives on DRB2, the first terminal can send the first information corresponding to the one or more haptic data after meeting the first condition. For example, in the case of sufficient uplink resources, the first information of all data in the one or more haptic data is sent. For another example, in the case of insufficient uplink resources, the first information of high-priority data is preferentially sent, or the first information of data with urgent synchronization needs, such as a short remaining synchronization time, is preferentially sent.

[0144] Taking the first condition including that the remaining time length of the first timer is less than or equal to the first time length as an example, in this example, the first condition that the remaining time length of the first timer is less than or equal to the first time length can mean that the first remaining time length is less than or equal to the first time length; the first remaining time length is the minimum of the remaining time lengths of the second timer and the third timer, or the first remaining time length is the intersection of the remaining time lengths of the second timer and the third timer.

[0145] For example, at time t4, the remaining time lengths of the second timer (Ta) and the third timer (Tb) are as follows Figure 6 , wherein the remaining time length of the third timer (Tb) is shorter, and the first terminal takes the remaining time length of the third timer (Tb) as the first remaining time length. At time t4, the first remaining time length is less than or equal to the first time length, so the first terminal determines that the first condition is met, triggering the first information.

[0146] For example, at time t4, the remaining time lengths of the second timer (Ta) and the third timer (Tb) are as follows Figure 6 , wherein the intersection of the remaining time lengths of Ta and Tb is N, and the first terminal takes N as the first remaining time length. At time t4, the first remaining time length is less than or equal to the first time length, so the first terminal determines that the first condition is met, triggering the first information.

[0147] Taking the synchronization at the package level as an example, before the second timer (Ta) and the third timer (Tb) expire, one or more haptic data arrive. The first terminal can send the first information of the haptic data that has a synchronization relationship with the audio data and the video data when the first condition is met. For example, before the second timer and the third timer expire, the first terminal determines that the arrived haptic data A has a synchronization relationship with the audio data and the video data. Then, the first terminal can trigger the first information corresponding to the haptic data A when the first remaining time length is less than or equal to the first time length. The first terminal determines that the arrived haptic data B does not have a synchronization relationship with the audio data and the video data. Then, the first terminal does not trigger the first information corresponding to the haptic data B.

[0148] For another example, the data#1 of the third modality arrives, and the first terminal starts the timer Timer1. The data#2 of the fourth modality arrives, and the first terminal starts the timer Timer2. Then, the data#3 arrives, the data#3 is not associated with the data#1 of the third modality, and is associated with the data#2 of the fourth modality. Then, the first terminal determines whether to trigger the first information according to the Timer2. For another example, the data#3 arrives, the data#3 is not associated with the data#2, and is associated with the data#1. Then, the first terminal determines whether to trigger the first information according to the Timer1.

[0149] In a possible implementation, in the embodiments of the present application, the arrival of the second data in the first condition can include that the second data arrives when the remaining time length of the timer is greater than or equal to the second time length, that is, the second data arrives before the timer expires. It can be understood that the second data arrives under the premise that the remaining time length of the timer is greater than or equal to the second time length. The second data arrives during the running of the timer. It can be understood that the second data arrives under the premise that the remaining time length of the timer is greater than or equal to the second time length. It can be understood that if the second data arrives too late, for example, the second data arrives after the remaining time length of the timer reaches or is less than the second time length, the synchronization requirement of the second data can not be considered. Optionally, the second time length and the first time length can be the same or different.

[0150] In some embodiments, the method of the present application can further include: sending, by the first terminal, second information to the access network device, the second information indicating at least one of the following: a synchronization relationship between the plurality of modalities, a synchronization relationship between the plurality of Qos flows, a synchronization relationship between the plurality of Qos, a synchronization relationship between the plurality of DRBs. Optionally, the plurality of modalities includes the first modality and the second modality; the plurality of Qos flows are Qos flows corresponding to the plurality of modalities, each modality corresponding to one or more Qos flows; the plurality of Qos are Qos corresponding to the plurality of modalities, each modality corresponding to one or more Qos; and the plurality of DRBs are DRBs corresponding to the plurality of modalities, each modality corresponding to one or more DRBs.

[0151] In a possible implementation, the second information includes a first list, the first list indicating a synchronization relationship of one or more modalities, or indicating a synchronization relationship of one or more Qos, or indicating a synchronization relationship of one or more Qos flows, or indicating a synchronization relationship of one or more DRBs, etc.

[0152] Optionally, the first list directly indicates information of each modality in the one or more modalities, and information of other modalities associated with each modality, wherein the information of a modality includes an identifier or a name of the modality, etc. For example, Table 2-1 shows an example of the first list. In Table 2-1, the name of modality 1 is shown, and the names of modalities 2 and 3 associated with modality 1 are shown. Similarly, the names of the modalities associated with modalities 2 and 3 are shown in Table 2-1. Table 2-2 shows another example of the first list, and the present application does not limit the implementation of the first list.

[0153] Table 2-1

[0154] Modality 1 Modality 2, Modality 3 Modality 2 Modality 3 Modality 3 Modality 1

[0155] Table 2-2

[0156] Modality 1 Modality 2 Modality 1 Modality 3 Modality 2 Modality 3 Modality 3 Modality 1

[0157] Alternatively, the first list directly indicates information of each of the one or more Qos and information of other Qos associated with each of the one or more Qos, wherein the information of the Qos includes an identifier of the Qos, etc. Alternatively, the first list directly indicates information of each of the one or more Qos flow and information of other Qos flow associated with each of the one or more Qos flow, wherein the information of the Qos flow includes an identifier of the Qos flow, etc. Alternatively, the first list directly indicates information of each of the one or more DRB and information of other DRB associated with each of the one or more DRB, wherein the information of the DRB includes an identifier of the DRB, etc. For example, Table 2-3 shows an example of the first list. In Table 2-3, the identifier of DRB1 and the identifiers of DRB2 and DRB3 associated with DRB1 are shown. Similarly, the identifiers of the DRBs associated with DRB2 and DRB3 respectively are shown in Table 2-3. Table 2-4 shows another example of the first list, and the implementation of the first list by the embodiments of the present application is not limited.

[0158] Table 2-3

[0159] DRB 1 DRB 2, DRB 3 DRB 2 DRB 1, DRB 3 DRB 3 DRB 1

[0160] Table 2-4

[0161] DRB 1 DRB 2 DRB 1 DRB 3 DRB 2 DRB 1 DRB 2 DRB 3 DRB 3 DRB 1

[0162] Alternatively, the first list indicates synchronization information corresponding to each of the one or more modalities, where the synchronization information includes a synchronization value, a synchronization index, or a group identifier, etc. It can be understood that if the synchronization information of two or more modalities is the same, the two or more modalities have a synchronization relationship. Alternatively, the first list indicates synchronization information corresponding to each of the one or more Qos, where the synchronization information includes a synchronization value, a synchronization index, or a group identifier, etc. It can be understood that if the synchronization information of two or more Qos is the same, the two or more Qos have a synchronization relationship. Alternatively, the first list indicates synchronization information corresponding to each of the one or more Qos flows, where the synchronization information includes a synchronization value, a synchronization index, or a group identifier, etc. It can be understood that if the synchronization information of two or more Qos flows is the same, the two or more Qos flows have a synchronization relationship. Alternatively, the first list indicates synchronization information corresponding to each of the one or more DRBs, where the synchronization information includes a synchronization value, a synchronization index, or a group identifier, etc. It can be understood that if the synchronization information of two or more DRBs is the same, the two or more DRBs have a synchronization relationship. Alternatively, in an embodiment of the present application, the synchronization value, the synchronization index, or the group identifier can indicate the synchronization relationship, for example, the synchronization values are the same, then the synchronization relationship exists, the synchronization values are different, then the synchronization relationship does not exist; for example, the synchronization indexes are the same, then the synchronization relationship exists, the synchronization indexes are different, then the synchronization relationship does not exist; for example, the group identifiers are the same, then the synchronization relationship exists, the group identifiers are different, then the synchronization relationship does not exist. Alternatively, the synchronization value, the synchronization index, or the group identifier can be an integer greater than or equal to 0.

[0163] For example, Table 3-1 shows an example of the first list. In Table 3-1, the group identifiers corresponding to modality 1-modality 3 are shown respectively. Since modality 1 and modality 2 correspond to the same group identifier 1, modality 1 and modality 2 have a synchronization relationship. For another example, Table 3-2 shows an example of the first list. In Table 3-2, the group identifiers corresponding to Qos flow 1-Qos flow 3 are shown respectively. Since Qos flow 1 and Qos flow 3 correspond to the same group identifier 2, Qos flow 1 and Qos flow 3 have a synchronization relationship.

[0164] Table 3-1

[0165]

[0166]

[0167] Table 3-2

[0168] Qos flow 1 2 Qos flow 2 1 Qos flow 3 2

[0169] Optionally, the second information can be included in a quality of service profile (Qos profile). For example, the first modality corresponds to a first Qos profile, and the first Qos profile includes one or more modality information, such as a modality identifier, which is a modality having a synchronization relationship with the first modality. Alternatively, the first Qos corresponds to the first Qos profile, and the first Qos profile includes one or more Qos information, such as a Qos identifier, which is a Qos having a synchronization relationship with the first Qos. Alternatively, the first Qos flow corresponds to the first Qos profile, and the first Qos profile includes one or more Qos flow information, such as a Qos flow identifier, which is a Qos flow having a synchronization relationship with the first Qos flow. Alternatively, the first DRB corresponds to the first Qos profile, and the first Qos profile includes one or more DRB information, such as a DRB identifier, which is a DRB having a synchronization relationship with the first DRB.

[0170] In a possible implementation, the second information can be included in an RRC message, such as a UE assistance information (UEAssistanceInformation) message.

[0171] In some embodiments, the method of the present application can further include: the first terminal obtaining third information, the third information being used to indicate the first time length and / or the time length of the first timer. The first terminal can receive the third information sent by the access network device, or the first terminal can obtain the third information in a protocol predefined manner, or the first terminal can also obtain the third information in a protocol predefined manner and through the access network device.

[0172] In a possible implementation, the first time length corresponds to the terminal, or the first time length is configured in the granularity of the terminal, or the first time length is configured based on each terminal in the plurality of terminals, including the first terminal, so that each terminal has its respective applicable first time length, avoiding the use of the same first time length by all terminals to affect the synchronization effect of the services; or, the first time length corresponds to the DRB, or the first time length is configured in the granularity of the DRB, or the first time length is configured based on each DRB in the one or more DRBs, so that each DRB has its applicable first time length, and different DRBs carry services with different characteristics, thus avoiding the use of the same first time length by all DRBs to affect the synchronization effect of the services; or, the first time length corresponds to the mode, or the first time length is configured in the granularity of the mode, or the first time length is configured based on each mode in the plurality of modes, so that each mode has its applicable first time length, and different modes have different service characteristics, thus avoiding the use of the same first time length by all modes to affect the synchronization effect of the services; or, the first time length corresponds to the Qos flow, or the first time length is configured in the granularity of the Qos flow, or the first time length is configured based on each Qos flow in the plurality of Qos flows, so that each Qos flow has its applicable first time length, and different Qos flows carry services with different characteristics, thus avoiding the use of the same first time length by all Qos flows to affect the synchronization effect of the services; or, the first time length corresponds to the Qos, or the first time length is configured in the granularity of the Qos, or the first time length is configured based on each Qos in the plurality of Qos, so that each Qos has its applicable first time length, and different Qos carry services with different characteristics, thus avoiding the use of the same first time length by all Qos to affect the synchronization effect of the services.

[0173] In a possible implementation, the first timer has a duration corresponding to the terminal, or the duration of the first timer is configured in the granularity of the terminal, or the duration of the first timer is configured based on each terminal in the plurality of terminals, including the first terminal, so that each terminal has its respective duration of the first timer, avoiding the use of the same duration of the first timer by all terminals to affect the synchronization effect of the service; or, the first timer has a duration corresponding to the DRB, or the duration of the first timer is configured in the granularity of the DRB, or the duration of the first timer is configured based on each DRB in the one or more DRBs, so that each DRB has its respective duration of the first timer, and different DRBs carry services with different characteristics, thus avoiding the use of the same duration of the first timer by all DRBs to affect the synchronization effect of the service; or, the first timer has a duration corresponding to the mode, or the duration of the first timer is configured in the granularity of the mode, or the duration of the first timer is configured based on each mode in the plurality of modes, so that each mode has its respective duration of the first timer, and different modes have different service characteristics, thus avoiding the use of the same duration of the first timer by all modes to affect the synchronization effect of the service; or, the first timer has a duration corresponding to the Qos flow, or the duration of the first timer is configured in the granularity of the Qos flow, or the duration of the first timer is configured based on each Qos flow in the plurality of Qos flows, so that each Qos flow has its respective duration of the first timer, and different Qos flows carry services with different characteristics, thus avoiding the use of the same duration of the first timer by all Qos flows to affect the synchronization effect of the service; or, the first timer has a duration corresponding to the Qos, or the duration of the first timer is configured in the granularity of the Qos, or the duration of the first timer is configured based on each Qos in the plurality of Qos, so that each Qos has its respective duration of the first timer, and different Qos carry services with different characteristics, thus avoiding the use of the same duration of the first timer by all Qos to affect the synchronization effect of the service.

[0174] In a possible implementation, the third information can include a second list, and the second list indicates at least one first duration. For example, the second list includes one or more first durations, which are configured for one or more first devices. For another example, the second list includes one or more first durations, which are configured for each DRB of each first device. For another example, the second list includes one or more first durations, which are configured for each mode of each first device. For another example, the second list includes one or more first durations, which are configured for each mode of each DRB of each first device.

[0175] In a possible implementation, the third information can include a third list, and the third list indicates the time length of the at least one first timer. For example, the third list includes the time length of one or more first timers, and the time length of the one or more first timers is configured for the one or more first devices. For another example, the third list includes the time length of one or more first timers, and the time length of the one or more first timers is configured for each DRB of each first device. For another example, the third list includes the time length of one or more first timers, and the time length of the one or more first timers is configured for each modality of each first device. For another example, the third list includes the time length of one or more first timers, and the time length of the one or more first timers is configured for each modality of each DRB of each first device.

[0176] In a possible implementation, the second list is the same as or different from the third list.

[0177] In the above example in which the time length of the first timer is carried in the third information, in another embodiment, the time length of the first timer and the first time length can also be carried in different information, which is not limited.

[0178] Optionally, the third information can be included in a broadcast message, and in this case, the access network device can directly indicate the first time length and / or the time length of the first timer available to the one or more first terminals, saving signaling. Optionally, the third information can be included in a terminal-specific message, for example, an RRC reconfiguration message, and in this case, the access network device can specially configure the first time length and / or the time length of the first timer available to each terminal device in the one or more first terminals, indicating more flexible and more suitable different services of different terminals.

[0179] For example, the terminal device and the access network device in the embodiments of the present application can be implemented by the communication apparatus in the embodiments of the present application. Figure 8 Figure 8 The communication apparatus provided by the embodiments of the present application is shown in a hardware structure schematic diagram. The communication apparatus 400 includes at least one processor 401, a memory 403, and at least one communication interface 404.

[0180] The processor 401 can be a central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling program execution of the solutions of the present application.

[0181] Optionally, the communication apparatus can include a communication line, and the communication line can include a path for transmitting information between corresponding components of the apparatus.

[0182] ​Communication interface 404 uses any transceiver-like device for communicating with other devices or communication networks, such as Ethernet, RAN, wireless local area networks (WLAN), etc.

[0183] Memory 403 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital versatile optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. Memory may exist independently and be connected to the processor via communication lines. Memory may also be integrated with the processor.

[0184] The memory 403 stores computer execution instructions for implementing the scheme of this application, and the processor 401 controls the execution. The processor 401 executes the computer execution instructions stored in the memory 403 to implement the method provided in the embodiments of this application.

[0185] Optionally, the computer execution instructions in the embodiments of this application may also be referred to as application code, and the embodiments of this application do not specifically limit this.

[0186] In a specific implementation, as one example, processor 401 may include one or more CPUs, for example... Figure 8 CPU0 and CPU1 in the CPU.

[0187] In a specific implementation, as one example, the communication device 400 may include multiple processors, such as... Figure 8 Processors 401 and 408 are mentioned. Each of these processors can be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor here can refer to one or more devices, circuits, and / or processing cores used to process data (e.g., computer program instructions).

[0188] Figure 8The illustrated structure is only an example, and the communication device can also include more or fewer components, or other component layouts, without limitation. For example, the communication device can include a processor that is implemented in hardware or that is implemented in a program-invoking manner. Or the communication device includes a processor and a memory. Or the communication device includes a processor and a communication interface.

[0189] It can be understood that, in order to implement the above functions, the device in the embodiments of the present application comprises corresponding hardware structures and / or software modules for executing various functions. The units and algorithm steps of the examples described in conjunction with the embodiments disclosed in the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is implemented in the form of hardware or computer software driving hardware depends on a specific application and design constraint condition of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the technical solutions of the embodiments of the present application.

[0190] The embodiments of the present application can divide the functional units of the device / apparatus according to the above method examples, for example, each functional unit can be divided according to each function, or two or more functions can be integrated in one processing unit. The integrated unit can be realized in the form of hardware or software functional unit. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division. When actually implemented, there can be another division manner.

[0191] The embodiments of the present application provide a device, which can be the first terminal or other device or corresponding component. The device can include a memory and one or more processors. The memory and the processor are coupled. The memory is configured to store computer program code, which includes computer instructions. When the processor executes the computer instructions, the device can perform various functions or steps performed by the corresponding device in the above method embodiments. The structure of the device can be referred to Figure 8 The structure of the device shown.

[0192] The core structure of the device can be represented as Figure 9 The structure shown, the device includes a processing module 1301, a storage module 1303.

[0193] The processing module 1301 (also referred to as a processing unit) can include at least one of a central processing unit (CPU), an application processor (AP), or a communication processor (CP), or an AI processor, such as Figure 8The processor is shown. The processing module 1301 can perform operations or data processing related to the control and / or communication of at least one of the other elements of the user communication device.

[0194] The storage module 1303 can include a volatile memory and / or a non-volatile memory. The storage module is used to store instructions or data related to at least one of the other modules of the device. For example, it can be implemented as Figure 8 The memory is shown.

[0195] Optionally, it further includes a communication module 1305 (also referred to as a communication unit) for supporting the device to communicate with other devices (through a communication network). For example, the communication module can be connected to a network via wireless communication or wired communication to communicate with other devices. Wireless communication can employ at least one of cellular communication protocols, such as Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Universal Mobile Telecommunications System (UMTS), Wireless Broadband (WiBro), or Global System for Mobile Communications (GSM). Wireless communication can include, for example, short-range communication. Short-range communication can include at least one of Wireless Fidelity (Wi-Fi), Bluetooth, Near Field Communication (NFC), Magnetic Stripe Transmission (MST), or GNSS. For example, it can be implemented as Figure 8 The communication interface is shown.

[0196] The embodiments of the present application also provide a chip system including at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected by a line. For example, the interface circuit can be used to receive signals from other devices (e.g., the memory of the communication device). For another example, the interface circuit can be used to send signals to other devices (e.g., the processor). Illustratively, the interface circuit can read instructions stored in the memory and send the instructions to the processor. When the instructions are executed by the processor, the communication device can be caused to perform various steps in the above-described embodiments. Of course, the chip system can also include other discrete devices, which are not specifically limited by the embodiments of the present application.

[0197] The embodiments of the present application also provide a computer storage medium including computer instructions, which, when executed on the above-described communication device, cause the communication device to perform various functions or steps performed by the mobile phone in the above-described method embodiments.

[0198] The embodiments of the present application also provide a computer program product, which, when executed on a computer, causes the computer to perform various functions or steps performed by the mobile phone in the above-described method embodiments.

[0199] Through the description of the above embodiments, those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional modules is exemplified, and in actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0200] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative, for example, the division of modules or units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another device, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed units can be indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0201] The units described as separate components can or can not be physically separated, and the components shown as units can be one physical unit or multiple physical units, that is, can be located in one place or can be distributed to multiple different places. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0202] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0203] If the integrated unit is realized in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application essentially or the parts that make contributions to the prior art or all or part of the technical solutions can be embodied in the form of a software product, which is stored in a storage medium and includes a plurality of instructions to make a device (which can be a single-chip microcomputer, a chip, etc.) or a processor execute all or part of the steps of the method of the embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various storage media that can store program codes.

[0204] The above merely provides the specific implementation of the present application, but the protection scope of the present application is not limited to this. Any change or replacement within the technical scope disclosed by the present application should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A multi-modal data transmission method, characterized by, Comprise: When the first data of the first mode arrives, the first terminal starts the first timer; the first timer corresponds to the second mode which has a synchronization relationship with the first mode; If the first condition is met, the first information is sent; The first condition includes at least one of the following conditions: the remaining time length of the first timer is less than or equal to the first time length, and the second data of the second mode arrives; The first information indicates at least one of the following: the remaining synchronization time length corresponding to the second data, and the data amount of the second data.

2. The method of claim 1, wherein, The remaining synchronization time length corresponding to the second data indicates the remaining synchronization time length of the second data, or the remaining synchronization time length of the logical channel group to which the second data belongs; the remaining synchronization time length of the second data is related to the remaining time length of the first timer.

3. The method of claim 2, wherein, There are multiple second data; the first information indicates at least one of the following: the remaining synchronization time length corresponding to the second data, and the data amount of the second data, including: Preferentially indicating at least one of the following: the remaining synchronization time length corresponding to the data with the highest priority in the multiple second data, and the data amount of the data with the highest priority in the multiple second data; Or preferentially indicating at least one of the following: the remaining synchronization time length corresponding to the data with the most urgent synchronization demand in the multiple second data, and the data amount of the data with the most urgent synchronization demand in the multiple second data.

4. The method according to any one of claims 1 to 3, characterized in that, The first condition also includes that the second data has a synchronization relationship with the first data.

5. The method according to any one of claims 1 to 4, characterized in that, The first mode includes a third mode and a fourth mode; the first timer includes a second timer and a third timer; When the first data of the first mode arrives, the first terminal starts the first timer, including: When the first data of the third mode arrives, the second timer corresponding to the second mode is started; When the first data of the fourth mode arrives, the third timer corresponding to the second mode is started; The remaining time length of the first timer is less than or equal to the first time length, including: the first remaining time length is less than or equal to the first time length; the first remaining time length is the minimum remaining time length of the remaining time length of the second timer and the remaining time length of the third timer.

6. The method according to any one of claims 1 to 5, characterized in that, Also include: Send the second information, the second information includes at least one of the following information: the synchronization relationship between multiple modes, the synchronization relationship between multiple quality of service Qos, the synchronization relationship between multiple quality of service flow Qos flow, and the synchronization relationship of one or more data radio bearers DRB; The multiple modes include the first mode and the second mode, the multiple Qos are the Qos corresponding to the multiple modes, the multiple Qos flow are the Qos flow corresponding to the multiple modes, and the one or more DRB are the DRB corresponding to the multiple modes.

7. The method of claim 6, wherein, Also include: Obtain the third information, the third information is used to indicate the first time length and / or the time length of the first timer; The first time length and / or the time length of the first timer are configured based on each terminal in a plurality of terminals, the plurality of terminals including the first terminal; or, the first time length and / or the time length of the first timer are configured based on each DRB in the one or more DRBs; or, the first time length and / or the time length of the first timer are configured based on each modality in the plurality of modalities, or, the first time length and / or the time length of the first timer are configured based on each Qos flow in the plurality of Qos flows; or, the first time length and / or the time length of the first timer are configured based on each Qos in the plurality of Qos.

8. The method according to any one of claims 1 to 7, characterized in that, The first timer is a timer of a medium access control (MAC) layer, and the first information is transmitted if a first condition is met, including: The first condition is met, and the first information is transmitted through the MAC layer.

9. The method according to any one of claims 1 to 7, characterized in that, The first timer is a timer of a first protocol layer, and the first protocol layer is a protocol layer above the MAC layer, and the first information is transmitted if a first condition is met, including: The first condition is met, and indication information is transmitted to the MAC layer through the first protocol layer; The first information is transmitted based on the indication information through the MAC layer.

10. The method according to any one of claims 1 to 9, characterized in that, The first information is carried in a first medium access control control element (MAC CE), or in a first delay status report (DSR), or in a first scheduling request (SR).

11. The method according to any one of claims 1 to 10, characterized in that, The first data is carried by a first data radio bearer (DRB), and the second data is carried by a second DRB, and the first DRB and the second DRB are the same or different.

12. A computer-readable storage medium, characterized in that, The program or instructions, when executed, implement the method of any one of claims 1 to 11.

13. A computer program product, characterised in that, The computer program product, when executed on a communication device, causes the communication device to perform the method of any one of claims 1 to 11.

14. A communications device, characterized by The circuitry includes units or modules for performing the method of any one of claims 1 to 11.

15. A circuit system, characterized by The circuitry includes processing circuitry configured to perform the method of any one of claims 1 to 11.

Citation Information

Patent Citations

  • Multiparty video data fusion realization method, device, system and fusion server

    CN105282477A

  • Video data transmission method and device and electronic equipment

    CN114024914A