Multi-modal service indication method, communication apparatus and storage medium

Abstract

The present application provides a multi-modal service indication method, a communication apparatus and a storage medium, aiming to solve the problem of data discarding under a multi-modal service. The present application provides the multi-modal service indication method, which is applied to a first terminal device, and comprises: determining that data associated with a multi-modal service has been discarded; and sending first indication information to a network device, wherein the first indication information is used for indicating that data discarding has occurred in the multi-modal service. In the described implementation, the first terminal device can indicate to the network device that data discarding has occurred in the multi-modal service, and the network device can instruct the terminal device using the same multi-modal service to also discard data, so that other data of the same multi-modal service can also be discarded, thereby implementing collaborative discarding of different data streams of a multi-modal service, and improving the data transmission efficiency of the multi-modal service.

Description

A multimodal service indication method, communication device and storage medium

[0001] This application claims priority to a Chinese patent application filed with the Patent Office of China on February 1, 2024, with application number 202410144870.X and invention name “A method for indicating a multimodal service, a communication device and a storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a method for indicating a multimodal service, a communication device, and a storage medium. Background Art

[0003] A multimodal extended reality device refers to a device that performs multimodal services, which may include multiple data streams.

[0004] For a wireless access network (RAN) system, the main requirement for multimodal services is the synchronization of multiple data streams under a multimodal service. The transmission of data streams depends on resource scheduling on the network side.

[0005] When the data stream transmission of a multimodal service fails, the multimodal service cannot be continued. For a terminal device, how to process the data stream of the multimodal service remains an unresolved issue. Summary of the Invention

[0006] The present application provides a method for indicating a multimodal service, a communication device, and a storage medium, aiming to solve the problem of data discard in multimodal services.

[0007] In order to achieve the above objectives, this application provides the following technical solutions:

[0008] A first aspect of the present application provides a method for indicating a multimodal service, which is applied to a first terminal device, and the method includes: determining that data associated with the multimodal service is discarded; sending first indication information to a network device, wherein the first indication information is used to indicate that data discard occurs in the multimodal service.

[0009] In the above implementation scheme, in order to realize the joint discard of data on the multimodal service, the first terminal device can send a first indication message. For example, the first terminal device and the network device can communicate with each other, and the first terminal device sends a first indication message to the network device, so that the network device can receive the first indication message. In the embodiment of the present application, when data discard occurs in the multimodal service of the first terminal device, the first terminal device can indicate to the network device that data discard occurs in the multimodal service, and the network device can instruct the terminal devices using the same multimodal service to also discard it, so that other data of the same multimodal service can also be discarded. It is possible to realize the coordinated discard of different data streams of the multimodal service and improve the data transmission efficiency of the multimodal service.

[0010] In a possible implementation of the first aspect of the present application, the method further includes: receiving second indication information from the network device, the second indication information being used to indicate that data discard occurs in the multimodal service; and discarding the to-be-processed data associated with the multimodal service according to the second indication information. In the above implementation scheme, when the multimodal service is used in a scenario where the data transmission of a single terminal is carried out, the network device sends the second indication information to the first terminal device. When the multiple packet data entities of the first terminal device cannot interact with each other and data loss occurs in the multimodal service of the first terminal device, the first terminal device may send the first indication information of data loss in the multimodal service through the network device, and the network device generates the second indication information based on the first indication information and sends the second indication information to the first terminal device.

[0011] In a possible implementation of the first aspect of the present application, the second indication information is used to indicate to the second packet data entity that the data associated with the multimodal service on the first packet data entity has been discarded; the discarding of the to-be-processed data associated with the multimodal service according to the second indication information includes: determining the multimodal service where data discard has occurred according to the second indication information; and discarding the data associated with the multimodal service on the second packet data entity. In the above implementation scheme, the first terminal device determines the multimodal service where data discard has occurred according to the second indication information, and based on the data loss in the multimodal service, performs data collaborative discarding on the to-be-processed data associated with the multimodal service, which can achieve collaborative discarding of different data streams of the multimodal service and improve the data transmission efficiency of the multimodal service.

[0012] In a possible implementation of the first aspect of the present application, determining that data associated with a multimodal service has been discarded includes: determining that data associated with the multimodal service on a first packet data entity has been discarded; wherein the first indication information is used to indicate that data associated with the multimodal service on the first packet data entity has been discarded. In the above implementation, a data stream in the multimodal service may experience a data stream transmission failure. The first terminal device first determines the discarded data in the multimodal service. For example, the first terminal device obtains a first packet data entity associated with the multimodal service, where the first packet data entity includes multiple data units.

[0013] In a possible implementation of the first aspect of the present application, the first indication information is carried in a first signaling, and the first signaling includes at least one of the following: a first packet data convergence protocol control element PDCP CE, a first PDCP layer control PDU, a first PDCP layer report, a first radio resource control RRC signaling, and a first media access control control element MAC CE. In the above implementation scheme, the first indication information can be notified through the first PDCP CE. In addition to being sent through the first PDCP CE, the first indication information also has other implementation methods, such as the first indication information is notified through the first PDCP layer control PDU or the first PDCP layer report. For example, the first indication information can be notified through the first RRC signaling. For example, the first indication information can be notified through the first MAC CE. In the embodiment of the present application, the above-mentioned multiple first signalings can all enable the first terminal device to indicate to the network device the first packet data entity where data discard has occurred.

[0014] In a possible implementation of the first aspect of the present application, the second indication information is carried in a second signaling, and the second signaling includes at least one of the following: a second PDCP CE, a second PDCP layer control PDU, a second PDCP layer report, a second RRC signaling, and a second MAC CE. In the above implementation scheme, the second indication information can be notified through the second PDCP CE. In addition to being sent through the second PDCP CE, the second indication information also has other implementation methods, such as the second indication information is notified through the second PDCP layer control PDU or the second PDCP layer report. For example, the second indication information can be notified through the second RRC signaling. For example, the second indication information can be notified through the second MAC CE. In the embodiment of the present application, the above-mentioned multiple second signalings can all be used to implement the network device indicating the first packet data entity where data discard occurs.

[0015] In a possible implementation of the first aspect of the present application, the first indication information includes at least one of the following: multimodal identification information, associated identification information, protocol data unit set PDU set identification information, protocol data unit PDU information, and an identifier of a first packet data entity of the multimodal service; the first packet data entity includes a packet data entity associated with data discarding of the multimodal service; the associated identification information is used to indicate the data identifier associated with the first packet data entity. In the above scheme, the following information included in the first indication information can be combined in any way, such as combining two or three of the multimodal identification information, associated identification information, PDU set identification information, PDU information, and an identifier of the first packet data entity of the multimodal service, and the first indication information is sent. The device that receives the first indication information can determine that data discarding has occurred in the first packet data entity associated with the multimodal service.

[0016] In a possible implementation of the first aspect of the present application, the method further includes: receiving configuration information from the network device, the configuration information being used to instruct the first terminal device to report that data discarded occurred in a multimodal service. In the above implementation, the network device can instruct the first terminal device to report that data discarded occurred in a multimodal service, thereby enabling the first terminal device to detect whether data was discarded when transmitting the multimodal service, thereby dynamically configuring the data discard method for the multimodal service.

[0017] The second aspect of the present application provides a method for indicating a multimodal service, which is applied to a network device, and the method includes: receiving a first indication message from a first terminal device, the first indication message being used to indicate that data associated with the multimodal service has been discarded; and sending a second indication message, the second indication message being used to indicate that data discard has occurred in the multimodal service. In the above implementation scheme, the network device can send the second indication message so that the terminal device receiving the first indication message can determine that data discard has occurred in the multimodal service through the second indication message. In the embodiment of the present application, the network device can instruct the terminal device using the same multimodal service to discard data of the same multimodal service, so that other data of the same multimodal service can also be discarded. It can achieve the coordinated discarding of different data streams of the multimodal service, and improve the data transmission efficiency of the multimodal service.

[0018] In a possible implementation of the second aspect of the present application, the first indication information is used to indicate that data associated with the multimodal service on the first packet data entity is discarded; and the second indication information is used to indicate to the second packet data entity that data associated with the multimodal service on the first packet data entity is discarded.

[0019] In a possible implementation of the second aspect of the present application, the first indication information is carried in a first signaling, and the first signaling includes at least one of the following: a first packet data convergence protocol control element PDCP CE, a first PDCP layer control PDU, a first PDCP layer report, a first radio resource control RRC signaling, and a first media access control control element MAC CE.

[0020] In a possible implementation of the second aspect of the present application, the second indication information is carried in a second signaling, and the second signaling includes at least one of the following: a second PDCP CE, a second PDCP layer control PDU, a second PDCP layer report, a second RRC signaling, and a second MAC CE.

[0021] In a possible implementation of the second aspect of the present application, the first indication information includes at least one of the following: multimodal identification information, association identification information, protocol data unit set PDU set identification information, protocol data unit PDU information, and an identifier of the first packet data entity of the multimodal service; the first packet data entity includes a packet data entity associated with data discard occurring in the multimodal service; the association identification information is used to indicate a data identifier associated with the first packet data entity.

[0022] In a possible implementation of the second aspect of the present application, the method further includes: sending configuration information to the first terminal device, where the configuration information is used to instruct the first terminal device to report that data discard occurs in the multimodal service.

[0023] In a possible implementation of the second aspect of the present application, the sending of the second indication information includes: when the multimodal service is used for data transmission of a single terminal, sending the second indication information to the first terminal device; or when the multimodal service is used for data transmission of multiple terminals, sending the second indication information to the second terminal device. In the above implementation, the multimodal service can be used for data transmission of a single terminal, in which case only the communication between the network device and the first terminal device is involved. Alternatively, the multimodal service can be used for data transmission of multiple terminals, in which case the communication between the network device and the first terminal device and the second terminal device is involved.

[0024] The third aspect of the present application provides a method for indicating a multimodal service, which is applied to a terminal device, and the method includes: determining that data associated with the multimodal service on a first packet data entity is discarded; discarding data associated with the multimodal service on a second packet data entity, wherein the second packet data entity and the first packet data entity are respectively mapped to different wireless bearers of the first terminal device. In the above implementation scheme, when data discard occurs on the first packet data entity of the multimodal service of the terminal device, the terminal device detects whether there are other packet data entities to be processed for the same multimodal service. For example, the same multimodal service is associated with the second packet data entity in addition to the first packet data entity, and the terminal device discards data for the same multimodal service, so that other packet data entities of the same multimodal service can also be discarded. It can achieve coordinated discarding of different data streams of the multimodal service and improve the data transmission efficiency of the multimodal service.

[0025] In a possible implementation of the third aspect of the present application, determining that data associated with a multimodal service on a first packet data entity has been discarded includes: determining that a first data unit associated with the multimodal service on the first packet data entity has been discarded. In the above implementation, due to the influence of the channel environment or the control method of the terminal device for receiving the data stream, the data stream in the multimodal service may experience data stream transmission failure. The terminal device first determines the data unit that has been discarded in the multimodal service. For example, the terminal device obtains a first packet data entity associated with the multimodal service, the first packet data entity includes multiple data units, and the terminal device detects that the data unit that has been discarded on the first packet data entity is the first data unit.

[0026] In a possible implementation of the third aspect of the present application, the discarding of data associated with the multimodal service on the second packet data entity includes: discarding the second data unit associated with the multimodal service on the second packet data entity. In the above implementation scheme, the first packet data entity and the second packet data entity of the terminal device are isolated from each other, and the first packet data entity and the second packet data entity cannot interact. Therefore, the terminal device determines the multimodal service associated with the first packet data entity where data discard occurs, and based on the data loss of the first packet data entity in the multimodal service, the second packet data entity is subjected to collaborative data discarding, which can achieve collaborative discarding of different data streams of the multimodal service and improve the data transmission efficiency of the multimodal service.

[0027] In a possible implementation of the third aspect of the present application, the method further includes: receiving configuration information from a network device, the configuration information being used to instruct the first terminal device to detect data discarding in a multimodal service. In the above implementation scheme, after the terminal device establishes a communication connection with the network device, the network device may send configuration information to the terminal device in a dynamic configuration manner, and the configuration information is used to instruct the terminal device to detect a packet data entity in which data discarding has occurred. In an embodiment of the present application, the network device may instruct the terminal device to detect a packet data entity in which data discarding has occurred, thereby enabling the terminal device to detect whether data has been discarded when transmitting a multimodal service, thereby realizing dynamic configuration of the data discarding method of the multimodal service.

[0028] A fourth aspect of the present application provides a communication device, which is specifically a first terminal device, and includes:

[0029] a determination module, configured to determine whether data associated with a multimodal service is discarded;

[0030] The sending module is used to send first indication information to the network device, where the first indication information is used to indicate that data discard occurs in the multimodal service.

[0031] A fifth aspect of the present application provides a communication device, which is specifically a network device, and includes:

[0032] A receiving module, configured to receive first indication information from a first terminal device, where the first indication information is used to indicate that data discard occurs in a multimodal service;

[0033] The sending module is used to send second indication information, where the second indication information is used to indicate that data discard occurs in the multimodal service.

[0034] A sixth aspect of the present application provides a communication device, specifically a terminal device, comprising:

[0035] a determining module, configured to determine that data associated with the multimodal service on the first packet data entity is discarded;

[0036] A discarding module is used to discard data associated with the multimodal service on the second packet data entity, where the second packet data entity and the first packet data entity are respectively mapped to different radio bearers of the first terminal device.

[0037] A seventh aspect of the present application provides a communication device, comprising: a memory and at least one processor. The memory is configured to store programs or computer instructions, and the at least one processor is configured to execute the computer programs or computer instructions stored in the memory, so that the communication device implements the multimodal service indication method provided in the first, second, or third aspects of the present application.

[0038] The eighth aspect of the present application provides a computer storage medium for storing a computer program. When the computer program is executed, it is used to implement the multimodal service indication method provided by the first aspect, or the second aspect or the third aspect of the present application.

[0039] A ninth aspect of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the multimodal service indication method described in the first, second or third aspect above.

[0040] The tenth aspect of the present application provides a chip system, which includes a processor for supporting a terminal device or a network device to implement the functions involved in the above aspects, for example, sending or processing the data and / or information involved in the above methods. In one possible design, the chip system also includes a memory, which is used to store program instructions and data necessary for the terminal device or network device. The chip system can be composed of chips or can include chips and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] FIG1 is a schematic diagram of the system architecture of a communication system provided in an embodiment of the present application;

[0042] FIG2 is a schematic diagram of an interaction process between a first terminal device and a network device provided in an embodiment of the present application;

[0043] FIG3 is a schematic diagram of another interaction process between a first terminal device and a network device provided in an embodiment of the present application;

[0044] FIG4 is a schematic diagram of an interaction process between a first terminal device, a second terminal device, and a network device according to an embodiment of the present application;

[0045] FIG5 is a schematic block diagram of a process flow of a method for indicating a multimodal service executed by a terminal device according to an embodiment of the present application;

[0046] FIG6a is a schematic diagram of data transmission of a single terminal provided in an embodiment of the present application;

[0047] FIG6 b is a schematic diagram of multi-terminal data transmission provided in an embodiment of the present application;

[0048] FIG7 is a structural diagram of an electronic device disclosed in an embodiment of the present application;

[0049] FIG8 is a structural diagram illustrating another electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0050] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to be limiting of the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the embodiments of the present application, "one or more" refers to one, two or more; "and / or" describes the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship.

[0051] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0052] The "multiple" involved in the embodiments of the present application means greater than or equal to two. It should be noted that in the description of the embodiments of the present application, the words "first" and "second" are only used for the purpose of distinguishing the description and cannot be understood as indicating or implying relative importance or order.

[0053] The embodiments of the present application are applied to communication systems, which may be second-generation (2G) communication systems, third-generation (3G) communication systems, long-term evolution (LTE) systems, fifth-generation (5G) communication systems, LTE and 5G hybrid architectures, 5G New Radio (5G NR) systems, and new communication systems emerging in future communication developments, such as possible sixth-generation (6G) communication systems.

[0054] The communication system includes a first device and a second device. The first device can be a device on the network side for providing network communication functions, which is sometimes also called a network device or a network element. The network device can generally be a base station (including a functional unit of a base station, or a combination of functional units of a base station) or a core network unit, wherein the core network unit can be a functional unit in the core network, including but not limited to an Access and Mobility Management Function (AMF) unit or a Session Management Function (SMF) unit. The second device can be a device for accessing the network, which can generally be a terminal. An example of a communication system is shown in Figure 1, which includes a base station 11 and a terminal 12.

[0055] In the embodiments provided in the present application, the base station can be any device with wireless transceiver functions, including but not limited to: an evolved base station (NodeB or eNB or e-NodeB, evolutionary Node B) in LTE, a base station (gNodeB or gNB) or a transmission receiving point (TRP) in new radio (NR), a base station of subsequent evolution of 3GPP, an access node in a Wi-Fi system, a wireless relay node, a wireless backhaul node, etc. The base station can be: a macro base station, a micro base station, a pico base station, a small station, a relay station, or a balloon station, etc. The base station can include one or more co-site or non-co-site transmission points (Transmission Reception Point, TRP). The base station can also be a wireless controller, a centralized unit (CU), and / or a distributed unit (DU) in a cloud radio access network (CRAN) scenario. The base station can communicate with the terminal, or communicate with the terminal through a relay station. The terminal can communicate with multiple base stations of different technologies. For example, the terminal can communicate with a base station supporting the LTE network, and can also communicate with a base station supporting the 5G network. It can also establish dual connections with a base station supporting the LTE network and a base station supporting the 5G network.

[0056] In the embodiments provided herein, the terminal may be in various forms, such as a mobile phone, a tablet computer, a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a vehicle-mounted terminal device, a wireless terminal in self-driving, a wireless terminal in remote medical, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, a wearable terminal device, etc. The terminal may also be sometimes referred to as a terminal device, user equipment (UE), access terminal device, vehicle-mounted terminal, industrial control terminal, UE unit, UE station, mobile station, mobile station, remote station, remote terminal device, mobile device, UE terminal device, terminal device, wireless communication device, UE agent or UE device, etc. The terminal may also be a fixed terminal or a mobile terminal.

[0057] In a communication system, multimodal extended reality (XR) devices may include the following two situations: one situation is that the multimodal XR device may be a single terminal, one terminal generates a multimodal service (a multi-modal service), and the multimodal service includes multiple data streams; the other situation is that the multimodal XR device may be multiple terminals, each terminal generates several data streams, and a multimodal service consists of multiple data streams generated by multiple terminals.

[0058] The multimodal service in the embodiment of the present application is composed of several interrelated data streams, which can also be called multimodal streams. These data streams may come from different sources. A data stream can be called unimodal data, and a data stream can be regarded as a type of data associated with the same communication service. For example, the data stream in the embodiment of the present application can be audio data, video data, positioning data, and tactile data. The data stream of the multimodal service can come from a single UE, or via a single device, or via multiple devices connected to a single UE that can access the communication system, or from multiple UEs.

[0059] In the embodiments of the present application, the requirements of the multimodal service refer to the service requirements of the multimodal service, for example, the quality of service (QoS) monitoring requirements of multiple Internet Protocol (IP) data flows related to the multimodal service.

[0060] In embodiments of the present application, a multimodal service identifier (Multi-modal Service ID) may be defined for a multimodal service. For multimodal services, the same multimodal service identifier corresponds to the same multimodal service, and terminal devices and network devices can identify different multimodal services based on the multimodal service identifier. For example, the multimodal service identifier refers to the identifier of the multimodal communication service, and multimodal flows belonging to the same multimodal service share the same multimodal service identifier.

[0061] In a single-terminal data transmission scenario, the terminal device can associate different packet data entities based on the multimodal service identifier. In a multi-terminal data transmission scenario, the multimodal service identifier corresponding to the same multimodal service is the same, and different terminal devices can associate the packet data entities belonging to their respective devices based on the multimodal service identifier. For example, in a multi-terminal data transmission scenario, the multimodal service identifier can be defined as single network slice selection support information (NSSAI), or the multimodal service identifier can be a data network name (DNN).

[0062] For the RAN system, it is necessary to achieve synchronization of multiple data streams under a multimodal service, such as audio / tactile synchronization, and the transmission of multiple data streams depends on resource scheduling on the network side.

[0063] When the data stream transmission of a multimodal service fails, it will lead to the inability to continue the multimodal service. For the terminal device, the embodiment of the present application provides a solution for processing the data stream of the multimodal service when the data stream transmission of the multimodal service fails. For example, each data stream in the multimodal service is strongly correlated. When the data stream transmission of a multimodal service fails, the transmission of the remaining data streams will be meaningless. If the terminal device continues to process the remaining data streams of the multimodal service, there will be a waste of processing resources and transmission resources of the terminal device, which reduces the data transmission efficiency of the multimodal service. If a data stream of the multimodal service is discarded, other data streams of the related multimodal service also need to be discarded. The embodiment of the present application provides an indication method for a multimodal service, which can realize the coordinated discarding of different data streams of the multimodal service and improve the data transmission efficiency of the multimodal service.

[0064] In order to make the technical solution of the present application clearer and easier to understand, the following describes the method for indicating the multimodal service of the embodiment of the present application in conjunction with the accompanying drawings. The embodiment of the present application is applicable to the data transmission process in the wireless communication scenario. In the embodiment of the present application, the multimodal service transmission between the terminal device and the network device is taken as an example, such as the multimodal service transmission between a single terminal device and the network device, and the multimodal service transmission between multiple terminal devices and the network device. The above-mentioned multimodal service between the terminal device and the network device is only a feasible example. The embodiment of the present application can be applied to data transmission between terminal devices and terminal devices, or data transmission between network devices and network devices, or data transmission between two network elements in a wireless communication network.

[0065] Please refer to FIG. 2 , which is a schematic diagram of an interaction process between a first terminal device and a network device according to an embodiment of the present application. The multimodal service indication method provided by the embodiment of the present application mainly includes the following steps:

[0066] 201. A first terminal device determines that data associated with a multimodal service is discarded.

[0067] In the embodiment of the present application, data transmission of a multimodal service is performed between a first terminal device and a network device. The multimodal service includes multiple interrelated data streams. Due to the influence of the channel environment or the control method of the first terminal device receiving the data stream, the data stream in the multimodal service may fail to transmit. The first terminal device first determines the data discarded in the multimodal service. For example, the first terminal device obtains the first packet data entity associated with the multimodal service and determines that data discard has occurred on the first packet data entity. The first packet data entity is the data to be sent by the first terminal device in the multimodal service. When data discard occurs on the first packet data entity, the first terminal device determines the first packet data entity from the multimodal service.

[0068] In the embodiments of the present application, a multimodal service may include multiple data streams, each of which includes multiple packet data entities. In the embodiments of the present application, a packet data entity in which data discard occurs is used as an example to illustrate the first packet data entity. The multimodal service may be a service on the first packet data entity. The processing method for multimodal services on other packet data entities when data discard occurs is similar to that for the first packet data entity. In the embodiments of the present application, a packet data entity is a data transmission unit in the multimodal service. For example, the packet data entity may be a Packet Data Convergence Protocol (PDCP) data packet, or the packet data entity may be a data packet of another protocol type, which is not limited here.

[0069] In some implementations of the present application, step 201, in which the first terminal device determines that data associated with the multimodal service is discarded, includes:

[0070] A1. The first terminal device determines that data associated with a multimodal service on a first packet data entity is discarded.

[0071] Specifically, due to the influence of the channel environment or the control method of receiving the data stream by the first terminal device, the data stream in the multimodal service may have data stream transmission failure. The first terminal device first determines the data that is discarded in the multimodal service. For example, the first terminal device obtains the first packet data entity associated with the multimodal service. The first packet data entity includes multiple data units. The first terminal device detects that the data unit where data discard occurs on the first packet data entity is the first data unit. For example, the data unit can specifically be a protocol data unit (Protocol Data Unit, PDU), or the data unit can be a protocol data unit set (Protocol Data Unit set, PDU set), or the data unit can be a data packet of other protocol types, which is not limited here.

[0072] 202. The first terminal device sends first indication information to the network device.

[0073] The first indication information is used to indicate that data discard occurs in the multimodal service.

[0074] In an embodiment of the present application, the first terminal device executes the aforementioned step 201 to determine that data discard occurs in the multimodal service. In order to achieve joint discard of the multimodal service, the first terminal device can send a first indication message. For example, the first terminal device and the network device can communicate with each other, and the first terminal device sends a first indication message to the network device, so that the network device can receive the first indication message. In an embodiment of the present application, when the multimodal service of the first terminal device is discarded, the first terminal device can indicate to the network device that data discard occurs in the multimodal service. The network device can instruct the terminal devices using the same multimodal service to also discard data, so that other data of the same multimodal service can also be discarded. It is possible to achieve collaborative discard of different data streams of the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0075] In some embodiments of the present application, in an implementation scenario where the terminal performs the aforementioned step A1, specifically, the first indication information is used to indicate that data associated with the multimodal service on the first packet data entity is discarded.

[0076] In this case, a first terminal device obtains a first packet data entity associated with a multimodal service, and data discard occurs on the first packet data entity. The first indication information can instruct the first packet data entity to also discard data on terminal devices using the same multimodal service, thereby also discarding other packet data entities of the same multimodal service. This can achieve coordinated discarding of different data streams of the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0077] In some embodiments of the present application, the first terminal device and the network device can communicate with each other, for example, via a mobile network or a WiFi network. The first indication information sent by the first terminal device to the network device can be implemented in various ways. In the embodiments of the present application, the first indication information is carried in a first signaling, and there are various implementation methods for the first signaling, for example, the first signaling includes at least one of the following:

[0078] First Packet Data Convergence Protocol Control Element (PDCP CE),

[0079] The first PDCP layer controls the PDU,

[0080] First PDCP layer report,

[0081] First Radio Resource Control (RRC) signaling,

[0082] A first Medium Access Control Control Element (MAC CE).

[0083] Among them, the first indication information can be notified through the first PDCP CE. The format of the PDCP CE is not limited in the embodiment of the present application. The first indication information in the embodiment of the present application can be interacted through PDCP layer signaling, so that the first terminal device indicates to the network device the first packet data entity where data discard occurs. For example, the PDCP CE can indicate the PDU type, and whether the PDU is a control PDU or a data PDU. The first PDCP CE may include a PDCP layer control PDU, such as a PDU type indicating PDU set information, or indicating multimodal service information, and the first PDCP CE includes the first indication information. For another example, the PDCP CE may include a report from the PDCP layer, and the first indication information is carried by the report from the PDCP layer.

[0084] Among them, in addition to being sent through the first PDCP CE, the first indication information also has other implementation methods, for example, the first indication information is notified through the first PDCP layer control PDU or the first PDCP layer report. In the embodiment of the present application, there is no limitation on the PDCP layer control PDU or the PDCP layer report. In the embodiment of the present application, the first indication information can be interacted through PDCP layer signaling, so that the first terminal device indicates to the network device the first packet data entity where data discard occurs.

[0085] For example, the first indication information can be notified through the first RRC signaling. In the embodiment of the present application, the format of the first RRC signaling is not limited. In the embodiment of the present application, the first terminal device can indicate to the network device through RRC signaling the first packet data entity where data discard has occurred.

[0086] For example, the first indication information can be notified through the first MAC CE. In the embodiment of the present application, the format of the first MAC CE is not limited. In the embodiment of the present application, the first terminal device can use MAC CE to indicate to the network device the first packet data entity where data discard has occurred.

[0087] In the implementation of some embodiments of the present application, in the implementation scenario where the first terminal device executes the aforementioned step A1, the first indication information is used to indicate that the first data unit is discarded.

[0088] In the above implementation, the first terminal device determines that data is discarded in the first data unit associated with the multimodal service on the first packet data entity, and the first indication information is used to indicate the discarded first data unit. The first indication information does not limit the indication method of the first data unit. For example, the first indication information carries a first field, and the first field records the identifier of the discarded first data unit. There is no limit on the position of the first field in the first indication information.

[0089] The above embodiment illustrates the information format of the first indication information. Next, the specific content of the first indication information in the embodiment of the present application is described.

[0090] In implementations of some embodiments of the present application, the first indication information includes: multimodal identification information of the multimodal service.

[0091] The multimodal identification information may specifically be the aforementioned multimodal service identifier. The terminal device or network device that receives the first indication information may obtain the multimodal identification information through the first indication information, and determine, based on the multimodal identification information, that data associated with the multimodal service has been discarded. For example, when data discard occurs on a first packet data entity, the first terminal device determines the multimodal identification information associated with the first packet data entity where the data discard occurred. The first indication information generated by the first terminal device may include the multimodal identification information, so that the terminal device or network device that receives the first indication information may obtain the multimodal identification information through the first indication information, and determine, based on the multimodal identification information, that data discard has occurred on the first packet data entity associated with the multimodal service.

[0092] In implementations of some embodiments of the present application, the first indication information includes: association identification information, where the association identification information is used to indicate a data identifier associated with the first grouped data entity.

[0093] The association identification information may specifically be an association tag. The first packet data entity includes a packet data entity associated with data discarded by the multimodal service. When data discard occurs on the first packet data entity, the first terminal device determines the data identifier associated with the first packet data entity where the data discard occurred. The first indication information generated by the first terminal device may include the association identification information, so that the terminal device or network device receiving the first indication information can obtain the association identification information through the first indication information, determine based on the association identification information that data associated with the multimodal service on the first packet data entity has been discarded, and determine other data associated with the same multimodal service through the association identification information.

[0094] In some implementations of the present application, the first indication information includes: PDU set identification information.

[0095] Among them, the PDU set identification information refers to the identification of the PDU set that is discarded on the multimodal service. When data discard occurs on the first packet data entity, the first terminal device determines the PDU set identification information on the first packet data entity where data discard occurs, and the first indication information generated by the first terminal device may include the PDU set identification information, so that the terminal device or network device that receives the first indication information can obtain the PDU set identification information through the first indication information, and determine that data discard occurs on the PDU set associated with the multimodal service on the first packet data entity based on the PDU set identification information. Other PDU set data associated with the same multimodal service can be determined through the PDU set identification information.

[0096] In some implementations of the present application, the first indication information includes: PDU information.

[0097] Among them, PDU information refers to the information of the PDU that is discarded on the multimodal service, for example, the PDU information can be the serial number (SN) of the PDU. When data discard occurs on the first packet data entity, the first terminal device determines the PDU information on the first packet data entity where the data discard occurs. The first indication information generated by the first terminal device may include the PDU information, so that the terminal device or network device that receives the first indication information can obtain the PDU information through the first indication information, and determine that data discard occurs on the PDU associated with the multimodal service on the first packet data entity based on the PDU information. Other PDU data associated with the same multimodal service can be determined through the PDU information.

[0098] In implementations of some embodiments of the present application, the first indication information includes: an identifier of the first packet data entity.

[0099] The first packet data entity includes a packet data entity associated with data discard occurring in a multimodal service.

[0100] The identifier of the first packet data entity refers to the identifier of the first packet data entity that is discarded on the multimodal service. When data discard occurs on the first packet data entity, the first terminal device determines the identifier of the first packet data entity on which the data discard occurs. The first indication information generated by the first terminal device may include the identifier of the first packet data entity, so that the terminal device or network device that receives the first indication information can obtain the identifier of the first packet data entity through the first indication information, determine that data associated with the multimodal service on the first packet data entity is discarded based on the identifier of the first packet data entity, and determine other packet data entities associated with the same multimodal service based on the identifier of the first packet data entity.

[0101] It can be understood that in an embodiment of the present application, the following information included in the first indication information can be combined in any way of at least two or more, for example, two or three of the multimodal identification information of the multimodal service, the association identification information, the protocol data unit set PDU set identification information, the protocol data unit PDU information, and the identification of the first packet data entity are combined and sent through the first indication information.

[0102] 203. The network device receives first indication information from the first terminal device.

[0103] The first indication information is used to indicate that data discard occurs in the multimodal service.

[0104] The network device and the first terminal device can communicate with each other, and the first terminal device sends a first indication message to the network device, so that the network device can receive the first indication message. In an embodiment of the present application, when data discard occurs in the multimodal service of the first terminal device, the first terminal device can indicate to the network device the multimodal service in which data discard occurs, and the network device can determine that data discard occurs on the multimodal service based on the first indication message. For example, the first terminal device can indicate to the network device the first packet data entity in which data discard occurs, and the network device can determine that data discard occurs on the first packet data entity based on the first indication message.

[0105] 204. The network device sends second indication information.

[0106] The second indication information is used to indicate that data discard occurs in the multimodal service.

[0107] In an embodiment of the present application, a network device determines that data discard occurs in a multimodal service based on first indication information, and the network device generates second indication information based on the first indication information, and the second indication information is used to indicate that data discard occurs in the multimodal service. The network device can send the second indication information so that the terminal device that receives the first indication information can determine that data discard occurs in the multimodal service through the second indication information. In an embodiment of the present application, the network device can instruct the terminal device using the same multimodal service to discard data of the same multimodal service, so that other data of the same multimodal service can also be discarded. It is possible to achieve coordinated discarding of different data streams of the multimodal service and improve the data transmission efficiency of the multimodal service.

[0108] In some embodiments of the present application, the first indication information is used to indicate that data associated with the multimodal service on the first packet data entity is discarded. The second indication information is used to indicate to the second packet data entity that data associated with the multimodal service on the first packet data entity is discarded.

[0109] In this case, a first terminal device obtains a first packet data entity associated with a multimodal service, and data discard occurs on the first packet data entity. The first indication information can indicate the first packet data entity, and the second indication information determined by the network device is used to indicate to the second packet data entity that data associated with the multimodal service on the first packet data entity has been discarded. Terminal devices using the same multimodal service also discard data, so that the second packet data entity of the same multimodal service can also be discarded. This can achieve coordinated discarding of different data streams of the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0110] In the embodiment of the present application, there are multiple ways for the network device to send the second indication information, which are related to the data transmission mode of the multimodal service. For example, the network device sends the second indication information, including:

[0111] B1. When the multimodal service is used for data transmission of a single terminal, the network device sends second indication information to the first terminal device; or

[0112] B2. When the multimodal service is used for data transmission of multiple terminals, the network device sends second indication information to the second terminal device.

[0113] Among them, the multimodal service can be used for data transmission of a single terminal, which only involves communication between the network device and the first terminal device. For details, please refer to the subsequent description of the embodiment shown in Figure 3. In addition, the multimodal service can be used for data transmission of multiple terminals, which involves communication between the network device and the first terminal device and the second terminal device. For details, please refer to the subsequent description of the embodiment shown in Figure 4.

[0114] In an embodiment of the present application, multiple packet data entities of a single terminal device cannot interact with each other. When data loss occurs in a packet data entity in a multimodal service of the terminal device, the terminal device can send indication information of the data loss occurring in the packet data entity in the multimodal service through a network device. The network device can send the indication information so that the terminal device that receives the indication information can collaboratively discard data based on the data loss occurring in the packet data entity in the multimodal service. There are various types of terminal devices that receive the indication information. Please see the examples in the subsequent Figures 3 and 4 for details.

[0115] In some embodiments of the present application, the second indication information sent by the network device has multiple implementations. In the embodiment of the present application, the second indication information is carried in the second signaling. There are multiple implementations of the second signaling. For example, the second signaling includes at least one of the following:

[0116] The second signaling includes at least one of the following: a second PDCP CE, a second PDCP layer control PDU, a second PDCP layer report, a second RRC signaling, and a second MAC CE.

[0117] The second indication information may be notified via a second PDCP CE. The embodiment of the present application does not limit the format of the PDCP CE. In the embodiment of the present application, the second indication information may be exchanged via PDCP layer signaling, thereby enabling the network device to indicate the first packet data entity that has discarded data. For example, the PDCP CE may indicate the PDU type and whether the PDU is a control PDU or a data PDU. The second PDCP CE may include a PDCP layer control PDU, such as a PDU type indicating PDU set identification information, or indicating multimodal identification information. The second PDCP CE may also include the second indication information.

[0118] Among them, in addition to being sent through the second PDCP CE, the second indication information also has other implementation methods, for example, the second indication information is notified through the second PDCP layer control PDU or the second PDCP layer report. In the embodiment of the present application, there is no limitation on the PDCP layer control PDU or the PDCP layer report. In the embodiment of the present application, the second indication information can be interacted through PDCP layer signaling, so that the second terminal device indicates to the network device the second packet data entity where data discard has occurred.

[0119] For example, the second indication information can be notified through the second RRC signaling. The format of the second RRC signaling is not limited in the embodiment of the present application. In the embodiment of the present application, the network device can indicate the first packet data entity where data discard occurs through RRC signaling.

[0120] For example, the second indication information can be notified through the second MAC CE. In the embodiment of the present application, the format of the second MAC CE is not limited. In the embodiment of the present application, the network device can use MAC CE to indicate the first packet data entity where data discard occurs.

[0121] Through the examples of the aforementioned embodiments, it can be seen that in the embodiments of the present application, the first terminal device can send a first indication message. For example, the first terminal device and the network device can communicate with each other, and the first terminal device sends a first indication message to the network device, so that the network device can receive the first indication message. In the embodiment of the present application, when the first packet data entity in the multimodal service of the first terminal device is discarded, the first terminal device can indicate to the network device the first packet data entity where data discard occurs, and the network device can instruct the terminal devices using the same multimodal service to also discard it, so that other packet data entities of the same multimodal service can also be discarded. It is possible to achieve collaborative discarding of different data streams of the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0122] As shown in Figure 3, another schematic diagram of the interaction process between the first terminal device and the network device provided in an embodiment of the present application is shown. Taking the scenario where the multimodal service is used for data transmission of a single terminal as an example, the first terminal device in the embodiment of the present application can perform a multimodal service of a single terminal, which mainly includes the following process:

[0123] 301. The network device sends configuration information to the first terminal device.

[0124] The configuration information is used to instruct the first terminal device to report that data discard occurs in a multimodal service.

[0125] In an embodiment of the present application, after a first terminal device establishes a communication connection with a network device, the network device may send configuration information to the first terminal device through dynamic configuration. The configuration information is used to instruct the first terminal device to report that data discard has occurred in a multimodal service. For example, the configuration information instructs the first terminal device to report a packet data entity in which data discard has occurred. In an embodiment of the present application, the network device may instruct the first terminal device to report that data discard has occurred in a multimodal service, thereby enabling the first terminal device to detect whether data is lost when transmitting the multimodal service, thereby implementing dynamic configuration of the data discard method for the multimodal service.

[0126] 302. The first terminal device receives configuration information from the network device.

[0127] The configuration information is used to instruct the first terminal device to report that data discard occurs in a multimodal service.

[0128] In an embodiment of the present application, after the first terminal device establishes a communication connection with the network device, the first terminal device can receive configuration information from the network device. The first terminal device can detect whether data is lost when transmitting multimodal services according to the configuration information, thereby achieving real-time detection of data discard of multimodal services.

[0129] In some embodiments of the present application, the configuration information is a third PDCP CE.

[0130] Among them, the configuration information can be notified through the third PDCP CE. The format of the PDCP CE is not limited in the embodiment of the present application. The configuration information in the embodiment of the present application can be interacted through PDCP layer signaling, so that the network device can instruct the first terminal device to report the packet data entity where data discard occurs.

[0131] For example, the PDCP CE may indicate the PDU type and whether the PDU is a control PDU or a data PDU. The third PDCP CE is a control PDU, and the third PDCP CE includes configuration information.

[0132] 303. The first terminal device determines that data associated with the multimodal service on the first packet data entity is discarded.

[0133] 304. The first terminal device sends first indication information to the network device.

[0134] The first indication information is used to indicate that data discard occurs on the first packet data entity.

[0135] 305. The network device receives first indication information from the first terminal device.

[0136] The first indication information is used to indicate that data associated with the multimodal service on the first packet data entity is discarded.

[0137] The above steps 303 to 305 are similar to steps 201 to 203 in the above embodiment and will not be described in detail here.

[0138] 306. The network device sends second indication information to the first terminal device.

[0139] The second indication information is used to indicate to the second packet data entity that data associated with the multimodal service on the first packet data entity is discarded.

[0140] In an embodiment of the present application, a network device determines that data discard occurs on a first packet data entity based on first indication information, and the network device generates second indication information based on the first indication information, and sends the second indication information to the first terminal device. The second indication information is used to indicate to the second packet data entity that data associated with the multimodal service on the first packet data entity has been discarded.

[0141] 307. The first terminal device receives second indication information from the network device.

[0142] The second indication information is used to indicate to the second packet data entity that data associated with the multimodal service on the first packet data entity is discarded.

[0143] In an embodiment of the present application, when a multimodal service is used in a scenario where data transmission is performed by a single terminal, the network device sends second indication information to the first terminal device. When multiple packet data entities of the first terminal device cannot interact with each other, and data loss occurs in a packet data entity in the multimodal service of the first terminal device, the first terminal device may send first indication information indicating data loss in the first packet data entity in the multimodal service through the network device. The network device generates second indication information based on the first indication information and sends the second indication information to the first terminal device.

[0144] 308. The first terminal device discards the data associated with the multimodal service on the second packet data entity according to the second indication information.

[0145] The second packet data entity and the first packet data entity are respectively mapped to different radio bearers of the first terminal device.

[0146] In some embodiments of the present application, a network device may send a second indication to a first terminal device, causing the first terminal device to discard data for the same multimodal service, thereby also discarding other packet data entities for the same multimodal service. This enables coordinated discarding of different data streams of a multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0147] In some embodiments of the present application, step 308 of discarding data associated with the multimodal service on the second packet data entity according to the second indication information includes:

[0148] C1. Determining, according to the second indication information, a multimodal service associated with the first packet data entity in which data discard occurs;

[0149] C2. Discard the data associated with the multimodal service on the second packet data entity.

[0150] The first packet data entity and the second packet data entity of the first terminal device are isolated from each other, and the first packet data entity and the second packet data entity cannot interact with each other. Therefore, the first terminal device determines the multimodal service associated with the first packet data entity where data discard occurs based on the second indication information, and based on the data loss of the first packet data entity in the multimodal service, the second packet data entity is collaboratively discarded, which can achieve collaborative discard of different data streams of the multimodal service and improve the data transmission efficiency of the multimodal service.

[0151] As shown in Figure 4, an interaction flow diagram between a first terminal device, a second terminal device, and a network device is provided in an embodiment of the present application. Taking a scenario where a multimodal service is used for data transmission of multiple terminals as an example, in an embodiment of the present application, the first terminal device and the second terminal device can collaborate to perform a multimodal service for multiple terminals, which mainly includes the following processes:

[0152] 401. A first terminal device determines that data associated with a multimodal service on a first packet data entity is discarded.

[0153] 402. The first terminal device sends first indication information to the network device.

[0154] The first indication information is used to indicate that data associated with the multimodal service on the first packet data entity is discarded.

[0155] 403. The network device receives first indication information from the first terminal device.

[0156] The first indication information is used to indicate that data associated with the multimodal service on the first packet data entity is discarded.

[0157] The above steps 401 to 403 are similar to steps 201 to 203 in the above embodiment and will not be described in detail here.

[0158] 405. The network device sends second indication information to the second terminal device.

[0159] The second indication information is used to indicate to the second packet data entity that data associated with the multimodal service on the first packet data entity is discarded.

[0160] In an embodiment of the present application, a network device determines that data discard occurs on a first packet data entity based on first indication information, generates second indication information based on the first indication information, and sends the second indication information to a second terminal device, where the second indication information is used to indicate that data discard occurs on the first packet data entity.

[0161] 406. The second terminal device receives second indication information from the network device.

[0162] The second indication information is used to indicate to the second packet data entity that data associated with the multimodal service on the first packet data entity is discarded.

[0163] In an embodiment of the present application, when a multimodal service is used in a scenario where data is transmitted between multiple terminals, a network device sends second indication information to a second terminal device. When multiple packet data entities between a first terminal device and a second terminal device cannot interact, and data loss occurs in a packet data entity in the multimodal service of the first terminal device, the first terminal device may send, via the network device, first indication information indicating data loss in the first packet data entity in the multimodal service. The network device generates second indication information based on the first indication information and sends the second indication information to the second terminal device.

[0164] 308. The second terminal device discards the data associated with the multimodal service on the second packet data entity according to the second indication information.

[0165] The second packet data entity is mapped to the radio bearer of the second terminal device, and the first packet data entity is mapped to the radio bearer of the first terminal device.

[0166] In some embodiments of the present application, a network device may send a first indication message to a second terminal device, causing the second terminal device to discard data for the same multimodal service, thereby also discarding other packet data entities for the same multimodal service. This enables coordinated discarding of different data streams for the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0167] It can be understood that in the embodiment of the present application, when the multimodal service is used for data transmission of multiple terminals, it is not limited to the second terminal device that receives the second indication information. In other scenarios, multiple terminal devices performing multimodal services can receive the second indication information. These terminal devices can all collaboratively discard data of the same multimodal service, thereby improving the data processing efficiency of the multimodal service.

[0168] Please refer to FIG5 , which is a flow chart of a method for indicating a multimodal service performed by a terminal device according to an embodiment of the present application. The method for indicating a multimodal service provided by an embodiment of the present application mainly includes the following steps:

[0169] 501. A terminal device determines that data associated with a multimodal service on a first packet data entity is discarded.

[0170] In an embodiment of the present application, a terminal device performs data transmission for a multimodal service. The multimodal service includes multiple interrelated data streams. Due to the influence of the channel environment or the control method of the terminal device receiving the data stream, the data streams in the multimodal service may experience data stream transmission failure. The terminal device first determines whether data has been discarded in the multimodal service. For example, the terminal device obtains a first packet data entity associated with the multimodal service and determines that data discard has occurred on the first packet data entity. The first packet data entity is the data to be sent by the terminal device in the multimodal service. When data discard occurs in the first packet data entity, the terminal device determines the first packet data entity from the multimodal service.

[0171] 502. The terminal device discards the data associated with the multimodal service on the second packet data entity;

[0172] The second packet data entity and the first packet data entity are respectively mapped to different radio bearers of the first terminal device.

[0173] In an embodiment of the present application, when a terminal device discards data for a first packet data entity in a multimodal service, the terminal device detects whether there are other packet data entities to be processed for the same multimodal service. For example, if the same multimodal service is associated with not only the first packet data entity but also a second packet data entity, the terminal device discards data for the same multimodal service, thereby also discarding other packet data entities for the same multimodal service. This enables coordinated discarding of different data streams of the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0174] In some implementations of the present application, step 501, in which the terminal device determines that data associated with the multimodal service on the first packet data entity is discarded, includes:

[0175] It is determined that data discard occurs on a first data unit associated with a multimodal service on a first packet data entity.

[0176] Specifically, due to the influence of the channel environment or the control method of the terminal device for receiving the data stream, the data stream in the multimodal service may fail to transmit the data stream. The terminal device first determines the data unit that is discarded in the multimodal service. For example, the terminal device obtains the first packet data entity associated with the multimodal service. The first packet data entity includes multiple data units. The terminal device detects that the data unit on the first packet data entity where data is discarded is the first data unit. For example, the data unit can be a PDU, or the data unit can be a PDU set, or the data unit can be a data packet of other protocol types, which is not limited here.

[0177] In some implementations of the present application, in step 502, the terminal device discards data associated with the multimodal service on the second packet data entity, including:

[0178] A second data unit associated with the multimodal service on the second packet data entity is discarded.

[0179] Among them, the first packet data entity and the second packet data entity of the terminal device are isolated from each other, and the first packet data entity and the second packet data entity cannot interact. Therefore, the terminal device determines the multimodal service associated with the first packet data entity where data discard occurs, and according to the data loss of the first packet data entity in the multimodal service, the second packet data entity is collaboratively discarded, which can achieve collaborative discard of different data streams of the multimodal service and improve the data transmission efficiency of the multimodal service.

[0180] In some implementations of the present application, the method performed by the terminal device further includes:

[0181] The terminal device receives configuration information from the network device, where the configuration information is used to instruct the first terminal device to detect data discarding in a multimodal service.

[0182] In an embodiment of the present application, after a terminal device and a network device establish a communication connection, the network device can send configuration information to the terminal device through dynamic configuration, where the configuration information is used to instruct the terminal device to detect a packet data entity that has experienced data discarding. In an embodiment of the present application, the network device can instruct the terminal device to detect a packet data entity that has experienced data discarding, thereby enabling the terminal device to detect the packet data entity when transmitting a multimodal service to determine the packet data entity that has experienced data discarding, thereby dynamically configuring the data discarding method for the multimodal service.

[0183] In order to make the technical solution of the present application clearer and easier to understand, the multimodal service indication method of the present application is described in detail below in conjunction with a specific single-terminal data transmission scenario.

[0184] First, referring to a schematic diagram of data transmission of a single terminal shown in FIG6a , the method includes the following steps:

[0185] S01. The UE sends a PDCP CE, where the PDCP CE is used to indicate discarding of association identifier 1, where association identifier 1 corresponds to PDCP entity multimodal identifier 1.

[0186] In a single-terminal scenario, the UE conducts multimodal services with the gNB. A multimodal service is transmitted through one or more quality of service (QoS) flows. When mapped to a data radio bearer (DRB), it is transmitted through one or more DRBs.

[0187] The UE sends multiple DRBs, where one DRB is mapped to one PDCP entity. Therefore, there is a scenario where joint discarding of data on multiple PDCP entities is required.

[0188] The PDCP CE is used to carry the first indication information in the aforementioned embodiment. The UE is notified via the PDCP CE. The format of the PDCP CE is not restricted, and the UE and gNB can exchange PDCP layer signaling.

[0189] The PDCP CE may indicate the PDU type and whether the PDU is a control PDU or a data PDU, for example, the PDCP CE is a control PDU, for example, the PDU type indicates PDU set information, or indicates multi-modal identification information, and the PDCP CE includes first indication information.

[0190] For example, the PDCP CE is used to indicate the discard of association identifier 1, which corresponds to the PDCP entity multimodal identifier 1. Therefore, after receiving the PDCP CE, the gNB can determine that the discard of association identifier 1 corresponds to the PDCP entity multimodal identifier 1.

[0191] It is not limited to that the PDCP CE in the above step S01 can also be replaced by RRC signaling. The UE is notified via RRC signaling. In addition, the PDCP CE in the above step S01 can also be replaced by MAC CE. The UE is notified via MAC CE.

[0192] S02. The gNB sends RRC signaling, where the RRC signaling is used to indicate discarding association ID 1, where association ID 1 corresponds to PDCP entity multimodal ID 1.

[0193] The PDCP CE is used to indicate that the association identifier 1 is discarded. The association identifier 1 corresponds to the PDCP entity multimodal identifier 1. Therefore, after receiving the PDCP CE, the gNB can determine that the association identifier 1 is discarded. The association identifier 1 corresponds to the PDCP entity multimodal identifier 1.

[0194] Multiple PDCP entities of a single UE cannot interact with each other. When PDCP entity 1 is discarded on the UE side, the gNB can be notified of the discarded association identifier, for example, the association identifier is an association tag. The network side notifies the UE side PDCP entity 2 of the PDU set corresponding to the association tag that needs to be discarded through the second signaling.

[0195] Before step S01, the method performed by the gNB may further include: the gNB generating configuration information for instructing the UE to report discarded data information. For example, the data information may include: PDU set identification information, PDU information, multimodal identification information, and association identification information. The PDU information may be the SN of the discarded PDU.

[0196] For example, when a PDU set is discarded, the UE sends multimodal identification information or associated identification information of the discarded PDU set through the first signaling.

[0197] After receiving the first signaling, the gNB may send second indication information through second signaling. For example, the second indication information includes the first indication information received by the gNB in ​​the first signaling, such as multimodal identification information or associated identification information, or the second indication information includes information that needs to be discarded, such as multimodal identification information or associated identification information.

[0198] After receiving the second signaling, the UE discards the PDU set having the same association identifier as the multimodal identification information indicated in the second signaling.

[0199] In some embodiments of the present application, the first signaling and the second signaling may be PDCP CE, RRC signaling, and MAC CE, respectively, and the first signaling and the second signaling may be the same signaling or different signaling, which is not limited here.

[0200] In some embodiments of the present application, the first signaling and the second signaling are configured by each PDCP entity, thereby enabling real-time data discard detection for multimodal services.

[0201] Referring to FIG6b , which is a schematic diagram of multi-terminal data transmission, the method includes the following steps:

[0202] S11. UE1 sends a PDCP CE to the gNB. The PDCP CE is used to indicate the discard of association ID 1, where association ID 1 corresponds to PDCP entity multimodal ID 1.

[0203] S12. The gNB sends RRC signaling to UE2. The RRC signaling is used to indicate that association identifier 1 is discarded. Association identifier 1 corresponds to PDCP entity multimodal identifier 1.

[0204] For multi-terminal scenarios, a multimodal service will be transmitted through multiple DRBs, so it is necessary to implement joint discarding of PDU sets between multiple PDCP entities. The PDU set discarding method of multiple PDCP entities in multi-terminal scenarios is similar to that in single-terminal scenarios.

[0205] It should be noted that the above embodiments are merely some illustrative implementation methods provided by this application, and it does not mean that this application only provides the above methods. In actual applications, the steps of the above embodiments can also be split or combined, and this application does not limit this.

[0206] Figure 7 shows an example of the composition of an electronic device provided in an embodiment of the present application. The electronic device may be a first device, including but not limited to a base station or a core network unit. Figure 7 shows a simplified schematic diagram of the base station structure. The base station includes a processor 710, a memory 720, and a transceiver 730. The processor 710 is primarily used for baseband processing, controlling the base station, etc. The processor 710 is typically the control center of the base station and can be generally referred to as a processor, and is used to control the base station to perform the processing operations on the first device side of the above-mentioned method embodiment. The memory 720 is primarily used to store computer program code and data. The transceiver 730 is primarily used for transmitting and receiving radio frequency signals and converting radio frequency signals into baseband signals. The transceiver 730 can generally be referred to as a transceiver module, transceiver, transceiver circuit, or transceiver. The transceiver module of the transceiver 730, which can also be referred to as a transceiver or transceiver, includes an antenna 733 and a radio frequency circuit (not shown in the figure), where the radio frequency circuit is primarily used for radio frequency processing. Alternatively, the device for implementing the receiving function in the transceiver 730 portion may be considered a receiver, and the device for implementing the transmitting function may be considered a transmitter. That is, the transceiver 730 portion includes a receiver 732 and a transmitter 731. The receiver may also be referred to as a receiving module, a receiver, or a receiving circuit, and the transmitter may be referred to as a transmitting module, a transmitter, or a transmitting circuit.

[0207] The processor 710 and memory 720 may include one or more boards, each of which may include one or more processors and one or more memories. The processor is used to read and execute programs in the memory to implement baseband processing functions and control the base station. If multiple boards are present, the boards may be interconnected to enhance processing capabilities. As an optional implementation, multiple boards may share one or more processors, multiple boards may share one or more memories, or multiple boards may simultaneously share one or more processors.

[0208] For example, in one implementation, the transceiver module of the transceiver 730 is used to execute the transceiver-related processes performed by the base station (first device) in the aforementioned method embodiment. The processor of the processor 710 is used to execute the processing-related processes performed by the base station in the aforementioned method embodiment.

[0209] It should be understood that FIG7 is merely an example and not a limitation, and the network device including the processor, memory, and transceiver may not rely on the structure shown in FIG7 .

[0210] Figure 8 is an example of the composition of another electronic device provided in an embodiment of the present application. The electronic device can be a second device, which can be a terminal, including but not limited to mobile phones, smart wearable devices (such as smart watches), and other electronic devices. Taking a mobile phone as an example, the electronic device can include a processor 310, an external memory interface 320, an internal memory 321, a display 330, a camera 340, an antenna 1, an antenna 2, a mobile communication module 350, and a wireless communication module 360, etc.

[0211] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown, or some components may be combined or separated, or the components may be arranged differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0212] The processor 310 may include one or more processing units. For example, the processor 310 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0213] It is understood that the interface connection relationship between the modules illustrated in this embodiment is only a schematic illustration and does not constitute a structural limitation of the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0214] External memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with processor 310 via external memory interface 320 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0215] The internal memory 321 can be used to store computer executable program code, and the executable program code includes instructions. The processor 310 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 321. The internal memory 321 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 310 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 321, and / or the instructions stored in the memory provided in the processor.

[0216] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, modem processor and baseband processor.

[0217] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0218] The mobile communication module 350 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to electronic devices. The mobile communication module 350 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the processor 310. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the same device as at least some of the modules of the processor 310.

[0219] In some embodiments, the electronic device initiates or receives a call request via the mobile communication module 350 and the antenna 1 .

[0220] Furthermore, an operating system runs on the aforementioned components, such as the iOS operating system, the Android operating system, and the Windows operating system. Application programs can be installed and run on the operating system. Those skilled in the art will clearly understand that, for ease of description and brevity, the explanation and beneficial effects of any of the aforementioned electronic devices can be referred to the corresponding method embodiments provided above, and will not be further elaborated here.

[0221] The present application also provides a communication system, which may include a first device as shown in FIG7 (for example, a network device such as a base station) and a second device as shown in FIG8 (for example, a terminal device such as a mobile phone).

[0222] Alternatively, the communication system provided in the embodiment of the present application includes a terminal device such as a mobile phone as shown in Figure 8, and the terminal device executes the method shown in Figure 5.

[0223] In this application, a terminal or network device may include a hardware layer, an operating system layer running on the hardware layer, and an application layer running on the operating system layer. The hardware layer may include hardware such as a central processing unit (CPU), a memory management unit (MMU), and memory (also known as main memory). The operating system of the operating system layer may be any one or more computer operating systems that implement business processing through processes, such as the Linux operating system, Unix operating system, Android operating system, iOS operating system, or Windows operating system. The application layer may include applications such as browsers, address books, word processing software, and instant messaging software.

[0224] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described systems, devices and modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0225] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is merely a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or module, which can be electrical, mechanical or other forms.

[0226] The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules may be selected to achieve the purpose of this embodiment according to actual needs.

[0227] In addition, the functional modules in the various embodiments of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into a single module. The above-mentioned integrated modules may be implemented in the form of hardware or software functional modules.

[0228] If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the part that essentially contributes to the technical solution of the present application or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the process of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.

[0229] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, ordinary technicians in this field should understand that they can still modify the technical solutions recorded in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for indicating a multimodal service, characterized in that: Applied to a first terminal device, the method includes: Determining that data associated with the multimodal service is discarded; First indication information is sent to a network device, where the first indication information is used to indicate that data discard occurs in the multimodal service.

2. The method according to claim 1, characterized in that The method further comprises: receiving second indication information from the network device, where the second indication information is used to indicate that data discard occurs in the multimodal service; The to-be-processed data associated with the multimodal service is discarded according to the second indication information.

3. The method according to claim 2, characterized in that The second indication information is used to indicate to the second packet data entity that data associated with the multimodal service on the first packet data entity is discarded; The discarding of the to-be-processed data associated with the multimodal service according to the second indication information includes: Determining, according to the second indication information, the multimodal service for which data discard occurs; The data associated with the multimodal service on the second packet data entity is discarded.

4. The method according to any one of claims 1 to 3, characterized in that The determining that data associated with the multimodal service is discarded includes: Determining that data associated with the multimodal service is discarded on the first packet data entity; The first indication information is used to indicate that data associated with the multimodal service on the first packet data entity is discarded.

5. The method according to any one of claims 1 to 4, characterized in that The first indication information is carried in the first signaling, The first signaling includes at least one of the following: a first packet data convergence protocol control element PDCP CE, a first PDCP layer control PDU, a first PDCP layer report, a first radio resource control RRC signaling, and a first media access control control element MAC CE.

6. The method according to claim 2 or 3, characterized in that The second indication information is carried in the second signaling, The second signaling includes at least one of the following: a second PDCP CE, a second PDCP layer control PDU, a second PDCP layer report, a second RRC signaling, and a second MAC CE.

7. The method according to any one of claims 1 to 6, characterized in that The first indication information includes at least one of the following: multimodal identification information of the multimodal service, association identification information, protocol data unit set PDU set identification information, protocol data unit PDU information, and an identifier of the first packet data entity; The first packet data entity includes a packet data entity associated with data discard occurring in the multimodal service; The association identification information is used to indicate a data identifier associated with the first packet data entity.

8. The method according to any one of claims 1 to 7, characterized in that The method further comprises: Receive configuration information from the network device, where the configuration information is used to instruct the first terminal device to report that data discard occurs in a multimodal service.

9. A method for indicating a multimodal service, characterized in that: Applied to a network device, the method includes: Receiving first indication information from a first terminal device, where the first indication information is used to indicate that data discard occurs in a multimodal service; Second indication information is sent, where the second indication information is used to indicate that data discard occurs in the multimodal service.

10. The method according to claim 9, characterized in that The first indication information is used to indicate that data associated with the multimodal service on the first packet data entity is discarded; The second indication information is used to indicate to the second packet data entity that data associated with the multimodal service on the first packet data entity is discarded.

11. The method according to claim 9 or 10, characterized in that The first indication information is carried in the first signaling, The first signaling includes at least one of the following: a first packet data convergence protocol control element PDCP CE, a first PDCP layer control PDU, a first PDCP layer report, a first radio resource control RRC signaling, and a first media access control control element MAC CE.

12. The method according to any one of claims 9 to 11, characterized in that The second indication information is carried in the second signaling, The second signaling includes at least one of the following: a second PDCP CE, a second PDCP layer control PDU, a second PDCP layer report, a second RRC signaling, and a second MAC CE.

13. The method according to any one of claims 9 to 12, characterized in that The first indication information includes at least one of the following: multimodal identification information of the multimodal service, association identification information, protocol data unit set PDU set identification information, protocol data unit PDU information, and an identifier of the first packet data entity; The first packet data entity includes a packet data entity associated with data discard occurring in the multimodal service; The association identification information is used to indicate a data identifier associated with the first packet data entity.

14. The method according to any one of claims 9 to 13, characterized in that The method further comprises: Configuration information is sent to the first terminal device, where the configuration information is used to instruct the first terminal device to report that data discard occurs in a multimodal service.

15. The method according to any one of claims 9 to 14, characterized in that The sending of the second indication information includes: When the multimodal service is used for data transmission of a single terminal, sending the second indication information to the first terminal device; or, When the multimodal service is used for data transmission of multiple terminals, the second indication information is sent to the second terminal device.

16. A method for indicating a multimodal service, characterized in that: Applied to a terminal device, the method includes: Determining that data associated with the multimodal service is discarded on the first packet data entity; Data associated with the multimodal service on a second packet data entity is discarded, where the second packet data entity and the first packet data entity are respectively mapped to different radio bearers of the terminal device.

17. The method according to claim 16, characterized in that The determining that data associated with the multimodal service is discarded on the first packet data entity includes: It is determined that data discard occurs on a first data unit associated with a multimodal service on a first packet data entity.

18. The method according to claim 16 or 17, characterized in that The discarding of data associated with the multimodal service on the second packet data entity includes: A second data unit associated with the multimodal service on the second packet data entity is discarded.

19. The method according to any one of claims 16 to 18, characterized in that The method further comprises: Configuration information is received from a network device, where the configuration information is used to instruct the terminal device to detect data discarding in a multimodal service.

20. A communication device, characterized in that: The communication device is specifically a first terminal device, and the communication device includes: a determination module, configured to determine whether data associated with a multimodal service is discarded; The sending module is used to send first indication information to the network device, where the first indication information is used to indicate that data discard occurs in the multimodal service.

21. A communication device, characterized in that: The communication device is specifically a network device, and the communication device includes: A receiving module, configured to receive first indication information from a first terminal device, where the first indication information is used to indicate that data discard occurs in a multimodal service; The sending module is used to send second indication information, where the second indication information is used to indicate that data discard occurs in the multimodal service.

22. A communication device, characterized in that: The communication device is specifically a terminal device, and the communication device includes: a determining module, configured to determine that data associated with the multimodal service on the first packet data entity is discarded; A discarding module is used to discard data associated with the multimodal service on a second packet data entity, where the second packet data entity and the first packet data entity are respectively mapped to different radio bearers of the terminal device.

23. A communication device, characterized in that: The communication device comprises: Memory for storing computer programs or computer instructions; A processor, configured to execute the computer program or computer instructions stored in the memory, so that the communication device performs the method according to any one of claims 1 to 9, or 10 to 15, or 16 to 20.

24. A computer storage medium for storing a computer program, wherein when the computer program is executed, the computer program is used to implement the method according to any one of claims 1 to 9, or 10 to 15, or 16 to 20.

Images