Multimodal service indication method, electronic device, and storage medium

Abstract

Embodiments of the present application provide a multimodal service indication method, a communication apparatus, and a storage medium, aiming to solve the problem of data discarding under a multimodal service. The multimodal service indication method comprises: determining that the occurrence of discarding of data associated with a multimodal service satisfies a preset discarding condition; and sending first indication information, wherein the first indication information is used for indicating that data discarding occurs to the multimodal service. When discarding occurs to a multimodal service of a first terminal device, the first terminal device can indicate, to other devices, that the data discarding has occurred to the multimodal service, and the other devices also discard corresponding data of the same multimodal service, so that other data of the same multimodal service can also be discarded. Coordinated discarding of different data streams of the multimodal service can be realized, improving the data transmission efficiency of the multimodal service.

Description

Multimodal service indication method, electronic device and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on February 1, 2024, with application number 202410158771.7 and invention name “A method for indicating multimodal services, an electronic device and a storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a method for indicating a multimodal service, an electronic device, and a storage medium. Background Art

[0003] A multimodal extended reality device refers to a device that performs multimodal services, which may include multiple data streams.

[0004] For a wireless access network (RAN) system, the main requirement for multimodal services is the synchronization of multiple data streams under a multimodal service. The transmission of data streams depends on resource scheduling on the network side.

[0005] When the data stream transmission of a multimodal service fails, the multimodal service cannot be continued. For a terminal device, how to process the data stream of the multimodal service remains an unresolved issue. Summary of the Invention

[0006] The present application provides a method for indicating a multimodal service, a communication device, and a storage medium, aiming to solve the problem of data discard in multimodal services.

[0007] In order to achieve the above objectives, this application provides the following technical solutions:

[0008] The first aspect of the present application provides a method for indicating a multimodal service, specifically, applied to a first terminal device, the method comprising: determining that the data associated with the multimodal service is discarded and meets a preset discard condition; sending a first indication message, the first indication message being used to indicate that data discard occurs in the multimodal service. In the above implementation scheme, in order to achieve joint discard of data on the multimodal service, the first terminal device can send a first indication message. For example, the first terminal device and other devices can communicate with each other, and the first terminal device sends a first indication message to the other devices so that the other devices can receive the first indication message. For example, the other devices can be a second terminal device or a network device. In the embodiment of the present application, when data discard occurs in the multimodal service of the first terminal device, the first terminal device can indicate to the other devices that data discard occurs in the multimodal service, and the other devices will also discard the data using the same multimodal service, thereby discarding other data of the same multimodal service. It is possible to achieve collaborative discard of different data streams of the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0009] In a possible implementation of the first aspect of the present application, the sending of the first indication information includes: sending the first indication information by broadcast or multicast. In the above implementation scheme, the first terminal device can send the first indication information by broadcast or multicast. For example, the first indication information can include a multimodal service identifier. This allows multiple terminal devices to receive the first indication information, and the devices that receive the first indication information will also discard the data using the same multimodal service, thereby also discarding other data of the same multimodal service. It can achieve collaborative discarding of different data streams of a multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0010] In a possible implementation of the first aspect of the present application, the sending of the first indication information includes: sending a first signaling to the second terminal device through a short-distance direct communication PC5 interface between the first terminal device and the second terminal device, wherein the first signaling carries the first indication information. In the above implementation scheme, a short-distance direct communication PC5 interface is configured between the first terminal device and the second terminal device, so that the second terminal device can receive the first indication information, and the second terminal device will also discard the data using the same multimodal service, thereby also discarding other data of the same multimodal service. It is possible to achieve coordinated discarding of different data streams of a multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0011] In a possible implementation of the first aspect of the present application, the data associated with the multimodal service that is discarded includes: a protocol data unit set PDU set or a protocol data unit PDU; the determination that the data associated with the multimodal service is discarded and meets the preset discard condition includes: determining that the PDU set is discarded or the PDU is discarded, or the number of PDU set discards exceeds a first threshold value, or the number of PDU discards exceeds a second threshold value. In the above implementation scheme, the data associated with the multimodal service that is discarded may be a PDU set or a PDU. In the embodiment of the present application, the discard condition may be set for the PDU set or the PDU, for example, the discard condition may be that the PDU set is discarded or the PDU is discarded, so the first terminal device determines that the discard condition is satisfied when the PDU set is discarded or the PDU is discarded. In addition, the discard condition may be that the number of PDU set discards or the PDU discards exceeds their respective corresponding thresholds, for example, the discard condition is determined to be satisfied when the number of PDU set discards exceeds the first threshold value or the number of PDU discards exceeds the second threshold value.

[0012] In a possible implementation of the first aspect of the present application, the sending of the first indication information includes: determining the multimodal service group to which the first terminal device belongs, the multimodal service group including: at least one terminal device performing the same multimodal service; and sending the first indication information by multicast within the multimodal service group. In the above implementation scheme, when multiple terminals perform the same multimodal service, the first terminal device can pre-establish a multimodal service group, the multimodal service group including: at least one terminal device performing the same multimodal service. The first terminal device can send the first indication information by multicasting, and the first indication information is sent in a group within the multimodal service group, so that all terminal devices within the multimodal service group can receive the first indication information, and all terminal devices within the multimodal service group will also discard the data using the same multimodal service, thereby also discarding other data of the same multimodal service. It can achieve the coordinated discarding of different data streams of the multimodal service, and improve the data transmission efficiency of the multimodal service.

[0013] In a possible implementation of the first aspect of the present application, determining the multimodal service group to which the first terminal device belongs includes: determining the multimodal service group to which the first terminal device belongs based on the multimodal service group configuration information sent by the network device; or, sending a multimodal service group establishment request by broadcasting, receiving a multimodal service group establishment response sent by at least one terminal device, and establishing the multimodal service group based on the multimodal service group establishment response. In the above implementation scheme, the network device can pre-configure the multimodal service group, or the first terminal device can pre-configure the multimodal service group, so that the first terminal device can use the pre-configured multimodal service group to send the first indication information, thereby improving the efficiency of sending the indication information.

[0014] In a possible implementation of the first aspect of the present application, the method further includes: receiving second indication information sent by a second terminal device, the second indication information being used to indicate the first information and / or the identifier of the second terminal device, the first information being used to instruct the second terminal device to discard a second data unit of the same multimodal service associated with the first data unit; the first data unit including discarded data associated with the multimodal service. In the above implementation scheme, after the second terminal device discards the to-be-processed data associated with the multimodal service according to the first indication information, the second terminal device may notify the first terminal device of the discarded second data unit, and the second terminal device sends the second indication information to the first terminal device.

[0015] In a possible implementation of the first aspect of the present application, the method further includes: adding the second terminal device to a multimodal service group based on the second indication information. In the above implementation, the first terminal device determines that the first terminal device and the second terminal device are performing the same multimodal service based on the received second indication information. The first terminal device adds the second terminal device to the multimodal service group based on the second indication information, thereby adding the multimodal service group. The multimodal service group maintained by the first terminal device can be used to implement collaborative data transmission of the same multimodal service.

[0016] In a possible implementation of the first aspect of the present application, the method further includes: after the first terminal device stops performing a multimodal service, deleting the second terminal device from the multimodal service group. In the above implementation, the first terminal device may also perform real-time maintenance on the multimodal service group. After the first terminal device stops performing a multimodal service, the second terminal device may be deleted from the multimodal service group, thereby optimizing the multimodal service group and improving the configuration efficiency of the multimodal service group.

[0017] In a possible implementation of the first aspect of the present application, the method further includes: receiving third indication information sent by a second terminal device, the third indication information being used to instruct the second terminal device not to perform the multimodal service; and deleting the second terminal device from the multimodal service group. In the above implementation, when the second terminal device does not perform the multimodal service, the second terminal device may notify the first terminal device that the second terminal device will no longer perform the multimodal service, and the second terminal device may send the third indication information to the first terminal device.

[0018] In a possible implementation of the first aspect of the present application, the method further includes: sending a multimodal service resource request to a network device, the multimodal service resource request including: an identifier of the first terminal device; receiving multimodal service resource allocation information sent by the network device; and sending the multimodal service resource allocation information. In the above implementation scheme, after the first terminal device receives the multimodal service resource allocation information from the network device, the first terminal device can send the multimodal service resource allocation information in a broadcast or multicast manner. For example, the first terminal device sends the multimodal service resource allocation information in a multimodal service group, and the second terminal device determines the multimodal service resources of the second terminal device based on the multimodal service resource allocation information, so that the first terminal device and the second terminal device can collaborate to perform multimodal services.

[0019] In a possible implementation of the first aspect of the present application, the first indication information includes at least one of the following: multimodal identification information of the multimodal service, associated identification information, PDU set identification information corresponding to the first data unit, and PDU information corresponding to the first data unit; the first data unit includes discarded data associated with the multimodal service, wherein the associated identification information is used to indicate the data identification associated with the first data unit. In the above implementation scheme, the following information included in the first indication information can be combined in any way of at least two or more, for example, two or three of the multimodal identification information, associated identification information, protocol data unit set PDU set identification information, and protocol data unit PDU information of the multimodal service are combined, and the first indication information is sent, and the device that receives the first indication information can determine that the data associated with the multimodal service has been discarded.

[0020] In a possible implementation of the first aspect of the present application, the first indication information includes at least one of the following: discard time information of the first data unit, generation timestamp information of the first data unit, and transmission timestamp information of the first data unit, wherein the first data unit includes discarded data associated with a multimodal service. In the above implementation, the first terminal device determines that the discard of data associated with the multimodal service meets a preset discard condition. In addition, the first terminal device can also determine the discard time information of the first data unit. The first indication information includes the discard time information of the first data unit, so that the device receiving the first indication information can accurately obtain the discard time information of the first data unit. The device receiving the first indication information uses the discard time information of the first data unit to discard other data units of the same multimodal service. The first terminal device can also determine the generation timestamp information of the first data unit and the transmission timestamp information of the first data unit, so that the device receiving the first indication information can accurately obtain the generation timestamp information of the first data unit. The device receiving the first indication information uses the generation timestamp information of the first data unit to discard other data units of the same multimodal service. For another example, the device that receives the first indication information uses the sending timestamp information of the first data unit to discard other data units of the same multimodal service.

[0021] The second aspect of the present application provides a method for indicating a multimodal service, which is applied to a second terminal device, and the method includes: receiving a first indication message from a first terminal device, wherein the first indication message is used to indicate that data discard occurs in a multimodal service associated with the multimodal service; and discarding the to-be-processed data associated with the multimodal service according to the first indication message. In the above implementation scheme, the second terminal device receives the first indication message from the first terminal device, and the second terminal device discards the data of the same multimodal service, thereby discarding other data of the same multimodal service. It is possible to achieve the coordinated discarding of different data streams of the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0022] In a possible implementation of the first aspect of the present application, the method further includes:

[0023] The multimodal service group to which the second terminal device belongs is determined based on the multimodal service group configuration information sent by the network device; or, the multimodal service group establishment request sent by the first terminal device is received via broadcast, and a multimodal service group establishment response is sent to the first terminal device. In the above implementation scheme, the network device can pre-configure the multimodal service group, or the first terminal device can pre-configure the multimodal service group, and the second terminal device can join the multimodal service group, so that the second terminal device can use the pre-configured multimodal service group to receive the first indication information, thereby improving the efficiency of receiving the indication information.

[0024] In a possible implementation of the second aspect of the present application, the receiving of the first indication information from the first terminal device includes: receiving the first indication information by broadcasting or multicasting.

[0025] In a possible implementation of the second aspect of the present application, the method further includes: sending second indication information to the first terminal device, the second indication information is used to indicate the first information and / or the identification of the second terminal device, the first information is used to instruct the second terminal device to discard the second data unit of the same multimodal service associated with the first data unit, and the first data unit includes the discarded data associated with the multimodal service.

[0026] In a possible implementation manner of the second aspect of the present application, the method further includes: adding the first terminal device to a multimodal service group according to the first indication information.

[0027] In a possible implementation of the second aspect of the present application, the method further includes: sending third indication information to the first terminal device, where the third indication information is used to instruct the second terminal device not to perform the multimodal service.

[0028] In a possible implementation of the second aspect of the present application, the method further includes: receiving multimodal service resource allocation information from the first terminal device; and determining the multimodal service resources of the second terminal device based on the multimodal service resource allocation information. In the above implementation scheme, after the first terminal device receives the multimodal service resource allocation information from the network device, the first terminal device can send the multimodal service resource allocation information in a broadcast or multicast manner. For example, the first terminal device sends the multimodal service resource allocation information in the multimodal service group, and the second terminal device determines the multimodal service resources of the second terminal device based on the multimodal service resource allocation information, so that the first terminal device and the second terminal device can collaborate to perform multimodal services.

[0029] In a possible implementation of the second aspect of the present application, the first indication information includes at least one of the following: multimodal identification information of the multimodal service, associated identification information, PDU set identification information corresponding to the first data unit, and PDU information corresponding to the first data unit; the first data unit includes discarded data associated with the multimodal service, wherein the associated identification information is used to indicate the data identification associated with the first data unit.

[0030] In a possible implementation of the second aspect of the present application, the first indication information includes at least one of the following: discard time information of the first data unit, generation timestamp information of the first data unit, and sending timestamp information of the first data unit, and the first data unit includes discarded data associated with the multimodal service.

[0031] A third aspect of the present application provides a communication device, which is specifically a first terminal device, and includes:

[0032] A determination module, configured to determine whether data associated with a multimodal service is discarded and meets a preset discard condition;

[0033] The sending module is used to send first indication information to the network device, where the first indication information is used to indicate that data discard occurs in the multimodal service.

[0034] A fourth aspect of the present application provides a communication device, which is specifically a network device, and includes:

[0035] A receiving module, configured to receive first indication information from a first terminal device, where the first indication information is used to indicate that data discard occurs in a multimodal service;

[0036] The sending module is used to send second indication information, where the second indication information is used to indicate that data discard occurs in the multimodal service.

[0037] A fifth aspect of the present application provides a communication device, comprising: a memory and at least one processor. The memory is configured to store programs or computer instructions, and the at least one processor is configured to execute the computer programs or computer instructions stored in the memory, so that the communication device implements the multimodal service indication method provided in the first or second aspect of the present application.

[0038] The sixth aspect of the present application provides a computer storage medium for storing a computer program. When the computer program is executed, it is used to implement the multimodal service indication method provided by the first aspect or the second aspect of the present application.

[0039] In a seventh aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the multimodal service indication method described in the first or second aspect above.

[0040] In an eighth aspect, the present application provides a chip system, which includes a processor for supporting a terminal device or a network device to implement the functions involved in the above aspects, for example, sending or processing the data and / or information involved in the above methods. In one possible design, the chip system also includes a memory, which is used to store program instructions and data necessary for the terminal device or network device. The chip system can be composed of a chip, or it can include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] FIG1 is a schematic diagram of the system architecture of a communication system provided in an embodiment of the present application;

[0042] FIG2 is a schematic diagram of an interaction process between a first terminal device and a network device provided in an embodiment of the present application;

[0043] FIG3 is a schematic diagram of another interaction process between a first terminal device and a network device provided in an embodiment of the present application;

[0044] FIG4 is a schematic diagram of another interaction process between a first terminal device and a network device provided in an embodiment of the present application;

[0045] FIG5 is a schematic diagram of multi-terminal data transmission provided in an embodiment of the present application;

[0046] FIG6 is a schematic diagram of another multi-terminal data transmission according to an embodiment of the present application;

[0047] FIG7 is a structural diagram illustrating an electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0048] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to be limiting of the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the embodiments of the present application, "one or more" refers to one, two or more; "and / or" describes the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship.

[0049] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0050] The "multiple" involved in the embodiments of the present application means greater than or equal to two. It should be noted that in the description of the embodiments of the present application, the words "first" and "second" are only used for the purpose of distinguishing the description and cannot be understood as indicating or implying relative importance or order.

[0051] The embodiments of the present application are applied to communication systems, which may be second-generation (2G) communication systems, third-generation (3G) communication systems, long-term evolution (LTE) systems, fifth-generation (5G) communication systems, LTE and 5G hybrid architectures, 5G New Radio (5G NR) systems, and new communication systems emerging in future communication developments, such as possible sixth-generation (6G) communication systems.

[0052] The communication system includes a first device and a second device. The first device can be a device on the network side for providing network communication functions, which is sometimes also called a network device or a network element. The network device can generally be a base station (including a functional unit of a base station, or a combination of functional units of a base station) or a core network unit, wherein the core network unit can be a functional unit in the core network, including but not limited to an Access and Mobility Management Function (AMF) unit or a Session Management Function (SMF) unit. The second device can be a device for accessing the network, which can generally be a terminal. An example of a communication system is shown in Figure 1, which includes a base station 11 and a terminal 12.

[0053] In the embodiments provided in the present application, the base station can be any device with wireless transceiver functions, including but not limited to: an evolved base station (NodeB or eNB or e-NodeB, evolutionary Node B) in LTE, a base station (gNodeB or gNB) or a transmission receiving point (TRP) in new radio (NR), a base station of subsequent evolution of 3GPP, an access node in a Wi-Fi system, a wireless relay node, a wireless backhaul node, etc. The base station can be: a macro base station, a micro base station, a pico base station, a small station, a relay station, or a balloon station, etc. The base station can include one or more co-site or non-co-site transmission points (Transmission Reception Point, TRP). The base station can also be a wireless controller, a centralized unit (CU), and / or a distributed unit (DU) in a cloud radio access network (CRAN) scenario. The base station can communicate with the terminal, or communicate with the terminal through a relay station. The terminal can communicate with multiple base stations of different technologies. For example, the terminal can communicate with a base station supporting the LTE network, and can also communicate with a base station supporting the 5G network. It can also establish dual connections with a base station supporting the LTE network and a base station supporting the 5G network.

[0054] In the embodiments provided herein, the terminal may be in various forms, such as a mobile phone, a tablet computer, a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a vehicle-mounted terminal device, a wireless terminal in self-driving, a wireless terminal in remote medical, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, a wearable terminal device, etc. The terminal may also be sometimes referred to as a terminal device, user equipment (UE), access terminal device, vehicle-mounted terminal, industrial control terminal, UE unit, UE station, mobile station, mobile station, remote station, remote terminal device, mobile device, UE terminal device, terminal device, wireless communication device, UE agent or UE device, etc. The terminal may also be a fixed terminal or a mobile terminal.

[0055] In a communication system, multimodal extended reality (XR) devices may include the following two situations: one situation is that the multimodal XR device may be a single terminal, one terminal generates a multimodal service (a multi-modal service), and the multimodal service includes multiple data streams; the other situation is that the multimodal XR device may be multiple terminals, each terminal generates several data streams, and a multimodal service consists of multiple data streams generated by multiple terminals.

[0056] The multimodal service in the embodiment of the present application is composed of several interrelated data streams, which can also be called multimodal streams. These data streams may come from different sources. A data stream can be called unimodal data, and a data stream can be regarded as a type of data associated with the same communication service. For example, the data stream in the embodiment of the present application can be audio data, video data, positioning data, and tactile data. The data stream of the multimodal service can come from a single UE, or via a single device, or via multiple devices connected to a single UE that can access the communication system, or from multiple UEs.

[0057] In the embodiments of the present application, the requirements of the multimodal service refer to the service requirements of the multimodal service, for example, the quality of service (QoS) monitoring requirements of multiple Internet Protocol (IP) data flows related to the multimodal service.

[0058] In embodiments of the present application, a multimodal service identifier (Multi-modal Service ID) may be defined for a multimodal service. For multimodal services, the same multimodal service identifier corresponds to the same multimodal service, and terminal devices and network devices can identify different multimodal services based on the multimodal service identifier. For example, the multimodal service identifier refers to the identifier of the multimodal communication service, and multimodal flows belonging to the same multimodal service share the same multimodal service identifier.

[0059] In a single-terminal data transmission scenario, the terminal device can associate different data based on the multimodal service identifier. In a multi-terminal data transmission scenario, the multimodal service identifier corresponding to the same multimodal service is the same, and different terminal devices can associate the data belonging to their respective devices based on the multimodal service identifier. For example, in a multi-terminal data transmission scenario, the multimodal service identifier defined can be single network slice selection support information (NSSAI), or the multimodal service identifier can be a data network name (DNN).

[0060] For the RAN system, it is necessary to achieve synchronization of multiple data streams under a multimodal service, such as audio / tactile synchronization, and the transmission of multiple data streams depends on resource scheduling on the network side.

[0061] When the data stream transmission of a multimodal service fails, it will lead to the inability to continue the multimodal service. For the terminal device, the embodiment of the present application provides a solution for processing the data stream of the multimodal service when the data stream transmission of the multimodal service fails. For example, each data stream in the multimodal service is strongly correlated. When the data stream transmission of a multimodal service fails, the transmission of the remaining data streams will be meaningless. If the terminal device continues to process the remaining data streams of the multimodal service, there will be a waste of processing resources and transmission resources of the terminal device, which reduces the data transmission efficiency of the multimodal service. If a data stream of the multimodal service is discarded, other data streams of the related multimodal service also need to be discarded. The embodiment of the present application provides an indication method for a multimodal service, which can realize the coordinated discarding of different data streams of the multimodal service and improve the data transmission efficiency of the multimodal service.

[0062] In order to make the technical solution of the present application clearer and easier to understand, the following describes the method for indicating the multimodal service of the embodiment of the present application in conjunction with the accompanying drawings. The embodiment of the present application is applicable to the data transmission process in the wireless communication scenario. In the embodiment of the present application, the multimodal service transmission between the terminal device and the network device is taken as an example, such as the multimodal service transmission between a single terminal device and the network device, and the multimodal service transmission between multiple terminal devices and the network device. The above-mentioned multimodal service between the terminal device and the network device is only a feasible example. The embodiment of the present application can be applied to data transmission between terminal devices and terminal devices, or data transmission between network devices and network devices, or data transmission between two network elements in a wireless communication network.

[0063] Please refer to FIG. 2 , which is a schematic diagram of an interaction process between a first terminal device and a network device according to an embodiment of the present application. The multimodal service indication method provided by the embodiment of the present application mainly includes the following steps:

[0064] 201. The first terminal device determines that data associated with a multimodal service is discarded and meets a preset discard condition.

[0065] In the embodiment of the present application, data transmission of a multimodal service is performed between the first terminal device and the network device. The multimodal service includes multiple data streams that are related to each other. Affected by the channel environment or the control method of the first terminal device receiving the data stream, the data stream in the multimodal service may have a data stream transmission failure. The first terminal device first determines the data that has been discarded in the multimodal service. For example, the first terminal device obtains the first data unit associated with the multimodal service and determines that data discard occurs in the multimodal service. The first data unit is the data to be sent by the first terminal device in the multimodal service. When data discard occurs in the first data unit, the first terminal device determines the first data unit from the multimodal service.

[0066] In the embodiments of the present application, a multimodal service may include multiple data streams, and a data unit may belong to one of the data streams. In the embodiments of the present application, a data unit in which data discard occurs is used as an example to illustrate the first data unit. The processing method for other data units in the multimodal service when data discard occurs is similar to that for the first data unit. In the embodiments of the present application, the data unit is a data transmission unit in the multimodal service. For example, the data unit may be a Packet Data Convergence Protocol (PDCP) data packet, or the data unit may be a data packet of another protocol type, which is not limited here.

[0067] In an embodiment of the present application, a discard condition is preset in the first terminal device. The discard condition is a condition that needs to be met to determine whether data associated with a multimodal service is discarded. The specific content of the discard condition is not limited. In an embodiment of the present application, by setting the discard condition, it is possible to accurately determine whether data is discarded on the first data unit associated with the modal service.

[0068] In some embodiments of the present application, the discarded data associated with the multimodal service includes: a protocol data unit set (PDU set) or a protocol data unit (PDU);

[0069] Step 201: The first terminal device determines that data associated with the multimodal service is discarded and meets a preset discard condition, including:

[0070] A1. The first terminal device determines that a PDU set is discarded or a PDU is discarded, or the number of discarded PDU sets exceeds a first threshold value, or the number of discarded PDUs exceeds a second threshold value.

[0071] Among them, the discarded data associated with the multimodal service may be a PDU set or a PDU. In the embodiment of the present application, a discard condition may be set for the PDU set or the PDU respectively. For example, the discard condition may be that the PDU set is discarded or the PDU is discarded. Therefore, the first terminal device determines that the discard condition is satisfied when the PDU set is discarded or the PDU is discarded. In addition, the discard condition may be that the number of discarded PDUs or PDUs exceeds their respective corresponding thresholds. For example, the discard condition is determined to be satisfied when the number of discarded PDUs exceeds a first threshold value or the number of discarded PDUs exceeds a second threshold value.

[0072] 202. The first terminal device sends first indication information, where the first indication information is used to indicate that data discard occurs in a multimodal service.

[0073] Among them, the first terminal device executes the aforementioned step 201 to determine that data discard occurs in the multimodal service. In order to realize the joint discard of data on the multimodal service, the first terminal device can send a first indication message. For example, the first terminal device and other devices can communicate with each other, and the first terminal device sends a first indication message to the other devices, so that the other devices can receive the first indication message. For example, the other devices can be a second terminal device or a network device. In the embodiment of the present application, when data discard occurs in the multimodal service of the first terminal device, the first terminal device can indicate to the other devices that data discard occurs in the multimodal service, and the other devices will also discard the data using the same multimodal service, so that other data of the same multimodal service can also be discarded. It is possible to realize the coordinated discard of different data streams of the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0074] In some embodiments of the present application, step 202, in which the first terminal device sends the first indication information, includes:

[0075] B1. The first terminal device sends the first indication information via broadcast or multicast.

[0076] The first terminal device may send the first indication information by broadcast or multicast. For example, the first indication information may include a multimodal service identifier. This allows multiple terminal devices to receive the first indication information. The devices that receive the first indication information will discard data related to the same multimodal service, thereby also discarding other data related to the same multimodal service. This enables coordinated discarding of different data streams of a multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0077] In some embodiments of the present application, step 202, in which the first terminal device sends the first indication information, includes:

[0078] C1. The first terminal device sends a first signaling to the second terminal device through the short-distance direct communication PC5 interface between the first terminal device and the second terminal device, where the first signaling carries first indication information.

[0079] A short-range direct communication PC5 interface is configured between the first terminal device and the second terminal device, so that the second terminal device can receive the first instruction information and discard data using the same multimodal service, thereby also discarding other data of the same multimodal service. This can achieve coordinated discarding of different data streams of the multimodal service, improving the data transmission efficiency of the multimodal service.

[0080] For example, in 5G and LTE mobile communication systems, PC5 (Proximity Communication) is a technology for direct communication between devices based on short-range communication standards such as wireless local area network (WLAN) or Bluetooth, and can be applied to application scenarios such as the Internet of Vehicles, intelligent transportation, and the Internet of Things.

[0081] For example, the first signaling is transmitted via the PC5 interface and can be transmitted via multicast and broadcast. When the second terminal device receives the first indication information of the first terminal device, it determines whether to discard the current data packet based on the multimodal service identifier in the first indication information. If the second terminal device has a data packet associated with the multimodal service identifier, the data packet is discarded. If the second terminal device does not have a data packet associated with the multimodal service identifier, the data packet is not discarded.

[0082] In some embodiments of the present application, the first indication information includes at least one of the following: discarding time information of the first data unit, generation timestamp information of the first data unit, and sending timestamp information of the first data unit.

[0083] Among them, the first terminal device determines that the data associated with the multimodal service is discarded and meets the preset discard condition. The first data unit includes the discarded data associated with the multimodal service. The first terminal device can also determine the discard time information of the first data unit. The first indication information includes the discard time information of the first data unit, so that the device receiving the first indication information can accurately obtain the discard time information of the first data unit. The device receiving the first indication information uses the discard time information of the first data unit to discard other data units of the same multimodal service.

[0084] In another possible implementation, the first terminal device may also determine the generation timestamp information of the first data unit and the sending timestamp information of the first data unit, so that the device receiving the first indication information can accurately obtain the generation timestamp information of the first data unit, and the device receiving the first indication information uses the generation timestamp information of the first data unit to discard other data units of the same multimodal service. For another example, the device receiving the first indication information uses the sending timestamp information of the first data unit to discard other data units of the same multimodal service.

[0085] For example, the aforementioned generation timestamp information may include a generation time sequence, where similar or related generation timestamp information is used to indicate that the time at which the data packets were generated is similar or related, or the generation timestamp information is an absolute time, which is used to indicate the moment when the data packets were generated. For another example, the aforementioned transmission timestamp information may include a transmission time sequence, where similar or related transmission timestamp information is used to indicate that the time at which the data packets were transmitted is similar or related, or the transmission timestamp information is an absolute time, which is used to indicate the moment when the data packets were transmitted.

[0086] In implementations of some embodiments of the present application, the first indication information includes: multimodal identification information of the multimodal service.

[0087] Among them, the multimodal identification information can specifically be the aforementioned multimodal service identification. When data discard occurs in the multimodal service, the first terminal device determines the multimodal identification information where data discard occurs. The first indication information generated by the first terminal device can include the multimodal identification information, so that the device receiving the first indication information can obtain the multimodal identification information through the first indication information, and determine that the data associated with the multimodal service is discarded based on the multimodal identification information.

[0088] In some implementations of the present application, the first indication information includes: association identification information, where the association identification information is used to indicate a data identifier associated with the first data unit, and the first data unit includes discarded data associated with the multimodal service.

[0089] The association identification information may specifically be an association tag. When data discard occurs in a multimodal service, the first terminal device determines the data identifier associated with the first data unit in which the data discard occurred. The first indication information generated by the first terminal device may include the association identification information, so that the device receiving the first indication information can obtain the association identification information through the first indication information, determine that data discard occurred in the multimodal service associated with the multimodal service based on the association identification information, and determine other data associated with the same multimodal service through the association identification information.

[0090] In implementations of some embodiments of the present application, the first indication information includes: PDU set identification information corresponding to the first data unit.

[0091] Among them, the PDU set identification information refers to the identification of the PDU set on which data discard occurs on the multimodal service. When data discard occurs in the multimodal service, the first terminal device determines the PDU set identification information on the first data unit where data discard occurs. The first indication information generated by the first terminal device may include the PDU set identification information, so that the device receiving the first indication information can obtain the PDU set identification information through the first indication information, and determine that data discard occurs on the PDU set on the first data unit associated with the multimodal service based on the PDU set identification information. Other PDU set data associated with the same multimodal service can be determined through the PDU set identification information.

[0092] In some implementations of the present application, the first indication information includes: PDU information corresponding to the first data unit.

[0093] Among them, PDU information refers to the information of the PDU that is discarded on the multimodal service, for example, the PDU information can be the serial number (SN) of the PDU. When data discard occurs in the multimodal service, the first terminal device determines the PDU information on the first data unit where data discard occurs. The first indication information generated by the first terminal device may include the PDU information, so that the device receiving the first indication information can obtain the PDU information through the first indication information, and determine that data discard occurs on the PDU on the first data unit associated with the multimodal service based on the PDU information. Other PDU data associated with the same multimodal service can be determined through the PDU information.

[0094] It can be understood that in an embodiment of the present application, the following information included in the first indication information can be combined in any way, including at least two or more types, for example, two or three types of multimodal identification information, association identification information, PDU set identification information, and PDU information of a multimodal service can be combined and sent through the first indication information.

[0095] In some embodiments of the present application, step 202, in which the first terminal device sends the first indication information, includes:

[0096] D1. The first terminal device determines a multimodal service group to which the first terminal device belongs, where the multimodal service group includes at least one terminal device that provides the same multimodal service.

[0097] D2. The first terminal device sends the first indication information via multicast within the multimodal service group.

[0098] Among them, when multiple terminals are performing the same multimodal service, the first terminal device can pre-establish a multimodal service group, and the multimodal service group includes: at least one terminal device performing the same multimodal service. The first terminal device can send the first indication information by multicasting, and the first indication information is sent in a group within the multimodal service group, so that all terminal devices in the multimodal service group can receive the first indication information, and all terminal devices in the multimodal service group will also discard the data using the same multimodal service, so that other data of the same multimodal service can also be discarded. It can achieve the coordinated discarding of different data streams of the multimodal service and improve the data transmission efficiency of the multimodal service.

[0099] In one implementation of the embodiment of the present application, step D1, in which the first terminal device determines the multimodal service group to which the first terminal device belongs, includes:

[0100] D11. The first terminal device determines the multimodal service group to which the first terminal device belongs according to the multimodal service group configuration information sent by the network device; or

[0101] D12. The first terminal device sends a multimodal service group establishment request by broadcasting, receives a multimodal service group establishment response sent by the at least one terminal device, and establishes the multimodal service group according to the multimodal service group establishment response.

[0102] Among them, in the embodiment of the present application, a multimodal service group can be established in advance. There are many methods for establishing a multimodal service group, for example, the network device configures the multimodal service group. Specifically, the network device configures a group of terminal devices to transmit the same multimodal service, and the network device generates multimodal service group configuration information and sends the multimodal service group configuration information to the first terminal device in the multimodal service group. For example, the multimodal service group configuration information is sent to each terminal device in the multimodal service group, wherein the multimodal service group configuration information includes information of multiple terminal devices, and the information of the terminal device can be the identification of the terminal device, for example, it can be the destination L2 ID.

[0103] In another implementation of the embodiment of the present application, a multimodal service group can also be established in advance. There are many methods for establishing a multimodal service group. For example, the terminal device itself establishes a multimodal service group. Specifically, the first terminal device sends a multimodal service group establishment request in the form of a broadcast. The multimodal service group establishment request may include a multimodal service identifier. If the second terminal device receives the multimodal service group establishment request, it can send a multimodal service group establishment response to the first terminal device and establish the first terminal device in the multimodal service group. After receiving the reply, the first terminal device can add the second terminal device to the multimodal service group. Among them, if the first terminal device also receives a reply from the third terminal device, it can notify the second terminal device of the information of the third terminal device, and the second terminal device can also add the third terminal device to the multimodal service group. Similarly, the third terminal device can also add both the first terminal device and the second terminal device to the multimodal service group. The number of terminal devices that establish a multimodal group is not limited in the embodiment of the present application.

[0104] In the embodiment of the present application, the first indication information is carried in the first signaling. There are many ways to implement the first signaling. For example, the first signaling includes at least one of the following:

[0105] First Packet Data Convergence Protocol Control Element (PDCP CE),

[0106] The first PDCP layer controls the PDU,

[0107] First PDCP layer report,

[0108] First Radio Resource Control (RRC) signaling,

[0109] A first Medium Access Control Control Element (MAC CE).

[0110] Among them, the first indication information can be notified through the first PDCP CE. The format of the PDCP CE is not limited in the embodiment of the present application. In the embodiment of the present application, the first indication information can be interacted through PDCP layer signaling, so that the first terminal device can indicate to the network device that data discard occurs in the multimodal service.

[0111] For example, the PDCP CE may indicate the PDU type, and whether the PDU is a control PDU or a data PDU. The first PDCP CE may include a PDCP layer control PDU, such as a PDU type indicating PDU set related information, or indicating multimodal related information, and the first PDCP CE includes the first indication information.

[0112] For another example, the PDCP CE may include a report of the PDCP layer, and the report of the PDCP layer carries the first indication information.

[0113] Among them, in addition to being sent through the first PDCP CE, the first indication information also has other implementation methods. For example, the first indication information is notified through the first PDCP layer control PDU or the first PDCP layer report. In the embodiment of the present application, there is no limitation on the PDCP layer control PDU or the PDCP layer report. In the embodiment of the present application, the first indication information can be interacted through PDCP layer signaling, so that the first terminal device indicates to the network device that data discard occurs in the multimodal service.

[0114] For example, the first indication information can be notified through the first RRC signaling. The format of the first RRC signaling is not limited in the embodiment of the present application. In the embodiment of the present application, the first terminal device can indicate to the network device that data discard occurs in the multimodal service through RRC signaling.

[0115] For example, the first indication information can be notified through the first MAC CE. The format of the first MAC CE is not limited in the embodiment of the present application. In the embodiment of the present application, the first terminal device can indicate to the network device that data discard occurs in the multimodal service through MAC CE.

[0116] 203. The second terminal device receives first indication information from the first terminal device.

[0117] The first indication information is used to indicate that data discard occurs in the multimodal service.

[0118] The second terminal device and the first terminal device can communicate with each other, and the first terminal device sends first indication information to the second terminal device, so that the second terminal device can receive the first indication information. In the embodiment of the present application, when data is discarded in the multimodal service of the first terminal device, the first terminal device can indicate to the second terminal device that data discard has occurred in the multimodal service, and the second terminal device can determine that data discard has occurred in the multimodal service based on the first indication information.

[0119] 204. The second terminal device discards the to-be-processed data associated with the multimodal service according to the first indication information.

[0120] In some embodiments of the present application, when a second terminal device receives first indication information from a first terminal device, the second terminal device discards data of the same multimodal service, thereby also discarding other data of the same multimodal service. This enables coordinated discarding of different data streams of the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0121] In some embodiments of the present application, in addition to executing the aforementioned method, the first terminal device further executes the following steps:

[0122] E1. A first terminal device sends a multimodal service resource request to a network device, where the multimodal service resource request includes: an identifier of the first terminal device;

[0123] E2. The first terminal device receives multimodal service resource allocation information sent by the network device;

[0124] E3. The first terminal device sends multimodal service resource allocation information.

[0125] Accordingly, in addition to executing the aforementioned method, the terminal device further executes the following steps:

[0126] F1. The second terminal device receives multimodal service resource allocation information from the first terminal device;

[0127] F2. The second terminal device determines the multimodal service resources of the second terminal device according to the multimodal service resource allocation information.

[0128] When the first terminal device determines that it will perform the same multimodal service as the second terminal device, the first terminal device may request the network device to allocate multimodal service resources. For example, the first terminal device sends a multimodal service resource allocation request, the network device receives the multimodal service resource allocation request, and the network device allocates multimodal service resources based on the multimodal service resource allocation request, generating multimodal service resource allocation information. For example, the multimodal service resources may be resources for PC5 communication. After the first terminal device receives the multimodal service resource allocation information from the network device, the first terminal device may send the multimodal service resource allocation information by broadcast or multicast. For example, the first terminal device sends the multimodal service resource allocation information in a multimodal service group, and the second terminal device determines the multimodal service resources of the second terminal device based on the multimodal service resource allocation information, thereby enabling the first terminal device and the second terminal device to collaboratively perform multimodal services.

[0129] In one implementation of the embodiment of the present application, the method for indicating a multimodal service executed by the second terminal device further includes the following steps:

[0130] G1. Determine the multimodal service group to which the second terminal device belongs according to the multimodal service group configuration information sent by the network device; or

[0131] G2. Receive a multimodal service group establishment request sent by the first terminal device in a broadcasting manner, and send a multimodal service group establishment response to the first terminal device.

[0132] Among them, in the embodiment of the present application, a multimodal service group can be established in advance. There are many methods for establishing a multimodal service group. For example, the network device configures the multimodal service group. Specifically, the network device configures a group of terminal devices to transmit the same multimodal service. The network device generates multimodal service group configuration information and sends the multimodal service group configuration information to the second terminal device in the multimodal service group.

[0133] In another implementation of the embodiment of the present application, a multimodal service group may be pre-established. There are various methods for establishing a multimodal service group, such as a terminal device establishing a multimodal service group itself. Specifically, a first terminal device sends a multimodal service group establishment request via broadcast. The multimodal service group establishment request may include a multimodal service identifier. Upon receiving the multimodal service group establishment request, a second terminal device may send a multimodal service group establishment response to the first terminal device and establish the first terminal device in the multimodal service group. The embodiment of the present application does not limit the number of terminal devices that can establish a multimodal service group.

[0134] Through the examples of the aforementioned embodiments, it can be seen that in the embodiments of the present application, the first terminal device can send a first indication message. For example, the first terminal device and the network device can communicate with each other, and the first terminal device sends a first indication message to the network device, so that the network device can receive the first indication message. In the embodiment of the present application, when the first data unit in the multimodal service of the first terminal device is discarded, the first terminal device can indicate to the network device that data discard occurs in the multimodal service, and the network device can instruct the terminal devices using the same multimodal service to also discard it, so that other data of the same multimodal service can also be discarded. It is possible to achieve collaborative discarding of different data streams of the multimodal service, thereby improving the data transmission efficiency of the multimodal service.

[0135] As shown in Figure 3, another schematic diagram of the interaction process between a first terminal device and a second terminal device provided in an embodiment of the present application is provided. Taking the scenario where a multimodal service is used for data transmission of multiple terminals as an example, the first terminal device in an embodiment of the present application can perform a multimodal service for multiple terminals, which mainly includes the following process:

[0136] 301. The first terminal device determines that data associated with a multimodal service is discarded and meets a preset discard condition.

[0137] 302. The first terminal device sends first indication information, where the first indication information is used to indicate that data discard occurs in a multimodal service.

[0138] 303. The second terminal device receives first indication information from the first terminal device.

[0139] 304. The second terminal device discards the to-be-processed data associated with the multimodal service according to the first indication information.

[0140] The above steps 301 to 304 are similar to steps 201 to 204 in the above embodiment and will not be described in detail here.

[0141] 305. The second terminal device sends second indication information to the first terminal device.

[0142] The second indication information is used to indicate the first information and / or the identifier of the second terminal device, and the first information is used to instruct the second terminal device to discard the second data unit of the same multimodal service associated with the first data unit.

[0143] In an embodiment of the present application, after the second terminal device discards the to-be-processed data associated with the multimodal service according to the first indication information, the second terminal device may notify the first terminal device of the discarded second data unit, and the second terminal device sends the second indication information to the first terminal device.

[0144] Among them, the second indication information is used to indicate the first information, and the first information is used to instruct the second terminal device to discard the second data unit associated with the same multimodal service as the first data unit, so that the first terminal device can identify the second terminal device that performs the same multimodal service as the first terminal device. The structure of the first information generated by the second terminal device is not limited.

[0145] In addition to indicating the first information, the second indication information sent by the second terminal device includes the identification of the second terminal device, so that the first terminal device can identify the second terminal device that performs the same multimodal service as the first terminal device. In the embodiment of the present application, the implementation method of the second indication information including the identification of the second terminal device is not limited. For example, the identification of the second terminal device can be the destination layer 2 identification (destination L2 ID) of the second terminal device.

[0146] In some embodiments of the present application, the second indication information sent by the second terminal device has multiple implementations. In the embodiment of the present application, the second indication information is carried in the second signaling. There are multiple implementations of the second signaling. For example, the second signaling includes at least one of the following:

[0147] The second signaling includes at least one of the following: a second PDCP CE, a second PDCP layer control PDU, a second PDCP layer report, a second RRC signaling, and a second MAC CE.

[0148] Among them, the second indication information can be notified through the second PDCP CE. The format of the PDCP CE is not limited in the embodiment of the present application. The second indication information in the embodiment of the present application can be interacted through PDCP layer signaling, thereby notifying the first terminal device of the discarded second data unit.

[0149] For example, the PDCP CE may indicate the PDU type, and whether the PDU is a control PDU or a data PDU. The second PDCP CE may include the PDCP layer control PDU, such as the PDU type is PDU set identification information, or indicates multimodal identification information, and the second PDCP CE includes second indication information.

[0150] Among them, in addition to being sent through the second PDCP CE, the second indication information also has other implementation methods, for example, the second indication information is notified through the second PDCP layer control PDU or the second PDCP layer report. In the embodiment of the present application, there is no limitation on the PDCP layer control PDU or the PDCP layer report. In the embodiment of the present application, the second indication information can be interacted through PDCP layer signaling, so that the second terminal device indicates to the network device that the second terminal device discards the second data unit of the multimodal service associated with the same first data unit.

[0151] For example, the second indication information can be notified through the second RRC signaling. In the embodiment of the present application, the format of the second RRC signaling is not limited. In the embodiment of the present application, RRC signaling can be used to notify the first terminal device of the discarded second data unit.

[0152] For example, the second indication information can be notified through the second MAC CE. The format of the second MAC CE is not limited in the embodiment of the present application. In the embodiment of the present application, the MAC CE can be used to notify the first terminal device of the discarded second data unit.

[0153] 306. The first terminal device receives second indication information from the second terminal device.

[0154] 307. The first terminal device adds the second terminal device to the multimodal service group according to the second indication information.

[0155] Among them, the first terminal device determines that the first terminal device and the second terminal device perform the same multimodal service based on the received second indication information, and the first terminal device adds the second terminal device to the multimodal service group based on the second indication information, thereby realizing the addition of the multimodal service group. The multimodal service group maintained by the first terminal device can be used to realize collaborative data transmission of the same multimodal service.

[0156] In some embodiments of the present application, the second indication information includes an identifier of the second terminal device.

[0157] It can be understood that in the embodiment of the present application, in addition to the first terminal device maintaining the multimodal service group of the first terminal device, the second terminal device can also maintain the multimodal service group of the second terminal device accordingly. For example, the second terminal device adds the first terminal device to the multimodal service group according to the first indication information, thereby realizing the addition of the multimodal service group. The multimodal service group maintained by the second terminal device can be used to realize collaborative data transmission of the same multimodal service.

[0158] 308. When the first terminal device stops performing the multimodal service, the first terminal device deletes the second terminal device from the multimodal service group.

[0159] Among them, the first terminal device can also perform real-time maintenance on the multimodal service group. When the first terminal device does not perform multimodal service, the second terminal device is deleted from the multimodal service group, thereby optimizing the multimodal service group and improving the configuration efficiency of the multimodal service group.

[0160] As shown in Figure 4, another schematic diagram of the interaction process between the first terminal device and the second terminal device provided in an embodiment of the present application is provided. Taking the scenario where the multimodal service is used for data transmission of multiple terminals as an example, the first terminal device and the second terminal device in the embodiment of the present application can collaborate to perform the multimodal service of the multiple terminals, which mainly includes the following processes:

[0161] 401. The first terminal device determines that data associated with a multimodal service is discarded and meets a preset discard condition.

[0162] 402. The first terminal device sends first indication information, where the first indication information is used to indicate that data discard occurs in a multimodal service.

[0163] 403. The second terminal device receives first indication information from the first terminal device.

[0164] 404. The second terminal device discards the to-be-processed data associated with the multimodal service according to the first indication information.

[0165] The above steps 401 to 404 are similar to steps 201 to 204 in the above embodiment and will not be described in detail here.

[0166] 405. The second terminal device sends third indication information to the first terminal device.

[0167] Among them, the third indication information is used to instruct the second terminal device not to perform multimodal services.

[0168] 406. The first terminal device receives third indication information from the second terminal device.

[0169] 407. The first terminal device deletes the second terminal device from the multimodal service group.

[0170] When the second terminal device does not perform a multimodal service, the second terminal device may notify the first terminal device that the second terminal device no longer performs a multimodal service, and the second terminal device sends third indication information to the first terminal device.

[0171] In some embodiments of the present application, the third indication information sent by the second terminal device has multiple implementations. In the embodiments of the present application, the third indication information is carried in third signaling. There are multiple implementations of the third signaling. For example, the third signaling includes at least one of the following:

[0172] The third signaling includes at least one of the following: a third PDCP CE, a third PDCP layer control PDU, a third PDCP layer report, a third RRC signaling, and a third MAC CE.

[0173] The implementation method of the third signaling is similar to that of the first signaling and the second signaling, and will not be described in detail here.

[0174] In an embodiment of the present application, the first terminal device can also perform real-time maintenance on the multimodal service group. The first terminal device determines that the second terminal device does not perform multimodal service based on the third indication information, and deletes the second terminal device from the multimodal service group, thereby optimizing the multimodal service group and improving the configuration efficiency of the multimodal service group.

[0175] In order to make the technical solution of the present application clearer and easier to understand, the multimodal service indication method of the present application is described in detail below in conjunction with a specific single-terminal data transmission scenario.

[0176] For a single-terminal scenario, a multimodal service is transmitted through one or more quality of service (QoS) flows, and when mapped to a DRB, it is also transmitted through one or more DRBs.

[0177] The UE sends multiple DRBs, where one DRB is mapped to one PDCP entity. Therefore, there is a scenario where joint discarding of data on multiple PDCP entities is required.

[0178] Multiple PDCP entities of a single UE cannot interact with each other. When PDCP entity 1 on the UE side is discarded, the network side can be notified of the discarded association tag. The network side notifies PDCP entity 2 on the UE side of the PDU set corresponding to the association tag that needs to be discarded through signaling.

[0179] For multi-terminal scenarios, a multimodal service will be transmitted through multiple DRBs, so it is necessary to implement PDU set coordinated discard among multiple PDCP entities.

[0180] First, referring to a schematic diagram of multi-terminal data transmission shown in FIG5 , taking the first terminal device as UE1 and the second terminal device as UE2 as an example, the method provided in the embodiment of the present application includes the following steps:

[0181] S01. UE1 determines to discard PDU set1.

[0182] S02. UE1 notifies that PDU set1 is discarded.

[0183] In one implementation, UE1 is notified via PDCP CE. In the embodiment of the present application, the format of the PDCP CE is not limited, and UE1 and UE2 can perform PDCP layer signaling interaction.

[0184] The PDCP CE may indicate the PDU type and whether the PDU is a control PDU or a data PDU. For example, the PDCP CE may be a PDCP layer control PDU, for example, the PDU type may indicate PDU set information, or indicate multi-modal identification information.

[0185] When a PDU set is discarded or a PDU is discarded, or when the number of discarded PDU sets exceeds a first threshold or the number of discarded PDUs exceeds a second threshold, UE1 sends multimodal identification information or associated identification information of the discarded PDU set to UE2 via first signaling.

[0186] S03. UE2 discards PDU set 2 related to PDU set 1.

[0187] For example, the first signaling is transmitted via the PC5 interface and can be transmitted via multicast and broadcast. When UE2 receives the first indication information from UE1, it determines whether to discard the current data packet based on the multimodal identification information in the first indication information. If UE2 has a data packet related to the multimodal identification information, it discards the data packet. If UE2 does not have a data packet related to the multimodal identification information, it does not discard the data packet.

[0188] Referring to a schematic diagram of multi-terminal data transmission shown in FIG6 , in addition to the aforementioned S01 to S03 , the method provided in the embodiment of the present application includes the following steps:

[0189] S04. UE2 replies to UE1 that the discarding of PDU set2 has been completed.

[0190] When UE2 determines that the data packet needs to be discarded, it replies to UE1 through a second signaling to inform it that the discarding of the data packet has been completed, and includes an identifier of UE2 (eg, destination L2 ID) in the second signaling.

[0191] UE2 determines through the first signaling that it and UE1 are transmitting a multimodal service at the same time, and therefore marks UE1 as a related device in the multimodal service group. When UE2 no longer transmits the multimodal service, it notifies UE1 through the second signaling, and at the same time UE2 deletes the mark of UE1 as a related device in the multimodal service group.

[0192] After UE1 receives the second signaling, it determines that UE1 and UE2 are transmitting a multimodal service at the same time, so UE2 is marked as a related device in the multimodal service group. When UE1 no longer transmits the multimodal service, UE2 is notified through the third signaling, and UE1 will delete the mark of UE2 as a related device in the multimodal service group.

[0193] After completing the configuration of the above-mentioned multimodal service group, the UEs can determine that they are transmitting the same multimodal service to each other. Then UE1 or UE2 marks the UEs belonging to the same multimodal service group. When a multimodal service needs to be discarded, the indication information will be transmitted to the UE of the specific multimodal service group by multicast.

[0194] After the UE is determined to be in the multimodal service group, the UE1 initiating the service will be designated to notify the network device of the UE ID for transmitting the multimodal service. After the network device learns the UE ID for the multimodal service, it can allocate PC5 communication resources for the UE in the multimodal service group.

[0195] It should be noted that multicast is used for data transmission between UEs within a multimodal service group. Multicast refers to grouping UEs transmitting the same multimodal service into one multimodal service and applying the same data transmission scheme. When data is discarded within a multimodal service group, the UEs in the multimodal service group coordinate data discarding to improve the data transmission efficiency of the multimodal service.

[0196] It should be noted that the above embodiments are merely some illustrative implementation methods provided by this application, and it does not mean that this application only provides the above methods. In actual applications, the steps of the above embodiments can also be split or combined, and this application does not limit this.

[0197] Figure 7 is an example of the composition of another electronic device provided in an embodiment of the present application. The electronic device can be a first terminal device or a second terminal device, including but not limited to mobile phones, smart wearable devices (such as smart watches), and other electronic devices. Taking a mobile phone as an example, the electronic device may include a processor 310, an external memory interface 320, an internal memory 321, a display 330, a camera 340, an antenna 1, an antenna 2, a mobile communication module 350, and a wireless communication module 360, etc.

[0198] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown, or some components may be combined or separated, or the components may be arranged differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0199] The processor 310 may include one or more processing units. For example, the processor 310 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0200] It is understood that the interface connection relationship between the modules illustrated in this embodiment is only a schematic illustration and does not constitute a structural limitation of the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0201] External memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with processor 310 via external memory interface 320 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0202] The internal memory 321 can be used to store computer executable program code, and the executable program code includes instructions. The processor 310 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 321. The internal memory 321 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 310 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 321, and / or the instructions stored in the memory provided in the processor.

[0203] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 350, wireless communication module 360, modem processor and baseband processor.

[0204] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0205] The mobile communication module 350 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to electronic devices. The mobile communication module 350 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the processor 310. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the same device as at least some of the modules of the processor 310.

[0206] In some embodiments, the electronic device initiates or receives a call request via the mobile communication module 350 and the antenna 1 .

[0207] Furthermore, an operating system runs on the aforementioned components, such as the iOS operating system, the Android operating system, and the Windows operating system. Application programs can be installed and run on the operating system. Those skilled in the art will clearly understand that, for ease of description and brevity, the explanation and beneficial effects of any of the aforementioned electronic devices can be referred to the corresponding method embodiments provided above, and will not be further elaborated here.

[0208] The present application also provides a communication system, which may include the aforementioned first terminal device and second terminal device.

[0209] In this application, the terminal may include a hardware layer, an operating system layer running on the hardware layer, and an application layer running on the operating system layer. The hardware layer may include hardware such as a central processing unit (CPU), a memory management unit (MMU), and memory (also known as main memory). The operating system of the operating system layer may be any one or more computer operating systems that implement business processing through processes, such as the Linux operating system, Unix operating system, Android operating system, iOS operating system, or Windows operating system. The application layer may include applications such as browsers, address books, word processing software, and instant messaging software.

[0210] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described systems, devices and modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0211] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is merely a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or module, which can be electrical, mechanical or other forms.

[0212] The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules may be selected to achieve the purpose of the present embodiment according to actual needs.

[0213] In addition, the functional modules in the various embodiments of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into a single module. The above-mentioned integrated modules may be implemented in the form of hardware or software functional modules.

[0214] If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the part that essentially contributes to the technical solution of the present application or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the process of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.

[0215] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, ordinary technicians in this field should understand that they can still modify the technical solutions recorded in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for indicating a multimodal service, characterized in that: Applied to a first terminal device, the method includes: Determining that data associated with the multimodal service is discarded and meets a preset discard condition; Sending first indication information, where the first indication information is used to indicate that data discard occurs in the multimodal service.

2. The method according to claim 1, characterized in that The sending of the first indication information includes: The first indication information is sent by broadcasting or multicasting.

3. The method according to claim 1, characterized in that The sending of the first indication information includes: A first signaling is sent to the second terminal device via a short-distance direct communication PC5 interface between the first terminal device and the second terminal device, where the first signaling carries the first indication information.

4. The method according to claim 1, wherein The discarded data associated with the multimodal service includes: a protocol data unit set PDU set or a protocol data unit PDU; The determining that the data associated with the multimodal service is discarded and meets a preset discard condition includes: It is determined that the PDU set is discarded or the PDU is discarded, or the number of discarded PDU sets exceeds a first threshold, or the number of discarded PDUs exceeds a second threshold.

5. The method according to claim 1, wherein The sending of the first indication information includes: Determining a multimodal service group to which the first terminal device belongs, the multimodal service group comprising: at least one terminal device performing the same multimodal service; The first indication information is sent in the multimodal service group by multicasting.

6. The method according to claim 5, characterized in that The determining the multimodal service group to which the first terminal device belongs includes: determining the multimodal service group to which the first terminal device belongs according to the multimodal service group configuration information sent by the network device; or, A multimodal service group establishment request is sent by broadcasting, a multimodal service group establishment response is received from at least one terminal device, and the multimodal service group is established according to the multimodal service group establishment response.

7. The method according to any one of claims 1 to 5, characterized in that The method further comprises: receiving second indication information sent by a second terminal device, where the second indication information is used to indicate the first information and / or an identifier of the second terminal device, and the first information is used to instruct the second terminal device to discard a second data unit of the same multimodal service associated with the first data unit; The first data unit includes discarded data associated with a multimodal service.

8. The method according to claim 7, characterized in that The method further comprises: Add the second terminal device to the multimodal service group according to the second indication information.

9. The method according to claim 8, characterized in that The method further comprises: When the first terminal device does not perform a multimodal service, the second terminal device is deleted from the multimodal service group.

10. The method according to claim 8, characterized in that The method further comprises: receiving third indication information sent by the second terminal device, where the third indication information is used to instruct the second terminal device not to perform the multimodal service; The second terminal device is deleted from the multimodal service group.

11. The method according to any one of claims 1 to 10, characterized in that The method further comprises: Sending a multimodal service resource request to a network device, wherein the multimodal service resource request includes: an identifier of the first terminal device; receiving multimodal service resource allocation information sent by the network device; The multimodal service resource allocation information is sent.

12. The method according to any one of claims 1 to 11, characterized in that The first indication information includes at least one of the following: multimodal identification information of the multimodal service, association identification information, PDU set identification information corresponding to the first data unit, and PDU information corresponding to the first data unit; The first data unit includes discarded data associated with the multimodal service; The associated identification information is used to indicate a data identification associated with the first data unit.

13. The method according to any one of claims 1 to 12, characterized in that The first indication information includes at least one of the following: discard time information of the first data unit, generation timestamp information of the first data unit, and sending timestamp information of the first data unit; The first data unit includes discarded data associated with a multimodal service.

14. A method for indicating a multimodal service, characterized in that: Applied to a second terminal device, the method includes: Receiving first indication information from a first terminal device, where the first indication information is used to indicate that data discard occurs in a multimodal service; The to-be-processed data associated with the multimodal service is discarded according to the first indication information.

15. The method according to claim 14, characterized in that The receiving first indication information from the first terminal device includes: The first indication information is received by broadcasting or multicasting.

16. The method according to claim 14 or 15, characterized in that The method further comprises: Sending second indication information to the first terminal device, where the second indication information is used to indicate the first information and / or an identifier of the second terminal device, and the first information is used to instruct the second terminal device to discard a second data unit of the same multimodal service associated with the first data unit; The first data unit includes discarded data associated with a multimodal service.

17. The method according to any one of claims 14 to 16, characterized in that The method further comprises: determining the multimodal service group to which the second terminal device belongs according to the multimodal service group configuration information sent by the network device; or, The multimodal service group establishment request sent by the first terminal device is received in a broadcasting manner, and a multimodal service group establishment response is sent to the first terminal device.

18. The method according to any one of claims 14 to 17, characterized in that The method further comprises: Add the first terminal device to the multimodal service group according to the first indication information.

19. The method according to claim 18, characterized in that The method further comprises: Send third indication information to the first terminal device, where the third indication information is used to instruct the second terminal device not to perform the multimodal service.

20. The method according to any one of claims 14 to 19, characterized in that The method further comprises: Receiving multimodal service resource allocation information from the first terminal device; Determine the multimodal service resources of the second terminal device according to the multimodal service resource allocation information.

21. The method according to any one of claims 14 to 20, characterized in that The first indication information includes at least one of the following: multimodal identification information of the multimodal service, association identification information, PDU set identification information corresponding to the first data unit, and PDU information corresponding to the first data unit; The first data unit includes discarded data associated with the multimodal service; The associated identification information is used to indicate a data identification associated with the first data unit.

22. The method according to any one of claims 14 to 21, characterized in that The first indication information includes at least one of the following: discard time information of the first data unit, generation timestamp information of the first data unit, and sending timestamp information of the first data unit; The first data unit includes discarded data associated with a multimodal service.

23. A communication device, characterized in that: The communication device is specifically a first terminal device, and the communication device includes: A determination module, configured to determine whether data associated with a multimodal service is discarded and meets a preset discard condition; The sending module is used to send first indication information, where the first indication information is used to indicate that data discard occurs in the multimodal service.

24. A communication device, characterized in that: The communication device is specifically a second terminal device, and the communication device includes: A receiving module, configured to receive first indication information from a first terminal device, where the first indication information is used to indicate that data discard occurs in a multimodal service; A discarding module is used to discard the to-be-processed data associated with the multimodal service according to the first indication information.

25. A communication device, characterized in that: The communication device comprises: Memory for storing computer programs or computer instructions; A processor, configured to execute the computer program or computer instructions stored in the memory, so that the communication device performs the method according to any one of claims 1 to 13, or 14 to 22.

26. A computer storage medium for storing a computer program, wherein when the computer program is executed, the computer program is used to implement the method according to any one of claims 1 to 13, or 14 to 22.

Images