Communication method, equipment, device and medium

Abstract

The invention relates to a communication method, equipment, a device and a medium. The method comprises: sending indication information to a second device, the indication information being used for indicating a serial number corresponding to a data packet of a multi-modal service, and different data packets having the same serial number having a delay synchronization demand. In the method disclosed by the invention, the first equipment indicates the serial number of the data packet of the multi-modal service to the second equipment by sending the indication information, so that the second equipment can acquire the data packet with a synchronization requirement in the multi-modal service based on the indication information, the time delay synchronization requirement is conveniently met in a data transmission or scheduling process, and the user experience is improved.

Description

Communication methods, equipment, devices and media Technical Field

[0001] This disclosure relates to the field of communication technology, and in particular to a communication method, device, apparatus and medium. Background Technology

[0002] A multi-modality service is a communication service that consists of multiple related data streams and is coordinated and controlled by an application. Multi-modality services can be applied to various fields, such as industry, robotics and telepresence, virtual reality, augmented reality, healthcare, road transportation, gaming, education, culture, and smart grids.

[0003] Summary of the Invention

[0004] For immersive, multimodal virtual reality applications, synchronization between different media components is crucial.

[0005] This disclosure provides a communication method, device, apparatus, and medium.

[0006] In a first aspect, embodiments of this disclosure provide a communication method, executed by a first device, the method comprising:

[0007] Send indication information to the second device. The indication information is used to indicate the sequence number corresponding to the data packet of the multimodal service. There is a time delay synchronization requirement between different data packets with the same sequence number.

[0008] Secondly, embodiments of this disclosure provide a communication method executed by a second device, the method comprising:

[0009] The system receives indication information sent by the first device. The indication information is used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets with the same sequence number.

[0010] Thirdly, embodiments of this disclosure provide a communication device, including:

[0011] The transceiver module is used to send indication information to the second device. The indication information is used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets with the same sequence number.

[0012] Fourthly, embodiments of this disclosure provide a communication device, including:

[0013] The transceiver module is used to receive indication information sent by the first device. The indication information is used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets with the same sequence number.

[0014] Fifthly, embodiments of this disclosure provide a communication device, including:

[0015] One or more processors;

[0016] The communication device is configured to implement the method described in the first aspect or the second aspect.

[0017] Sixthly, embodiments of this disclosure provide a communication system, including a first device and a second device, wherein,

[0018] The first device is configured to implement the method described in the first aspect;

[0019] The second device is configured to implement the method described in the second aspect.

[0020] In a seventh aspect, embodiments of this disclosure provide a storage medium storing instructions, wherein...

[0021] When the instructions are executed on the communication device, the communication device causes the communication device to perform the method as described in the first aspect or the second aspect.

[0022] Eighthly, embodiments of this disclosure provide a program product, wherein,

[0023] When the program product is executed by a communication device, the communication device performs the method described in the first aspect or the second aspect.

[0024] In this embodiment of the disclosure, the first device sends an indication message to the second device to indicate the sequence number of the data packets of the multimodal service. The second device can then know the data packets with synchronization requirements in the multimodal service based on the indication message, which facilitates meeting the latency synchronization requirements during data transmission or scheduling and improves the user experience. Attached Figure Description

[0025] To more clearly illustrate the technical solutions in the embodiments of this disclosure, the accompanying drawings required for the description of the embodiments are introduced below. The following drawings are only some embodiments of this disclosure and do not impose specific limitations on the protection scope of this disclosure.

[0026] Figures 1a and 1b are exemplary schematic diagrams of the architecture of a communication system provided according to embodiments of the present disclosure;

[0027] Figures 2a and 2b are exemplary interactive schematic diagrams of a method provided according to an embodiment of the present disclosure;

[0028] Figure 2c is a schematic diagram of a serial number provided according to an embodiment of the present disclosure;

[0029] Figure 2d is a schematic diagram of the signaling structure provided according to an embodiment of the present disclosure;

[0030] Figure 3 is an exemplary flowchart of a method provided according to an embodiment of the present disclosure;

[0031] Figure 4 is an exemplary flowchart of a method provided according to an embodiment of the present disclosure;

[0032] Figure 5a is a schematic diagram of the structure of a device according to an embodiment of the present disclosure;

[0033] Figure 5b is a schematic diagram of the structure of a device according to an embodiment of the present disclosure;

[0034] Figure 6a is a schematic diagram of a communication device according to an embodiment of the present disclosure;

[0035] Figure 6b is a schematic diagram of a communication device according to an embodiment of the present disclosure. Detailed Implementation

[0036] This disclosure provides a communication method, device, apparatus, and medium.

[0037] In a first aspect, embodiments of this disclosure provide a communication method, executed by a first device, the method comprising:

[0038] Send indication information to the second device. The indication information is used to indicate the sequence number corresponding to the data packet of the multimodal service. There is a time delay synchronization requirement between different data packets with the same sequence number.

[0039] In the above embodiments, the first device sends an indication message to the second device to indicate the sequence number of the data packets of the multimodal service. The second device can then know the data packets with synchronization requirements in the multimodal service based on the indication message, which facilitates meeting the latency synchronization requirements during data transmission or scheduling and improves the user experience.

[0040] In conjunction with the embodiments of the first aspect, in some embodiments, the first device or the second device satisfies one of the following:

[0041] In uplink data transmission, the first device is the terminal, and the second device is the access network device;

[0042] In uplink data transmission, the first device is the access network device, and the second device is the core network device;

[0043] In downlink data transmission, the first device is the core network device, and the second device is the access network device;

[0044] In uplink or downlink data transmission, the first device and the second device are different units in the access network equipment;

[0045] In uplink or downlink data transmission, the first device and the second device are different access network devices.

[0046] In the above embodiments, the first device or the second device can be multiple in different scenarios, so that the sequence number of the multimodal service data packet can be indicated in different communication scenarios to ensure time delay synchronization.

[0047] In conjunction with the embodiments of the first aspect, in some embodiments, the indication information includes a first information field for indicating a sequence number, wherein the length of the first information field is multiple bits.

[0048] In the above embodiments, the indication information can be used to dynamically indicate the sequence number of the corresponding data packet in order to indicate the latency synchronization requirements of the data packet.

[0049] In conjunction with the embodiments of the first aspect, in some embodiments, the value of the sequence number is within the range of [first value, second value]; wherein, when the number of data packets is greater than the second value, the sequence number wraps back to the first value to start counting again.

[0050] The above embodiments illustrate possible values ​​for the serial number to meet the serial number counting requirements.

[0051] In conjunction with the embodiments of the first aspect, in some embodiments, the header of the data packet includes a second information field, which is used to indicate the length of the first information field corresponding to the data packet.

[0052] In the above embodiments, the length of the first information field can be dynamically indicated in the data packet, so that the receiving end can process the information of the first information field according to the second information field.

[0053] In conjunction with the embodiments of the first aspect, in some embodiments, first configuration information sent by a second device is received, the first configuration information being used to configure the length of a first information field; wherein the first device is a terminal and the second device is an access network device.

[0054] In the above embodiments, when the first device is a terminal, it can obtain the length of the first information field through network configuration, thereby reasonably allocating the serial number.

[0055] In conjunction with the embodiments of the first aspect, in some embodiments, the multimodal service includes multiple data streams, and in a first data stream of the multiple data streams, the sequence numbers of multiple data packets correspond to the timing of the multiple data packets.

[0056] In the above embodiments, a main data stream can be selected from multiple data streams, and sequence numbers can be assigned to the data packets therein in a time sequence.

[0057] In conjunction with the embodiments of the first aspect, in some embodiments, in a second data stream of multiple data streams, the sequence number of multiple data packets is determined based on the sequence number of data packets in the first data stream.

[0058] In the above embodiments, the sequence number of the data packets of the second data stream can be determined based on the sequence number of the first data stream, and the synchronization requirements can be determined.

[0059] In conjunction with the embodiments of the first aspect, in some embodiments, the first data stream satisfies one of the following:

[0060] The first data stream is determined based on the data types of the multiple data streams;

[0061] The first data stream is determined based on the period of multiple data streams;

[0062] The first data stream is determined based on the second configuration information sent by the second device. The second configuration information is used to configure the selection method of the first data stream. The first device is a terminal, and the second device is an access network device.

[0063] The above embodiments illustrate the method of selecting the first data stream in order to allocate sequence numbers reasonably.

[0064] In conjunction with the embodiments of the first aspect, in some embodiments, the sequence number of each data packet in the second data stream is determined based on the sequence number of the data packet with the closest time-domain position in the first data stream.

[0065] The above embodiments illustrate a method for determining the sequence number of data packets in the second data stream.

[0066] In conjunction with the embodiments of the first aspect, in some embodiments, the sequence number of the data packets in the second data stream satisfies one of the following:

[0067] The sequence number of the data packet with the closest time domain position in the first data stream;

[0068] It is the sequence number of the data packet with the closest time domain position in the first data stream, and the data packet with the closest time domain position is located before the data packet in the second data stream;

[0069] It is the sequence number of the data packet with the closest time domain position in the first data stream, and the data packet with the closest time domain position is located after the data packet in the second data stream;

[0070] It is determined based on the third configuration information sent by the second device. The third configuration information is used to configure the method for determining the sequence number of data packets in the second data stream; wherein, the first device is the terminal and the second device is the access network device.

[0071] In conjunction with the embodiments of the first aspect, in some embodiments, the indication information is also used to indicate at least one of the following: service identifier, group identifier, and flow identifier;

[0072] Among them, the service identifier is used to indicate multiple data streams associated with the multimodal service, the group identifier is used to indicate a multimodal group consisting of data streams with synchronization requirements in the multimodal service, and the stream identifier is used to indicate data streams with synchronization requirements in the multimodal service.

[0073] In the above embodiments, the indication information may indicate other information about the multimodal service.

[0074] In conjunction with the embodiments of the first aspect, in some embodiments, different group identifiers correspond to different multimodal groups, and the indication information is used to indicate: the sequence number corresponding to the data packets of different data streams in the same multimodal group indicated by any group identifier; wherein, the data packets in different data streams with the same sequence number meet the time delay synchronization requirements corresponding to the multimodal group.

[0075] In the above embodiments, the serial number indication can be applied to a single multimodal group.

[0076] In conjunction with the embodiments of the first aspect, in some embodiments, the method further includes:

[0077] The device receives fourth configuration information sent by the second device. The fourth configuration information is used to configure the method of obtaining multimodal groups for data stream packets, and / or the correspondence between group identifiers and data streams; wherein, the first device is a terminal and the second device is an access network device.

[0078] In the above embodiments, the terminal can learn the correspondence between the grouping method or the group identifier based on the network configuration.

[0079] In conjunction with the embodiments of the first aspect, in some embodiments, the indication information is used to indicate the sequence number corresponding to the data packets of all data streams in the multimodal service.

[0080] In the above embodiments, the serial number indication can be applied to all data streams.

[0081] In conjunction with the embodiments of the first aspect, in some embodiments, the indication information is sent together with the Quality of Service (QoS) flow identifier (QFI) of the data packet; wherein the data stream of the multimodal service and the QoS flow have a mapping relationship.

[0082] In conjunction with the embodiments of the first aspect, in some embodiments, the indication information satisfies at least one of the following:

[0083] The User Plane Tunneling Protocol GTP-U extension header includes indication information;

[0084] The header of the Service Data Adaptation Protocol (SDAP) includes indication information.

[0085] In the above embodiments, different methods of sending indication information can be applied to different communication scenarios or communication objects.

[0086] In conjunction with the embodiments of the first aspect, in some embodiments, the method further includes:

[0087] The device receives the fifth configuration information sent by the second device. The fifth configuration information is used to configure the format of the SDAP packet header. The first device is a terminal and the second device is an access network device.

[0088] In the above embodiments, the terminal can learn the format of the SDAP packet header based on the network configuration, and thus transmit the SDAP packet header according to the format configured by the network.

[0089] In conjunction with the embodiments of the first aspect, in some embodiments, the fifth configuration information includes at least one of the following:

[0090] Information used to indicate whether to transmit instruction information;

[0091] This is used to indicate whether the above-mentioned indication information includes service identifier information;

[0092] Used to indicate whether the above indication information includes group identifier information;

[0093] This is used to indicate whether the above indication information includes information about the flow identifier.

[0094] In conjunction with the embodiments of the first aspect, in some embodiments, the method further includes:

[0095] Receive a switching command sent by the second device. The switching command is used to indicate whether to change the format of the SDAP packet header.

[0096] In the above embodiments, the terminal can determine whether it needs to change the SDAP packet header format according to the instructions of the network.

[0097] In conjunction with the embodiments of the first aspect, in some embodiments, the SDAP header includes a third information field, which is used to indicate whether indication information is transmitted in the SDAP header.

[0098] In the above embodiments, the third information in the SDAP packet header can be used to dynamically indicate whether to transmit indication information.

[0099] In conjunction with the embodiments of the first aspect, in some embodiments, the data streams included in the multimodal service correspond to the same data source or different data sources.

[0100] In conjunction with the embodiments of the first aspect, in some embodiments, multiple data packets in a multimodal service belong to the same Protocol Data Unit (PDU) set, indicating that the information is transmitted in one of the multiple data packets, or in each of the multiple data packets.

[0101] In conjunction with the embodiments of the first aspect, in some embodiments, the method further includes:

[0102] The device receives the sixth configuration information sent by the second device. The sixth configuration information is used to configure the transmission mode of the indication information corresponding to the data packets in the PDU set. The first device is a terminal and the second device is an access network device.

[0103] In the above embodiments, the terminal can learn the transmission method of PDU centralized indication information based on network configuration.

[0104] Secondly, embodiments of this disclosure provide a communication method executed by a second device, the method comprising:

[0105] The system receives indication information sent by the first device. The indication information is used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets with the same sequence number.

[0106] In conjunction with the embodiments of the second aspect, in some embodiments, the first device or the second device satisfies one of the following:

[0107] In uplink data transmission, the first device is the terminal, and the second device is the access network device;

[0108] In uplink data transmission, the first device is the access network device, and the second device is the core network device;

[0109] In downlink data transmission, the first device is the core network device, and the second device is the access network device;

[0110] In uplink or downlink data transmission, the first device and the second device are different units in the access network equipment;

[0111] In uplink or downlink data transmission, the first device and the second device are different access network devices.

[0112] In conjunction with embodiments of the second aspect, in some embodiments, the indication information includes a first information field for indicating a sequence number, wherein the length of the first information field is multiple bits.

[0113] In conjunction with the embodiments of the second aspect, in some embodiments, the value of the sequence number is within the range of [first value, second value]; wherein, when the number of data packets is greater than the second value, the sequence number wraps back to the first value to start counting again.

[0114] In conjunction with the embodiments of the second aspect, in some embodiments, the header of the data packet includes a second information field, which is used to indicate the length of the first information field corresponding to the data packet.

[0115] In conjunction with the embodiments of the second aspect, in some embodiments, first configuration information is sent to a first device, the first configuration information being used to configure the length of a first information field; wherein the first device is a terminal and the second device is an access network device.

[0116] In conjunction with the embodiments of the second aspect, in some embodiments, the multimodal service includes multiple data streams, and in a first data stream of the multiple data streams, the sequence number of multiple data packets corresponds to the timing of the multiple data packets.

[0117] In conjunction with the embodiments of the second aspect, in some embodiments, in the second data stream of a plurality of data streams, the sequence number of a plurality of data packets is determined based on the sequence number of data packets in the first data stream.

[0118] In conjunction with embodiments of the second aspect, in some embodiments, the first data stream satisfies one of the following:

[0119] The first data stream is determined based on the data types of the multiple data streams;

[0120] The first data stream is determined based on the period of multiple data streams;

[0121] The first data stream is determined based on the second configuration information, which is used to configure the selection method of the first data stream; wherein, the first device is a terminal and the second device is an access network device.

[0122] In conjunction with the embodiments of the second aspect, in some embodiments, the sequence number of each data packet in the second data stream is determined based on the sequence number of the data packet with the closest time domain position in the first data stream.

[0123] In conjunction with the embodiments of the second aspect, in some embodiments, the sequence number of the data packets in the second data stream satisfies one of the following:

[0124] The sequence number of the data packet with the closest time domain position in the first data stream;

[0125] It is the sequence number of the data packet with the closest time domain position in the first data stream, and the data packet with the closest time domain position is located before the data packet in the second data stream;

[0126] It is the sequence number of the data packet with the closest time domain position in the first data stream, and the data packet with the closest time domain position is located after the data packet in the second data stream;

[0127] It is determined based on the third configuration information sent by the second device. The third configuration information is used to configure the method for determining the sequence number of data packets in the second data stream; wherein, the first device is the terminal and the second device is the access network device.

[0128] In conjunction with the embodiments of the second aspect, in some embodiments, the indication information is also used to indicate at least one of the following: service identifier, group identifier, and flow identifier;

[0129] Among them, the service identifier is used to indicate multiple data streams associated with the multimodal service, the group identifier is used to indicate a multimodal group consisting of data streams with synchronization requirements in the multimodal service, and the stream identifier is used to indicate data streams with synchronization requirements in the multimodal service.

[0130] In conjunction with the embodiments of the second aspect, in some embodiments, different group identifiers correspond to different multimodal groups, and the indication information is used to indicate: the sequence number corresponding to the data packets of different data streams in the same multimodal group indicated by any group identifier; wherein, the data packets in different data streams with the same sequence number meet the time delay synchronization requirements corresponding to the multimodal group.

[0131] In conjunction with the embodiments of the second aspect, in some embodiments, the method further includes:

[0132] Send fourth configuration information to the first device. The fourth configuration information is used to configure the method of obtaining multimodal groups for data stream packets, and / or the correspondence between group identifiers and data streams; wherein, the first device is a terminal and the second device is an access network device.

[0133] In conjunction with the embodiments of the second aspect, in some embodiments, the indication information is used to indicate the sequence number corresponding to the data packets of all data streams in the multimodal service.

[0134] In conjunction with the embodiments of the second aspect, in some embodiments, the indication information is sent together with the Quality of Service (QoS) flow identifier (QFI) of the data packet; wherein the data stream of the multimodal service and the QoS flow have a mapping relationship.

[0135] In conjunction with the embodiments of the second aspect, in some embodiments, the indication information satisfies at least one of the following:

[0136] The User Plane Tunneling Protocol GTP-U extension header includes indication information;

[0137] The header of the Service Data Adaptation Protocol (SDAP) includes indication information.

[0138] In conjunction with the embodiments of the second aspect, in some embodiments, the method further includes:

[0139] Send fifth configuration information to the first device. The fifth configuration information is used to configure the format of the SDAP packet header. The first device is the terminal and the second device is the access network device.

[0140] In conjunction with the embodiments of the second aspect, in some embodiments, the fifth configuration information includes at least one of the following:

[0141] Information used to indicate whether to transmit instruction information;

[0142] This is used to indicate whether the above-mentioned indication information includes service identifier information;

[0143] Used to indicate whether the above indication information includes group identifier information;

[0144] This is used to indicate whether the above indication information includes information about the flow identifier.

[0145] In conjunction with the embodiments of the second aspect, in some embodiments, the method further includes:

[0146] A switching command is sent to the first device. The switching command is used to indicate whether to change the format of the SDAP packet header.

[0147] In conjunction with the embodiments of the second aspect, in some embodiments, the SDAP header includes a third information field, which is used to indicate whether indication information is transmitted in the SDAP header.

[0148] In conjunction with the embodiments of the second aspect, in some embodiments, the data streams included in the multimodal service correspond to the same data source or different data sources.

[0149] In conjunction with the embodiments of the second aspect, in some embodiments, multiple data packets in a multimodal service belong to the same Protocol Data Unit (PDU) set, indicating that the information is transmitted in one of the multiple data packets, or in each of the multiple data packets.

[0150] In conjunction with the embodiments of the second aspect, in some embodiments, the method further includes:

[0151] The sixth configuration information is sent to the first device. The sixth configuration information is used to configure the transmission method of the indication information corresponding to the data packets in the PDU set; wherein, the first device is a terminal and the second device is an access network device.

[0152] In conjunction with the embodiments of the second aspect, in some embodiments, the method further includes:

[0153] The sequence number of the data packet is determined based on the reception time of the data packet in the multimodal service; wherein the first device is a terminal, the second device is an access network device, and the first device does not transmit indication information in the uplink data transmission.

[0154] Thirdly, embodiments of this disclosure provide a communication device, including:

[0155] The transceiver module is used to send indication information to the second device. The indication information is used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets with the same sequence number.

[0156] Fourthly, embodiments of this disclosure provide a communication device, including:

[0157] The transceiver module is used to receive indication information sent by the first device. The indication information is used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets with the same sequence number.

[0158] Fifthly, embodiments of this disclosure provide a communication device, including:

[0159] One or more processors;

[0160] The communication device is configured to implement the method described in the first aspect or the second aspect.

[0161] Sixthly, embodiments of this disclosure provide a communication system, including a first device and a second device, wherein,

[0162] The first device is configured to implement the method described in the first aspect;

[0163] The second device is configured to implement the method described in the second aspect.

[0164] In a seventh aspect, embodiments of this disclosure provide a storage medium storing instructions, wherein...

[0165] When the instructions are executed on the communication device, the communication device causes the communication device to perform the method as described in the first aspect or the second aspect.

[0166] Eighthly, embodiments of this disclosure provide a program product, wherein,

[0167] When the program product is executed by a communication device, the communication device performs the method described in the first aspect or the second aspect.

[0168] In a ninth aspect, embodiments of this disclosure provide a computer program that, when run on a computer, causes the computer to perform the methods described in alternative implementations of the first and second aspects.

[0169] In a tenth aspect, embodiments of this disclosure provide a chip or chip system. The chip or chip system includes processing circuitry configured to perform the methods described according to optional implementations of the first and second aspects above.

[0170] It is understood that the aforementioned terminals, network devices, communication systems, storage media, program products, computer programs, chips, or chip systems are all used to execute the methods proposed in the embodiments of this disclosure. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here.

[0171] This disclosure is not exhaustive, but merely illustrative of some embodiments, and is not intended to limit the scope of protection of this disclosure. Unless otherwise specified, each step in a particular embodiment can be implemented as an independent embodiment, and the steps can be arbitrarily combined. For example, a solution after removing some steps in a particular embodiment can also be implemented as an independent embodiment, and the order of the steps in a particular embodiment can be arbitrarily interchanged. Furthermore, the optional implementation methods in a particular embodiment can be arbitrarily combined; moreover, the embodiments can be arbitrarily combined, for example, some or all steps of different embodiments can be arbitrarily combined, and a particular embodiment can be arbitrarily combined with the optional implementation methods of other embodiments.

[0172] In each of the disclosed embodiments, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions of the embodiments are consistent and can be referenced by each other. Technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships.

[0173] The terminology used in the embodiments of this disclosure is for the purpose of describing particular embodiments only and is not intended to limit the scope of this disclosure.

[0174] In this disclosure, unless otherwise stated, elements expressed in the singular form, such as "a," "an," "the," "the," "the," "the," "the," "the," "this," etc., can mean "one and only one," or "one or more," "at least one," etc. For example, when using articles such as "a," "an," "the," etc. in translation, the noun following the article can be understood as either a singular or a plural expression.

[0175] In the embodiments disclosed herein, "multiple" refers to two or more.

[0176] In some embodiments, the terms “at least one of”, “one or more”, “a plurality of”, “multiple”, etc., may be used interchangeably.

[0177] In some embodiments, the notation "at least one of A and B", "A and / or B", "A in one case, B in another", "in response to one case A, in response to another case B", etc., may include the following technical solutions depending on the situation: in some embodiments, A (execute A regardless of B); in some embodiments, B (execute B regardless of A); in some embodiments, execution is selected from A and B (A and B are selectively executed); in some embodiments, A and B (both A and B are executed). The same applies when there are more branches such as A, B, C, etc.

[0178] In some embodiments, the notation "A or B" may include the following technical solutions, depending on the situation: in some embodiments, A (execution of A regardless of B); in some embodiments, B (execution of B regardless of A); in some embodiments, execution is selected from A and B (A and B are selectively executed). The same applies when there are more branches such as A, B, C, etc.

[0179] The prefixes "first," "second," etc., used in the embodiments of this disclosure are merely for distinguishing different descriptive objects and do not impose restrictions on the position, order, priority, quantity, or content of the descriptive objects. The description of the descriptive objects is found in the claims or the context of the embodiments, and the use of prefixes should not constitute unnecessary restrictions. For example, if the descriptive object is a "field," the ordinal numbers preceding "field" in "first field" and "second field" do not restrict the position or order of the "fields." "First" and "second" do not restrict whether the "fields" they modify are in the same message, nor do they restrict the order of "first field" and "second field." Similarly, if the descriptive object is a "level," the ordinal numbers preceding "level" in "first level" and "second level" do not restrict the priority between "levels." Furthermore, the number of descriptive objects is not limited by ordinal numbers and can be one or more. For example, in "first device," the number of "devices" can be one or more. Furthermore, the objects modified by different prefixes can be the same or different. For example, if the object being described is "device", then "first device" and "second device" can be the same device or different devices, and their types can be the same or different. Similarly, if the object being described is "information", then "first information" and "second information" can be the same information or different information, and their content can be the same or different.

[0180] In some embodiments, “including A,” “containing A,” “for indicating A,” and “carrying A” can be interpreted as directly carrying A or indirectly indicating A.

[0181] In some embodiments, the terms “in response to…”, “in response to determining…”, “in the case of…”, “when…”, “if…”, “if…”, etc., can be used interchangeably.

[0182] In some embodiments, the terms “greater than,” “greater than or equal to,” “not less than,” “more than,” “more than or equal to,” “not less than,” “higher than,” “higher than or equal to,” “not lower than,” and “above” can be used interchangeably, as can the terms “less than,” “less than or equal to,” “not greater than,” “less than,” “less than or equal to,” “not more than,” “lower than,” “lower than or equal to,” “not higher than,” and “below”.

[0183] In some embodiments, the apparatus and device may be interpreted as physical or virtual, and their names are not limited to the names recorded in the embodiments. In some cases, they may also be understood as "equipment", "device", "circuit", "network element", "node", "function", "unit", "section", "system", "network", "chip", "chip system", "entity", "body", etc.

[0184] In some embodiments, "network" can be interpreted as devices included in the network, such as access network devices, core network devices, etc.

[0185] In some embodiments, "access network device (AN device)" may also be referred to as "radio access network device (RAN device)," "base station (BS)," "radio base station," or "fixed station." In some embodiments, it may also be understood as "node," "access point," "transmission point (TP)," "reception point (RP)," "transmission / reception point (TRP)," "panel," "antenna panel," "antenna array," "cell," "macro cell," "small cell," "femto cell," "pico cell," "sector," "cell group," "serving cell," "carrier," "component carrier," or "bandwidth part (BWP)."

[0186] In some embodiments, "terminal" or "terminal device" may be referred to as "user equipment (UE)," "user terminal," "mobile station (MS)," "mobile terminal (MT)," "subscriber station," "mobile unit," "subscriber unit," "wireless unit," "remote unit," "mobile device," "wireless device," "wireless communication device," "remote device," "mobile subscriber station," "access terminal," "mobile terminal," "wireless terminal," "remote terminal," "handset," "user agent," "mobile client," "client," etc.

[0187] In some embodiments, the acquisition of data, information, etc., may comply with the laws and regulations of the country where the location is situated.

[0188] In some embodiments, data, information, etc., may be obtained with the user's consent.

[0189] Furthermore, each element, each row, or each column in the table of this disclosure can be implemented as an independent embodiment, and any combination of any element, any row, or any column can also be implemented as an independent embodiment.

[0190] Figures 1a and 1b are schematic diagrams of the architecture of a communication system according to embodiments of the present disclosure.

[0191] As shown in Figure 1a, the communication system 100 includes a first device 101 and a second device 102. The first device 101 may be a terminal, an access network device, or a core network device; the second device 102 may be an access network device or a core network device. The access network device and the core network device can be collectively referred to as network devices.

[0192] Referring to the communication architecture shown in Figure 1b, the terminal can connect to the core network equipment through the access network equipment.

[0193] The control plane and user plane each have their own protocol stack structures, and devices communicate with each other based on these stacks. For example, the control plane's protocol stack structure may include: Radio Resource Control (RRC) layer, Packet Data Convergence Protocol (PDCP) layer, RLC layer, Media Access Control (MAC) layer, and Physical Layer (PHY). The user plane's protocol stack structure may include: Service Data Adaptation Protocol (SDAP) layer, PDCP layer, RLC layer, MAC layer, and Physical Layer.

[0194] In some embodiments, the terminal includes, but is not limited to, at least one of the following: mobile phone, wearable device, Internet of Things device, car with communication function, smart car, tablet computer, computer with wireless transceiver function, virtual reality (VR) terminal device, augmented reality (AR) terminal device, wireless terminal device in industrial control, wireless terminal device in self-driving, wireless terminal device in remote medical surgery, wireless terminal device in smart grid, wireless terminal device in transportation safety, wireless terminal device in smart city, and wireless terminal device in smart home.

[0195] In some embodiments, the access network device is, for example, a node or device that connects a terminal to a wireless network. The access network device may include, but is not limited to, at least one of the following in a 5G communication system: evolved Node B (eNB), next-generation eNB (ng-eNB), next-generation Node B (gNB), node B (NB), home node B (HNB), home evolved node B (HeNB), wireless backhaul device, radio network controller (RNC), base station controller (BSC), base transceiver station (BTS), base band unit (BBU), mobile switching center, base station in a 6G communication system, open RAN, cloud RAN, base station in other communication systems, and access node in a wireless fidelity (WiFi) system.

[0196] In some embodiments, the technical solutions of this disclosure can be applied to the Open RAN architecture. In this case, the interfaces between or within access network devices involved in the embodiments of this disclosure can be transformed into internal interfaces of Open RAN. The processes and information interactions between these internal interfaces can be implemented by software or programs.

[0197] In some embodiments, the access network device may be composed of a central unit (CU) and a distributed unit (DU). The CU may also be called a control unit. The CU-DU structure can separate the protocol layer of the access network device. Some of the protocol layer functions are centrally controlled by the CU, while the remaining part or all of the protocol layer functions are distributed in the DU and centrally controlled by the CU. However, this is not the only possibility.

[0198] In some embodiments, a core network device can be a single device comprising one or more network elements, or it can be multiple devices or a group of devices, each comprising all or part of one or more network elements. Network elements can be virtual or physical. The core network includes, for example, at least one of the Evolved Packet Core (EPC), 5G Core Network (5GCN), and Next Generation Core (NGC). Alternatively, a core network device refers to a network element with a specific function, such as an Access Management Function (AMF), Service Management Function (SMF), or User Plane Function (UPF).

[0199] It is understood that the communication system described in this disclosure is for the purpose of more clearly illustrating the technical solutions of this disclosure, and does not constitute a limitation on the technical solutions provided in this disclosure. As those skilled in the art will know, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in this disclosure are also applicable to similar technical problems.

[0200] The following embodiments of this disclosure can be applied to the communication system 100 shown in FIG1a, or to a part thereof, but are not limited thereto.

[0201] The entities shown in Figure 1a are illustrative. The communication system may include all or some of the entities in Figure 1a, or it may include other entities besides those in Figure 1a. The number and form of each entity are arbitrary. The connection relationship between the entities is illustrative. The entities may not be connected to each other or may be connected in any way. The connection may be direct or indirect, wired or wireless.

[0202] The embodiments disclosed herein can be applied to Long Term Evolution (LTE), LTE-Advanced (LTE-A), LTE-Beyond (LTE-B), SUPER 3G, IMT-Advanced, 4th generation mobile communication system (4G), 5th generation mobile communication system (5G), 5G new radio (NR), Future Radio Access (FRA), New-Radio Access Technology (RAT), New Radio (NR), New radio access (NX), Future generation radio access (FX), Global System for Mobile communications (GSM), CDMA2000, Ultra Mobile Broadband (UMB), IEEE 802.11 (Wi-Fi), IEEE 802.16 (WiMAX), and IEEE 802.20, Ultra-Wideband (UWB), Bluetooth (a registered trademark), Public Land Mobile Network (PLMN) networks, Device-to-Device (D2D) systems, Machine-to-Machine (M2M) systems, Internet of Things (IoT) systems, Vehicle-to-Everything (V2X) systems, systems utilizing other communication processing methods, and next-generation systems built upon them, etc. Furthermore, multiple systems can be combined (e.g., a combination of LTE or LTE-A with 5G).

[0203] In multimodal services, a lack of latency synchronization between different media components will negatively impact user experience, such as viewers noticing a lack of synchronization. Furthermore, the network lacks an effective mechanism to ensure the synchronization of related multimodal data during data transmission.

[0204] Figure 2a is an interactive schematic diagram of a communication method according to an embodiment of the present disclosure. As shown in Figure 2a, the present disclosure relates to a communication method, which includes:

[0205] In step S2101, the first device 101 sends an instruction message to the second device 102.

[0206] In some embodiments, the indication information is used to indicate the sequence number (SN) corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets with the same sequence number.

[0207] Alternatively, the serial number can also be called a multimodal serial number. The serial number can be an ordered natural number, such as 0, 1, 2, etc.

[0208] Optionally, the requirement for time synchronization between different data packets with the same sequence number can mean that these different data packets need to maintain time synchronization. For example, two or more data packets with the same sequence number need to maintain time synchronization. Specifically, if the time delay between different data packets is less than or equal to the time synchronization threshold, the different data packets are considered to be in time synchronization. If the time delay between different data packets is greater than the time synchronization threshold, the different data packets are considered to be out of time or lack synchronization.

[0209] Optionally, the indication information can be understood as information used to indicate the synchronization relationship of multimodal data packets.

[0210] In some embodiments, a multimodal service may include multiple data streams, and each data stream may include multiple data packets. Data packets with the same sequence number belong to different data streams. These data streams may also be referred to as multimodal data streams.

[0211] In some embodiments, the aforementioned multiple data streams may correspond to different data types, and each type of data stream can be considered a media component. The data types may include at least one of the following:

[0212] Video (visual) data, also known as video media data;

[0213] Audio data, also known as audio media data;

[0214] Test data;

[0215] Tactile data;

[0216] The detection data can be environmental information received by the sensor, such as temperature, brightness, or humidity. Tactile data can be sensory data when touching the surface of the device, such as pressure, texture, vibration, or temperature, or motion sensory data, such as gravity, tension, or position.

[0217] The data types mentioned above are for illustrative purposes only. Data streams may also include other types of data or be distinguished using other classification methods.

[0218] In some embodiments, the latency synchronization threshold differs depending on the data type. The latency synchronization threshold that needs to be met between data packets of different data types can be determined based on the protocol definition.

[0219] For example, the protocol defines the audio-video latency synchronization thresholds supported by 5G systems to support Virtual Reality (VR) environments, where audio delay is within the range of 125ms to 5ms and audio advanced is within the range of 45ms to 5ms.

[0220] For example, the protocol defines typical synchronization thresholds for immersive multi-modality VR applications, as shown in Table 1.

[0221] Table 1

[0222] In some embodiments, the first device 101 may be the sender of multimodal data, and indication information may be transmitted along with the multimodal data transmission. The second device 102 may be the receiver of multimodal data. For example, the first device 101 may add indication information to a data packet and send the data packet carrying the indication information to the second device 102.

[0223] In some embodiments, end-to-end communication needs to meet the above-mentioned time delay synchronization requirements. Each hop between the two endpoints of the application layer communication link, i.e. the transmission channel of adjacent nodes in the communication link, should consider the time delay synchronization requirements. In particular, the time delay synchronization requirements need to be met at the last hop of the communication link, such as the data receiver in the application layer.

[0224] Optionally, in a wireless communication network, for downlink data transmission, since the transmission between the access network device (e.g., gNB) and the terminal is the last hop of the communication link, the scheduler of the access network device should meet the above-mentioned delay synchronization requirements.

[0225] In the first example, during downlink data transmission, the first device 101 is a core network device, and the second device 102 is an access network device. That is, the access network device needs to obtain indication information from the core network device (e.g., UPF) to understand the synchronization relationship of multimodal data packets, such as obtaining the multimodal sequence number of the data packets.

[0226] Optionally, for uplink data transmission, although the access network device and the core network device are not the last hop of the communication link during uplink transmission, the access network device and the core network device (e.g., UPF) still need to obtain the synchronization relationship of multimodal data packets to meet the latency synchronization requirements. The terminal and the access network device also need to meet the latency synchronization requirements.

[0227] In the second example, during uplink data transmission, the first device 101 is a terminal and the second device 102 is an access network device. That is, the access network device obtains indication information from the terminal to know the synchronization relationship of the multimodal data packets, such as the multimodal sequence number of the data packets.

[0228] In the third example, during uplink data transmission, the first device 101 is an access network device and the second device 102 is a core network device. That is, the core network device obtains indication information from the access network device to know the synchronization relationship of the multimodal data packets, such as the multimodal sequence number of the data packets.

[0229] In the fourth example, during uplink or downlink data transmission, the first device 101 and the second device 102 are different units within the access network device. For example, during data transmission, the Centralized Unit (CU) and Distributed Unit (DU) within the access network device gNB can forward data via the F1-U interface. In this example, the first device 101 is the CU and the second device 102 is the DU; or, the first device 101 is the DU and the second device 102 is the CU.

[0230] In the fifth example, during uplink or downlink data transmission, the first device 101 and the second device 102 are different access network devices. For example, during data transmission, data forwarding occurs between different access network devices; the first device 101 could be access network device 1, and the second device 101 could be access network device 102.

[0231] In some embodiments, the data streams included in the multimodal service correspond to the same data source or different data sources.

[0232] For example, data streams for multimodal services can originate from different data sources, such as a single UE, a single device, multiple devices connected to a single UE, or multiple UEs. In the case where the data source originates from a single UE, multiple data streams for the same multimodal service can be transmitted within the same Protocol Data Unit (PDU) session.

[0233] In this embodiment, the indication information, or the information on the synchronization relationship of multimodal data packets, is applicable to situations where the data stream of a multimodal service comes from different data sources, such as a single UE, a single device, multiple devices connected to a single UE, or multiple UEs.

[0234] In some embodiments, multiple data packets in a multimodal service belong to the same Protocol Data Unit (PDU) set, indicating that information is transmitted in one of the multiple data packets, or in each of the multiple data packets.

[0235] Optionally, the terminal can learn the transmission method of the PDU set indication information based on the network configuration, as detailed in the description of step S2207 in the embodiment corresponding to Figure 2b.

[0236] In multimodal services, when several data packets belong to the same PDU set, the indication information, or the synchronization relationship information of the multimodal data packets, can be transmitted in a single data packet, or in multiple or all data packets within the PDU set. In the PDU set-based QoS processing mechanism, a PDU set refers to a single information unit (e.g., a frame or video clip from an extended reality (XR) service) generated at the application layer.

[0237] In some embodiments, the indication information includes a first information field for indicating a sequence number, wherein the length of the first information field is multiple bits.

[0238] Optionally, the length of the first information field may be several bits (not an integer multiple of 8 bits), or the first information field may be one or more bytes.

[0239] For example, the length of the first information field can be 1 byte (8 bits), or the length of the first information field can be 2 bytes (16 bits). The first information field can indicate the sequence number using different bit values.

[0240] Optionally, the sequence number can be within the range of [first value, second value]; wherein, when the number of data packets is greater than the second value, the sequence number is wrapped around to the first value and counted again.

[0241] The first value is the minimum value of the sequence number, which can be 0 or 1. The multimodal sequence number has a maximum value, and the second value is the maximum value of the sequence number.

[0242] In one example, the first information field is 1 byte long, with a first value of 0 and a second value of 255. The multimodal sequence number ranges from 0 to 255. When the multimodal sequence number is 255 and needs to be incremented, the next sequence number will be 0, and a new round of sequence numbering will begin from 0 to 255.

[0243] In another example, the length of the first information field is 2 bytes, the first value is 0, the second value is 65535, and the multimodal sequence number ranges from 0 to 65535.

[0244] In the two examples above, since data packets with the same sequence number have a time delay synchronization requirement, a suitable range of sequence number values ​​or a sufficiently large range of sequence number values ​​can prevent confusion that may occur when the sequence number wraps around. That is, there is a sufficient time interval between data packets with the same sequence number for new and old data, which can avoid the assumption that new data and old data with the same multimodal sequence number value have a time delay synchronization requirement.

[0245] In some embodiments, the header of the data packet includes a second information field, which is used to indicate the length of the first information field corresponding to the data packet.

[0246] Based on the description of the foregoing embodiments, when the length of the first information field has multiple possibilities, such as being 1 byte or 2 bytes, each data packet can dynamically indicate the length of the first information field in the packet header. For example, the second information field occupies 1 bit; when the value of this 1 bit is 1, it indicates that the length of the first information field is 1 byte, and when the value of this 1 bit is 0, it indicates that the length of the first information field is 2 bytes.

[0247] For the terminal, it can know the length of the first information field based on the network configuration, as detailed in the description of step S2201 in the embodiment corresponding to Figure 2b.

[0248] In some embodiments, the indication information is also used to indicate at least one of the following: service identifier, group identifier, and flow identifier;

[0249] Among them, the service identifier is used to indicate multiple data streams associated with the multimodal service, the group identifier is used to indicate a multimodal group consisting of data streams with synchronization requirements in the multimodal service, and the stream identifier is used to indicate data streams with synchronization requirements in the multimodal service.

[0250] Optionally, the service identifier can also be called a multi-modal service ID, used to explicitly indicate that multiple data streams are associated with a multi-modal service. The group identifier can also be called a multi-modal group identifier, and the flow identifier can also be called a multi-modal flow identifier. Within the same multi-modal service, data packets with the same multi-modal sequence number in related data streams sometimes require latency synchronization. The multi-modal service identifier is used to indicate that multiple data streams are associated with a multi-modal service. The multi-modal group identifier is used to identify the group of multi-modal data streams that have synchronization requirements within a multi-modal service. The multi-modal flow identifier is used to identify the individual multi-modal data streams that have synchronization requirements within a multi-modal service.

[0251] Optionally, corresponding to the foregoing embodiments, the data streams included in the multimodal service may correspond to the same data source or different data sources. A multimodal service identifier corresponding to a multimodal service may correspond to a single UE, a single device, multiple devices connected to a single UE, or multiple UEs, etc.

[0252] In some embodiments, different group identifiers correspond to different multimodal groups, and the indication information is used to indicate: the sequence number of data packets of different data streams in the same multimodal group indicated by any group identifier; wherein, data packets in different data streams with the same sequence number meet the time delay synchronization requirements corresponding to the multimodal group.

[0253] Within a multimodal service, the synchronization requirements between any two data streams may differ. For example, the protocol defines various synchronization thresholds in the aforementioned embodiments, resulting in synchronization requirements between audio and haptic data streams, as well as between video and haptic data streams, and these requirements vary. In this embodiment, multimodal data streams with synchronization requirements can be grouped into their respective multimodal groups and identified using a multimodal group identifier.

[0254] For example, multimodal group identifier 0 indicates a multimodal group consisting of audio data streams and video data streams, multimodal group identifier 1 indicates a multimodal group consisting of audio data streams and haptic data streams, and multimodal group identifier 2 indicates a multimodal group consisting of video data streams and haptic data streams.

[0255] For the terminal, the correspondence between the group identifier and the data stream can also be obtained through network configuration, as detailed in the description of step S2204 in the embodiment corresponding to Figure 2b.

[0256] When using multimodal group identifiers, the multimodal sequence number of a data packet can be used within a single multimodal group within the same multimodal service. For example, the multimodal sequence number can be incremented sequentially from 0, 1, 2, ... within the multimodal group to indicate the time synchronization correspondence of data packets in multimodal data streams that have synchronization requirements within that multimodal group. The multimodal sequence numbers within a multimodal group can be seen in Figure 2c.

[0257] In some embodiments, the indication information is used to indicate the sequence number corresponding to the data packets of all data streams in the multimodal service.

[0258] Optionally, the use of multimodal group identifiers is optional.

[0259] For example, the indication information does not indicate this group of identifiers. In a multimodal service, the need for latency synchronization is achieved through multimodal stream identifiers and multimodal sequence numbers. The multimodal sequence number can be used by all data streams within the same multimodal service. That is, the multimodal sequence number increases sequentially from 0, 1, 2, ... within the multimodal service to indicate the time synchronization correspondence of data packets of multimodal data streams that have synchronization needs within the multimodal service, as shown in Figure 2c.

[0260] Based on the description of the foregoing embodiments, a multimodal service may include multiple data streams, and the data streams may have different data types.

[0261] In some embodiments, in a first data stream of a plurality of data streams, the sequence numbers of a plurality of data packets correspond to the timing of the plurality of data packets.

[0262] Optionally, the first data stream can be a primary multimodal data stream selected from multiple data streams. During the sequence number allocation process, this primary data stream is used, and each data packet of this multimodal data stream is assigned a multimodal sequence number according to the timing relationship. In the example shown in Figure 2c, the first data stream is an audio data stream.

[0263] In this embodiment, the first data stream is determined based on the data types of multiple data streams. The data types can be found in the descriptions of the preceding embodiments; for example, data types include video, audio, or haptic data. The selection of the first data stream, i.e., the primary multimodal data stream, can follow a fixed selection order based on the data types. For example, following the order of video, audio, and haptic data, if the relevant multimodal data streams are video and audio data streams, then the video data stream is selected as the first data stream, i.e., the primary multimodal data stream.

[0264] Alternatively, the first data stream can be determined based on the period of multiple data streams. For example, the multimodal data stream with the shorter packet period can be used as the first data stream, or the main multimodal data stream.

[0265] Alternatively, the terminal can determine the first data stream through network configuration, as detailed in the description of step S2202 in the embodiment corresponding to Figure 2b.

[0266] In some embodiments, in a second data stream of a plurality of data streams, the sequence numbers of a plurality of data packets are determined based on the sequence numbers of data packets in a first data stream.

[0267] Optionally, the second data stream is used to distinguish it from the first data stream, and the second data stream may also be referred to as a non-primary multimodal data stream. There may be one or more second data streams. The first data stream may have a higher importance or priority than the second data stream.

[0268] In this embodiment, for non-primary multimodal data streams, the multimodal sequence number is determined according to the temporal relationship with the data packets of the primary multimodal data stream.

[0269] In this embodiment, the sequence number of each data packet in the second data stream is determined based on the sequence number of the data packet with the closest time domain position in the first data stream.

[0270] For example, the sequence number of a data packet in the second data stream is the sequence number of the data packet with the closest time domain position in the first data stream.

[0271] Alternatively, the sequence number of the data packet in the second data stream is the sequence number of the data packet with the closest time domain position in the first data stream, and the data packet with the closest time domain position is located before the data packet in the second data stream.

[0272] Alternatively, the sequence number of the data packet in the second data stream is the sequence number of the data packet with the nearest time domain position in the first data stream, and the data packet with the nearest time domain position is located after the data packet in the second data stream.

[0273] Alternatively, the terminal can determine the sequence number of the data packets in the second data stream through network configuration, as detailed in the description of the embodiment corresponding to step S2203 in Figure 2b.

[0274] In one example, referring to Figure 2c, a multimodal service has two data streams: a video stream and an audio stream. The video stream has a frame rate of 60fps, corresponding to a period of 1000 / 60 = 16.7 milliseconds, while the audio stream has a period of 10 milliseconds. Assume that neither data stream has time jitter. Based on the period, when the audio stream is the primary multimodal data stream, the data packets of the audio stream are identified by their sequence numbers according to their timing. For the data packets of the video stream, the sequence numbers are determined based on the closest data packets of the audio stream. For example, the first data packet of the video stream is closest to the first data packet of the audio stream (sequence number 0), therefore the sequence number of the first data packet of the video stream is also 0. The second data packet of the video stream is closest to the third data packet of the audio stream (sequence number 2), therefore the sequence number of the second data packet of the video stream is also 2. The first device 101 and / or the second device 102 should guarantee the latency synchronization requirements for data packets with the same multimodal sequence number.

[0275] In some embodiments, the indication information is sent together with the Quality of Service Flow ID (QFI) of the data packet; wherein the data flow of the multimodal service is mapped to the Quality of Service (QoS) flow.

[0276] In this embodiment, in the multimodal service, the indication information of the synchronization relationship of data packets is indicated together with the QFI of the data packets.

[0277] In this embodiment, multimodal data streams are mapped to QoS streams according to QoS rules. If a QoS stream can only carry data for one multimodal service, the indication information does not need to indicate the multimodal service identifier. If a QoS stream can only carry data for one multimodal group, the indication information does not need to indicate the multimodal group identifier. If a QoS stream can only carry data for one multimodal data stream, the indication information does not need to indicate the multimodal stream identifier.

[0278] In 5G, the QoS model is based on QoS flows. At the Non-Access Stratum (NAS), a QoS flow is the smallest unit of QoS differentiation within a PDU session; a QoS flow is identified by the QFI in the packet header. At the Access Stratum (AS), the Data Radio Bearer (DRB) defines packet processing within the Radio Interface (Uu).

[0279] In one example, the GPRS Tunneling Protocol for the User Plane (GTP-U) extension header includes indicative information.

[0280] Optionally, when multimodal data is transmitted on the NG-U interface, F1-U interface, or Xn-U interface, indication information can be carried in the GTP-U extension header, such as indicating one or more of the following: packet sequence number, multimodal service identifier, multimodal group identifier, and multimodal flow identifier. For example, the above indication information can be carried in DL PDU SESSION INFORMATION frames and UL PDU SESSION INFORMATION frames. Here, the NG-U interface is the user plane interface connecting the gNB and the core network, the F1-U interface is the user plane interface between different units within the gNB, and the Xn-U interface is the user plane interface between gNBs.

[0281] In another example, the SDAP header includes indication information. This example is applicable to scenarios where the first device 101 is a terminal.

[0282] In this example, for the terminal, the format of the SDAP packet header can be determined based on the network configuration, as detailed in the description of steps S2205-S2206 in the embodiment corresponding to Figure 2b. Alternatively, in this example, the SDAP packet header dynamically indicates whether to transmit the aforementioned indication information.

[0283] For example, the SDAP header includes a third information field, which indicates whether indication information is transmitted in the SDAP header. That is, the third information field can be used to indicate whether information regarding the synchronization relationship of multimodal data packets is transmitted in the SDAP header.

[0284] Referring to Figure 2d, the third information field (E) can occupy 1 bit. Taking the indication information including the Multi-Modal Sequence Number (Multi-Modal SN) as an example, the 1 bit of the third information field can be used to indicate whether the Multi-Modal SN has been transmitted, and the Multi-Modal SN field is used to indicate the sequence number. In the example of Figure 2d, a QoS flow can only carry the data of one multi-modal data flow, so the indication information does not need to indicate the multi-modal service identifier, multi-modal group identifier, and multi-modal flow identifier. The third information field can reuse the original reserved (R) bits in the SDAP packet header.

[0285] In some embodiments, the second device 102 receives instruction information.

[0286] In step S2102, the second device 102 transmits data based on the instruction information.

[0287] In some embodiments, the second device 102 can receive data packets and indication information of multimodal services, and perform corresponding scheduling and data transmission according to the indication information, such as ensuring the time synchronization requirement between data packets with the same sequence number.

[0288] In some embodiments, the names of information, etc., are not limited to the names described in the embodiments. Terms such as "information", "message", "signal", "signaling", "report", "configuration", "indication", "instruction", "command", "channel", "parameter", "domain", and "field" can be used interchangeably.

[0289] In some embodiments, “get,” “obtain,” “receive,” “transmit,” “bidirectional transmission,” and “send and / or receive” can be used interchangeably and can be interpreted as receiving from other entities, obtaining from protocols, obtaining from higher layers, obtaining through self-processing, or autonomous implementation, among other meanings.

[0290] In some embodiments, terms such as “send,” “transmit,” “report,” “distribute,” “transfer,” “bidirectional transmission,” “send and / or receive” can be used interchangeably.

[0291] In some embodiments, the terms “radio”, “wireless”, “radio access network (RAN)”, “access network (AN)”, and “RAN-based” can be used interchangeably.

[0292] In some embodiments, terms such as “moment,” “point in time,” “time,” and “time location” can be used interchangeably, as can terms such as “duration,” “segment,” “time window,” “window,” and “time.”

[0293] In some embodiments, the terms "component carrier (CC)," "cell," "frequency carrier," and "carrier frequency" can be used interchangeably.

[0294] In some embodiments, terms such as "certain," "preset," "default," "set," "indicated," "a certain," "any," and "first" can be used interchangeably. "Certain A," "preset A," "default A," "set A," "indicated A," "a certain A," "any A," and "first A" can be interpreted as A pre-defined in a protocol or the like, or as A obtained through setting, configuration, or instruction, or as specific A, a certain A, any A, or first A, but are not limited thereto.

[0295] In some embodiments, the determination or judgment can be made by a value represented by 1 bit (0 or 1), or by a true or false value (boolean), or by a comparison of numerical values ​​(e.g., a comparison with a predetermined value), but is not limited thereto.

[0296] In some embodiments, "not expecting to receive" can be interpreted as not receiving on time domain resources and / or frequency domain resources, or as not performing subsequent processing on the data after receiving it; "not expecting to send" can be interpreted as not sending, or as sending but not expecting the receiver to respond to the sent content.

[0297] The method involved in the embodiments of this disclosure may include at least one of steps S2101 to S2102.

[0298] In some embodiments, other alternative implementations may be described before or after the specification corresponding to FIG2a.

[0299] Figure 2b is an interactive schematic diagram of a communication method according to an embodiment of the present disclosure. As shown in Figure 2b, the present disclosure relates to a communication method, which includes:

[0300] In step S2201, the second device 102 sends the first configuration information to the first device 101.

[0301] In some embodiments, this step may be performed during uplink data transmission, where the first device 101 is a terminal and the second device 102 is an access network device.

[0302] In some embodiments, the first configuration information is used to configure the length of the first information field. The length of the first information field can also be determined through the implementation of step S2101 in FIG2a, which will not be elaborated here.

[0303] In some embodiments, the second device 102 may send the first configuration information via RRC signaling.

[0304] For example, the length of the first information field in the first configuration information is configured to be 1 byte or 2 bytes.

[0305] In some embodiments, the first device 101 receives the first configuration information and learns the length of the first information field.

[0306] In step S2202, the second device 102 sends the second configuration information to the first device 101.

[0307] In some embodiments, this step may be performed during uplink data transmission, where the first device 101 is a terminal and the second device 102 is an access network device.

[0308] In some embodiments, the second configuration information is used to configure the selection method of the first data stream. The selection method of the first data stream can also be determined through the implementation of step S2101 in Figure 2a, which will not be elaborated here.

[0309] In some embodiments, the second device 102 may send the second configuration information via RRC signaling.

[0310] For example, the second configuration information configures the selection method of the first data stream as follows: select a specific type of data stream, or select one with a short cycle.

[0311] In some embodiments, the first device 101 receives the first configuration information, selects a first data stream, and can provide uplink data transmission indication information based on the selected first data stream.

[0312] In step S2203, the second device 102 sends third configuration information to the first device 101.

[0313] In some embodiments, this step may be performed during uplink data transmission, where the first device 101 is a terminal and the second device 102 is an access network device.

[0314] In some embodiments, the third configuration information is used to configure the method for determining the sequence number of data packets in the second data stream. The method for determining the sequence number of data packets in the second data stream can also be determined through the implementation of step S2101 in Figure 2a, which will not be elaborated here.

[0315] In some embodiments, the second device 102 may send the third configuration information via RRC signaling.

[0316] For example, the third configuration information configures the method for determining the sequence number of the data packet in the second data stream as: the sequence number of the data packet with the closest time domain position in the first data stream.

[0317] In some embodiments, the first device 101 receives the third configuration information and determines the sequence number of the data packets in the second data stream.

[0318] In step S2204, the second device 102 sends the fourth configuration information to the first device 101.

[0319] In some embodiments, this step may be performed during uplink data transmission, where the first device 101 is a terminal and the second device 102 is an access network device.

[0320] In some embodiments, the fourth configuration information is used to configure the method of obtaining multimodal groups for data stream packetization, and / or the correspondence between group identifiers and data streams. The method of obtaining multimodal groups for data stream packetization, and / or the correspondence between group identifiers and data streams, can also be determined through the implementation of step S2101 in Figure 2a, which will not be elaborated here.

[0321] In some embodiments, the second device 102 may send the fourth configuration information via RRC signaling.

[0322] For example, the fourth configuration information configures two known types of data streams to form a multimodal group, and / or configures the mapping between the two known types of data streams and the group identifier.

[0323] In some embodiments, the first device 101 receives the fourth configuration information to determine the group identifier of the data stream in the multimodal service so as to assign a sequence number within the multimodal group.

[0324] In step S2205, the second device 102 sends the fifth configuration information to the first device 101.

[0325] In some embodiments, this step may be performed during uplink data transmission, where the first device 101 is a terminal and the second device 102 is an access network device.

[0326] In some embodiments, the fifth configuration information is used to configure the format of the SDAP packet header. The SDAP packet header can be used to carry indication information.

[0327] In some embodiments, the fifth configuration information includes at least one of the following:

[0328] Information used to indicate whether to transmit instruction information;

[0329] Used to indicate whether the following indication information includes service identifier information;

[0330] Used to indicate whether the following instruction information includes group identifier information;

[0331] This is used to indicate whether the following indication information includes information about the flow identifier.

[0332] In some embodiments, the second device 102 can send the fifth configuration information via RRC signaling, for example, by configuring the format of the SDAP packet header in the SDAP-Config Information Element (IE). This configures whether the synchronization relationship information of the aforementioned multimodal data packets is transmitted in the SDAP packet header. Optionally, it can also be configured whether certain information is transmitted, such as whether to transmit the multimodal service identifier, multimodal group identifier, multimodal flow identifier, etc.

[0333] In some embodiments, the first device 101 receives the fifth configuration information.

[0334] In step S2206, the second device 102 sends a switching command to the first device 101.

[0335] In some embodiments, this step may be performed during uplink data transmission, where the first device 101 is a terminal and the second device 102 is an access network device.

[0336] In some embodiments, step S2206 may be performed based on step S2205.

[0337] In some embodiments, the switching command is used to indicate whether to change the format of the SDAP packet header.

[0338] Optionally, when the network changes the SDAP header format through configuration, a switching command is used to ensure that the receiver can correctly identify the SDAP header format. For example, the switching command could be RRCReconfiguration carrying reconfigurationWithSync.

[0339] In some embodiments, the first device 101 receives the switching command.

[0340] In step S2207, the second device 102 sends the sixth configuration information to the first device 101.

[0341] In some embodiments, this step may be performed during uplink data transmission, where the first device 101 is a terminal and the second device 102 is an access network device.

[0342] In some embodiments, the sixth configuration information is used to configure the transmission method of the indication information corresponding to the data packets in the PDU set.

[0343] In some embodiments, the second device 102 may send the sixth configuration information via RRC signaling.

[0344] For example, when a UE transmits multimodal data uplink, the network configures the synchronization relationship information of multimodal data packets via RRC signaling, whether it is transmitted in one data packet or in multiple or all data packets in the PDU set.

[0345] In step S2208, the first device 101 sends an instruction message to the second device 102.

[0346] In some embodiments, the implementation of step S2207 can be referred to the implementation of step S2101 in FIG2a, and will not be repeated here.

[0347] In some embodiments, a terminal may determine how to assign sequence numbers to data packets based on network configuration, thereby adding sequence numbers to uplink multimodal service data packets to be transmitted and transmitting uplink data in order to maintain latency synchronization between related data packets.

[0348] In step S2209, the second device 102 determines the sequence number of the data packet based on the reception time of the data packet of the multimodal service.

[0349] In some embodiments, this step may be performed during uplink data transmission, where the first device 101 is a terminal and the second device 102 is an access network device.

[0350] In some embodiments, this step can be performed when the terminal 101 does not perform step S2208, such as when the terminal 101 is transmitting multimodal data uplink, it may not transmit the multimodal sequence number.

[0351] In some embodiments, the first device 101 sends a multimodal service data packet without indication information to the second device 102, and the second device 102 determines the multimodal sequence number based on the time of the received data packet. The second device 102 may indicate the multimodal sequence number in an NG-U interface, an F1-U interface, or an Xn-U interface. The indication method in the above interfaces can be determined by referring to the implementation of step S2101 in FIG2a, and will not be repeated here.

[0352] The method involved in the embodiments of this disclosure may include at least one of steps S2201 to S2209. For example, the method includes steps S2208 or S2209.

[0353] In some embodiments, at least one of steps S2201 to S2207 is optional, and one or more of these steps may be omitted or substituted in different embodiments.

[0354] In some embodiments, the order of steps S2201 to S2205 and S2207 may be interchanged, or some or all of the steps may be executed synchronously. For example, the second device 102 may send some or all of the configuration information through the same RRC signaling.

[0355] In some embodiments, steps S2208 and S2209 are performed in parallel, and one of them can be selected according to the actual execution situation.

[0356] In some embodiments, other alternative implementations may be described before or after the specification corresponding to FIG2b.

[0357] Figure 3 is a flowchart illustrating a communication method according to an embodiment of the present disclosure. As shown in Figure 3, this embodiment of the present disclosure relates to a communication method executed by a first device 101, the method comprising:

[0358] Step S3101: Send instruction information to the second device 102.

[0359] In some embodiments, the implementation of step S3101 can be found in the implementation of step S2101 in FIG2a or step S2208 in FIG2b, and will not be repeated here.

[0360] In some embodiments, other optional implementations may be described before or after the specification corresponding to FIG3.

[0361] Figure 4 is a flowchart illustrating a communication method according to an embodiment of the present disclosure. As shown in the figure, this embodiment of the present disclosure relates to a communication method executed by a second device 102, the method comprising:

[0362] Step S4101: Receive instruction information sent by the first device 101.

[0363] In some embodiments, the implementation of step S4101 can be found in the implementation of step S2101 in FIG2a or step S2208 in FIG2b, and will not be repeated here.

[0364] Step S4102: Determine the sequence number of the data packet based on the reception time of the data packet of the multimodal service.

[0365] In some embodiments, the implementation of step S4102 can be referred to the implementation of step S2209 in FIG2b, and will not be repeated here.

[0366] The method involved in the embodiments of this disclosure may include step S4101 or step S4102, or step S4102 may be executed when the instruction information is not successfully received.

[0367] In some embodiments, other optional implementations may be described before or after the specification corresponding to Figure 4.

[0368] This disclosure provides an effective mechanism to ensure the synchronization of multimodal data during transmission across different QoS flows / DRBs. The method provided in this disclosure indicates the synchronization relationship of multimodal data packets. Through this method, the network can perform corresponding scheduling and data transmission based on the indicated information, ensuring that the latency synchronization requirements between different modes are met.

[0369] To facilitate understanding of the embodiments of this disclosure, some embodiments are listed below:

[0370] Example 1:

[0371] This embodiment provides a method for indicating the synchronization relationship of multimodal data packets, the method indicating the multimodal sequence number of the data packets, and optionally indicating one or more of the following: multimodal service identifier, multimodal group identifier, multimodal flow identifier.

[0372] Within the same multimodal service, data packets with the same multimodal sequence number in related data streams sometimes require latency synchronization. A multimodal service identifier is used to indicate that multiple data streams are associated with a multimodal service. A multimodal group identifier is used to identify a group of multimodal data streams that require synchronization within a multimodal service. A multimodal stream identifier is used to identify the individual multimodal data streams that require synchronization within a multimodal service.

[0373] The aforementioned latency synchronization requirements are met end-to-end. This means that each hop between the two endpoints of the application layer communication link (i.e., the transmission channel between adjacent nodes in the communication link) must consider latency synchronization requirements, with the final hop (corresponding to the data receiver in the application layer) being particularly crucial. For wireless communication networks (e.g., those in 3GPP specifications), for downlink data transmission, since the transmission between the base station (e.g., gNB) and the terminal is the final hop in the communication link, the base station scheduler must meet the aforementioned latency synchronization requirements. Therefore, the base station needs to obtain the synchronization relationship of multimodal data packets from the core network (e.g., UPF), such as the multimodal sequence number of the data packets. For uplink data transmission, although the 3GPP network (access network and core network) is not the final hop in the uplink transmission, the base station and the core network (e.g., UPF) still need to obtain the synchronization relationship of multimodal data packets to meet the latency synchronization requirements.

[0374] Example 2:

[0375] Based on embodiment 1, embodiment 2 may include the following various examples:

[0376] Example 1:

[0377] Within the same multimodal service, data packets with the same multimodal sequence number in related data streams sometimes require latency synchronization.

[0378] Example 1.1: The multimodal sequence number has a maximum value. For example, if the multimodal sequence number ranges from 0 to 255, when the multimodal sequence number is 255 and needs to be incremented, the next sequence number will be 0 (i.e., wrap around). In this case, the field indicating the multimodal sequence number uses 1 byte. Alternatively, the multimodal sequence number ranges from 0 to 65535, in which case the field indicating the multimodal sequence number uses 2 bytes. Since the multimodal sequence number indicates a time-delay synchronization relationship, choosing an appropriate sequence number value range or defining a sufficiently large sequence number value range, considering the data generation cycle and time-delay synchronization requirements, can prevent confusion that may occur when the sequence number wraps around. That is, a sufficient time interval can avoid the assumption that new data with the same multimodal sequence number value has a time-delay synchronization requirement with old data.

[0379] Example 1.1.1: When the length of the field indicating the multimodal sequence number has two or more values, the length can be dynamically indicated in the packet header. For example, when the length of the multimodal sequence number field has two values ​​(e.g., 1 byte and 2 bytes), it is indicated in the packet header using a 1-bit field.

[0380] Example 1.1.2: When the length of the field indicating the multimodal sequence number has two or more values, and when the UE transmits the multimodal sequence number group identifier in the uplink data packet, the length of the multimodal sequence number field is configured by the network (e.g., via RRC signaling).

[0381] Example 1.2: The allocation of multimodal sequence numbers can be based on a primary multimodal data stream (i.e., the main multimodal data stream), where each data packet of the multimodal data stream is assigned a multimodal sequence number according to the timing relationship.

[0382] Example 1.2.1: The selection of the primary multimodal data stream follows a fixed order based on data type. For example, it may be in the order of video, audio, and haptic feedback. If the relevant multimodal data streams are video and audio, then the video data stream is selected as the primary multimodal data stream.

[0383] Example 1.2.2: The selection of the primary multimodal data stream is based on the period of the multimodal data stream, for example, the shorter multimodal data stream is selected as the primary multimodal data stream.

[0384] Example 1.2.3: When the UE transmits the multimodal group identifier in the uplink data packet, the selection of the primary multimodal data stream is configured by the network (e.g., via RRC signaling).

[0385] Example 1.2.4: The multimodal sequence number of a packet in a non-primary multimodal data stream is determined according to its temporal relationship with the packets in the primary multimodal data stream.

[0386] Example 1.2.4.1: The multimodal sequence number of a packet in a non-primary multimodal data stream is set to the multimodal sequence number of a packet in the primary multimodal data stream that is closest to it in time.

[0387] Example 1.2.4.2: The multimodal sequence number of a packet in a non-primary multimodal data stream is set to the multimodal sequence number of the packet in the primary multimodal data stream that is the one that precedes and is closest to it in time.

[0388] Example 1.2.4.3: The multimodal sequence number of a packet in a non-primary multimodal data stream is set to the multimodal sequence number of the packet in the primary multimodal data stream that is time-later and closest to it.

[0389] Example 1.2.4.4: When the UE transmits a multimodal group identifier in an uplink data packet, the method for determining the multimodal sequence number of the data packet of the non-primary multimodal data stream is configured by the network (e.g., via RRC signaling).

[0390] In a specific example:

[0391] A multimodal service has two data streams: video and audio. The video stream has a frame rate of 60fps, corresponding to a period of 1000 / 60 = 16.7 milliseconds, while the audio stream has a period of 10 milliseconds. Assume there is no time jitter in either data stream. Then, according to the method described in Example 1.2, when the audio stream is the primary multimodal data stream, the corresponding multimodal sequence number for each data packet in both the video and audio streams is shown in Figure 2c. The network and / or the terminal should guarantee latency synchronization for data packets with the same multimodal sequence number.

[0392] Example 2:

[0393] Multimodal group identifiers are used to identify groups of multimodal data streams that have synchronization requirements within a multimodal service. Within a multimodal service, the synchronization requirements between any two data streams may differ. As defined by the protocol, audio and haptic data streams have synchronization requirements, as do video and haptic data streams, and these requirements are different. Therefore, multimodal data streams with synchronization requirements can be grouped into their respective multimodal groups and identified using multimodal group identifiers. For example, audio and video data streams can be identified using multimodal group identifier 0, audio and haptic data streams using multimodal group identifier 1, and video and haptic data streams using multimodal group identifier 2. When using multimodal group identifiers, the multimodal sequence number of data packets can be used within a single multimodal group within the same multimodal service. That is, the multimodal sequence number increases sequentially from 0, 1, 2, ... within the multimodal group to indicate the time synchronization correspondence of data packets from multimodal data streams that have synchronization requirements within that multimodal group.

[0394] The use of multimodal group identifiers is optional. In a multimodal service, latency synchronization requirements can be achieved using multimodal stream identifiers and multimodal sequence numbers. That is, corresponding data streams are scheduled for transmission using their associated multimodal stream identifiers and the same multimodal sequence number. In this case, the multimodal sequence number can be used for all data streams within the same multimodal service; that is, the multimodal sequence number increases sequentially from 0, 1, 2, ... within the multimodal service to indicate the time synchronization correspondence of data packets from multimodal data streams that have synchronization requirements within that multimodal service.

[0395] Example 2.1: When the UE transmits a multimodal group identifier in an uplink data packet, the mapping between the multimodal group identifier and the corresponding multimodal data stream is configured by the network (e.g., via RRC signaling).

[0396] Example 3:

[0397] The synchronization relationship of multimodal data packets is indicated along with the QFI of the packets. Multimodal data streams are mapped to QoS streams according to QoS rules. If a QoS stream can only carry data for one multimodal service, the multimodal service identifier does not need to be indicated. If a QoS stream can only carry data for one multimodal group, the multimodal group identifier does not need to be indicated. If a QoS stream can only carry data for one multimodal data stream, the multimodal stream identifier does not need to be indicated.

[0398] Example 3.1: When multimodal data is transmitted over NG-U, F1-U, and Xn-U interfaces, the multimodal sequence number of the data packet is indicated, and optionally one or more of the following are also indicated: multimodal service identifier, multimodal group identifier, and multimodal flow identifier. This information can be indicated in the GTP-U Extension Header. Specifically, this information can be indicated in the DL PDU SESSION INFORMATION frame and the UL PDU SESSION INFORMATION frame.

[0399] Example 3.2: When the UE transmits multimodal data uplink, it transmits the synchronization relationship information of the above multimodal data packets in the SDAP packet header.

[0400] Example 3.2.1: The network configures the SDAP header format, for example, by using RRC signaling (e.g., in IE SDAP-Config). The configuration may include whether to transmit information about the synchronization relationships of the aforementioned multimodal data packets in the SDAP header. Optionally, it may also be configured whether certain information is transmitted, such as whether to transmit the multimodal service identifier, multimodal group identifier, multimodal flow identifier, etc. When the network changes the SDAP header format through configuration, a constraint is that this change can only be implemented through a switching command (e.g., RRCReconfiguration with reconfigurationWithSync) to ensure that the receiving end can correctly identify the SDAP header format.

[0401] Example 3.2.2: Whether to transmit the synchronization information of the above multimodal data packets is dynamically indicated in the SDAP header. For example, it can be indicated by a 1-bit field in the SDAP header.

[0402] In a specific example:

[0403] Corresponding to Example 3.2.2, the multimodal sequence number is transmitted in the uplink SDAP header as shown in Figure 2d. The "E" bit (used to replace the reserved "R" bit in related technologies) indicates whether the multimodal sequence number (the Multi-Modal SN field in Figure 2d) has been transmitted. In this embodiment, a QoS flow can only carry the data of one multimodal data flow, thus eliminating the need to indicate the multimodal service identifier, multimodal group identifier, or multimodal flow identifier.

[0404] Example 4:

[0405] The synchronization information for multimodal data packets applies to situations where the data stream of a multimodal service originates from different data sources, such as a single UE, a single device, multiple devices connected to a single UE, or multiple UEs. Correspondingly, the multimodal service identifier for a multimodal service can correspond to a single UE, a single device, multiple devices connected to a single UE, or multiple UEs.

[0406] Example 5:

[0407] When several data packets in a multimodal service belong to the same PDU set, the synchronization relationship information of the multimodal data packets can be transmitted in one data packet, or in multiple or all data packets in the PDU set.

[0408] Example 5.1: When a UE transmits multimodal data uplink, is the information about the synchronization relationship of the multimodal data packets transmitted in one data packet or in multiple or all data packets in the PDU set, according to the network configuration (e.g., via RRC signaling)?

[0409] Example 6:

[0410] When the UE transmits multimodal data uplink, the UE may not transmit the multimodal sequence number. The network determines the multimodal sequence number based on the time of receipt and indicates the multimodal sequence number in the NG-U, F1-U, and Xn-U interfaces (see Example 3.1).

[0411] This disclosure also provides an apparatus for implementing any of the above methods. For example, an apparatus is provided that includes units or modules for implementing the steps performed by the terminal in any of the above methods. Alternatively, another apparatus is provided that includes units or modules for implementing the steps performed by a network device (e.g., an access network device, a core network functional node, a core network device, etc.) in any of the above methods.

[0412] It should be understood that the division of units or modules in the above device is only a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, the units or modules in the device can be implemented by a processor calling software: for example, the device includes a processor connected to a memory containing instructions. The processor calls the instructions stored in the memory to implement any of the above methods or to implement the functions of the units or modules in the above device. The processor can be, for example, a general-purpose processor, such as a Central Processing Unit (CPU) or a microprocessor, and the memory can be internal or external to the device. Alternatively, the units or modules in the device can be implemented in the form of hardware circuits. The functionality of some or all of the units or modules can be achieved through the design of these hardware circuits, which can be understood as one or more processors. For example, in one implementation, the hardware circuit is an application-specific integrated circuit (ASIC). The functionality of some or all of the units or modules is achieved through the design of the logical relationships between the components within the circuit. In another implementation, the hardware circuit can be implemented using a programmable logic device (PLD). Taking a field-programmable gate array (FPGA) as an example, it can include a large number of logic gates. The connection relationships between the logic gates are configured through configuration files, thereby achieving the functionality of some or all of the units or modules. All units or modules of the above device can be implemented entirely through processor-called software, entirely through hardware circuits, or partially through processor-called software with the remaining parts implemented through hardware circuits.

[0413] In this embodiment, the processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a Central Processing Unit (CPU), a microprocessor, a graphics processing unit (GPU) (which can be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. The logical relationships of the aforementioned hardware circuits are fixed or reconfigurable. For example, the processor is a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units or modules. Furthermore, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a Neural Network Processing Unit (NPU), a Tensor Processing Unit (TPU), or a Deep Learning Processing Unit (DPU).

[0414] Figure 5a is a schematic diagram of the structure of the first device proposed in an embodiment of this disclosure. As shown in Figure 5a, the first device 5100 may include at least one of a transceiver module 5101, a processing module 5102, etc. In some embodiments, the transceiver module 5101 is used to send indication information to a second device, the indication information being used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets having the same sequence number.

[0415] Optionally, the transceiver module 5101 is used to perform at least one of the communication steps such as sending and / or receiving performed by the first device 101 in any of the above methods, which will not be described in detail here. Optionally, the processing module 5102 is used to perform at least one of the other steps performed by the first device 101 in any of the above methods, which will not be described in detail here.

[0416] Figure 5b is a schematic diagram of the structure of the second device proposed in an embodiment of this disclosure. As shown in Figure 5b, the second device 5200 may include at least one of a transceiver module 5201, a processing module 5202, etc. In some embodiments, the transceiver module 5201 is used to receive indication information sent by the first device, the indication information being used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets having the same sequence number.

[0417] Optionally, the transceiver module 5201 is used to perform at least one of the communication steps such as sending and / or receiving performed by the second device 102 in any of the above methods, which will not be described in detail here. Optionally, the processing module 5202 is used to perform at least one of the other steps performed by the second device 102 in any of the above methods, which will not be described in detail here.

[0418] In some embodiments, the transceiver module may include a transmitting module and / or a receiving module, which may be separate or integrated. Optionally, the transceiver module may be interchangeable with a transceiver.

[0419] In some embodiments, the processing module may be a single module or may include multiple sub-modules. Optionally, the multiple sub-modules may each perform all or part of the steps required by the processing module. Optionally, the processing module may be interchangeable with a processor.

[0420] Figure 6a is a schematic diagram of the structure of the communication device 6100 proposed in an embodiment of this disclosure. The communication device 6100 can be a network device (e.g., access network device, core network device, etc.), a terminal (e.g., user equipment, etc.), a chip, chip system, or processor that supports the network device in implementing any of the above methods, or a chip, chip system, or processor that supports the terminal in implementing any of the above methods. The communication device 6100 can be used to implement the methods described in the above method embodiments; for details, please refer to the descriptions in the above method embodiments.

[0421] As shown in Figure 6a, the communication device 6100 includes one or more processors 6101. The processor 6101 can be a general-purpose processor or a dedicated processor, such as a baseband processor or a central processing unit (CPU). The baseband processor can be used to process communication protocols and communication data, while the CPU can be used to control communication devices (e.g., base stations, baseband chips, terminal devices, terminal device chips, DUs or CUs, etc.), execute programs, and process program data. Optionally, the communication device 6100 can be used to execute any of the above methods. Optionally, one or more processors 6101 can be used to invoke instructions to cause the communication device 6100 to execute any of the above methods.

[0422] In some embodiments, the communication device 6100 further includes one or more transceivers 6102. When the communication device 6100 includes one or more transceivers 6102, the transceiver 6102 performs at least one of the communication steps such as sending and / or receiving in the above method, and the processor 6101 performs at least one of the other steps. In optional embodiments, the transceiver may include a receiver and / or a transmitter, which may be separate or integrated. Optionally, the terms transceiver, transceiver unit, transceiver, transceiver circuit, interface circuit, interface, etc., can be used interchangeably; the terms transmitter, transmitting unit, transmitter, transmitting circuit, etc., can be used interchangeably; and the terms receiver, receiving unit, receiver, receiving circuit, etc., can be used interchangeably.

[0423] In some embodiments, the communication device 6100 further includes one or more memories 6103 for storing data. Optionally, all or part of the memories 6103 may be located outside the communication device 6100. In optional embodiments, the communication device 6100 may include one or more interface circuits 6104. Optionally, the interface circuits 6104 are connected to the memories 6103 and can be used to receive data from the memories 6103 or other devices, and to send data to the memories 6103 or other devices. For example, the interface circuits 6104 can read data stored in the memories 6103 and send that data to the processor 6101.

[0424] The communication device 6100 described in the above embodiments may be a network device or a terminal, but the scope of the communication device 6100 described in this disclosure is not limited thereto, and the structure of the communication device 6100 may not be limited by FIG. 6a. The communication device may be a standalone device or a part of a larger device. For example, the communication device may be: (1) a standalone integrated circuit IC, or chip, or chip system or subsystem; (2) a collection of one or more ICs, optionally, the IC collection may also include storage components for storing data and programs; (3) an ASIC, such as a modem; (4) a module that can be embedded in other devices; (5) a receiver, terminal device, smart terminal device, cellular phone, wireless device, handheld device, mobile unit, vehicle device, network device, cloud device, artificial intelligence device, etc.; (6) others, etc.

[0425] Figure 6b is a schematic diagram of the structure of chip 6200 according to an embodiment of this disclosure. For cases where the communication device 6100 can be a chip or a chip system, please refer to the schematic diagram of chip 6200 shown in Figure 6b, but it is not limited thereto.

[0426] Chip 6200 includes one or more processors 6201. Chip 6200 is used to perform any of the methods described above.

[0427] In some embodiments, chip 6200 further includes one or more interface circuits 6202. Optionally, terms such as interface circuit, interface, and transceiver pin can be used interchangeably. In some embodiments, chip 6200 further includes one or more memories 6203 for storing data. Optionally, all or part of the memories 6203 may be located outside chip 6200. Optionally, interface circuit 6202 is connected to memory 6203, and interface circuit 6202 can be used to receive data from memory 6203 or other devices, and interface circuit 6202 can be used to send data to memory 6203 or other devices. For example, interface circuit 6202 can read data stored in memory 6203 and send the data to processor 6201.

[0428] In some embodiments, the interface circuit 6202 performs at least one of the communication steps, such as sending and / or receiving, in the above-described method. For example, the interface circuit 6202 performing the communication steps, such as sending and / or receiving, in the above-described method means that the interface circuit 6202 performs data interaction between the processor 6201, the chip 6200, the memory 6203, or the transceiver device. In some embodiments, the processor 6201 performs at least one of the other steps.

[0429] The modules and / or devices described in the various embodiments, such as virtual devices, physical devices, and chips, can be combined or separated arbitrarily as needed. Optionally, some or all steps can also be performed collaboratively by multiple modules and / or devices, which is not limited here.

[0430] This disclosure also proposes a storage medium storing instructions that, when executed on the communication device 6100, cause the communication device 6100 to perform any of the above methods. Optionally, the storage medium is an electronic storage medium. Optionally, the storage medium is a computer-readable storage medium, but not limited thereto; it may also be a storage medium readable by other devices. Optionally, the storage medium may be a non-transitory storage medium, but not limited thereto; it may also be a temporary storage medium.

[0431] This disclosure also provides a program product that, when executed by the communication device 6100, causes the communication device 6100 to perform any of the above methods. Optionally, the program product is a computer program product.

[0432] This disclosure also proposes a computer program that, when run on a computer, causes the computer to perform any of the above methods. Industrial applicability

[0433] The first device sends an indication message to the second device, indicating the sequence number of the data packets in the multimodal service. The second device can then identify the data packets with synchronization requirements in the multimodal service based on the indication message, which facilitates meeting latency synchronization requirements during data transmission or scheduling and improves user experience.

Claims

1. A communication method, performed by a first device, the method comprising: Send indication information to the second device, the indication information being used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets having the same sequence number.

2. The method as described in claim 1, wherein, The first device or the second device satisfies one of the following: In uplink data transmission, the first device is a terminal, and the second device is an access network device; In uplink data transmission, the first device is an access network device, and the second device is a core network device; In downlink data transmission, the first device is a core network device, and the second device is an access network device; In uplink or downlink data transmission, the first device and the second device are different units in the access network device; In uplink or downlink data transmission, the first device and the second device are different access network devices.

3. The method as described in claim 1 or 2, wherein, The indication information includes a first information field for indicating the serial number, wherein the length of the first information field is multiple bits.

4. The method of claim 3, wherein, The sequence number takes a value within the range of [first value, second value]; wherein, when the number of data packets is greater than the second value, the sequence number wraps back to the first value and starts counting again.

5. The method of claim 3, wherein, The header of the data packet includes a second information field, which is used to indicate the length of the first information field corresponding to the data packet.

6. The method of claim 3, wherein, The device receives first configuration information sent by a second device, the first configuration information being used to configure the length of the first information field; wherein the first device is a terminal and the second device is an access network device.

7. The method according to any one of claims 1 to 6, wherein, The multimodal service includes multiple data streams. In the first data stream of the multiple data streams, the sequence number of multiple data packets corresponds to the timing of the multiple data packets.

8. The method of claim 7, wherein, In the second data stream of the plurality of data streams, the sequence numbers of the plurality of data packets are determined based on the sequence numbers of the data packets in the first data stream.

9. The method of claim 7 or 8, wherein, The first data stream satisfies one of the following: The first data stream is determined based on the data types of the plurality of data streams; The first data stream is determined based on the period of the plurality of data streams; The first data stream is determined based on the second configuration information sent by the second device, which is used to configure the selection method of the first data stream; wherein, the first device is a terminal and the second device is an access network device.

10. The method of claim 8, wherein, The sequence number of each data packet in the second data stream is determined based on the sequence number of the data packet with the closest time domain position in the first data stream.

11. The method of claim 10, wherein, The sequence number of the data packets in the second data stream satisfies one of the following: The sequence number of the data packet with the closest time domain position in the first data stream; The sequence number is the data packet with the closest time domain position in the first data stream, and the data packet with the closest time domain position is located before the data packet in the second data stream; The sequence number is the data packet with the closest time domain position in the first data stream, and the data packet with the closest time domain position is located after the data packet in the second data stream; It is determined based on the third configuration information sent by the second device, which is used to configure the method for determining the sequence number of data packets in the second data stream; wherein, the first device is a terminal and the second device is an access network device.

12. The method as claimed in any one of claims 1 to 11, wherein, The indication information is also used to indicate at least one of the following: service identifier, group identifier, and flow identifier; The service identifier is used to indicate multiple data streams associated with the multimodal service, the group identifier is used to indicate a multimodal group consisting of data streams with synchronization requirements in the multimodal service, and the stream identifier is used to indicate data streams with synchronization requirements in the multimodal service.

13. The method of claim 12, wherein, Different multimodal groups correspond to different group identifiers. The indication information is used to indicate: the sequence number of data packets of different data streams in the same multimodal group indicated by any group identifier; wherein, data packets in different data streams with the same sequence number meet the time delay synchronization requirements corresponding to the multimodal group.

14. The method of claim 13, wherein, The method further includes: The device receives fourth configuration information sent by the second device, which is used to configure the method of obtaining multimodal groups for data stream packets, and / or the correspondence between group identifiers and data streams; wherein, the first device is a terminal and the second device is an access network device.

15. The method of claim 12, wherein, The indication information is used to indicate the sequence number corresponding to the data packets of all data streams in the multimodal service.

16. The method as claimed in any one of claims 1 to 15, wherein, The indication information is sent together with the Quality of Service (QoS) flow identifier (QFI) of the data packet; wherein, the data stream of the multimodal service has a mapping relationship with the Quality of Service (QoS) flow.

17. The method of claim 16, wherein, The indication information satisfies at least one of the following: The User Plane Tunneling Protocol GTP-U extension header includes the aforementioned indication information; The header of the Service Data Adaptation Protocol (SDAP) includes the aforementioned indication information.

18. The method of claim 17, wherein, The method further includes: The device receives fifth configuration information sent by the second device, the fifth configuration information being used to configure the format of the SDAP packet header; wherein, the first device is a terminal and the second device is an access network device.

19. The method of claim 18, wherein, The fifth configuration information includes at least one of the following: Information used to indicate whether to transmit the indication information; Used to indicate whether the indication information includes service identifier information; Used to indicate whether the indication information includes group identifier information; This is used to indicate whether the indication information includes information about the flow identifier.

20. The method of claim 17, wherein, The method further includes: The device receives a switching command sent by the second device, the switching command being used to indicate whether to change the format of the SDAP packet header.

21. The method of claim 17, wherein, The SDAP header includes a third information field, which is used to indicate whether the indication information is transmitted in the SDAP header.

22. The method as claimed in any one of claims 1 to 21, wherein, The multimodal service includes data streams that correspond to the same data source or different data sources.

23. The method as claimed in any one of claims 1 to 21, wherein, In the multimodal service, multiple data packets belong to the same Protocol Data Unit (PDU) set, and the indication information is transmitted in one of the multiple data packets, or in each of the multiple data packets.

24. The method of claim 23, wherein, The method further includes: The device receives sixth configuration information sent by the second device, the sixth configuration information being used to configure the transmission mode of the indication information corresponding to the data packets in the PDU set; wherein, the first device is a terminal and the second device is an access network device.

25. A communication method performed by a second device, the method comprising: The system receives indication information sent by a first device, the indication information being used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein different data packets with the same sequence number have a time delay synchronization requirement.

26. The method of claim 25, wherein, The first device or the second device satisfies one of the following: In uplink data transmission, the first device is a terminal, and the second device is an access network device; In uplink data transmission, the first device is an access network device, and the second device is a core network device; In downlink data transmission, the first device is a core network device, and the second device is an access network device; In uplink or downlink data transmission, the first device and the second device are different units in the access network device; In uplink or downlink data transmission, the first device and the second device are different access network devices.

27. The method of claim 25 or 26, wherein, The indication information includes a first information field for indicating the serial number, wherein the length of the first information field is multiple bits.

28. The method of claim 27, wherein, The sequence number takes a value within the range of [first value, second value]; wherein, when the number of data packets is greater than the second value, the sequence number wraps back to the first value and starts counting again.

29. The method of claim 27, wherein, The header of the data packet includes a second information field, which is used to indicate the length of the first information field corresponding to the data packet.

30. The method of claim 27, wherein, Send first configuration information to the first device, the first configuration information being used to configure the length of the first information field; wherein, the first device is a terminal, and the second device is an access network device.

31. The method according to any one of claims 25 to 30, wherein, The multimodal service includes multiple data streams. In the first data stream of the multiple data streams, the sequence number of multiple data packets corresponds to the timing of the multiple data packets.

32. The method of claim 31, wherein, In the second data stream of the plurality of data streams, the sequence numbers of the plurality of data packets are determined based on the sequence numbers of the data packets in the first data stream.

33. The method of claim 31 or 32, wherein, The first data stream satisfies one of the following: The first data stream is determined based on the data types of the plurality of data streams; The first data stream is determined based on the period of the plurality of data streams; The first data stream is determined based on the second configuration information, which is used to configure the selection method of the first data stream; wherein, the first device is a terminal and the second device is an access network device.

34. The method of claim 32, wherein, The sequence number of each data packet in the second data stream is determined based on the sequence number of the data packet with the closest time domain position in the first data stream.

35. The method of claim 34, wherein, The sequence number of the data packets in the second data stream satisfies one of the following: The sequence number of the data packet with the closest time domain position in the first data stream; The sequence number is the data packet with the closest time domain position in the first data stream, and the data packet with the closest time domain position is located before the data packet in the second data stream; The sequence number is the data packet with the closest time domain position in the first data stream, and the data packet with the closest time domain position is located after the data packet in the second data stream; It is determined based on the third configuration information sent by the second device, which is used to configure the method for determining the sequence number of data packets in the second data stream; wherein, the first device is a terminal and the second device is an access network device.

36. The method according to any one of claims 25 to 35, wherein, The indication information is also used to indicate at least one of the following: service identifier, group identifier, and flow identifier; The service identifier is used to indicate multiple data streams associated with the multimodal service, the group identifier is used to indicate a multimodal group consisting of data streams with synchronization requirements in the multimodal service, and the stream identifier is used to indicate data streams with synchronization requirements in the multimodal service.

37. The method of claim 36, wherein, Different multimodal groups correspond to different group identifiers. The indication information is used to indicate: the sequence number of data packets of different data streams in the same multimodal group indicated by any group identifier; wherein, data packets in different data streams with the same sequence number meet the time delay synchronization requirements corresponding to the multimodal group.

38. The method of claim 37, wherein, The method further includes: Send fourth configuration information to the first device. The fourth configuration information is used to configure the method of obtaining multimodal groups for data stream packets, and / or the correspondence between group identifiers and data streams; wherein, the first device is a terminal and the second device is an access network device.

39. The method of claim 36, wherein, The indication information is used to indicate the sequence number corresponding to the data packets of all data streams in the multimodal service.

40. The method according to any one of claims 25 to 39, wherein, The indication information is sent together with the Quality of Service (QoS) flow identifier (QFI) of the data packet; wherein, the data stream of the multimodal service has a mapping relationship with the Quality of Service (QoS) flow.

41. The method of claim 40, wherein, The indication information satisfies at least one of the following: The User Plane Tunneling Protocol GTP-U extension header includes the aforementioned indication information; The header of the Service Data Adaptation Protocol (SDAP) includes the aforementioned indication information.

42. The method of claim 41, wherein, The method further includes: Send fifth configuration information to the first device, the fifth configuration information being used to configure the format of the SDAP packet header; wherein, the first device is a terminal and the second device is an access network device.

43. The method of claim 42, wherein, The fifth configuration information includes at least one of the following: Information used to indicate whether to transmit the indication information; Used to indicate whether the indication information includes service identifier information; Used to indicate whether the indication information includes group identifier information; This is used to indicate whether the indication information includes information about the flow identifier.

44. The method of claim 41, wherein, The method further includes: A switching command is sent to the first device, the switching command being used to indicate whether to change the format of the SDAP packet header.

45. The method of claim 41, wherein, The SDAP header includes a third information field, which is used to indicate whether the indication information is transmitted in the SDAP header.

46. ​​The method according to any one of claims 25 to 45, wherein, The multimodal service includes data streams that correspond to the same data source or different data sources.

47. The method according to any one of claims 25 to 45, wherein, In the multimodal service, multiple data packets belong to the same Protocol Data Unit (PDU) set, and the indication information is transmitted in one of the multiple data packets, or in each of the multiple data packets.

48. The method of claim 47, wherein, The method further includes: A sixth configuration information is sent to the first device, the sixth configuration information being used to configure the transmission method of the indication information corresponding to the data packets in the PDU set; wherein, the first device is a terminal and the second device is an access network device.

49. The method according to any one of claims 25 to 45, wherein, The method further includes: The sequence number of the data packet is determined based on the reception time of the data packet of the multimodal service; wherein the first device is a terminal, the second device is an access network device, and the first device does not transmit the indication information during uplink data transmission.

50. A communication device, comprising: The transceiver module is used to send indication information to the second device, the indication information being used to indicate the data packet corresponding to the multimodal service. The sequence number, wherein different data packets with the same sequence number have a time delay synchronization requirement.

51. A communication device, comprising: The transceiver module is used to receive indication information sent by the first device. The indication information is used to indicate the sequence number corresponding to the data packet of the multimodal service, wherein there is a time delay synchronization requirement between different data packets with the same sequence number.

52. A communication device, comprising: One or more processors; The communication device is configured to implement the method according to any one of claims 1 to 24 or any one of claims 25 to 49.

53. A communication system, comprising a first device and a second device, wherein, The first device is configured to implement the method as described in any one of claims 1 to 24; The second device is configured to implement the method as described in any one of claims 24 to 49.

54. A storage medium storing instructions, wherein, When the instructions are executed on the communication device, the communication device performs the method as described in any one of claims 1 to 24, or any one of claims 24 to 49.

55. A program product, wherein, When the program product is executed by a communication device, the communication device performs the method as described in any one of claims 1 to 24, or any one of claims 24 to 49.

Images