Multi-modal communication methods, communication node and storage medium

Abstract

Provided in the present application are multi-modal communication methods, a communication node and a storage medium. A method comprises: receiving a first service request of a second communication node, wherein the first service request includes multi-modal auxiliary information, and the first service request is used for requesting the establishment of a quality of service (QoS) flow related to multi-modality (110); and processing the first service request on the basis of the multi-modal auxiliary information (120).

Description

Multimodal communication methods, communication nodes and storage media Technical Field

[0001] This application relates to the field of wireless communication technology, such as a multimodal communication method, a communication node, and a storage medium. Background Technology

[0002] With the rapid development of Extended Reality (XR) technology, multimodal services in wireless communication networks are expected to become a crucial support for enhancing user immersion and the naturalness of interaction. Multimodal services refer to the integration of multimodal data from various XR sensing devices, including visual, audio, tactile, and environmental perception information (such as brightness, temperature, and humidity). Through diverse input and output methods, this data can create a more realistic experience for users.

[0003] Multimodal services place high demands on network resource allocation. The normal operation of multimodal services depends on the coordination and resource allocation of all relevant Quality of Service (QoS) flows. If any QoS flow fails to establish itself due to insufficient resources, even if other QoS flows have been allocated sufficient resources and successfully established, the entire multimodal application may fail to function properly. This dependency is particularly pronounced because multimodal applications typically require a high degree of synchronization and cooperation among multiple data flows, such as the simultaneous transmission of video, audio, and haptic data. The failure of any part will significantly impact the user experience. Therefore, establishing QoS flows and coordinating the allocation of resources related to multimodal services during UE service establishment and handover become crucial for multimodal communication. Summary of the Invention

[0004] This application provides a multimodal communication method, a communication node, and a storage medium.

[0005] This application provides a multimodal communication method applied to a first communication node, including:

[0006] Receive a first service request from a second communication node, the first service request containing multimodal assistance information, the first service request being used to request the establishment of a QoS flow related to multimodality;

[0007] The first service request is processed based on the multimodal auxiliary information.

[0008] This application also provides a multimodal communication method applied to a second communication node, including:

[0009] A first service request is sent to the first communication node. The first service request contains multimodal auxiliary information and is used to request the establishment of a QoS flow related to multimodality.

[0010] This application also provides a communication node, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the above-described multimodal communication method.

[0011] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described multimodal communication method. Attached Figure Description

[0012] Figure 1 is a flowchart of a multimodal communication method provided in one embodiment;

[0013] Figure 2 is a flowchart of another multimodal communication method provided in one embodiment;

[0014] Figure 3 is a schematic diagram of an interactive multimodal capability provided in one embodiment;

[0015] Figure 4 is a schematic diagram of an embodiment of updating multimodal capabilities;

[0016] Figure 5 is a schematic diagram of a multimodal capability-based cell selection and AMF (Active Cell Filtering) embodiment.

[0017] Figure 6 is a schematic diagram of a process for establishing multimodal services and resource allocation according to an embodiment;

[0018] Figure 7 is a schematic diagram of another process for establishing multimodal services and resource allocation provided in one embodiment;

[0019] Figure 8 is a schematic diagram of the multimodal service resource migration process provided in one embodiment;

[0020] Figure 9 is a schematic diagram of the structure of a multimodal communication device provided in one embodiment;

[0021] Figure 10 is a schematic diagram of another multimodal communication device provided in one embodiment;

[0022] Figure 11 is a schematic diagram of the hardware structure of a communication node according to an embodiment. Detailed Implementation

[0023] In this embodiment, the data for multimodal services may originate from a single user equipment (UE) or from multiple distributed devices. For example, a user can wear virtual reality (VR) glasses to receive video and audio, experience virtual touch through haptic gloves, interact via voice using a microphone, and record gestures or location information using motion capture devices. These devices can exist as independent UEs or be considered as belonging to the same UE, carrying and transmitting data through different QoS streams. In other words, multiple QoS streams in a multimodal service may simultaneously belong to the same UE or may be distributed among multiple UEs. Through collaborative processing, different types of information can be coordinated and transmitted to one or more distributed UEs.

[0024] Figure 1 is a flowchart of a multimodal communication method provided in one embodiment, which can be applied to a first communication node. As shown in Figure 1, the method provided in this embodiment includes steps 110 and 120.

[0025] In step 110, a first service request from the second communication node is received. The first service request includes multimodal assistance information and is used to request the establishment of a QoS flow related to multimodality.

[0026] In step 120, the first service request is processed according to the multimodal assistance information.

[0027] In this embodiment, the second communication node can refer to the node requesting the establishment of a QoS flow, and can be a network-side node, such as the Access and Mobility Management Function (AMF) in the core network. The first communication node can be the node that processes the request to establish a QoS flow, or it can be a network-side node, such as a base station or access point.

[0028] The first service request can be understood as a request to establish or modify QoS flows. It includes multimodal auxiliary information, which can be used to indicate relevant information about the multimodal services of one or more UEs. For example, for a UE (the first UE), it can indicate the corresponding QoS flows, Protocol Data Unit (PDU) sessions, multimodal services, and the relationships between them. It can also indicate whether multiple QoS flows must be accepted, and information about other UEs related to the multimodal services of that UE. By carrying multimodal auxiliary information in the service request, the first communication node can determine whether to establish and which specific QoS flows need to be established based on the actual situation and requirements, thereby improving the reliability of establishing QoS flows and multimodal services.

[0029] In one embodiment, the multimodal assistance information includes at least one of the following:

[0030] The first multimodal service indication information is used to indicate the multimodal services that each first user equipment participates in;

[0031] A multimodal session partial acceptance indication is used to indicate the acceptance method of QoS flows involved in a multimodal session, wherein the acceptance method includes at least one of full acceptance (all QoS flows are accepted) and partial acceptance (a portion of QoS flows are accepted and a portion of QoS flows are rejected);

[0032] The auxiliary information of the second user equipment can be used to indicate relevant information about the multimodal services of the second UE, which can be other UEs participating in the multimodal services of the first UE;

[0033] The first multimodal service indication information includes at least one of the following:

[0034] UE-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs;

[0035] PDU session-level multimodal service indication is used to indicate the multimodal service to which the QoS flow in the PDU session of the first user equipment belongs;

[0036] QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs.

[0037] In one embodiment, the assistance information of the second user equipment includes at least one of the following:

[0038] The identifier of the second user equipment is used to indicate the second user equipment participating in the multimodal service of the first user equipment, and to request the establishment of a multimodal service for the second user equipment;

[0039] The second multimodal service indication information is used to indicate the multimodal services in which each second user equipment participates. The second multimodal service indication information includes at least one of UE-level multimodal service indication, PDU session-level multimodal service indication, and QoS flow-level multimodal service indication.

[0040] QoS parameter information, used to indicate the QoS parameters of a QoS flow;

[0041] Radio resource information is used to indicate the radio resource requirements of each second user equipment;

[0042] The second multimodal service indication information includes at least one of the following:

[0043] UE-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs;

[0044] Protocol Data Unit (PDU) Session-Level Multimodal Service Indicator is used to indicate the multimodal service to which the QoS flow in the PDU session of the second user equipment belongs;

[0045] QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs;

[0046] The wireless resource information includes at least one of the following:

[0047] The number of radio resources required for multimodal services of the second user equipment;

[0048] The radio resource requirements corresponding to the QoS stream of each second user device belonging to a multimodal service;

[0049] The radio resource requirements for each PDU session of a second user equipment belonging to a multimodal service.

[0050] In one embodiment, the first service request further includes at least one of the following:

[0051] Initial context establishment request message; PDU session resource establishment request message; PDU session resource modification request message.

[0052] In one embodiment, processing the first service request based on the multimodal assistance information includes:

[0053] The QoS flow is accepted or rejected based on the multimodal auxiliary information. This can be done by accepting or rejecting all QoS flows of the multimodal service, or by accepting some QoS flows and rejecting others.

[0054] In one embodiment, the first communication node includes a centralized unit (CU) and a distributed unit (DU);

[0055] Processing the first service request based on the multimodal assistance information includes:

[0056] The CU sends a second service request to the DU. The second service request includes multimodal assistance information and is used to request the establishment of a QoS flow related to multimodality.

[0057] The DU accepts or rejects QoS flows based on the multimodal auxiliary information.

[0058] In one embodiment, processing the first service request based on the multimodal assistance information further includes:

[0059] The DU sends a feedback message to the CU, the feedback message containing the result of whether the QoS flow is accepted or rejected.

[0060] In one embodiment, the first communication node may be the source base station in a UE handover scenario, and the method further includes:

[0061] A handover request message is sent to a third communication node (the target base station in the UE handover scenario). The handover request message contains multimodal assistance information. The handover request message is used to request the third user equipment to be handed over to the target base station. The third user equipment can be understood as the UE that the first communication node requests to be handed over, such as the first user equipment.

[0062] Receive handover feedback messages from the third communication node, such as whether the handover of the third user equipment was successful or failed.

[0063] The handover feedback message determines whether to hand over the fourth user equipment to the target base station. The fourth user equipment can be understood as a UE that needs to be further determined whether to continue handover based on the handover feedback message, or it can be understood as a UE to be handed over other than the third user equipment, such as the second user equipment.

[0064] In one embodiment, the first communication node may be a target base station in a UE handover scenario, and the method further includes:

[0065] The system receives a handover request message from a fourth communication node (the source base station in the UE handover scenario). The handover request message contains multimodal assistance information and is used to request the third user equipment to be handed over to the target base station. The third user equipment can be understood as the UE that the first communication node requests to be handed over.

[0066] The access of the third user equipment may be accepted or rejected based on the multimodal assistance information.

[0067] The fourth communication node sends a handover feedback message, such as whether the handover of the third user equipment was successful or failed. Based on this, the fourth communication node can further determine whether to continue the handover of the fourth user equipment.

[0068] In one embodiment, the method further includes:

[0069] Send an interface establishment request message to the fifth communication node, or receive an interface establishment request message from the fifth communication node. The fifth communication node may be a network-side node different from the first communication node, such as other base stations or core network nodes (such as AMF).

[0070] The interface establishment request message contains multimodal capability information;

[0071] The multimodal capability information includes at least one of the following:

[0072] The node multimodal capability indicator is used to indicate whether the communication node that sends the interface establishment request message has the capability to provide multimodal services.

[0073] Cell multimodal capability indicator: Used to indicate whether each identified cell has the capability to provide multimodal services.

[0074] Based on this, the first communication node and the fifth communication node can exchange information on their multimodal service capabilities.

[0075] In one embodiment, the method further includes:

[0076] Send a configuration update request message to the fifth communication node, or receive a configuration update request message from the fifth communication node. The fifth communication node may be a network-side node different from the first communication node, such as other base stations or core network nodes (such as AMF).

[0077] The configuration update request message contains multimodal capability information;

[0078] The multimodal capability information includes at least one of the following:

[0079] The node multimodal capability indicator is used to indicate whether the communication node that sends the interface establishment request message has the capability to provide multimodal services.

[0080] The cell multimodal capability indicator is used to indicate whether each identified cell has the capability to provide multimodal services.

[0081] Based on this, the first communication node and the fifth communication node can update the capability information of the multimodal service.

[0082] In one embodiment, the method further includes:

[0083] A broadcast message is sent in at least one cell, the broadcast message containing a multimodal capability indication, the multimodal capability indication being used to indicate whether the at least one cell has the capability to provide multimodal services.

[0084] In one embodiment, the method further includes:

[0085] Receive a Radio Resource Control (RRC) connection establishment request message from a fifth user equipment, wherein the RRC connection establishment request message contains a multimodal service indication, and the fifth user equipment can be understood as a UE that needs to establish a multimodal service;

[0086] Send an initial UE message to the target communication node, the initial UE message containing the multimodal service indication;

[0087] The multimodal service indication is used to indicate that the fifth user equipment needs to establish a multimodal service. The target communication node can be a network-side node different from the first communication node, such as a core network node (e.g., AMF).

[0088] In one embodiment, the target communication node is determined based on the multimodal service indication and the multimodal capability information of the fifth communication node.

[0089] Figure 2 is a flowchart of a multimodal communication method provided in one embodiment, which can be applied to a second communication node. As shown in Figure 2, the method provided in this embodiment includes step 210.

[0090] In step 210, a first service request is sent to the first communication node. The first service request includes multimodal assistance information and is used to request the establishment of a QoS flow related to multimodality.

[0091] In this embodiment, the second communication node can refer to the node requesting the establishment of a QoS flow, and can be a network-side node, such as an AMF in the core network. The first communication node can be the node that processes the request to establish a QoS flow, or it can be a network-side node, such as a base station or access point.

[0092] The first service request can be understood as a request to establish or modify a QoS flow, which includes multimodal auxiliary information. By carrying multimodal auxiliary information in the service request, the first communication node can determine whether to establish and which specific QoS flows need to be established based on the actual situation and requirements, thereby improving the reliability of establishing QoS flows and multimodal services.

[0093] It should be noted that technical details not described in detail in this embodiment can be found in any of the above embodiments.

[0094] In one embodiment, the multimodal assistance information includes at least one of the following:

[0095] The first multimodal service indication information is used to indicate the multimodal services that each first user equipment participates in;

[0096] A multimodal session partial admission indication is used to indicate the admission method of the QoS flow involved in the multimodal session, wherein the admission method includes at least one of full admission and partial admission;

[0097] Auxiliary information for the second user equipment;

[0098] The first multimodal service indication information includes at least one of the following:

[0099] UE-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs;

[0100] Protocol Data Unit (PDU) Session-Level Multimodal Service Indicator is used to indicate the multimodal service to which the QoS flow in the PDU session of the first user equipment belongs;

[0101] QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs.

[0102] In one embodiment, the assistance information of the second user equipment includes at least one of the following:

[0103] The identifier of the second user equipment is used to indicate the second user equipment participating in the multimodal service of the first user equipment, and to request the establishment of a multimodal service for the second user equipment;

[0104] The second multimodal service indication information is used to indicate the multimodal services in which each second user equipment participates. The second multimodal service indication information includes at least one of UE-level multimodal service indication, PDU session-level multimodal service indication, and QoS flow-level multimodal service indication.

[0105] QoS parameter information, used to indicate the QoS parameters of a QoS flow;

[0106] Radio resource information is used to indicate the radio resource requirements of each second user equipment;

[0107] The second multimodal service indication information includes at least one of the following:

[0108] UE-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs;

[0109] Protocol Data Unit (PDU) Session-Level Multimodal Service Indicator is used to indicate the multimodal service to which the QoS flow in the PDU session of the second user equipment belongs;

[0110] QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs;

[0111] The wireless resource information includes at least one of the following:

[0112] The number of radio resources required for multimodal services of the second user equipment;

[0113] The radio resource requirements corresponding to the QoS stream of each second user device belonging to a multimodal service;

[0114] The radio resource requirements for each PDU session of a second user equipment belonging to a multimodal service.

[0115] In one embodiment, the first service request further includes at least one of the following:

[0116] Initial context establishment request message; PDU session resource establishment request message; PDU session resource modification request message.

[0117] In one embodiment, the method further includes:

[0118] Receive a feedback message from the first communication node, the feedback message containing the result of whether the QoS flow is accepted or rejected;

[0119] Based on the feedback message, determine whether to request the establishment of a multimodal service for the second user equipment.

[0120] In one embodiment, the method further includes:

[0121] Receive an initial UE message, the initial UE message containing the multimodal service indication, the multimodal service indication being used to indicate that the user equipment needs to establish a multimodal service;

[0122] The configuration strategy for the QoS flow of the multimodal service is determined based on the initial UE message.

[0123] In one embodiment, the method further includes:

[0124] Send an interface establishment request message to the fifth communication node, or receive an interface establishment request message from the fifth communication node;

[0125] The interface establishment request message contains multimodal capability information;

[0126] The multimodal capability information includes at least one of the following:

[0127] The node multimodal capability indicator is used to indicate whether the communication node that sends the interface establishment request message has the capability to provide multimodal services.

[0128] Cell multimodal capability indicator: Used to indicate whether each identified cell has the capability to provide multimodal services.

[0129] In one embodiment, the method further includes:

[0130] Send a configuration update request message to the fifth communication node, or receive a configuration update request message from the fifth communication node;

[0131] The configuration update request message contains multimodal capability information;

[0132] The multimodal capability information includes at least one of the following:

[0133] The node multimodal capability indicator is used to indicate whether the communication node that sends the interface establishment request message has the capability to provide multimodal services.

[0134] The cell multimodal capability indicator is used to indicate whether each identified cell has the capability to provide multimodal services.

[0135] The multimodal communication method of this application is illustrated by some embodiments below.

[0136] In one embodiment, a method for interacting with multimodal capabilities is provided. The interaction of multimodal capabilities can be achieved during the interface establishment process of network-side nodes. Multimodal capabilities can interact between wireless network nodes, or between wireless network nodes and core network nodes. Multimodal capabilities can refer to the network node's ability to support multimodal services, i.e., whether it supports providing key functions such as coordinated transmission, quality assurance, and resource allocation coordination for QoS flows of multimodal services, to ensure the reliable and smooth operation of multimodal applications.

[0137] Figure 3 is a schematic diagram of an interactive multimodal capability provided in one embodiment. As shown in Figure 3, both Node 1 and Node 2 can be wireless network nodes. For example, Node 1 and Node 2 can be different base stations; or in a CU / DU architecture base station, Node 1 is the CU of the base station, and Node 2 is the DU of the base station. On the other hand, Node 1 can also be a wireless network node, while Node 2 belongs to the core network node. For example, Node 1 is a base station, while Node 2 is an AMF node on the core network side. This cross-node multimodal service support capability interaction enables multimodal services to be established on nodes that support the service, thereby providing users with collaborative multimodal data transmission services.

[0138] Node 1 can be either the first or the fifth communication node, and correspondingly, Node 2 can be either the fifth or the first communication node.

[0139] As shown in Figure 3, the process of interactive multimodal capability includes:

[0140] Step 1: During the process of establishing an interface between Node 1 and Node 2, Node 1 sends an Interface Setup Request Message to Node 2 to initiate the interface establishment operation. This message contains multi-modal capability information, which includes at least one of the following:

[0141] Node multimodal capability indicator: Used to indicate whether this node (i.e., node 1) has the capability to support multimodal services;

[0142] Cell multimodal capability indicator: Contains one or more cell identifiers. For each cell identifier, it contains an indicator to indicate whether the corresponding cell has the capability to support multimodal services.

[0143] It is understandable that when Node 1 is a wireless network node, the multimodal capability information may include the cell multimodal capability indication.

[0144] Step 2: After receiving the interface establishment request message, Node 2 saves the relevant information in the request message, such as multimodal capability information, completes the interface establishment, and returns a feedback message to confirm that the interface has been successfully established. The feedback message contains the multimodal capability information of this node (i.e., Node 2). The content of the multimodal capability information can be found in Step 1.

[0145] In one embodiment, a method for updating multimodal capabilities is provided. After the network-side node completes interface establishment, the multimodal capability information can be updated when the multimodal capabilities change.

[0146] Figure 4 is a schematic diagram of an embodiment providing updated multimodal capabilities. As shown in Figure 4, Node 1 and Node 2 can both belong to the same wireless network node. For example, Node 1 and Node 2 may be different base stations; or in a base station using a CU / DU separation architecture, Node 1 may be the CU or DU of the base station, and Node 2 may correspond to the DU or CU of that base station. On the other hand, Node 1 and Node 2 may also belong to a wireless network node and a core network node, respectively. For example, Node 1 may be a base station or an AMF, while Node 2 may correspond to an AMF or a base station.

[0147] For example, after node 1 and node 2 have established an interface, if node 1's multimodal capabilities change due to configuration changes, node 1 and node 2 can interact regarding the changed multimodal capabilities.

[0148] As shown in Figure 4, the process of interactive multimodal capability includes:

[0149] Step 1: Node 1 sends a Configuration Updated Message to Node 2 to initiate a configuration update operation. The Configuration Updated Message contains the multimodal capability information of Node 1.

[0150] Step 2: After receiving the request message, Node 2 saves the multimodal capability information contained in the message and updates the corresponding information locally.

[0151] In one embodiment, a method for initial access cell selection and AMF based on node multimodal capability selection is provided. This method ensures that UEs wishing to establish network connections for multimodal data interaction can select suitable radio network nodes and core network nodes, thereby avoiding resource allocation failures required for multimodal services due to improper selection, and effectively improving the service reliability and experience quality of multimodal services.

[0152] Figure 5 is a schematic diagram of a cell selection based on multimodal capability and AMF provided in one embodiment. As shown in Figure 5, the base station (BS) can be the first communication node, and the AMF can be the target communication node. The process of selecting a cell and AMF based on multimodal capability includes:

[0153] Step 0: The nodes have already exchanged their respective multimodal capabilities (as in Examples 1 and 2).

[0154] Step 1: Based on its own multimodal capabilities, the base station carries a multimodal capability indication in the broadcast cell of one or more cells to indicate whether the cell has the capability to support multimodal services. (If the base station node level supports multimodal, the base station can also indicate the cell's capability to support multimodal services in the broadcast message of all cells).

[0155] Step 2: The UE receives the cell broadcast message. If the UE wants to establish a new connection for multimodal data transmission, the UE selects a target cell that supports multimodal services according to the multimodal capability indication in the cell broadcast message.

[0156] Step 3: The UE initiates an RRC connection establishment request message to the base station where the target cell is located. The message contains a multi-mode service indication, which is used to indicate that the UE needs to establish a multi-mode service.

[0157] Step 4: The base station receives the RRC Setup Request Message. If the message contains a Multi-modal Service Indicator, the base station selects a target AMF that supports multi-modal services based on the stored multi-modal capability information of the AMF node, so as to ensure that the core network side can successfully complete the policy configuration and coordination of multi-QoS flows for multi-modal services.

[0158] Step 5: The base station sends an Initial UE Message to the target AMF. The message contains a multimodal service indication, which indicates that the UE needs to establish a multimodal service.

[0159] Step 6: The core network receives the initial UE message and performs policy configuration and coordination for multi-QoS flows of multi-modal services. Following the 3GPP process definition, it completes the subsequent PDU session establishment process.

[0160] In one embodiment, a method for establishing multimodal services and allocating resources is provided. After the UE initially accesses the network, the core network can establish multimodal services and allocate resources during the subsequent multimodal service establishment process.

[0161] Figure 6 is a schematic diagram illustrating a process for establishing multimodal services and allocating resources according to an embodiment. As shown in Figure 6, the BS can be the first communication node, and the core network (CN) can be the second communication node. The process for establishing multimodal services and allocating resources includes:

[0162] Step 1: For a specific UE (the first UE), the core network sends a first service request (which can be a service setup request or a service modification request, such as a Service Setup Request Message) to the base station, requesting the establishment of a multimodal-related QoS flow for that UE. The messages used in this process may include, but are not limited to, at least one of the following 3GPP-defined messages:

[0163] Initial context setup request message (INITIAL CONTEXT SETUP REQUEST): When the UE first connects to the network, the core network initiates a service setup request to the base station, including QoS flow-related information.

[0164] PDU SESSION RESOURCE SETUP REQUEST: Used to request the allocation of resources for a specific PDU session of the UE and to configure parameters related to QoS flows.

[0165] PDU SESSION RESOURCE MODIFY REQUEST: Used to modify the configuration of existing PDU session resources to support new QoS requirements or adjust existing configurations.

[0166] The first service request message may contain multi-modal assistance information, which includes at least one of the following:

[0167] UE-level multimodal service indication: Includes a multimodal session identifier, which is used to uniquely identify a specific multimodal task or session. This task or session may be completed by a single UE or by multiple UEs working together. This identifier is used to indicate the multimodal task or session to which all QoS flows of this UE belong.

[0168] PDU Session Level Multimodal Service Indicator: Contains one or more PDU session identifiers. For each PDU session, there is a multimodal session identifier, which is used to indicate the multimodal task or session to which all QoS flows in the PDU session belong. Different PDU sessions may belong to the same or different multimodal sessions or tasks.

[0169] QoS flow level multimodal service indication: contains one or more QoS flow identifiers. For each QoS flow with an identifier, it contains a multimodal session identifier, which is used to indicate the multimodal task or session to which the QoS flow belongs. Different QoS flows may belong to the same or different multimodal sessions or tasks.

[0170] Multimodal session partial admission indication: includes one or more multimodal session identifiers. For each identifier, the multimodal task or session contains an indication that indicates whether the QoS flows involved in the multimodal session must be fully admitted or can be partially admitted.

[0171] Other UE (second UE) auxiliary information: including at least one of the following:

[0172] Identifiers of other UEs: including identifiers of one or more other UEs, used to indicate that these UEs have participated in the multimodal session or task of the current UE (first UE), and at the same time, to indicate that these UEs also need to establish the corresponding multimodal session at the target base station.

[0173] Multimodal service indication information: For each identified UE, it may include at least one of the following: UE-level multimodal service indication, PDU session-level multimodal service indication, or QoS flow-level multimodal service indication, to clarify the multimodal tasks that the UE participates in.

[0174] QoS parameter information: For each UE, the QoS flow belonging to multimodal services is identified, including the corresponding QoS parameters of these QoS flows, such as latency, reliability, and bandwidth requirements.

[0175] Radio resource requirements: For each UE (mainly referring to the second UE), one of the following may be included:

[0176] The total number of radio resources required for the UE's multimodal services;

[0177] The radio resource requirements corresponding to each QoS stream belonging to a multimodal service;

[0178] The radio resource requirements for each PDU session belonging to a multimodal service.

[0179] As an example, the quantity of wireless resources can be represented by specific parameters, such as bandwidth and the number of Physical Resource Blocks (PRBs), which facilitates resource allocation and optimization by the base station or network side, thereby better supporting the collaboration of multimodal services and ensuring quality of service.

[0180] Step 2: The base station receives the message and, based on the multimodal auxiliary information contained in the message, decides whether to accept or reject the establishment request of a certain multimodal QoS flow.

[0181] The decision-making process can be as follows: Based on the partial acceptance instruction for a multimodal session, if all QoS flows involved in a multimodal session must be accepted, the base station determines whether its resources are sufficient to meet the QoS flow requirements of the UE (i.e., the third UE, or possibly the first UE) involved in the multimodal session. Simultaneously, if there is other UE auxiliary information, the base station also needs to determine whether its resources are sufficient based on the QoS flow requirements of other UEs involved in the multimodal session. If the resources required by the UE and other UEs for the multimodal session are sufficient, and the service quality specified by the corresponding QoS parameters is also met, the base station accepts all QoS flows of the UE involved in the multimodal session and allocates corresponding resources. If all QoS flows involved in a multimodal session are not required to be accepted, the base station can determine whether to accept all QoS flows of the UE involved in the multimodal session or only accept a portion, based on the actual resource situation. If the partial acceptance instruction for a multimodal session is not carried, the base station can decide, according to its locally configured policy, whether to accept all QoS flows involved in a multimodal session or only partially. Based on this, base stations can flexibly handle resource allocation and admission of multimodal QoS streams, ensuring the effective use of network resources while meeting the transmission quality requirements of multimodal services as much as possible.

[0182] Step 3: The base station sends a feedback message to the core network (such as the AMF in the core network). The feedback message contains the result of whether the specific QoS flow was accepted. After receiving the feedback message, the core network decides whether to continue establishing a multimodal session for another UE (the fourth UE) on this base station. For example, the fourth UE can be the UE involved in the other UE auxiliary information in the multimodal auxiliary information sent in step 1 (i.e., the second UE).

[0183] The AMF decision-making basis can be as follows: If the feedback message indicates that the current base station has fully accepted all the QoS flows required by a certain multimodal session, then the AMF can continue to allocate relevant multimodal session resources to other UEs at the base station;

[0184] If the feedback indicates that the base station failed to meet the resource requirements of certain QoS flows, the AMF can assess whether to adjust the multimodal session resource configuration of other UEs, or consider reallocating resources for the relevant UEs at other base stations.

[0185] For multimodal sessions that require overall acceptance, the AMF needs to ensure that the QoS flows of all UEs involved in the session can be allocated to base stations with sufficient resources; if the current base station cannot meet this requirement, it is necessary to coordinate with other base stations or re-plan the allocation strategy for multimodal sessions.

[0186] Based on this, AMF can flexibly manage the resource scheduling of multimodal sessions, avoid multimodal service failures due to insufficient base station resources, maximize resource utilization efficiency, and ensure the service quality of multimodal services.

[0187] In one embodiment, another method for establishing multimodal services and resource allocation is provided. The first communication node can be an architecture with separate CU and DU.

[0188] Figure 7 is a schematic diagram of another process for establishing multimodal services and allocating resources according to an embodiment. As shown in Figure 7, after receiving the service establishment request message from the core network, the admission and resource allocation process on the base station side may include:

[0189] Step 1: For a given UE, the core network sends a first service request (service establishment or modification request) to the base station, requesting the establishment of a multimodal-related QoS flow for that UE. At this time, for a base station with separate CU / DU, the base station's CU receives this message, which contains the multimodal assistance information defined in the embodiments. The CU determines the target DU to accept the UE, and the CU sends a second service request (service establishment or modification request) to the target DU, requesting the establishment of a multimodal-related radio bearer for that UE. This message contains multimodal assistance information. It should be noted that the definition of the multimodal assistance information can refer to any of the above embodiments, but it does not necessarily have to be exactly the same as the content received from the core network, because the CU may establish different UEs involved in the multimodal session, or different QoS flows, on different DUs based on load-sharing strategies.

[0190] The messages used in this process may include, but are not limited to, the following 3GPP-defined messages:

[0191] UE CONTEXT SETUP REQUEST: When the UE first connects to the network, the CU initiates a service establishment request to the DU, including information related to radio bearers and QoS flows.

[0192] UE CONTEXT MODIFY REQUEST: Used to modify the configuration of the context resources of the UE on the existing DU to support new QoS requirements or adjust the existing configuration.

[0193] Step 2: The DU receives the message and, based on the multimodal auxiliary information contained in the message, decides whether to accept or reject the establishment request of a certain multimodal QoS flow. The basis for this decision can be found in any of the above embodiments. In the above embodiments, the base station mainly makes the decision based on its own base station resources, while in this embodiment, the DU makes the decision based on its own DU resources.

[0194] Step 3: DU sends a feedback message to CU, which contains the result of whether the specific QoS flow was accepted.

[0195] In one embodiment, a method for migrating multimodal service resources is provided. One or more UEs participating in the same multimodal session may have their relevant resources migrated during handover due to mobility.

[0196] Figure 8 is a schematic diagram of a multimodal service resource migration process provided in an embodiment. As shown in Figure 8, the multimodal service resource migration process includes:

[0197] Step 0: One or more UEs participating in the same multimodal session connect to the source base station (BS). Based on the measurement reports reported by one or more UEs, the source base station determines whether it is necessary to simultaneously hand over one or more UEs involved in the multimodal session to the target cell. (For example, multiple UEs may be devices belonging to the same user, located in the same location, or located close to each other. After handover, multiple UEs connected to the same base station or target cell can better coordinate multimodal data transmission and ensure data synchronization.)

[0198] Step 1: If the source base station decides to hand over one or more UEs involved in multimodal sessions to the target base station (BS), for a specific UE (the third UE, for example, the first UE), the source base station sends a handover request message to the target base station, which includes multimodal assistance information. (If the source base station decides to hand over multiple UEs involved in multimodal sessions to the target base station simultaneously, the multimodal assistance information should include assistance information for other UEs). Note that the definition of multimodal assistance information can be found in any of the above embodiments.

[0199] Step 2: The target base station receives the message and, based on the multimodal auxiliary information contained in the message, decides whether to accept or reject the UE's access. The criteria for this decision can be found in any of the above embodiments.

[0200] Step 3: The target base station sends a handover feedback message to the source base station. The feedback message contains information on whether the UE has been accepted. Based on the feedback result, the source base station can decide whether to continue handing over multiple other UEs involved in multimodal sessions (the fourth UE, for example, the second UE) to the target base station.

[0201] This application also provides a multimodal communication device. Figure 9 is a schematic diagram of the structure of a multimodal communication device according to an embodiment. As shown in Figure 9, the multimodal communication device includes:

[0202] The receiving module 310 is configured to receive a first service request from the second communication node. The first service request includes multimodal auxiliary information and is used to request the establishment of a QoS flow related to multimodality.

[0203] The processing module 320 is configured to process the first service request based on the multimodal auxiliary information.

[0204] In one embodiment,

[0205] The multimodal auxiliary information includes at least one of the following:

[0206] The first multimodal service indication information is used to indicate the multimodal services that each first user equipment participates in;

[0207] A multimodal session partial admission indication is used to indicate the admission method of the QoS flow involved in the multimodal session, wherein the admission method includes at least one of full admission and partial admission;

[0208] Auxiliary information for the second user equipment;

[0209] The first multimodal service indication information includes at least one of the following:

[0210] UE-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs;

[0211] Protocol Data Unit (PDU) Session-Level Multimodal Service Indicator is used to indicate the multimodal service to which the QoS flow in the PDU session of the first user equipment belongs;

[0212] QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs.

[0213] In one embodiment, the assistance information of the second user equipment includes at least one of the following:

[0214] The identifier of the second user equipment is used to indicate the second user equipment participating in the multimodal service of the first user equipment, and to request the establishment of a multimodal service for the second user equipment;

[0215] The second multimodal service indication information is used to indicate the multimodal services in which each second user equipment participates. The second multimodal service indication information includes at least one of UE-level multimodal service indication, PDU session-level multimodal service indication, and QoS flow-level multimodal service indication.

[0216] QoS parameter information, used to indicate the QoS parameters of a QoS flow;

[0217] Radio resource information is used to indicate the radio resource requirements of each second user equipment;

[0218] The second multimodal service indication information includes at least one of the following:

[0219] UE-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs;

[0220] Protocol Data Unit (PDU) Session-Level Multimodal Service Indicator is used to indicate the multimodal service to which the QoS flow in the PDU session of the second user equipment belongs;

[0221] QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs;

[0222] The wireless resource information includes at least one of the following:

[0223] The number of radio resources required for multimodal services of the second user equipment;

[0224] The radio resource requirements corresponding to the QoS stream of each second user device belonging to a multimodal service;

[0225] The radio resource requirements for each PDU session of a second user equipment belonging to a multimodal service.

[0226] In one embodiment, the first service request further includes at least one of the following:

[0227] Initial context establishment request message; PDU session resource establishment request message; PDU session resource modification request message.

[0228] In one embodiment, the processing module 320 is specifically configured as follows:

[0229] Accept or reject QoS flows based on the multimodal auxiliary information.

[0230] In one embodiment, the first communication node includes a CU and a DU;

[0231] The processing module 320 is specifically configured to: send a second service request to the DU via the CU, the second service request containing multimodal auxiliary information, the second service request being used to request the establishment of a QoS flow related to multimodality; and accept or reject the QoS flow via the DU based on the multimodal auxiliary information.

[0232] In one embodiment, the processing module 320 is further configured to send a feedback message to the CU via the DU, the feedback message containing the result of whether the QoS flow is accepted or rejected.

[0233] In one embodiment, the device further includes: a first switching module, configured to:

[0234] A handover request message is sent to a third communication node. The handover request message contains multimodal assistance information and is used to request that the third user equipment be handed over to the target base station.

[0235] Receive the handover feedback message from the third communication node;

[0236] The handover feedback message determines whether to hand over the fourth user equipment to the target base station.

[0237] In one embodiment, the device further includes: a second switching module, configured to:

[0238] The system receives a handover request message from a fourth communication node. The handover request message contains multimodal assistance information and is used to request the third user equipment to be handed over to the target base station.

[0239] The access of the third user equipment may be accepted or rejected based on the multimodal assistance information.

[0240] Send a handover feedback message to the fourth communication node.

[0241] In one embodiment, the device further includes an interaction module configured to:

[0242] Send an interface establishment request message to the fifth communication node, or receive an interface establishment request message from the fifth communication node;

[0243] The interface establishment request message contains multimodal capability information;

[0244] The multimodal capability information includes at least one of the following:

[0245] The node multimodal capability indicator is used to indicate whether the communication node that sends the interface establishment request message has the capability to provide multimodal services.

[0246] Cell multimodal capability indicator: Used to indicate whether each identified cell has the capability to provide multimodal services.

[0247] In one embodiment, the device further includes an update module configured to:

[0248] Send a configuration update request message to the fifth communication node, or receive a configuration update request message from the fifth communication node;

[0249] The configuration update request message contains multimodal capability information;

[0250] The multimodal capability information includes at least one of the following:

[0251] The node multimodal capability indicator is used to indicate whether the communication node that sends the interface establishment request message has the capability to provide multimodal services.

[0252] The cell multimodal capability indicator is used to indicate whether each identified cell has the capability to provide multimodal services.

[0253] In one embodiment, the apparatus further includes a broadcast module configured to transmit a broadcast message in at least one cell, the broadcast message containing a multimodal capability indication, the multimodal capability indication being used to indicate whether the at least one cell has the capability to provide multimodal services.

[0254] In one embodiment, the device further includes a service indication module, configured to:

[0255] Receive an RRC connection establishment request message from the fifth user equipment, wherein the RRC connection establishment request message contains a multimodal service indication;

[0256] Send an initial UE message to the target communication node, the initial UE message containing the multimodal service indication;

[0257] The multimodal service indication is used to indicate that the fifth user equipment needs to establish a multimodal service.

[0258] In one embodiment, the target communication node is determined based on the multimodal service indication and the multimodal capability information of the fifth communication node.

[0259] The multimodal communication device proposed in this embodiment belongs to the same concept as the multimodal communication method proposed in the above embodiments. Technical details not described in detail in this embodiment can be found in any of the above embodiments. Furthermore, this embodiment has the same beneficial effects as performing the multimodal communication method.

[0260] This application also provides another multimodal communication device. Figure 10 is a schematic diagram of the structure of a multimodal communication device according to an embodiment. As shown in Figure 10, the multimodal communication device includes:

[0261] The request module 410 is configured to send a first service request to the first communication node. The first service request includes multimodal auxiliary information and is used to request the establishment of a QoS flow related to multimodality.

[0262] In one embodiment,

[0263] The multimodal auxiliary information includes at least one of the following:

[0264] The first multimodal service indication information is used to indicate the multimodal services that each first user equipment participates in;

[0265] A multimodal session partial admission indication is used to indicate the admission method of the QoS flow involved in the multimodal session, wherein the admission method includes at least one of full admission and partial admission;

[0266] Auxiliary information for the second user equipment;

[0267] The first multimodal service indication information includes at least one of the following:

[0268] UE-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs;

[0269] Protocol Data Unit (PDU) Session-Level Multimodal Service Indicator is used to indicate the multimodal service to which the QoS flow in the PDU session of the first user equipment belongs;

[0270] QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs.

[0271] In one embodiment, the assistance information of the second user equipment includes at least one of the following:

[0272] The identifier of the second user equipment is used to indicate the second user equipment participating in the multimodal service of the first user equipment, and to request the establishment of a multimodal service for the second user equipment;

[0273] The second multimodal service indication information is used to indicate the multimodal services in which each second user equipment participates. The second multimodal service indication information includes at least one of UE-level multimodal service indication, PDU session-level multimodal service indication, and QoS flow-level multimodal service indication.

[0274] QoS parameter information, used to indicate the QoS parameters of a QoS flow;

[0275] Radio resource information is used to indicate the radio resource requirements of each second user equipment;

[0276] The second multimodal service indication information includes at least one of the following:

[0277] UE-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs;

[0278] Protocol Data Unit (PDU) Session-Level Multimodal Service Indicator is used to indicate the multimodal service to which the QoS flow in the PDU session of the second user equipment belongs;

[0279] QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs;

[0280] The wireless resource information includes at least one of the following:

[0281] The number of radio resources required for multimodal services of the second user equipment;

[0282] The radio resource requirements corresponding to the QoS stream of each second user device belonging to a multimodal service;

[0283] The radio resource requirements for each PDU session of a second user equipment belonging to a multimodal service.

[0284] In one embodiment, the first service request further includes at least one of the following:

[0285] Initial context establishment request message; PDU session resource establishment request message; PDU session resource modification request message.

[0286] In one embodiment, the apparatus further includes a service determination module, configured to:

[0287] Receive feedback messages from the first communication node, the feedback messages containing the result of whether the QoS flow is accepted or rejected; determine whether to request the establishment of multimodal services for the second user equipment based on the feedback messages.

[0288] In one embodiment, the device further includes a configuration module configured to:

[0289] Receive an initial UE message, the initial UE message containing the multimodal service indication, the multimodal service indication being used to indicate that the user equipment needs to establish a multimodal service;

[0290] The configuration strategy for the QoS flow of the multimodal service is determined based on the initial UE message.

[0291] In one embodiment, the device further includes an interaction module configured to:

[0292] Send an interface establishment request message to the fifth communication node, or receive an interface establishment request message from the fifth communication node;

[0293] The interface establishment request message contains multimodal capability information;

[0294] The multimodal capability information includes at least one of the following:

[0295] The node multimodal capability indicator is used to indicate whether the communication node that sends the interface establishment request message has the capability to provide multimodal services.

[0296] Cell multimodal capability indicator: Used to indicate whether each identified cell has the capability to provide multimodal services.

[0297] In one embodiment, the device further includes an update module configured to:

[0298] Send a configuration update request message to the fifth communication node, or receive a configuration update request message from the fifth communication node;

[0299] The configuration update request message contains multimodal capability information;

[0300] The multimodal capability information includes at least one of the following:

[0301] The node multimodal capability indicator is used to indicate whether the communication node that sends the interface establishment request message has the capability to provide multimodal services.

[0302] The cell multimodal capability indicator is used to indicate whether each identified cell has the capability to provide multimodal services.

[0303] The multimodal communication device proposed in this embodiment belongs to the same concept as the multimodal communication method proposed in the above embodiments. Technical details not described in detail in this embodiment can be found in any of the above embodiments. Furthermore, this embodiment has the same beneficial effects as performing the multimodal communication method.

[0304] This application also provides a communication node. Figure 11 is a schematic diagram of the hardware structure of a communication node provided in an embodiment. As shown in Figure 11, the communication node provided in this application includes a processor 510 and a memory 520. The processor 510 in the communication node can be one or more, and Figure 11 shows one processor 510 as an example. The memory 520 is configured to store one or more programs. The one or more programs are executed by the one or more processors 510, so that the one or more processors 510 implement the multimodal communication method as described in the embodiment of this application.

[0305] The communication node also includes: a communication device 530, an input device 540, and an output device 550.

[0306] The processor 510, memory 520, communication device 530, input device 540 and output device 550 in the communication node can be connected by a bus or other means. Figure 11 shows an example of connection by bus.

[0307] Input device 540 can be used to receive input digital or character information, and to generate key signal inputs related to user settings and function control of the communication node. Output device 550 may include display devices such as a display screen.

[0308] The communication device 530 may include a receiver and a transmitter. The communication device 530 is configured to perform information transmission and reception communication under the control of the processor 510.

[0309] The memory 520, as a computer-readable storage medium, can be configured to store software programs, computer-executable programs, and modules, such as program instructions / modules corresponding to the multimodal communication method described in the embodiments of this application (e.g., the receiving module 310 and processing module 320 in a multimodal communication device). The memory 520 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and at least one application program required for a function; the data storage area may store data created based on the use of the communication node, etc. Furthermore, the memory 520 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 520 may further include memory remotely located relative to the processor 510, and these remote memories can be connected to the communication node via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0310] This application also provides a storage medium storing a computer program, which, when executed by a processor, implements any of the multimodal communication methods described in this application.

[0311] This application also provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements any of the multimodal communication methods described in this application.

[0312] The computer storage medium in this application embodiment can be any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable CD-ROM, optical storage device, magnetic storage device, or any suitable combination thereof. The computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0313] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit programs for use by or in connection with an instruction execution system, apparatus, or device.

[0314] Program code contained on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, radio frequency (RF), etc., or any suitable combination thereof.

[0315] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0316] This application also provides a computer program product, including a computer program / instructions, which, when executed by a processor, implement the multimodal communication method as described in any of the above embodiments.

[0317] The above description is merely an exemplary embodiment of this application and is not intended to limit the scope of protection of this application.

[0318] Those skilled in the art will understand that the term user terminal encompasses any suitable type of wireless user equipment, such as mobile phones, portable data processing portable web browsers, or vehicle-mounted mobile stations.

[0319] Generally, the various embodiments of this application can be implemented in hardware or dedicated circuitry, software, logic, or any combination thereof. For example, some aspects can be implemented in hardware, while others can be implemented in firmware or software that can be executed by a controller, microprocessor, or other computing device, although this application is not limited thereto.

[0320] Embodiments of this application can be implemented by executing computer program instructions through the data processor of a mobile device, for example, in a processor entity, or through hardware, or through a combination of software and hardware. The computer program instructions can be assembly instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages.

[0321] Any block diagram of logical flow in the accompanying drawings of this application may represent program steps, or may represent interconnected logic circuits, modules, and functions, or may represent a combination of program steps and logic circuits, modules, and functions. The computer program may be stored in memory. The memory may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as, but not limited to, read-only memory (ROM), random access memory (RAM), optical storage devices and systems (Digital Video Disc (DVD) or Compact Disk (CD), etc.). Computer-readable media may include non-transitory storage media. The data processor may be of any type suitable to the local technical environment, such as, but not limited to, general-purpose computers, special-purpose computers, microprocessors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), and processors based on multi-core processor architectures.

Claims

1. A multimodal communication method, applied to a first communication node, comprising: Receive a first service request from a second communication node, the first service request containing multimodal assistance information, the first service request being used to request the establishment of a QoS flow related to multimodality; The first service request is processed based on the multimodal auxiliary information.

2. The method according to claim 1, wherein, The multimodal auxiliary information includes at least one of the following: The first multimodal service indication information is used to indicate the multimodal services in which the first user equipment participates; A multimodal session partial admission indication is used to indicate the admission method of the QoS flow involved in the multimodal session, wherein the admission method includes at least one of full admission and partial admission; Auxiliary information for the second user equipment; The first multimodal service indication information includes at least one of the following: User equipment (UE) level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs; Protocol Data Unit (PDU) Session-Level Multimodal Service Indicator is used to indicate the multimodal service to which the QoS flow in the PDU session of the first user equipment belongs; QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs.

3. The method according to claim 2, wherein, The auxiliary information of the second user equipment includes at least one of the following: The identifier of the second user equipment is used to indicate the second user equipment participating in the multimodal service of the first user equipment, and to request the establishment of a multimodal service for the second user equipment; The second multimodal service indication information is used to indicate the multimodal services in which the second user equipment participates; QoS parameter information, used to indicate the QoS parameters of a QoS flow; Radio resource information, used to indicate the radio resource requirements of the second user equipment; The second multimodal service indication information includes at least one of the following: UE-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs; PDU session-level multimodal service indication is used to indicate the multimodal service to which the QoS flow in the PDU session of the second user equipment belongs; QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs; The wireless resource information includes at least one of the following: The amount of radio resources required for the multimodal services of the second user equipment; The radio resource requirements corresponding to the QoS flow of the second user equipment belonging to multimodal services; The radio resource requirements corresponding to the PDU session of the second user equipment belonging to multimodal services.

4. The method according to claim 1, wherein, The first service request also includes at least one of the following: Initial context establishment request message; PDU session resource establishment request message; PDU session resource modification request message.

5. The method according to claim 1, wherein, The step of processing the first service request based on the multimodal assistance information includes: Accept or reject QoS flows based on the multimodal auxiliary information.

6. The method according to claim 1, wherein, The first communication node includes a centralized unit (CU) and a distributed unit (DU); The step of processing the first service request based on the multimodal assistance information includes: The CU sends a second service request to the DU, the second service request containing the multimodal assistance information, and the second service request is used to request the establishment of a QoS flow related to multimodality; The DU accepts or rejects QoS flows based on the multimodal auxiliary information.

7. The method according to claim 6, wherein, The step of processing the first service request based on the multimodal assistance information further includes: The DU sends a feedback message to the CU, the feedback message containing the result of whether the QoS flow is accepted or rejected.

8. The method according to claim 1, further comprising: A handover request message is sent to a third communication node. The handover request message contains the multimodal assistance information and is used to request that the third user equipment be handed over to the target base station. Receive the handover feedback message from the third communication node; The handover feedback message determines whether to hand over the fourth user equipment to the target base station.

9. The method according to claim 1, further comprising: The system receives a handover request message from a fourth communication node, the handover request message containing the multimodal assistance information, and the handover request message is used to request the third user equipment to be handed over to the target base station. The access of the third user equipment may be accepted or rejected based on the multimodal assistance information. Send a handover feedback message to the fourth communication node.

10. The method according to claim 1, further comprising: Send an interface establishment request message to the fifth communication node, or receive an interface establishment request message from the fifth communication node; The interface establishment request message contains multimodal capability information; The multimodal capability information includes at least one of the following: The node multimodal capability indicator is used to indicate whether the communication node that sends the interface establishment request message has the capability to provide multimodal services. Cell multimodal capability indicator: Used to indicate whether the identified cell has the capability to provide multimodal services.

11. The method of claim 10, further comprising: Send a configuration update request message to the fifth communication node, or receive a configuration update request message from the fifth communication node; The configuration update request message contains the multimodal capability information.

12. The method according to claim 1, further comprising: A broadcast message is sent in at least one cell, the broadcast message containing a multimodal capability indication, the multimodal capability indication being used to indicate whether the at least one cell has the capability to provide multimodal services.

13. The method according to claim 1, further comprising: Receive a Radio Resource Control (RRC) Connection Establishment Request message from a fifth user equipment, wherein the RRC Connection Establishment Request message contains a multimodal service indication; Send an initial UE message to the target communication node, the initial UE message containing the multimodal service indication; The multimodal service indication is used to indicate that the fifth user equipment needs to establish a multimodal service.

14. The method according to claim 13, wherein, The target communication node is determined based on the multimodal service indication and the multimodal capability information of the fifth communication node.

15. A multimodal communication method, applied to a second communication node, comprising: A first service request is sent to the first communication node. The first service request contains multimodal auxiliary information and is used to request the establishment of a QoS flow related to multimodality.

16. The method according to claim 15, wherein, The multimodal auxiliary information includes at least one of the following: The first multimodal service indication information is used to indicate the multimodal services in which the first user equipment participates; A multimodal session partial admission indication is used to indicate the admission method of the QoS flow involved in the multimodal session, wherein the admission method includes at least one of full admission and partial admission; Auxiliary information for the second user equipment; The first multimodal service indication information includes at least one of the following: User equipment (UE) level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs; Protocol Data Unit (PDU) Session-Level Multimodal Service Indicator is used to indicate the multimodal service to which the QoS flow in the PDU session of the first user equipment belongs; QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the first user equipment belongs.

17. The method according to claim 16, wherein, The auxiliary information of the second user equipment includes at least one of the following: The identifier of the second user equipment is used to indicate the second user equipment participating in the multimodal service of the first user equipment, and to request the establishment of a multimodal service for the second user equipment; The second multimodal service indication information is used to indicate the multimodal services in which the second user equipment participates; QoS parameter information, used to indicate the QoS parameters of a QoS flow; Radio resource information, used to indicate the radio resource requirements of the second user equipment; The second multimodal service indication information includes at least one of the following: UE-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs; Protocol Data Unit (PDU) Session-Level Multimodal Service Indicator is used to indicate the multimodal service to which the QoS flow in the PDU session of the second user equipment belongs; QoS flow-level multimodal service indication is used to indicate the multimodal service to which the QoS flow of the second user equipment belongs; The wireless resource information includes at least one of the following: The amount of radio resources required for the multimodal services of the second user equipment; The radio resource requirements corresponding to the QoS flow of the second user equipment belonging to multimodal services; The radio resource requirements corresponding to the PDU session of the second user equipment belonging to multimodal services.

18. The method according to claim 15, wherein, The first service request also includes at least one of the following: Initial context establishment request message; PDU session resource establishment request message; PDU session resource modification request message.

19. The method of claim 15, further comprising: Receive a feedback message from the first communication node, the feedback message containing the result of whether the QoS flow is accepted or rejected; Based on the feedback message, determine whether to request the establishment of a multimodal service for the second user equipment.

20. The method of claim 15, further comprising: Receive an initial UE message, the initial UE message containing the multimodal service indication, the multimodal service indication being used to indicate that the user equipment needs to establish a multimodal service; The configuration strategy for the QoS flow of the multimodal service is determined based on the initial UE message.

21. The method of claim 15, further comprising: Send an interface establishment request message to the fifth communication node, or receive an interface establishment request message from the fifth communication node; The interface establishment request message contains multimodal capability information; The multimodal capability information includes at least one of the following: The node multimodal capability indicator is used to indicate whether the communication node that sends the interface establishment request message has the capability to provide multimodal services. Cell multimodal capability indicator: Used to indicate whether the identified cell has the capability to provide multimodal services.

22. The method of claim 21, further comprising: Send a configuration update request message to the fifth communication node, or receive a configuration update request message from the fifth communication node; The configuration update request message contains the multimodal capability information.

23. A communication node, comprising: Memory, and one or more processors; The memory is configured to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the multimodal communication method as described in any one of claims 1-22.

24. A computer-readable storage medium having a computer program stored thereon, the computer program, when executed by a processor, implementing the multimodal communication method as described in any one of claims 1-22.

Images