Multi-mode service cooperative communication method and device, electronic equipment and storage medium

Abstract

The invention provides a multi-mode service cooperative communication method and device, electronic equipment and a storage medium, and relates to the technical field of communication, the method comprises the following steps: sending a first message to a user plane data function (UPF), the first message comprising quality of service (QoS) policy information; the QoS strategy information is used for indicating a link transmission strategy for transmitting at least one service flow in a multi-mode service to an augmented reality XR terminal, so that the XR terminal obtains the link transmission strategy for transmitting the at least one service flow in the multi-mode service based on the QoS strategy information, converged communication of XR multi-mode service cooperation is realized, and XR user experience is improved.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a multimodal service collaborative communication method, apparatus, electronic device and storage medium. Background Technology

[0002] Immersive experiences such as multiplayer Extended Reality (XR) competitive games, XR collaborative design, and XR cultural tourism typically involve multiple service flows, including audio, video, gesture, and location. These service flows are interconnected and are referred to as multimodal services. Current 5G networks, based on Quality of Service (QoS) policies, enhance multimodal service flows (audio, video, haptic feedback, etc.) to simultaneously reach end users, thereby ensuring the coordinated transmission of multimodal services.

[0003] Currently, XR services using 5G and WiFi converged communication are being explored, especially in XR parks. Current solutions mostly carry XR services independently on 5G or WiFi links without considering the coordinated transmission between several service streams. The two heterogeneous networks do not play a synergistic role, which particularly restricts the improvement of space efficiency in large XR spaces and other industry parks, and affects enterprise revenue.

[0004] Therefore, how to achieve converged communication for XR multimodal service collaboration is a technical problem that urgently needs to be solved. Summary of the Invention

[0005] This application provides a multimodal service collaborative communication method, apparatus, electronic device, and storage medium to solve the problem of how to achieve converged communication for XR multimodal service collaboration.

[0006] This application provides a multimodal service cooperative communication method applied to the Session Management Function (SMF), including: Send a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal.

[0007] According to the multimodal service cooperative communication method provided in this application, the QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

[0008] According to the multimodal service collaborative communication method provided in this application, the sending of the first message to the User Plane Data Function (UPF) is triggered based on any of the following: The first policy and charging control rule received from the Policy Control Function (PCF); the first policy and charging control rule includes at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID; The received predefined second policy and charging control rules issued by the PCF; the second policy and charging control rules include a specific 5QI value or a predefined rule ID; Local configuration information.

[0009] According to the multimodal service cooperative communication method provided in this application, the method further includes: The XR terminal receives first information sent by the UPF, the first information including QoS monitoring results, the QoS monitoring results being obtained by the XR terminal based on the QoS monitoring policy.

[0010] According to the multimodal service collaborative communication method provided in this application, the first information further includes the multimodal service ID and / or the link ID.

[0011] According to the multimodal service cooperative communication method provided in this application, the method further includes: The second information is reported to the PCF, NEF and AF respectively. The second information includes at least one of the QoS monitoring results, the multimodal service ID and the link ID.

[0012] According to the multimodal service cooperative communication method provided in this application, the method further includes: The XR terminal receives third information sent by the UPF, the third information including fourth indication information and / or link ID, the fourth indication information being used to indicate that the XR terminal supports WiFi link transmission; A fourth message is sent to the PCF, NEF, and AF respectively. The fourth message includes a fifth indication message and / or the link ID. The fifth indication message is used to indicate that the XR terminal supports WiFi link transmission.

[0013] According to the multimodal service collaborative communication method provided in this application, the link is a 5G link or a WiFi link.

[0014] This application provides a multimodal service cooperative communication method applied to the User Plane Data Function (UPF), including: The system receives a first message sent by the Session Management Function (SMF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal. The QoS policy information is sent to the XR terminal.

[0015] According to the multimodal service cooperative communication method provided in this application, the QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

[0016] According to the multimodal service cooperative communication method provided in this application, the method further includes: The XR terminal receives a fifth piece of information, which includes a QoS monitoring result obtained by the XR terminal based on the QoS monitoring policy.

[0017] According to the multimodal service collaborative communication method provided in this application, the fourth information further includes the multimodal service ID and / or the link ID.

[0018] According to the multimodal service cooperative communication method provided in this application, the method further includes: Send first information to the SMF or the Network Data Analysis Function (NWDAF), the first information including the QoS monitoring results.

[0019] According to the multimodal service collaborative communication method provided in this application, the first information further includes the multimodal service ID and / or the link ID.

[0020] According to the multimodal service cooperative communication method provided in this application, before sending the QoS policy information to the XR terminal, the method further includes: Receive a first request message sent by the XR terminal, the first request message being used to request the XR terminal to establish a link connection with the UPF; A first response message is sent to the XR terminal, which is used to instruct the XR terminal to complete the link connection with the UPF.

[0021] According to the multimodal service cooperative communication method provided in this application, the first request message carries at least one of the following: user equipment UE ID, subscription identifier, and link type; the first response message carries the link ID.

[0022] According to the multimodal service cooperative communication method provided in this application, the method further includes: Send a third message to the SMF, the third message including a fourth indication message and / or a link ID, the fourth indication message being used to indicate that the XR terminal supports WiFi link transmission.

[0023] According to the multimodal service collaborative communication method provided in this application, the link is a 5G link or a WiFi link.

[0024] This application provides a multimodal service cooperative communication method, applied to extended reality XR terminals, including: Obtain Quality of Service (QoS) policy information, which is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the XR terminal.

[0025] According to the multimodal service cooperative communication method provided in this application, the QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

[0026] According to the multimodal service cooperative communication method provided in this application, the step of obtaining Quality of Service (QoS) policy information includes any one of the following: Receive the QoS policy information generated by the Session Management Function (SMF); Receive the QoS policy information sent by the User Plane Data Function (UPF).

[0027] According to the multimodal service cooperative communication method provided in this application, the method further includes: Based on the QoS monitoring strategy, determine the QoS monitoring results; The fifth piece of information is reported to the UPF, which includes the QoS monitoring results.

[0028] According to the multimodal service collaborative communication method provided in this application, the fifth information further includes the multimodal service ID and / or the link ID.

[0029] According to the multimodal service cooperative communication method provided in this application, before obtaining the Quality of Service (QoS) policy information, the method further includes: Send a first request message to the UPF, the first request message being used to request the XR terminal to establish a link connection with the UPF; The XR terminal receives a first response message sent by the UPF, which is used to instruct the XR terminal to complete the link connection with the UPF.

[0030] According to the multimodal service cooperative communication method provided in this application, the first request message carries at least one of the following: user equipment UE ID, subscription identifier, and link type; the first response message carries the link ID.

[0031] According to the multimodal service collaborative communication method provided in this application, the link is a 5G link or a WiFi link.

[0032] This application also provides a multimodal service cooperative communication method, applied to the policy control function (PCF), including: The SMF sends policy and charging control rules to the Session Management Function (SMF). These rules include either a first policy and charging control rule or a second policy and charging control rule. Both the first and second policies and charging control rules are used by the SMF to send a first message to the User Plane Data Function (UPF). The first message includes Quality of Service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in multimodal services to the Extended Reality (XR) terminal.

[0033] According to the multimodal service cooperative communication method provided in this application, the QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

[0034] According to the multimodal service collaborative communication method provided in this application, the first policy and charging control rule includes at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

[0035] According to the multimodal service collaborative communication method provided in this application, the second strategy and charging control rule includes a specific 5QI value or a predefined rule ID.

[0036] According to the multimodal service cooperative communication method provided in this application, the method further includes: The XR terminal receives second information reported by the SMF, the second information including at least one of QoS monitoring results, the multimodal service ID and the link ID, wherein the QoS monitoring results are obtained by the XR terminal based on the QoS monitoring policy.

[0037] According to the multimodal service cooperative communication method provided in this application, the method further includes: The XR terminal receives a fourth message sent by the SMF, the fourth message including a fifth indication message and / or a WiFi link ID, the fifth indication message being used to indicate that the XR terminal supports WiFi link transmission.

[0038] According to the multimodal service cooperative communication method provided in this application, the method further includes: The system receives updated policy and charging control rules sent by the Network Data Analysis Function (NWDAF), wherein the updated policy and charging control rules include at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

[0039] According to the multimodal service collaborative communication method provided in this application, the link is a 5G link or a WiFi link.

[0040] This application also provides a multimodal service cooperative communication method, characterized in that it is applied to the Network Data Analysis Function (NWDAF) and includes: The system receives first information sent by the User Plane Data Function (UPF), the first information including Quality of Service (QoS) monitoring results, the QoS monitoring results being obtained by the Extended Reality (XR) terminal based on a QoS monitoring policy, the QoS monitoring policy being carried by QoS policy information, the QoS policy information being used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the XR terminal; Based on the QoS monitoring results, the updated policies and billing control rules are determined.

[0041] According to the multimodal service cooperative communication method provided in this application, the QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; The QoS monitoring strategy.

[0042] According to the multimodal service collaborative communication method provided in this application, the second information further includes the multimodal service ID and / or the link ID.

[0043] According to the multimodal service cooperative communication method provided in this application, the method further includes: The updated policy and charging control rules are sent to the Policy Control Function (PCF). The updated policy and charging control rules include at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

[0044] According to the multimodal service collaborative communication method provided in this application, the link is a 5G link or a WiFi link.

[0045] This application also provides a multimodal service cooperative communication device applied to the Session Management Function (SMF), including: The first sending module is used to send a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal.

[0046] This application also provides a multimodal service cooperative communication device applied to the User Plane Data Function (UPF), comprising: The first receiving module is configured to receive a first message sent by the Session Management Function (SMF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal. The second sending module is used to send the QoS policy information to the XR terminal.

[0047] This application also provides a multimodal service collaborative communication device, applied to an extended reality XR terminal, comprising: The acquisition module is used to acquire Quality of Service (QoS) policy information, which is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the XR terminal.

[0048] This application also provides a multimodal service cooperative communication device applied to a policy control function (PCF), comprising: The third sending module is used to send policy and charging control rules to the Session Management Function (SMF). The policy and charging control rules include a first policy and charging control rule or a second policy and charging control rule. Both the first and second policy and charging control rules are used by the SMF to send a first message to the User Plane Data Function (UPF). The first message includes Quality of Service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in multimodal services to the Extended Reality (XR) terminal.

[0049] This application also provides a multimodal service cooperative communication device for use in network data analysis function (NWDAF), comprising: The second receiving module is used to receive first information sent by the User Plane Data Function (UPF). The first information includes a Quality of Service (QoS) monitoring result. The QoS monitoring result is obtained by the Extended Reality (XR) terminal based on a QoS monitoring policy. The QoS monitoring policy is carried by QoS policy information, which is used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the XR terminal. The determination module is used to determine the updated policy and billing control rules based on the QoS monitoring results.

[0050] This application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement any of the multimodal service collaborative communication methods described above.

[0051] This application also provides a non-transitory computer-readable storage medium storing a computer program thereon, characterized in that the computer program, when executed by a processor, implements any of the multimodal service cooperative communication methods described above.

[0052] This application also provides a computer program product, including a computer program, characterized in that, when the computer program is executed by a processor, it implements any of the multimodal service collaborative communication methods described above.

[0053] The multimodal service collaborative communication method, apparatus, electronic device, and storage medium provided in this application send a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal, so that the XR terminal can know the link transmission policy for transmitting at least one service flow of multimodal services based on the QoS policy information, thereby realizing converged communication for XR multimodal service collaboration and improving the XR user experience. Attached Figure Description

[0054] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0055] Figure 1 This is a flowchart illustrating the multimodal business collaboration process provided by existing technologies.

[0056] Figure 2 This is a schematic diagram of the architecture provided in this application.

[0057] Figure 3 This is one of the flowcharts of the multimodal service collaborative communication method provided in this application.

[0058] Figure 4 This is a schematic diagram of the dual-link establishment process provided in this application.

[0059] Figure 5 This is a flowchart illustrating the process of sending QoS policy information to an XR terminal, as provided in this application.

[0060] Figure 6 This is a flowchart illustrating the process of QoS monitoring result reporting and policy and charging control rule updates provided in this application.

[0061] Figure 7 This is the second flowchart of the multimodal service collaborative communication method provided in this application.

[0062] Figure 8 This is the third flowchart of the multimodal service collaborative communication method provided in this application.

[0063] Figure 9 This is the fourth flowchart of the multimodal service collaborative communication method provided in this application.

[0064] Figure 10 This is the fifth flowchart of the multimodal service collaborative communication method provided in this application.

[0065] Figure 11 This is one of the structural schematic diagrams of the multimodal service collaborative communication device provided in this application.

[0066] Figure 12 This is the second structural schematic diagram of the multimodal service collaborative communication device provided in this application.

[0067] Figure 13 This is the third structural schematic diagram of the multimodal service collaborative communication device provided in this application.

[0068] Figure 14 This is the fourth structural schematic diagram of the multimodal service collaborative communication device provided in this application.

[0069] Figure 15 This is the fifth structural schematic diagram of the multimodal service collaborative communication device provided in this application.

[0070] Figure 16 This is a schematic diagram of the structure of the electronic device provided in this application. Detailed Implementation

[0071] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0072] To facilitate understanding of the various embodiments of this application, the relevant technical knowledge of this application will first be introduced.

[0073] The 3rd Generation Partnership Project (3GPP) Release 18, Extended Reality Media (XRM), proposes a multimodal service collaboration technology. Aiming at immersive experiences such as multiplayer XR competitive games, XR collaborative design, and XR cultural tourism, these typically involve multiple service flows, such as audio, video, gesture, and location. These service flows are interconnected and are referred to as multimodal services. Current 5G networks, based on QoS policy enhancements, enable multimodal service flows (audio, video, haptic feedback, etc.) to reach end users simultaneously, thereby ensuring the collaborative transmission of multimodal services.

[0074] Figure 1 This is a flowchart illustrating the multimodal business collaboration process provided by existing technologies, such as... Figure 1As shown, Application Functions (AFs) (which can come from multiple different AFs) provide the Policy Control Function (PCF) with the following: 1) Multi-modal Service ID: The multi-modal service ID is logically bound to multiple collaborative service flows. That is, it is an indication of the service flow and the multi-modal service. Multiple service flows in the same multi-modal service use the same ID. For example, the service flow can be 3DOF / 6DOF head display posture data, or it can be gesture, video, or audio data.

[0075] 2) Multimodal service requirements: including service QoS requests and QoS monitoring requirements.

[0076] PCF associates multiple flows (i.e. multiple service flows) based on the multimodal service ID, and generates corresponding policy and charging control rules (PCC rules) for each service flow in the multimodal service. The PCC rule includes the multimodal service ID, QoS policy, and QoS monitoring policy, and sends it to the Session Management Function (SMF).

[0077] SMF sends the latest QoS requirements, i.e. the latest QoS policies and QoS monitoring policies, to the Radio Access Network (RAN) and User Plane Function (UPF).

[0078] For immersive communication, metaverse, and other 5G-A / 6G scenarios, from a standards perspective, 3GPP has proposed a communication assurance mechanism for multimodal services. This mechanism binds different applications (APPs) to multimodal service IDs and formulates QoS enhancement strategies for inter-application collaboration, thereby ensuring a good XR user experience. However, the 3GPP standard only considers cellular communication and does not consider collaborative communication assurance between non-3GPP standards such as 5G and WiFi. From an industry perspective, mobile operators and industry partners are currently exploring XR services using 5G and WiFi converged communication, especially in XR parks. Current solutions often involve XR services being independently carried on 5G or WiFi links without considering collaborative transmission between different service flows. The two heterogeneous networks do not play a synergistic role, which particularly hinders the improvement of space efficiency in large XR spaces and other industry parks, impacting enterprise revenue.

[0079] In summary, there is currently no heterogeneous converged communication solution in the industry for XR multimodal service collaboration.

[0080] To facilitate rapid industrial deployment, the heterogeneous converged architecture should be as lightweight as possible, meaning it should not involve NAS protocol modifications or require upgrades to terminal chips. Figure 2 This is a schematic diagram of the architecture provided in this application, such as... Figure 2 As shown, the XR terminal includes a front-end heterogeneous fusion processing module, a 5G SIM card, and a WiFi module. The front-end heterogeneous fusion processing module includes a Software Development Kit (SDK), which includes a customized client proxy. A WiFi Access Point (AP) / Access Controller (AC) port is added between the UPF and the XR terminal's WiFi module. A dedicated tunnel is built based on Generic Routing Encapsulation (GRE) or Internet Security Protocol (IPSEC), or implemented using an enhanced General Packet Data Gateway (eGPDG). The AC port / eGPDG communicates with Authentication, Authorization, and Accounting (AAA). The UPF includes a rear-end heterogeneous fusion processing module, which includes a server proxy that supports processing both 5G and WiFi data.

[0081] Figure 3 This is one of the flowcharts illustrating the multimodal service collaborative communication method provided in this application, such as... Figure 3 As shown, the method is applied to an extended reality XR terminal and includes step 301.

[0082] Step 301: Obtain Quality of Service (QoS) policy information, which is used to indicate the link transmission policy for transmitting at least one service flow in multimodal services to the XR terminal.

[0083] Specifically, the XR terminal can obtain QoS policy information, which is used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the XR terminal. The link is either a 5G link or a WiFi link, enabling the SDK in the XR terminal to identify uplink services.

[0084] Optionally, the QoS policy information includes at least one of the following: (1) First indication information, used to indicate transmission via WiFi link, that is, the service flow is transmitted on WiFi link.

[0085] (2) Second indication information, used to indicate transmission via 5G link, i.e., the service flow is transmitted on 5G link.

[0086] (3) Third indication information, used to indicate the mode of WiFi link transmission, that is, the mode includes at least one of primary, redundant, aggregation, and aggregation ratio.

[0087] (4) The first request indicates a request to subscribe to WiFi link quality; (5) Multimodal service identifier ID; (6) QoS monitoring strategy.

[0088] The multimodal service collaborative communication method provided in this application obtains QoS policy information through an XR terminal. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the XR terminal, so that the XR terminal can know the link transmission policy for transmitting at least one service flow in the multimodal services based on the QoS policy information, thereby realizing converged communication for XR multimodal service collaboration and improving the XR user experience.

[0089] Optionally, before obtaining the Quality of Service (QoS) policy information, the method further includes: Send a first request message to the UPF, the first request message being used to request the XR terminal to establish a link connection with the UPF; receive a first response message sent by the UPF, the first response message being used to instruct the XR terminal to complete the link connection with the UPF.

[0090] Specifically, before obtaining QoS policy information, the XR terminal needs to establish a link with the UP. During 5G link establishment, the User Equipment (UE) (i.e., the 5G card) in the XR terminal initiates a normal 5G session. During WiFi link establishment, the XR terminal accesses the UPF through the WiFi AP / AC. The UPF uniformly manages the link IDs of the 5G and WiFi links. The UPF can allocate link IDs using either an over-IP protocol or an over-UDP protocol.

[0091] The XR terminal sends a first request message to the UPF, requesting the XR terminal to establish a link connection with the UPF. The first request message carries at least one of the following: User Equipment ID (UE ID), subscription identifier, and link type; the first response message carries a link ID. The subscription identifier can be a Subscription Permanent Identifier (SUPI). The link ID can be a link ID assigned to a 5G link or a link ID assigned to a WiFi link.

[0092] Optionally, after the link is established, the UPF detects the dual-link access of the XR terminal and triggers the N4 reporting field. It can send third information to the SMF, which includes fourth indication information and / or the WiFi link ID. The fourth indication information indicates that the XR terminal supports WiFi link transmission. Upon receiving the third information, the SMF triggers corresponding session modifications (N7, N5, and N33). The SMF then sends fifth information to the PCF, NEF, and AF, respectively. The fifth information includes fifth indication information and / or the WiFi link ID, indicating that the XR terminal supports WiFi link transmission.

[0093] Figure 4 This is a schematic diagram of the dual-link establishment process provided in this application, such as... Figure 4 As shown, it includes steps 401-408.

[0094] Step 401: The UE initiates a 5G session normally.

[0095] Step 402: The XR terminal sends a first request message to the UPF. The first request message is used to request the XR terminal to establish a link connection with the UPF. The first request message carries at least one of the following: User Equipment ID, subscription identifier, and 5G link type.

[0096] Step 403: The UPF sends a first response message to the XR terminal, which carries the 5G link ID.

[0097] Step 404: The XR terminal connects to the UPF via WiFi AP / AC.

[0098] Step 405: The XR terminal sends a first request message to the UPF. The first request message is used to request the XR terminal to establish a WiFi link connection with the UPF. The first request message carries at least one of the following: User Equipment ID, subscription identifier, and WiFi link type.

[0099] Step 406: The UPF sends a first response message to the XR terminal. The first response message carries the WiFi link ID.

[0100] Step 407: UPF sends third information to SMF via N4. The third information includes fourth indication information and / or WiFi link ID. The fourth indication information is used to indicate that the XR terminal supports WiFi link transmission.

[0101] Step 408: After receiving the third information, the SMF triggers the N7, N5, and N33 session modifications accordingly. The SMF sends the fourth information to the PCF, NEF, and AF respectively. The fourth information includes the fifth indication information and / or the link ID. The fifth indication information is used to indicate that the XR terminal supports WiFi link transmission.

[0102] It should be noted that there is no distinction in the execution order between steps 401-403 and steps 404-408; they can be executed in parallel.

[0103] Optionally, obtaining the Quality of Service (QoS) policy information includes any one of the following: Receive the QoS policy information generated by the Session Management Function (SMF); receive the QoS policy information sent by the User Plane Data Function (UPF).

[0104] Specifically, the SMF sends QoS policy information to the AMF through the N1 and N2 interfaces. The AMF can then send QoS policy information to the XR terminal through the RAN, and the XR terminal receives the QoS policy information sent by the AMF. Alternatively, the UPF can send QoS policy information to the XR terminal through the RAN, and the XR terminal receives the QoS policy information sent by the UPF.

[0105] The QoS policy information is obtained based on the following steps: AF session establishment; AF sends a second message to PCF via NEF; the second message includes at least one of the following: APP ID, multimodal service ID, first indication information, second indication information, third indication information, first request, etc.; PCF receives the second message sent by AF and generates a policy and charging control rule (PCC rule) based on the second message; the policy and charging control rule includes a first policy and charging control rule, a second policy and charging control rule, and a third policy and charging control rule; the first policy and charging control rule includes at least one of the first indication information, second indication information, third indication information, first request, and multimodal service ID; the second policy and charging control rule includes a specific 5G QoS Identifier (5QI) value or a predefined rule ID; the 5QI value and the predefined rule ID correspond to the indication information transmitted on the WiFi link. The third policy and charging control rule is a policy and charging control rule that does not include at least one of the following: first instruction information, second instruction information, third instruction information, first request and multimodal service ID, 5QI value and predefined rule ID.

[0106] If the PCF determines that the service flow is allocated to the 5G link, it sends the third policy and charging control rule to the SMF. If the PCF determines that the service flow is allocated to the WiFi link, it sends either the first or second policy and charging control rule to the SMF. Based on the first or second policy and charging control rule, the SMF generates corresponding QoS policy information and sends it to the XR terminal. It should be noted that the SMF sends QoS policy information to the XR terminal in two ways: based on the NAS protocol and without. In the NAS-based method, the SMF sends the QoS policy information to the AMF through the N1 and N2 interfaces, and the AMF then sends the QoS policy information to the XR terminal through the RAN. In the non-NAS-based method, the SMF sends a first message (i.e., a PDR message) to the UPF, which includes the QoS policy information for the server proxy to identify downlink services. The UPF then sends the QoS policy information to the XR terminal.

[0107] Figure 5 This is a flowchart illustrating the process of sending QoS policy information to an XR terminal, as provided in this application. Figure 5 As shown, it includes steps 501-507.

[0108] Step 501: AF session is established. AF sends a second message to PCF via NEF. The second message includes at least one of the following: APP ID, multimodal service ID, first instruction information, second instruction information, third instruction information, first request, etc.

[0109] Step 502: The PCF receives the second message from the AF and generates a Policy and Charging Control (PCC) rule based on the second message. The PCC rule includes a first PCC rule, a second PCC rule, and a third PCC rule. The first PCC rule includes at least one of a first indication information, a second indication information, a third indication information, a first request, and a multimodal service ID. The second PCC rule includes a specific 5G Quality of Service Identifier (5QI) value or a predefined rule ID. The 5QI value and the predefined rule ID correspond to the indication information transmitted via the WiFi link. The third PCC rule is a PCC rule that does not include at least one of the first indication information, the second indication information, the third indication information, the first request, the multimodal service ID, the 5QI value, and the predefined rule ID.

[0110] Step 503: If the PCF determines that the service flow is allocated to the 5G link for transmission, it sends the third policy and charging control rule to the SMF; if the PCF determines that the service flow is allocated to the WiFi link for transmission, it sends the first policy and charging control rule or the second policy and charging control rule to the SMF.

[0111] Step 504: SMF generates corresponding QoS policy information based on the first policy and charging control rule or the second policy and charging control rule.

[0112] Step 505: The SMF sends QoS policy information to the AMF through the N1 and N2 interfaces, and the AMF then sends the QoS policy information to the XR terminal through the RAN.

[0113] Step 506: SMF sends the first message (i.e., PDR message) to UPF. The first message includes QoS policy information.

[0114] Step 507: UPF sends QoS policy information to the XR terminal.

[0115] It should be noted that steps 505 and 506-507 are parallel solutions, and either one can be executed.

[0116] Optionally, the method further includes: Based on the QoS monitoring strategy, the QoS monitoring result is determined; the fifth piece of information, including the QoS monitoring result, is reported to the UPF.

[0117] Specifically, after obtaining QoS policy information, the XR terminal monitors QoS based on the QoS monitoring policy in the QoS policy information, obtains QoS monitoring results, and reports fifth information to the UPF, which includes the QoS monitoring results. The fifth information also includes the multimodal service ID and / or link ID. The UPF receives the fifth information sent by the XR terminal and sends first information to the SMF or Network Data Analytics Function (NWDAF), which includes the QoS monitoring results. The first information may also include the multimodal service ID and / or link ID.

[0118] The SMF reports second information to the PCF via N7, or to the NEF and AF via N5 and N33 respectively. This second information includes at least one of the following: QoS monitoring results, multimodal service ID, and link ID. The NWDAF can also update policy and charging control rules based on the QoS monitoring results, obtaining updated policy and charging control rules. The NWDAF itself includes these updated policy and charging control rules. The NWDAF can also send the updated policy and charging control rules to the PCF. The PCF can then send the updated policy and charging control rules to the SMF.

[0119] Figure 6 This is a flowchart illustrating the QoS monitoring result reporting and policy and charging control rule updates provided in this application. Figure 6 As shown, steps 601-608 are included.

[0120] Step 601: If the service flow is allocated to the 5G link for transmission, the QoS monitoring policy will be executed normally.

[0121] Step 602: If the service flow is allocated to WiFi link transmission, the XR terminal determines the QoS monitoring result based on the QoS monitoring policy.

[0122] Step 603: The XR terminal reports the fifth piece of information to the UPF. The fifth piece of information includes at least one of the following: QoS monitoring results, multimodal service ID, and link ID.

[0123] Step 604: The UPF receives the fifth information sent by the XR terminal and sends the first information to the SMF or NWDAF. The first information includes at least one of the following: QoS monitoring result, multimodal service ID, and link ID.

[0124] Step 605: The SMF reports the second information to the PCF via N7 or to the NEF and AF via N5 and N33 respectively. The second information includes at least one of the following: QoS monitoring results, multimodal service ID, and link ID.

[0125] Step 606: Based on the QoS monitoring results, NWDAF updates the policy and charging control rules to obtain the updated policy and charging control rules, wherein NWDAF includes the policy and charging control rules.

[0126] Step 607: NWDAF sends the updated policy and billing control rules to PCF.

[0127] Step 608: PCF sends the updated policy and billing control rules to SMF.

[0128] Figure 7 This is the second flowchart of the multimodal service cooperative communication method provided in this application, as shown below. Figure 7As shown, the method applied to the User Plane Data Function (UPF) includes steps 701-702.

[0129] Step 701: Receive a first message sent by the Session Management Function (SMF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal.

[0130] Specifically, the SMF generates corresponding QoS policy information based on either the first or second policy and charging control rules, and then sends the QoS policy information to the XR terminal. It should be noted that the SMF sends the QoS policy information to the XR terminal in two ways: based on the NAS protocol and without the NAS protocol. In the NAS-based method, the SMF sends the QoS policy information to the AMF via the N1 and N2 interfaces, and the AMF then sends the QoS policy information to the XR terminal via the RAN. In the non-NAS-based method, the SMF sends a first message (i.e., a PDR message) to the UPF, which includes the QoS policy information for the server proxy to identify downlink services. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the extended reality XR terminal; the link can be a 5G link or a WiFi link.

[0131] Optionally, the QoS policy information includes at least one of the following: (1) First indication information, used to indicate transmission via WiFi link, that is, the service flow is transmitted on WiFi link.

[0132] (2) Second indication information, used to indicate transmission via 5G link, i.e., the service flow is transmitted on 5G link.

[0133] (3) Third indication information, used to indicate the mode of WiFi link transmission, that is, the mode includes at least one of primary, redundant, aggregation, and aggregation ratio.

[0134] (4) The first request indicates a request to subscribe to WiFi link quality; (5) Multimodal service identifier ID; (6) QoS monitoring strategy.

[0135] Step 702: Send the QoS policy information to the XR terminal.

[0136] Specifically, the UPF sends QoS policy information to the XR terminal, enabling the SDK in the XR terminal to identify uplink services.

[0137] The multimodal service collaborative communication method provided in this application receives a first message sent by an SMF through a UPF. The first message includes Quality of Service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to an extended reality (XR) terminal. The QoS policy information is sent to the XR terminal, so that the XR terminal can learn the link transmission policy for transmitting at least one service flow of multimodal services based on the QoS policy information, thereby realizing converged communication for XR multimodal service collaboration and improving the XR user experience.

[0138] Optionally, before sending the QoS policy information to the XR terminal, the method further includes: The system receives a first request message from the XR terminal, which requests the XR terminal to establish a link connection with the UPF; and sends a first response message to the XR terminal, which instructs the XR terminal to complete the link connection with the UPF.

[0139] Specifically, before obtaining QoS policy information, the XR terminal needs to establish a link with the UP. During 5G link establishment, the User Equipment (UE) (i.e., the 5G card) in the XR terminal initiates a normal 5G session. During WiFi link establishment, the XR terminal accesses the UPF through the WiFi AP / AC. The UPF uniformly manages the link IDs of the 5G and WiFi links. The UPF can allocate link IDs using either an over-IP protocol or an over-UDP protocol.

[0140] The XR terminal sends a first request message to the UPF, requesting the XR terminal to establish a link connection with the UPF. The first request message carries at least one of the following: User Equipment ID (UE ID), subscription identifier, and link type; the first response message carries a link ID. The subscription identifier can be a Subscription Permanent Identifier (SUPI). The link ID can be a link ID assigned to a 5G link or a link ID assigned to a WiFi link.

[0141] Optionally, the method further includes: Send a third message to the SMF, the third message including a fourth indication message and / or a link ID, the fourth indication message being used to indicate that the XR terminal supports WiFi link transmission.

[0142] Specifically, after the link is established, the UPF detects the dual-link access of the XR terminal and triggers the N4 reporting field. It can then send third information to the SMF, which includes fourth indication information and / or the link ID. The fourth indication information indicates that the XR terminal supports WiFi link transmission. Upon receiving the third information, the SMF triggers corresponding session modifications (N7, N5, and N33). The SMF then sends fourth information to the PCF, NEF, and AF, respectively. This fourth information includes fifth indication information and / or the link ID, which indicates that the XR terminal supports WiFi link transmission.

[0143] Optionally, the method further includes: The XR terminal receives a fifth piece of information, which includes a QoS monitoring result obtained by the XR terminal based on the QoS monitoring policy.

[0144] Specifically, after obtaining the QoS policy information, the XR terminal monitors QoS based on the QoS monitoring policy in the QoS policy information, obtains the QoS monitoring result, and reports the fifth piece of information to the UPF. The fifth piece of information includes the QoS monitoring result. The fifth piece of information also includes the multimodal service ID and / or the WiFi link ID.

[0145] Optionally, the method further includes: Send first information to the SMF or the Network Data Analysis Function (NWDAF), the first information including the QoS monitoring results.

[0146] Specifically, the UPF receives the fifth information sent by the XR terminal and sends the first information to the SMF or NWDAF. The first information includes the QoS monitoring results. The first information may also include the multimodal service ID and / or the link ID.

[0147] The SMF reports second information to the PCF via N7, or to the NEF and AF via N5 and N33 respectively. This second information includes at least one of the following: QoS monitoring results, multimodal service ID, and link ID. The NWDAF can also update policy and charging control rules based on the QoS monitoring results, obtaining updated policy and charging control rules. The NWDAF itself includes these updated policy and charging control rules. The NWDAF can also send the updated policy and charging control rules to the PCF. The PCF can then send the updated policy and charging control rules to the SMF.

[0148] Figure 8 This is the third flowchart of the multimodal service collaborative communication method provided in this application, as shown below. Figure 8 As shown, the method applied to the Session Management Function (SMF) includes step 801.

[0149] Step 801: Send a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal.

[0150] Specifically, the SMF generates corresponding QoS policy information based on either the first or second policy and charging control rules, and then sends the QoS policy information to the XR terminal. It should be noted that the SMF sends the QoS policy information to the XR terminal in two ways: based on the NAS protocol and without the NAS protocol. In the NAS-based method, the SMF sends the QoS policy information to the AMF via the N1 and N2 interfaces, and the AMF then sends the QoS policy information to the XR terminal via the RAN. In the non-NAS-based method, the SMF sends a first message (i.e., a PDR message) to the UPF, which includes the QoS policy information for the server proxy to identify downlink services. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the extended reality XR terminal; the link can be a 5G link or a WiFi link.

[0151] Optionally, the QoS policy information includes at least one of the following: (1) First indication information, used to indicate transmission via WiFi link, that is, the service flow is transmitted on WiFi link.

[0152] (2) Second indication information, used to indicate transmission via 5G link, i.e., the service flow is transmitted on 5G link.

[0153] (3) Third indication information, used to indicate the mode of WiFi link transmission, that is, the mode includes at least one of primary, redundant, aggregation, and aggregation ratio.

[0154] (4) The first request indicates a request to subscribe to WiFi link quality; (5) Multimodal service identifier ID; (6) QoS monitoring strategy.

[0155] The multimodal service collaborative communication method provided in this application sends a first message to the User Plane Data Function (UPF) through the SMF. The first message includes Quality of Service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the Extended Reality (XR) terminal. This enables the UPF to send the QoS policy information to the XR terminal, thereby allowing the XR terminal to learn the link transmission policy for transmitting at least one service flow in the multimodal services based on the QoS policy information. This achieves converged communication for XR multimodal service collaboration and improves the XR user experience.

[0156] Optionally, the method further includes: The XR terminal receives third information sent by the UPF, the third information including fourth indication information and / or link ID, the fourth indication information being used to indicate that the XR terminal supports WiFi link transmission; and sends fourth information to the PCF, NEF and AF respectively, the fourth information including fifth indication information and / or the WiFi link ID, the fifth indication information being used to indicate that the XR terminal supports WiFi link transmission.

[0157] Specifically, before obtaining QoS policy information, the XR terminal needs to establish a link with the UP. During 5G link establishment, the User Equipment (UE) (i.e., the 5G card) in the XR terminal initiates a normal 5G session. During WiFi link establishment, the XR terminal accesses the UPF through the WiFi AP / AC. The UPF uniformly manages the link IDs of the 5G and WiFi links. The UPF can allocate link IDs using either an over-IP protocol or an over-UDP protocol.

[0158] The XR terminal sends a first request message to the UPF, requesting the XR terminal to establish a link connection with the UPF. The first request message carries at least one of the following: User Equipment ID (UE ID), subscription identifier, and link type; the first response message carries a link ID. The subscription identifier can be a Subscription Permanent Identifier (SUPI). The link ID can be a link ID assigned to a 5G link or a link ID assigned to a WiFi link.

[0159] After the link is established, the UPF detects the dual-link access of the XR terminal and triggers the N4 reporting field. It can then send third information to the SMF, which includes fourth indication information and / or the WiFi link ID. The fourth indication information indicates that the XR terminal supports WiFi link transmission. Upon receiving the third information, the SMF triggers corresponding session modifications (N7, N5, and N33). The SMF then sends fourth information to the PCF, NEF, and AF, respectively. This fourth information includes fifth indication information and / or the link ID, indicating that the XR terminal supports WiFi link transmission.

[0160] Optionally, the sending of the first message to the User Plane Data Function (UPF) is triggered based on any of the following: The first policy and charging control rule received from the Policy Control Function (PCF); the first policy and charging control rule includes at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID; The received predefined second policy and charging control rules issued by the PCF; the second policy and charging control rules include a specific 5QI value or a predefined rule ID; Local configuration information.

[0161] Specifically, upon establishing an AF session, the AF sends a second message to the PCF via the NEF. This second message includes at least one of the following: APP ID, multimodal service ID, first indication information, second indication information, third indication information, and a first request. The PCF receives the second message from the AF and, based on it, generates a policy and charging control rule (PCC rule). This rule includes a first, second, and third policy and charging control rule. The first rule includes at least one of the first, second, and third indication information, the first request, and the multimodal service ID. The second rule includes a specific 5G QoS Identifier (5QI) value or a predefined rule ID, with the 5QI value and the predefined rule ID corresponding to the indication information transmitted via the WiFi link. The third rule is a policy and charging control rule that does not include at least one of the first, second, and third indication information, the first request, the multimodal service ID, the 5QI value, and the predefined rule ID.

[0162] If the PCF determines that the service flow is allocated to the 5G link, it sends the third policy and charging control rule to the SMF. If the PCF determines that the service flow is allocated to the WiFi link, it sends either the first or second policy and charging control rule to the SMF. Based on the first or second policy and charging control rule, the SMF generates corresponding QoS policy information and sends it to the XR terminal. It should be noted that the SMF sends QoS policy information to the XR terminal in two ways: based on the NAS protocol and without. In the NAS-based method, the SMF sends the QoS policy information to the AMF through the N1 and N2 interfaces, and the AMF then sends the QoS policy information to the XR terminal through the RAN. In the non-NAS-based method, the SMF sends a first message (i.e., a PDR message) to the UPF, which includes the QoS policy information for the server proxy to identify downlink services. The UPF then sends the QoS policy information to the XR terminal.

[0163] Optionally, the SMF is pre-configured locally with configuration information. The SMF can send a first message to the UPF based on the local configuration information. The first message includes QoS policy information, which is used by the server proxy to identify downlink services. The UPF then sends the QoS policy information to the XR terminal.

[0164] Optionally, the method further includes: The XR terminal receives first information sent by the UPF, the first information including QoS monitoring results, the QoS monitoring results being obtained by the XR terminal based on the QoS monitoring policy.

[0165] Specifically, after obtaining QoS policy information, the XR terminal monitors QoS based on the QoS monitoring policy in the QoS policy information, obtains QoS monitoring results, and reports first information to the UPF. The first information includes the QoS monitoring results. The first information also includes the multimodal service ID and / or the link ID.

[0166] The UPF receives the fifth message from the XR terminal and sends the first message to the SMF. The first message includes the QoS monitoring results. The first message may also include the multimodal service ID and / or the link ID.

[0167] UPF can also send first information to NWDAF, the first information including the QoS monitoring results. NWDAF can also update policy and charging control rules based on the QoS monitoring results, obtaining updated policy and charging control rules, wherein NWDAF includes the policy and charging control rules. NWDAF can also send the updated policy and charging control rules to PCF. PCF can issue the updated policy and charging control rules to SMF.

[0168] Optionally, the method further includes: The second information is reported to the PCF, NEF and AF respectively. The second information includes at least one of the QoS monitoring results, the multimodal service ID and the link ID.

[0169] Specifically, the SMF reports the second information to the PCF via N7 or to the NEF and AF via N5 and N33 respectively. The second information includes at least one of the following: QoS monitoring results, multimodal service ID, and link ID.

[0170] Figure 9 This is the fourth flowchart of the multimodal service collaborative communication method provided in this application, as shown below. Figure 9 As shown, the method applied to the policy control function PCF includes step 901.

[0171] Step 901: Send policy and charging control rules to the Session Management Function (SMF). The policy and charging control rules include a first policy and charging control rule or a second policy and charging control rule. Both the first and second policy and charging control rules are used by the SMF to send a first message to the User Plane Data Function (UPF). The first message includes Quality of Service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in multimodal services to the Extended Reality (XR) terminal.

[0172] Specifically, upon establishing an AF session, the AF sends a second message to the PCF via the NEF. This second message includes at least one of the following: APP ID, multimodal service ID, first indication information, second indication information, third indication information, and a first request. The PCF receives the second message from the AF and, based on it, generates a policy and charging control rule (PCC rule). This rule includes a first, second, and third policy and charging control rule. The first rule includes at least one of the first, second, and third indication information, the first request, and the multimodal service ID. The second rule includes a specific 5G QoS Identifier (5QI) value or a predefined rule ID, with the 5QI value and the predefined rule ID corresponding to the indication information transmitted via the WiFi link. The third rule is a policy and charging control rule that does not include at least one of the first, second, and third indication information, the first request, the multimodal service ID, the 5QI value, and the predefined rule ID.

[0173] If the PCF determines that the service flow is allocated to a 5G link, it sends the third policy and charging control rule to the SMF. If the PCF determines that the service flow is allocated to a WiFi link, it sends either the first policy and charging control rule or the second policy and charging control rule to the SMF.

[0174] The Service Provider (SMF) generates corresponding QoS policy information based on either the first or second policy and charging control rules, and then sends this information to the XR terminal. It should be noted that the SMF sends QoS policy information to the XR terminal using either the NAS protocol or a non-NAS protocol. In the NAS-based method, the SMF sends the QoS policy information to the AMF via the N1 and N2 interfaces, and the AMF then sends the QoS policy information to the XR terminal via the RAN. In the non-NAS-based method, the SMF sends a first message (i.e., a PDR message) to the UPF, which includes the QoS policy information for the server proxy to identify downlink services. The UPF then sends the QoS policy information to the XR terminal. The QoS policy information indicates the link transmission policy for transmitting at least one service flow in the multimodal services to the extended reality XR terminal; the link can be a 5G link or a WiFi link.

[0175] Optionally, the QoS policy information includes at least one of the following: (1) First indication information, used to indicate transmission via WiFi link, that is, the service flow is transmitted on WiFi link.

[0176] (2) Second indication information, used to indicate transmission via 5G link, i.e., the service flow is transmitted on 5G link.

[0177] (3) Third indication information, used to indicate the mode of WiFi link transmission, that is, the mode includes at least one of primary, redundant, aggregation, and aggregation ratio.

[0178] (4) The first request indicates a request to subscribe to WiFi link quality; (5) Multimodal service identifier ID; (6) QoS monitoring strategy.

[0179] The multimodal service collaborative communication method provided in this application sends policy and charging control rules to the Session Management Function (SMF) through the PCF. These policy and charging control rules include either a first policy and charging control rule or a second policy and charging control rule. Both the first and second policy and charging control rules are used by the SMF to send a first message to the User Plane Data Function (UPF). The first message includes Quality of Service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the Extended Reality (XR) terminal. This allows the UPF to send the QoS policy information to the XR terminal, enabling the XR terminal to learn the link transmission policy for transmitting at least one service flow in the multimodal services based on the QoS policy information. This achieves converged communication for XR multimodal service collaboration and improves the XR user experience.

[0180] Optionally, the method further includes: The XR terminal receives second information reported by the SMF, the second information including at least one of QoS monitoring results, the multimodal service ID and the WiFi link ID, wherein the QoS monitoring results are obtained by the XR terminal based on the QoS monitoring policy.

[0181] Specifically, after obtaining QoS policy information, the XR terminal monitors QoS based on the QoS monitoring policy in the QoS policy information, obtains QoS monitoring results, and reports fifth information to the UPF, which includes the QoS monitoring results. The fifth information also includes the multimodal service ID and / or link ID. The UPF receives the fifth information sent by the XR terminal and sends first information to the SMF or Network Data Analytics Function (NWDAF), which includes the QoS monitoring results. The first information may also include the multimodal service ID and / or link ID.

[0182] SMF reports the second information to PCF via N7 or to NEF and AF via N5 and N33 respectively. The second information includes at least one of QoS monitoring results, multimodal service ID, and link ID.

[0183] Optionally, the method further includes: The XR terminal receives a fourth message sent by the SMF, the fourth message including a fifth indication message and / or a WiFi link ID, the fifth indication message being used to indicate that the XR terminal supports WiFi link transmission.

[0184] Specifically, before obtaining QoS policy information, the XR terminal needs to establish a link with the UP. During 5G link establishment, the User Equipment (UE) (i.e., the 5G card) in the XR terminal initiates a normal 5G session. During WiFi link establishment, the XR terminal accesses the UPF through the WiFi AP / AC. The UPF uniformly manages the link IDs of the 5G and WiFi links. The UPF can allocate link IDs using either an over-IP protocol or an over-UDP protocol.

[0185] The XR terminal sends a first request message to the UPF, requesting the XR terminal to establish a link connection with the UPF. The first request message carries at least one of the following: User Equipment ID (UE ID), subscription identifier, and link type; the first response message carries a link ID. The subscription identifier can be a Subscription Permanent Identifier (SUPI). The link ID can be a link ID assigned to a 5G link or a link ID assigned to a WiFi link.

[0186] Optionally, after the link is established, the UPF detects the dual-link access of the XR terminal and triggers the N4 reporting field. It can send third information to the SMF, which includes fourth indication information and / or the WiFi link ID. The fourth indication information indicates that the XR terminal supports WiFi link transmission. Upon receiving the third information, the SMF triggers corresponding session modifications (N7, N5, and N33). The SMF then sends fourth information to the PCF, NEF, and AF, respectively. This fourth information includes fifth indication information and / or the WiFi link ID, which indicates that the XR terminal supports WiFi link transmission.

[0187] Optionally, the method further includes: The system receives updated policy and charging control rules sent by the Network Data Analysis Function (NWDAF), wherein the updated policy and charging control rules include at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

[0188] Specifically, the NWDAF can update the policy and charging control rules based on QoS monitoring results to obtain updated policy and charging control rules, wherein the NWDAF includes the policy and charging control rules. The NWDAF sends the updated policy and charging control rules to the PCF, and the updated policy and charging control rules include at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

[0189] PCF can also send updated policies and billing control rules to SMF.

[0190] Figure 10 This is the fifth flowchart illustrating the multimodal service collaborative communication method provided in this application, as shown below. Figure 10 As shown, the method applied to the Network Data Analysis Function (NWDAF) includes steps 1001-1002.

[0191] Step 1001: Receive first information sent by the User Plane Data Function (UPF). The first information includes QoS monitoring results. The QoS monitoring results are obtained by the Extended Reality (XR) terminal based on the QoS monitoring policy. The QoS monitoring policy is carried by QoS policy information, which is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the XR terminal.

[0192] Specifically, after obtaining QoS policy information, the XR terminal monitors QoS based on the QoS monitoring policy in the QoS policy information, obtains QoS monitoring results, and reports fifth information to the UPF, which includes the QoS monitoring results. The fifth information also includes the multimodal service ID and / or the WiFi link ID. The UPF receives the fifth information sent by the XR terminal and sends first information to the SMF or the Network Data Analytics Function (NWDAF), which includes the QoS monitoring results. The first information may also include the multimodal service ID and / or the WiFi link ID.

[0193] The QoS monitoring policy is carried by QoS policy information, which indicates the link transmission policy for transmitting at least one service flow of multimodal services to the XR terminal. The link is either a 5G link or a WiFi link.

[0194] Step 1002: Based on the QoS monitoring results, determine the updated policy and billing control rules.

[0195] Specifically, NWDAF can update policy and charging control rules based on QoS monitoring results to obtain updated policy and charging control rules, wherein NWDAF includes policy and charging control rules.

[0196] Optionally, the QoS policy information includes at least one of the following: (1) First indication information, used to indicate transmission via WiFi link, that is, the service flow is transmitted on WiFi link.

[0197] (2) Second indication information, used to indicate transmission via 5G link, i.e., the service flow is transmitted on 5G link.

[0198] (3) Third indication information, used to indicate the mode of WiFi link transmission, that is, the mode includes at least one of primary, redundant, aggregation, and aggregation ratio.

[0199] (4) The first request indicates a request to subscribe to WiFi link quality; (5) Multimodal service identifier ID; (6) QoS monitoring strategy.

[0200] The multimodal service collaborative communication method provided in this application receives first information sent by the User Plane Data Function (UPF) through the NWDAF. The first information includes QoS monitoring results, which are obtained by the Extended Reality (XR) terminal based on a QoS monitoring policy. The QoS monitoring policy is carried by QoS policy information, which is used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the XR terminal. Based on the QoS monitoring results, updated policies and charging control rules are determined, causing the NWDAF to send the updated policies and charging control rules to the PCF, and the PCF to send the updated policies and charging control rules to the SMF. The SMF then generates new QoS policy information based on the updated policies and charging control rules, thereby realizing converged communication for XR multimodal service collaboration and improving the XR user experience.

[0201] Optionally, the method further includes: The updated policy and charging control rules are sent to the Policy Control Function (PCF). The updated policy and charging control rules include at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

[0202] Specifically, NWDAF can also send updated policy and charging control rules to PCF. PCF can then send updated policy and charging control rules to SMF.

[0203] The multimodal service cooperative communication device provided in this application is described below. The multimodal service cooperative communication device described below and the multimodal service cooperative communication method described above can be referred to in correspondence.

[0204] Figure 11 This is one of the structural schematic diagrams of the multimodal service cooperative communication device provided in this application, such as... Figure 11 As shown, the multimodal service collaborative communication device 1100, applied to an extended reality XR terminal, includes: The acquisition module 1101 is used to acquire Quality of Service (QoS) policy information, which is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the XR terminal.

[0205] The multimodal service collaborative communication device provided in this application obtains Quality of Service (QoS) policy information, which is used to indicate the link transmission policy for transmitting at least one service flow in multimodal services to an XR terminal. This enables the link transmission policy for transmitting at least one service flow in multimodal services to be known based on the QoS policy information, thereby realizing converged communication for XR multimodal service collaboration and improving the XR user experience.

[0206] Optionally, the QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

[0207] Optionally, the acquisition module 1101 is specifically used for any of the following: Receive the QoS policy information generated by the Session Management Function (SMF); Receive the QoS policy information sent by the User Plane Data Function (UPF).

[0208] Optionally, the multimodal service collaborative communication device 1100 further includes: The second determining module is used to determine the QoS monitoring result based on the QoS monitoring strategy; The first reporting module is used to report the fifth piece of information to the UPF, which includes the QoS monitoring results.

[0209] Optionally, the fifth piece of information may also include the multimodal service ID and / or the link ID.

[0210] Optionally, before acquiring the Quality of Service (QoS) policy information, the multimodal service cooperative communication device 1100 further includes: The fourth sending module is used to send a first request message to the UPF, the first request message being used to request the XR terminal to establish a link connection with the UPF; The third receiving module is used to receive the first response message sent by the UPF, which is used to instruct the XR terminal to complete the link connection with the UPF.

[0211] Optionally, the first request message carries at least one of the following: User Equipment ID, Subscription Identifier, and Link Type; the first response message carries the Link ID.

[0212] Optionally, the link is a 5G link or a WiFi link.

[0213] Figure 12 This is the second structural schematic diagram of the multimodal service collaborative communication device provided in this application, as shown below. Figure 12As shown, the multimodal service cooperative communication device 1200, applied to the User Plane Data Function (UPF), includes: a first receiving module 1201 and a second transmitting module 1202; wherein, The first receiving module 1201 is used to receive a first message sent by the Session Management Function (SMF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal. The second sending module 1202 is used to send the QoS policy information to the XR terminal.

[0214] The multimodal service collaborative communication device provided in this application receives a first message sent by an SMF, the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to an extended reality (XR) terminal; and sends the QoS policy information to the XR terminal, so that the XR terminal can learn the link transmission policy for transmitting at least one service flow of multimodal services based on the QoS policy information, thereby realizing converged communication for XR multimodal service collaboration and improving the XR user experience.

[0215] Optionally, the QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

[0216] Optionally, the multimodal service collaborative communication device 1200 further includes: The fourth receiving module is used to receive the fifth information reported by the XR terminal, the fifth information including QoS monitoring results, the QoS monitoring results being obtained by the XR terminal based on the QoS monitoring policy.

[0217] Optionally, the fifth piece of information may also include the multimodal service ID and / or the link ID.

[0218] Optionally, the multimodal service collaborative communication device 1200 further includes: The fifth sending module is used to send first information to the SMF or the Network Data Analysis Function (NWDAF), the first information including the QoS monitoring result.

[0219] Optionally, the first information may further include the multimodal service ID and / or the link ID.

[0220] Optionally, before sending the QoS policy information to the XR terminal, the multimodal service cooperative communication device 1200 further includes: The fifth receiving module is used to receive a first request message sent by the XR terminal, the first request message being used to request the XR terminal to establish a link connection with the UPF; The sixth sending module is used to send a first response message to the XR terminal, the first response message being used to instruct the XR terminal to complete the link connection with the UPF.

[0221] Optionally, the first request message carries at least one of the following: User Equipment ID, Subscription Identifier, and Link Type; the first response message carries the Link ID.

[0222] Optionally, the multimodal service collaborative communication device 1200 further includes: The seventh sending module is used to send third information to the SMF, the third information including fourth indication information and / or link ID, the fourth indication information being used to indicate that the XR terminal supports WiFi link transmission.

[0223] Optionally, the link is a 5G link or a WiFi link.

[0224] Figure 13 This is the third structural schematic diagram of the multimodal service collaborative communication device provided in this application, as shown below. Figure 13 As shown, the multimodal service collaborative communication device 1300, applied to the Session Management Function (SMF), includes: a first transmitting module 1301; wherein, The first sending module 1301 is used to send a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal.

[0225] The multimodal service collaborative communication device provided in this application sends a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the Extended Reality (XR) terminal. This enables the UPF to send the QoS policy information to the XR terminal, thereby allowing the XR terminal to learn the link transmission policy for transmitting at least one service flow in the multimodal services based on the QoS policy information. This achieves converged communication for XR multimodal service collaboration and improves the XR user experience.

[0226] Optionally, the QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

[0227] Optionally, the first sending module 1301 is triggered based on any of the following: The first policy and charging control rule received from the Policy Control Function (PCF); the first policy and charging control rule includes at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID; The received predefined second policy and charging control rules issued by the PCF; the second policy and charging control rules include a specific 5QI value or a predefined rule ID; Local configuration information.

[0228] Optionally, the multimodal service collaborative communication device 1300 further includes: The sixth receiving module is used to receive the first information sent by the UPF, the first information including QoS monitoring results, the QoS monitoring results being obtained by the XR terminal based on the QoS monitoring policy.

[0229] Optionally, the first information may further include the multimodal service ID and / or the link ID.

[0230] Optionally, the multimodal service collaborative communication device 1300 further includes: The second reporting module is used to report second information to the PCF, NEF and AF respectively. The second information includes at least one of the QoS monitoring results, the multimodal service ID and the link ID.

[0231] Optionally, the multimodal service collaborative communication device 1300 further includes: The seventh receiving module is used to receive the third information sent by the UPF, the third information including the fourth indication information and / or the link ID, the fourth indication information being used to indicate that the XR terminal supports WiFi link transmission; The eighth sending module is used to send fourth information to PCF, NEF and AF respectively. The fourth information includes fifth indication information and / or the link ID. The fifth indication information is used to indicate that the XR terminal supports WiFi link transmission.

[0232] Optionally, the link is a 5G link or a WiFi link.

[0233] Figure 14 This is the fourth structural schematic diagram of the multimodal service collaborative communication device provided in this application, as shown below. Figure 14 As shown, the multimodal service cooperative communication device 1400, applied to the policy control function (PCF), includes: a third transmitting module 1401; wherein, The third sending module 1401 is used to send policy and charging control rules to the Session Management Function (SMF). The policy and charging control rules include a first policy and charging control rule or a second policy and charging control rule. Both the first and second policy and charging control rules are used by the SMF to send a first message to the User Plane Data Function (UPF). The first message includes Quality of Service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in multimodal services to the Extended Reality (XR) terminal.

[0234] The multimodal service collaborative communication device provided in this application sends policy and charging control rules to the Session Management Function (SMF). These rules include either a first or a second policy and charging control rule. Both rules are used by the SMF to send a first message to the User Plane Data Function (UPF). The first message includes Quality of Service (QoS) policy information. The QoS policy information indicates the link transmission policy for transmitting at least one service flow in the multimodal services to the Extended Reality (XR) terminal. This allows the UPF to send the QoS policy information to the XR terminal, enabling the XR terminal to learn the link transmission policy for transmitting at least one service flow in the multimodal services based on the QoS policy information. This achieves converged communication for XR multimodal service collaboration and improves the XR user experience.

[0235] Optionally, the QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

[0236] Optionally, the first policy and charging control rule includes at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

[0237] Optionally, the second strategy and billing control rule includes a specific 5QI value or a predefined rule ID.

[0238] Optionally, the multimodal service collaborative communication device 1400 further includes: The eighth receiving module is used to receive second information reported by the SMF. The second information includes at least one of QoS monitoring results, the multimodal service ID, and the link ID. The QoS monitoring results are obtained by the XR terminal based on the QoS monitoring policy.

[0239] Optionally, the multimodal service collaborative communication device 1400 further includes: The ninth receiving module is used to receive updated policy and charging control rules sent by the Network Data Analysis Function (NWDAF). The updated policy and charging control rules include at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

[0240] Optionally, the link is a 5G link or a WiFi link.

[0241] Figure 15 This is the fifth structural schematic diagram of the multimodal service cooperative communication device provided in this application, as shown below. Figure 15 As shown, the multimodal service collaborative communication device 1500, applied to the Network Data Analysis Function (NWDAF), includes: a second receiving module 1501 and a first determining module 1502; wherein, The second receiving module 1501 is used to receive first information sent by the User Plane Data Function (UPF). The first information includes QoS monitoring results. The QoS monitoring results are obtained by the Extended Reality (XR) terminal based on a QoS monitoring strategy. The QoS monitoring strategy is carried by QoS strategy information. The QoS strategy information is used to indicate the link transmission strategy for transmitting at least one service flow in the multimodal services to the XR terminal. The first determining module 1502 is used to determine the updated policy and charging control rules based on the QoS monitoring results.

[0242] The multimodal service collaborative communication device provided in this application receives first information sent by the User Plane Data Function (UPF). This first information includes QoS monitoring results, which are obtained by the Extended Reality (XR) terminal based on a QoS monitoring policy. The QoS monitoring policy is carried by QoS policy information, which indicates the link transmission policy for transmitting at least one service flow in the multimodal services to the XR terminal. Based on the QoS monitoring results, updated policies and charging control rules are determined. The NWDAF then sends the updated policies and charging control rules to the PCF, and the PCF sends the updated policies and charging control rules to the SMF. The SMF then generates new QoS policy information based on the updated policies and charging control rules, thereby achieving converged communication for XR multimodal service collaboration and improving the XR user experience.

[0243] Optionally, the QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; The QoS monitoring strategy.

[0244] Optionally, the first information may further include the multimodal service ID and / or the link ID.

[0245] Optionally, the multimodal service collaborative communication device 1500 further includes: The ninth sending module is used by the Policy Control Function (PCF) to send the updated policy and charging control rules, which include at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

[0246] Optionally, the link is a 5G link or a WiFi link.

[0247] Figure 16 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 16As shown, the electronic device 1600 may include a processor 1610, a communications interface 1620, a memory 1630, and a communication bus 1640. The processor 1610, communications interface 1620, and memory 1630 communicate with each other via the communication bus 1640. When the electronic device 1600 is an XR terminal, the processor 1610 can call logical instructions in the memory 1630 to execute a multimodal service cooperative communication method. This method includes: acquiring Quality of Service (QoS) policy information, wherein the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the XR terminal.

[0248] When the electronic device 1600 is a UPF, the processor 1610 can call the logical instructions in the memory 1630 to execute a multimodal service cooperative communication method. The method includes: receiving a first message sent by the session management function (SMF), the first message including quality of service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the extended reality (XR) terminal; and sending the QoS policy information to the XR terminal.

[0249] When the electronic device 1600 is an SMF, the processor 1610 can call the logical instructions in the memory 1630 to execute a multimodal service cooperative communication method. The method includes: sending a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the extended reality XR terminal.

[0250] When the electronic device 1600 is a PCF, the processor 1610 can call the logical instructions in the memory 1630 to execute a multimodal service cooperative communication method. The method includes: sending policy and charging control rules to the session management function (SMF), wherein the policy and charging control rules include a first policy and charging control rule or a second policy and charging control rule. Both the first and second policy and charging control rules are used by the SMF to send a first message to the user plane data function (UPF). The first message includes quality of service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the extended reality (XR) terminal.

[0251] When the electronic device 1600 is an NWDAF, the processor 1610 can call the logical instructions in the memory 1630 to execute a multimodal service cooperative communication method. The method includes: receiving first information sent by the User Plane Data Function (UPF), the first information including QoS monitoring results, the QoS monitoring results being obtained by the extended reality XR terminal based on a QoS monitoring policy, the QoS monitoring policy being carried by QoS policy information, the QoS policy information being used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the XR terminal; and determining updated policies and charging control rules based on the QoS monitoring results.

[0252] Furthermore, the logical instructions in the aforementioned memory 1630 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0253] On the other hand, this application also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer is able to execute the multimodal service cooperative communication method provided by the above methods. The method includes: obtaining Quality of Service (QoS) policy information, wherein the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to an XR terminal.

[0254] Optionally, the computer can execute the multimodal service cooperative communication method provided by the above methods, the method comprising: receiving a first message sent by a Session Management Function (SMF), the first message including Quality of Service (QoS) policy information; the QoS policy information being used to indicate a link transmission policy for transmitting at least one service flow of multimodal services to an extended reality (XR) terminal; and sending the QoS policy information to the XR terminal.

[0255] Optionally, the computer can execute the multimodal service cooperative communication method provided by the above methods, the method comprising: sending a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information being used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal.

[0256] Optionally, the computer can execute the multimodal service cooperative communication method provided by the above methods. The method includes: sending policy and charging control rules to the Session Management Function (SMF), wherein the policy and charging control rules include a first policy and charging control rule or a second policy and charging control rule, and both the first and second policy and charging control rules are used by the SMF to send a first message to the User Plane Data Function (UPF), wherein the first message includes Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal.

[0257] Optionally, the computer can execute the multimodal service cooperative communication method provided by the above methods, the method comprising: receiving first information sent by the User Plane Data Function (UPF), the first information including QoS monitoring results, the QoS monitoring results being obtained by the Extended Reality (XR) terminal based on a QoS monitoring policy, the QoS monitoring policy being carried by QoS policy information, the QoS policy information being used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the XR terminal; and determining updated policies and charging control rules based on the QoS monitoring results.

[0258] In another aspect, this application also provides a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the multimodal service cooperative communication method provided by the above methods. The method includes: acquiring Quality of Service (QoS) policy information, wherein the QoS policy information is used to indicate a link transmission policy for transmitting at least one service flow of multimodal services to an XR terminal.

[0259] Optionally, when the computer program is executed by a processor, it implements a multimodal service cooperative communication method provided by the above methods, the method comprising: receiving a first message sent by a Session Management Function (SMF), the first message including Quality of Service (QoS) policy information; the QoS policy information being used to indicate a link transmission policy for transmitting at least one service flow of multimodal services to an extended reality (XR) terminal; and sending the QoS policy information to the XR terminal.

[0260] Optionally, when the computer program is executed by a processor, it implements a multimodal service cooperative communication method provided by the above methods, the method comprising: sending a first message to a User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information being used to indicate a link transmission policy for transmitting at least one service flow of multimodal services to an Extended Reality (XR) terminal.

[0261] Optionally, when the computer program is executed by the processor, it implements the multimodal service cooperative communication method provided by the above methods. The method includes: sending policy and charging control rules to the Session Management Function (SMF), wherein the policy and charging control rules include a first policy and charging control rule or a second policy and charging control rule, both the first and second policy and charging control rules being used by the SMF to send a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information being used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal.

[0262] Optionally, when the computer program is executed by a processor, it implements the multimodal service cooperative communication method provided by the above methods. The method includes: receiving first information sent by a User Plane Data Function (UPF), the first information including QoS monitoring results, the QoS monitoring results being obtained by an Extended Reality (XR) terminal based on a QoS monitoring policy, the QoS monitoring policy being carried by QoS policy information, the QoS policy information being used to indicate a link transmission policy for transmitting at least one service flow of multimodal services to the XR terminal; and determining an updated policy and charging control rules based on the QoS monitoring results.

[0263] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0264] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0265] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A multimodal service collaborative communication method, characterized in that, The Session Management Function (SMF) includes: Send a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal.

2. The multimodal service collaborative communication method according to claim 1, characterized in that, The QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

3. The multimodal service collaborative communication method according to claim 2, characterized in that, The sending of the first message to the User Plane Data Function (UPF) is triggered based on any of the following: The first policy and charging control rule received from the Policy Control Function (PCF); the first policy and charging control rule includes at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID; The received predefined second policy and charging control rules issued by the PCF; the second policy and charging control rules include a specific 5QI value or a predefined rule ID; Local configuration information.

4. The multimodal service collaborative communication method according to claim 2, characterized in that, The method further includes: The XR terminal receives first information sent by the UPF, the first information including QoS monitoring results, the QoS monitoring results being obtained by the XR terminal based on the QoS monitoring policy.

5. The multimodal service collaborative communication method according to claim 4, characterized in that, The first information also includes the multimodal service ID, and / or the link ID.

6. The multimodal service collaborative communication method according to claim 5, characterized in that, The method further includes: The second information is reported to the PCF, NEF and AF respectively. The second information includes at least one of the QoS monitoring results, the multimodal service ID and the link ID.

7. The multimodal service cooperative communication method according to claim 1, characterized in that, The method further includes: The XR terminal receives third information sent by the UPF, the third information including fourth indication information and / or link ID, the fourth indication information being used to indicate that the XR terminal supports WiFi link transmission; A fourth message is sent to the PCF, NEF, and AF respectively. The fourth message includes a fifth indication message and / or the link ID. The fifth indication message is used to indicate that the XR terminal supports WiFi link transmission.

8. The multimodal service cooperative communication method according to any one of claims 1 to 7, characterized in that, The link is either a 5G link or a WiFi link.

9. A multimodal service collaborative communication method, characterized in that, Applications to User Plane Data Functions (UPF) include: The system receives a first message sent by the Session Management Function (SMF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal. The QoS policy information is sent to the XR terminal.

10. The multimodal service cooperative communication method according to claim 9, characterized in that, The QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

11. The multimodal service cooperative communication method according to claim 10, characterized in that, The method further includes: The XR terminal receives a fifth piece of information, which includes a QoS monitoring result obtained by the XR terminal based on the QoS monitoring policy.

12. The multimodal service cooperative communication method according to claim 11, characterized in that, The fifth piece of information also includes the multimodal service ID, and / or the link ID.

13. The multimodal service cooperative communication method according to claim 12, characterized in that, The method further includes: Send first information to the SMF or the Network Data Analysis Function (NWDAF), the first information including the QoS monitoring results.

14. The multimodal service cooperative communication method according to claim 13, characterized in that, The first information also includes the multimodal service ID, and / or the link ID.

15. The multimodal service cooperative communication method according to any one of claims 9 to 14, characterized in that, Before sending the QoS policy information to the XR terminal, the method further includes: Receive a first request message sent by the XR terminal, the first request message being used to request the XR terminal to establish a link connection with the UPF; A first response message is sent to the XR terminal, which is used to instruct the XR terminal to complete the link connection with the UPF.

16. The multimodal service cooperative communication method according to claim 15, characterized in that, The first request message carries at least one of the following: User Equipment ID, Subscription Identifier, and Link Type; the first response message carries the Link ID.

17. The multimodal service cooperative communication method according to claim 15, characterized in that, The method further includes: Send a third message to the SMF, the third message including a fourth indication message and / or a link ID, the fourth indication message being used to indicate that the XR terminal supports WiFi link transmission.

18. The multimodal service cooperative communication method according to claim 9, characterized in that, The link is either a 5G link or a WiFi link.

19. A multimodal service collaborative communication method, characterized in that, Applications to extended reality XR terminals include: Obtain Quality of Service (QoS) policy information, which is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the XR terminal.

20. The multimodal service cooperative communication method according to claim 19, characterized in that, The QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

21. The multimodal service cooperative communication method according to claim 19, characterized in that, The acquisition of Quality of Service (QoS) policy information includes any one of the following: Receive the QoS policy information generated by the Session Management Function (SMF); Receive the QoS policy information sent by the User Plane Data Function (UPF).

22. The multimodal service cooperative communication method according to claim 20, characterized in that, The method further includes: Based on the QoS monitoring strategy, determine the QoS monitoring results; The fifth piece of information is reported to the UPF, which includes the QoS monitoring results.

23. The multimodal service cooperative communication method according to claim 22, characterized in that, The fifth piece of information also includes the multimodal service ID, and / or the link ID.

24. The multimodal service cooperative communication method according to any one of claims 19 to 23, characterized in that, Before obtaining the Quality of Service (QoS) policy information, the method further includes: Send a first request message to the UPF, the first request message being used to request the XR terminal to establish a link connection with the UPF; The XR terminal receives a first response message sent by the UPF, which is used to instruct the XR terminal to complete the link connection with the UPF.

25. The multimodal service cooperative communication method according to claim 24, characterized in that, The first request message carries at least one of the following: User Equipment ID, Subscription Identifier, and Link Type; the first response message carries the Link ID.

26. The multimodal service cooperative communication method according to claim 19, characterized in that, The link is either a 5G link or a WiFi link.

27. A multimodal service collaborative communication method, characterized in that, Applications to policy control functions (PCF) include: The SMF sends policy and charging control rules to the Session Management Function (SMF). These rules include either a first policy and charging control rule or a second policy and charging control rule. Both the first and second policies and charging control rules are used by the SMF to send a first message to the User Plane Data Function (UPF). The first message includes Quality of Service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in multimodal services to the Extended Reality (XR) terminal.

28. The multimodal service cooperative communication method according to claim 27, characterized in that, The QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; QoS monitoring policy.

29. The multimodal service cooperative communication method according to claim 28, characterized in that, The first policy and billing control rule includes at least one of the first instruction information, the second instruction information, the third instruction information, the first request, and the multimodal service ID.

30. The multimodal service cooperative communication method according to claim 27, characterized in that, The second strategy and billing control rules include specific 5QI values ​​or predefined rule IDs.

31. The multimodal service cooperative communication method according to claim 28, characterized in that, The method further includes: The XR terminal receives second information reported by the SMF, the second information including at least one of QoS monitoring results, the multimodal service ID and the link ID, wherein the QoS monitoring results are obtained by the XR terminal based on the QoS monitoring policy.

32. The multimodal service cooperative communication method according to claim 27, characterized in that, The method further includes: The XR terminal receives a fourth message sent by the SMF, the fourth message including a fifth indication message and / or a link ID, the fifth indication message being used to indicate that the XR terminal supports WiFi link transmission.

33. The multimodal service cooperative communication method according to claim 28, characterized in that, The method further includes: The system receives updated policy and charging control rules sent by the Network Data Analysis Function (NWDAF), wherein the updated policy and charging control rules include at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

34. The multimodal service cooperative communication method according to claim 27, characterized in that, The link is either a 5G link or a WiFi link.

35. A multimodal service collaborative communication method, characterized in that, The network data analysis function NWDAF includes: The system receives first information sent by the User Plane Data Function (UPF), the first information including Quality of Service (QoS) monitoring results, the QoS monitoring results being obtained by the Extended Reality (XR) terminal based on a QoS monitoring policy, the QoS monitoring policy being carried by QoS policy information, the QoS policy information being used to indicate the link transmission policy for transmitting at least one service flow in the multimodal services to the XR terminal; Based on the QoS monitoring results, the updated policies and billing control rules are determined.

36. The multimodal service cooperative communication method according to claim 35, characterized in that, The QoS policy information includes at least one of the following: The first indication information is used to indicate transmission via a WiFi link; The second instruction information is used to indicate transmission via a 5G link; The third indication information is used to indicate the mode of WiFi link transmission; The first request indicates a request to subscribe to WiFi link quality; Multimodal service identifier ID; The QoS monitoring strategy.

37. The multimodal service cooperative communication method according to claim 36, characterized in that, The first information also includes the multimodal service ID, and / or the link ID.

38. The multimodal service cooperative communication method according to claim 36, characterized in that, The method further includes: The updated policy and charging control rules are sent to the Policy Control Function (PCF). The updated policy and charging control rules include at least one of the first indication information, the second indication information, the third indication information, the first request, and the multimodal service ID.

39. The multimodal service collaborative communication method according to claim 35, characterized in that, The link is either a 5G link or a WiFi link.

40. A multimodal service collaborative communication device, characterized in that, The Session Management Function (SMF) includes: The first sending module is used to send a first message to the User Plane Data Function (UPF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal.

41. A multimodal service collaborative communication device, characterized in that, Applications to User Plane Data Functions (UPF) include: The first receiving module is configured to receive a first message sent by the Session Management Function (SMF), the first message including Quality of Service (QoS) policy information; the QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the Extended Reality (XR) terminal. The second sending module is used to send the QoS policy information to the XR terminal.

42. A multimodal service collaborative communication device, characterized in that, Applications to extended reality XR terminals include: The acquisition module is used to acquire Quality of Service (QoS) policy information, which is used to indicate the link transmission policy for transmitting at least one service flow of multimodal services to the XR terminal.

43. A multimodal service collaborative communication device, characterized in that, Applications to policy control functions (PCF) include: The third sending module is used to send policy and charging control rules to the Session Management Function (SMF). The policy and charging control rules include a first policy and charging control rule or a second policy and charging control rule. Both the first and second policy and charging control rules are used by the SMF to send a first message to the User Plane Data Function (UPF). The first message includes Quality of Service (QoS) policy information. The QoS policy information is used to indicate the link transmission policy for transmitting at least one service flow in multimodal services to the Extended Reality (XR) terminal.

44. A multimodal service collaborative communication device, characterized in that, The network data analysis function NWDAF includes: The second receiving module is used to receive first information sent by the User Plane Data Function (UPF). The first information includes QoS monitoring results. The QoS monitoring results are obtained by the Extended Reality (XR) terminal based on the QoS monitoring strategy. The QoS monitoring strategy is carried by QoS strategy information. The QoS strategy information is used to indicate the link transmission strategy for transmitting at least one service flow in the multimodal services to the XR terminal. The first determining module is used to determine the updated policy and billing control rules based on the QoS monitoring results.

45. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the multimodal service collaborative communication method as described in any one of claims 1 to 8, or the multimodal service collaborative communication method as described in any one of claims 9 to 18, or the multimodal service collaborative communication method as described in any one of claims 19 to 26, or the multimodal service collaborative communication method as described in any one of claims 27 to 34, or the multimodal service collaborative communication method as described in any one of claims 35 to 39.

46. ​​A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the multimodal service collaborative communication method as described in any one of claims 1 to 8, or the multimodal service collaborative communication method as described in any one of claims 9 to 18, or the multimodal service collaborative communication method as described in any one of claims 19 to 26, or the multimodal service collaborative communication method as described in any one of claims 27 to 34, or the multimodal service collaborative communication method as described in any one of claims 35 to 39.

47. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the multimodal service collaborative communication method as described in any one of claims 1 to 8, or the multimodal service collaborative communication method as described in any one of claims 9 to 18, or the multimodal service collaborative communication method as described in any one of claims 19 to 26, or the multimodal service collaborative communication method as described in any one of claims 27 to 34, or the multimodal service collaborative communication method as described in any one of claims 35 to 39.

Images