Immersive service processing method and device

Abstract

The present invention provides a method and apparatus for processing immersive services, the method comprising: determining UE capability information based on device information of a user terminal; sending the UE capability information to an application function AF via a network so that the AF can determine an initial encoding and decoding rate; and transmitting data for the immersive service after determining that a protocol data unit (PDU) session has been established. The method and apparatus for processing immersive services provided by the present invention are based on the fact that when the UE establishes a PDU session for the immersive service, the UE reports the UE capability information to assist the AF in determining the initial encoding and decoding rate and then completes the establishment of the PDU session, and carries out the immersive service based on the session. This realizes opening the UE's performance processing capability information to applications via 5GS, assisting the AF in adapting the encoding and decoding rate, and providing a better user experience.

Description

Technical Field

[0001] The present invention relates to the field of wireless communication technologies, and in particular to a method and device for processing immersive services. Background Art

[0002] The fifth generation mobile communication technology (5G) is a new generation of broadband mobile communication technology with the characteristics of high speed, low latency and large connection. 5G and the future era of digital life provide more room for imagination for new real-time communication services.

[0003] Immersive services (XR services such as VR / AR / MR) carry interactive information in real time through wider channels and a wider range of content types. Furthermore, addressing both business-oriented (To Business, B) and consumer-oriented (To Customer, C) application scenarios is one of the most important research directions of 3GPP Rel-18. These services, with their requirements and technical features of large bandwidth, low latency, and multi-stream coordinated transmission, pose significant challenges to 5G network deployment. Exposing certain information to applications through the fifth-generation system (5GS) to support their codec rate adaptation needs is a critical issue currently under investigation in the industry. Summary of the Invention

[0004] The present invention provides an immersive service processing method and device for assisting an application server in performing codec rate adaptation.

[0005] The present invention provides a method for processing an immersive service, which is applied to a user terminal UE, comprising:

[0006] Determine UE capability information based on the device information of the user terminal;

[0007] Sending the UE capability information to the application function AF through the network, so that the AF can determine the initial codec rate;

[0008] After confirming that the protocol data unit (PDU) session is established, data transmission of the immersive service is performed;

[0009] The device information includes at least one of the CPU main frequency and number of cores, running memory and storage capacity, DSP computing speed and number of transceiver antennas in the user terminal; the UE capability information is sent when it is determined that the PDU session is used to execute immersive services; the PDU session is established after the AF determines the initial codec rate.

[0010] According to a method for processing an immersive service provided by the present invention, after determining that the PDU session is established, the method further includes:

[0011] Determining that the UE is internally overheated;

[0012] Notifying the access and mobility management function AMF through the radio access network RAN ​​that the UE is internally overheated, so that the AMF notifies the AF to adjust the codec rate in response to the UE overheat event;

[0013] The UE overheat event is a service event opened by the AMF according to the UE overheat, and the AF subscribes to the UE overheat event to the AMF in advance before the immersive service starts.

[0014] The present invention also provides an immersive service processing method, which is applied to application function AF, including:

[0015] When determining that a PDU session is established, receiving a policy authorization request message carrying UE capability information sent by a policy control function PCF;

[0016] Determining an initial codec rate based on the UE capability information;

[0017] Feedback a policy authorization response message to the PCF to establish a protocol data unit (PDU) session;

[0018] The UE capability information is determined by the user terminal UE based on the device information of the user terminal and sent to the PCF through a session management related message.

[0019] According to a method for processing an immersive service provided by the present invention, after feeding back a policy authorization response message to the PCF to establish a protocol data unit (PDU) session, the method further includes:

[0020] Subscribe to UE overheat events from AMF to obtain UE overheat event notification messages;

[0021] Adjusting the codec rate based on the UE overheat information carried in the UE overheat event notification message, and notifying the PCF through the NEF to adjust the quality of service QoS policy;

[0022] The UE overheat event is a service event that the AMF pre-opens based on UE overheating.

[0023] The present invention also provides an immersive service processing device, which is provided in a user terminal UE, comprising:

[0024] A terminal capability determination module is used to obtain UE capability information based on the device information of the user terminal;

[0025] A service initiation module, configured to send the UE capability information to the application function AF via the network, so that the AF can determine an initial codec rate;

[0026] A data transmission module, configured to transmit data for the immersive service after determining that a protocol data unit (PDU) session is established;

[0027] The device information includes at least one of the CPU main frequency and number of cores, running memory and storage capacity, DSP computing speed and number of transceiver antennas in the user terminal; the UE capability information is sent when it is determined that the PDU session is used to execute immersive services; the PDU session is established after the AF determines the initial codec rate.

[0028] The present invention further provides an immersive service processing device, which is provided in the application function AF and includes:

[0029] A receiving module, configured to receive a policy authorization request message carrying UE capability information sent by a policy control function PCF when determining that a PDU session is established;

[0030] A codec rate adaptation module, configured to determine an initial codec rate based on the UE capability information;

[0031] A feedback module, configured to feed back a policy authorization response message to the PCF to establish a protocol data unit (PDU) session;

[0032] The UE capability information is determined by the user terminal UE based on the device information of the user terminal and sent to the PCF through a session management related message.

[0033] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for processing an immersive service as described above is implemented.

[0034] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the computer program implements any of the above-mentioned methods for processing immersive services.

[0035] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements any of the above-mentioned methods for processing immersive services.

[0036] The immersive service processing method and device provided by the present invention is based on the fact that when the UE establishes a PDU session for the immersive service, it reports the UE capability information to assist the AF in determining the initial codec rate and then completing the establishment of the PDU session, and then carries out the immersive service based on the session. This realizes the opening of the UE's performance processing capability information to the application through 5GS, assisting the AF in adapting the codec rate, and providing a better user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0038] Figure 1 This is one of the flowcharts of the method for processing immersive services provided by the present invention;

[0039] Figure 2 This is the second flow chart of the method for processing immersive services provided by the present invention;

[0040] Figure 3 This is one of the overall flow diagrams of the method for processing immersive services provided by the present invention;

[0041] Figure 4 This is the second overall flow diagram of the method for processing immersive services provided by the present invention;

[0042] Figure 5 This is one of the structural diagrams of the processing device for immersive services provided by the present invention;

[0043] Figure 6 This is the second structural diagram of the immersive service processing device provided by the present invention;

[0044] Figure 7 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0045] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0046] The terms "first," "second," and the like in this application are used to distinguish similar objects, and are not used to describe a particular order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in orders other than those illustrated or described herein. Furthermore, the objects distinguished by "first," "second," and the like generally refer to a class of objects and do not limit the number of objects. For example, the first object may be one or more.

[0047] It should be understood that the terms used in this specification are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the present invention, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include the plural forms.

[0048] The terms “include” and “comprising” indicate the presence of described features, integers, steps, operations, elements and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0049] Figure 1 This is one of the flow charts of the method for processing immersive services provided by the present invention. Figure 1 As shown, the immersive service processing method provided by the embodiment of the present invention is applied to a user terminal UE, including: step 101, determining UE capability information based on device information of the user terminal.

[0050] The device information includes at least one of the CPU main frequency and number of cores, running memory and storage capacity, DSP operation speed and number of transmitting and receiving antennas in the user terminal.

[0051] It should be noted that the immersive service processing method provided in the embodiment of the present invention is executed by an immersive service processing device, which can be set on a user terminal or be the user terminal.

[0052] The application scenario of the immersive service processing device is that before the immersive service communication is carried out between the user terminal (User Equipment, UE) and the data network (Data Network, DN) / network slice, the UE opens the relevant information corresponding to the device's own performance processing capability to the application function (Application Function, AF), and assists the AF to adapt the codec rate corresponding to the device's own performance processing capability.

[0053] Specifically, in step 101, the immersive service processing device in the UE integrates its own device information into UE capability information.

[0054] UE capability information is used to characterize the UE's capabilities in network transmission, computing, storage, and security.

[0055] The device information may be device parameters related to the UE, such as CPU frequency and number of cores, RAM and storage capacity, DSP operation speed, number of transceiver antennas, etc. The device information is used to evaluate a specific aspect of the UE's capabilities or overall capabilities to obtain UE capability information.

[0056] The embodiment of the present invention does not specifically limit the method for evaluating UE capability information.

[0057] Optionally, the UE may perform weighted calculations based on parameters such as the CPU main frequency and number of cores, running memory and storage capacity, DSP operation speed, and the number of transmitting and receiving antennas, and use the comprehensive score as UE capability information.

[0058] The score range of the UE capability information is divided into intervals in advance. For example, the divided three intervals may correspond to the three capability levels of "high", "medium" and "low" respectively.

[0059] Optionally, the UE can also represent UE capability information in a bitmap format by setting corresponding bits to 1 when parameters such as CPU frequency and number of cores, RAM and storage capacity, DSP speed, and number of transceiver antennas meet certain criteria. For example, if RAM exceeds 16GB, the corresponding bit is set to "1." Similarly, if the CPU frequency does not exceed 2.4GB, the corresponding bit is set to "0."

[0060] Step 102: Send the UE capability information to the application function AF through the network, so that the AF can determine the initial codec rate.

[0061] It should be noted that, before step 102, the immersive service processing device in the UE needs to predetermine that the data transmission channel initiated by the UE has the characteristics of large bandwidth and low latency, so as to establish a PDU session for the immersive service.

[0062] For example, the immersive service processing device in the UE can determine whether this PDU session is established for services such as XR with large bandwidth and low latency characteristics based on information such as single network slice selection assistance information (Single Network Slice Selection Assistance Information, S-NSSAI).

[0063] Specifically, in step 102, the immersive service processing device in the UE initiates a PDU session establishment process, and forwards the UE capability information as part of the session management related message to the application function AF in sequence via the unit nodes (i.e., RAN, AMF, SMF, PCF) included in the network.

[0064] After receiving the UE capability information, the AF determines the codec rate corresponding to the UE capability information based on the performance processing capability reflected in the UE capability information, and sets an initial codec rate before executing the XR service.

[0065] Step 103: After determining that the protocol data unit (PDU) session is established, perform data transmission for the immersive service.

[0066] The PDU session is established after the AF determines the initial encoding and decoding rate.

[0067] It should be noted that the PDU session is a PDU session established after the AF determines the initial codec rate adapted to the UE capability.

[0068] PDU session, used to transmit data traffic of XR services between UE and DN.

[0069] Specifically, in step 103, after the PDU session is established, the immersive service processing device in the UE can receive downlink data generated by decoding at the initial codec rate by the AF, and can also send uplink data to the DN / S-NSSAI.

[0070] This embodiment of the present invention is based on the fact that when the UE establishes a PDU session for immersive services, it reports UE capability information to assist the AF in determining the initial codec rate and completing the PDU session establishment. Immersive services are then carried out based on this session. This enables the UE's performance processing capability information to be exposed to applications via 5GS, assisting the AF in adapting the codec rate to provide a better user experience.

[0071] Based on any of the above embodiments, after determining that the PDU session is established, the method further includes: determining that the UE is overheated.

[0072] Specifically, after step 103, during the immersive service, the UE monitors relevant operating parameters within itself in real time, and determines based on the above parameters whether its load is excessive, resulting in internal overheating.

[0073] The access and mobility management function AMF is notified through the radio access network RAN ​​that the UE is overheating, so that the AMF can respond to the UE overheating event and notify the AF to adjust the codec rate.

[0074] Among them, the UE overheat event is a service event opened by AMF based on UE overheat. AF subscribes to the UE overheat event from AMF in advance before the start of the immersive service.

[0075] It should be noted that AMF needs to pre-define the event ID (Event ID) as "UE overheat event" to provide an open service for UE overheat events. AF can subscribe to UE overheat events through the network open function NEF. After that, when a UE overheat event occurs, AMF notifies AF through NEF.

[0076] Specifically, after step 103, during the immersive service, when the immersive service processing device in the UE detects that it is overheating, it reports to the AMF through the radio access network RAN, so that the AMF notifies the UE overheating information to the AF that has subscribed to the overheating event open service based on the received overheating information.

[0077] In the early stage of immersive services, AF encodes and decodes the received video at the initial codec rate. As the service continues, if the UE overheats due to excessive load, AF receives UE overheating information notification and adjusts it based on the current codec rate.

[0078] This embodiment of the present invention does not specifically limit the process of notifying the AMF of internal overheating of the UE.

[0079] Preferably, after the UE detects internal overheating, it reports overheating assistance information to the radio access network RAN. The information contained in the overheating assistance information, such as the maximum number of CCs, maximum bandwidth and maximum number of MIMO layers, is applicable to the air interface and is not of concern to the AF and core network sides. The RAN only needs to generate overheating information based on the overheating assistance information to indicate to the AMF that the UE is overheating.

[0080] This embodiment of the present invention enables the UE to monitor its own overheating during immersive services and report this information to the AF, assisting the AF in adjusting the codec rate during immersive services. This approach exposes UE overheating information to applications via 5GS, assisting the AF in adaptively adjusting the codec rate to provide a better user experience.

[0081] Figure 2 This is the second flow chart of the method for processing immersive services provided by the present invention. Figure 2 As shown, the immersive service processing method provided by the embodiment of the present invention is applied to the application function AF, including: step 201, when determining that the PDU session is established, receiving a policy authorization request message carrying UE capability information sent by the policy control function PCF.

[0082] Among them, the UE capability information is determined by the user terminal UE based on the device information of the user terminal and forwarded to the PCF in sequence via the unit nodes (i.e., RAN, AMF, SMF) included in the network as part of the session management related message.

[0083] It should be noted that the execution subject of the immersive service processing method provided in the embodiment of the present invention is the immersive service processing device, which can be set in the AF.

[0084] The application scenario of the immersive service processing device is that before executing the communication of the immersive service, the AF assists in adapting the codec rate corresponding to the performance processing capability of the device itself according to the device-related information openly reported by the UE.

[0085] Specifically, in step 201, the immersive service processing device in the AF receives a policy authorization request message sent from the PCF, and extracts the UE capability information carried in the message from the message.

[0086] Step 202: Determine the initial codec rate based on the UE capability information in the policy authorization request message.

[0087] Specifically, in step 202, the immersive service processing device in the AF receives the UE capability information carried in the policy authorization request message, determines the codec rate corresponding to the UE capability information based on the performance processing capability reflected in the UE capability information, and sets an initial codec rate before executing the XR service.

[0088] Step 203: Feedback a policy authorization response message to the policy control function PCF to establish a protocol data unit (PDU) session.

[0089] Specifically, in step 203, after determining the initial codec rate adapted to the UE capability, the processing device of the immersive service in the AF responds to the policy authorization request message and feeds back a policy authorization response message to the policy control function PCF, and establishes a PDU session after creating / updating the policy of the PDU session.

[0090] PDU session, used to transmit data traffic of XR services between UE and DN / S-NSSAI.

[0091] In this embodiment of the present invention, when establishing a PDU session for immersive services, the AF uses the UE capability information carried in session management-related messages transmitted step by step. After determining the initial codec rate, the AF provides feedback to the PCF to determine the session strategy, complete the PDU session establishment, and provide immersive services based on the initial codec rate. This enables the 5GS to expose the UE's performance processing capability information to applications, assisting the AF in adapting the codec rate and providing a better user experience.

[0092] On the basis of any of the above embodiments, after feeding back a policy authorization response message to the PCF to establish a protocol data unit PDU session, it also includes: obtaining a UE overheat event notification message by subscribing to the UE overheat event from the AMF.

[0093] Among them, the UE overheat event is a service event opened by the AMF based on UE overheating.

[0094] It should be noted that AMF needs to pre-define the event ID (Event ID) as "UE overheat event" to provide an open service for UE overheat events. AF can subscribe to UE overheat events through the network open function NEF. After that, when a UE overheat event occurs, AMF notifies AF through NEF.

[0095] Specifically, after step 203, at the beginning of the immersive service, the AF encodes and decodes the received video at the initial encoding and decoding rate. As the service continues, the immersive service processing device in the AF subscribes to the UE overheat event to the AMF in advance, and receives the UE overheat notification message sent by the AMF through the NEF.

[0096] Based on the UE overheat information carried in the UE overheat event notification message, the codec rate is adjusted, and the PCF is notified through the NEF to adjust the quality of service (QoS) policy.

[0097] Specifically, the immersive service processing device in the AF determines that the load in the UE's current service is too heavy and causes internal overheating based on the UE overheating information carried in the UE overheating event notification message, adjusts it based on the current encoding and decoding rate, and also notifies the PCF through the NEF to adjust the QoS policy of this immersive service.

[0098] Figure 3 This is one of the overall flow diagrams of the method for processing immersive services provided by the present invention. Figure 4 This is the second overall flow chart of the method for processing immersive services provided by the present invention. Figure 3 and Figure 4 As shown, the embodiments of the present invention respectively provide specific implementation methods of the PDU session establishment process for XR services and the process of notifying the AF of a UE overheating event:

[0099] (1) PDU session establishment process for XR services:

[0100] Step 301: The UE determines, based on information such as S-NSSAI, that this PDU session is established for services with large bandwidth and low latency characteristics, such as XR.

[0101] Step 302: The UE sends a NAS message to the AMF through the RAN, in which the N1 SM container carries the PDUSession Establishment Request message and UE capability information.

[0102] Step 303: AMF sends Nsmf_PDUSession_CreateSMContext Request to SMF, and the N1 SM container it carries contains the PDU Session Establishment Request message and UE capability information.

[0103] Step 304: SMF interacts with UDM to obtain the session management subscription data of the UE.

[0104] Step 305: SMF returns Nsmf_PDUSession_CreateSMContext Response to AMF.

[0105] Step 306: If the SMF needs to perform secondary authentication with the DN-AAA server when the PDU session is established, the SMF initiates the PDU session establishment authentication / authorization process.

[0106] Step 307: If the PDU session uses a dynamic PCC, the SMF selects a PCF.

[0107] Step 308: If the SMF has previously received the UE capability information, it sends an Npcf_SMPolicyControl_Create request to the selected PCF, also carrying the UE capability information.

[0108] Step 309: The PCF sends an Npcf_PolicyAuthorization_Create Request to the AF to notify the AF of the UE capability information.

[0109] Step 310: The AF may determine an initial codec rate according to the UE capability information.

[0110] Step 311: The AF returns an Npcf_PolicyAuthorization_Create response to the PCF.

[0111] Step 312: The current PDU session establishment is completed (for details, refer to steps 7b to 21 in section 3GPP TS 23.5024.3.2.2.1).

[0112] In order to reduce the impact on the existing process and simplify exception handling, this process tries to decouple the relevant steps of the newly added UE capability reporting from the existing PDU session establishment process.

[0113] It is understandable that Figure 3 The AF shown is deployed in a trusted domain. If the AF is in an untrusted domain, the PCF forwards the UE capability information to the AF through the NEF.

[0114] (2) Process of notifying AF of UE overheating event:

[0115] Step 401: The UE detects that it is overheated.

[0116] Step 402: The UE sends a UEAssistanceInformation message to the RAN, reporting overheating assistance information through the OverheatingAssistance IE, including the expected maximum number of CCs, maximum bandwidth, maximum number of MIMO layers, and other information.

[0117] Step 403: The RAN receives the UE overheat assistance information and sends an N2 message to the AMF to notify the UE of overheat.

[0118] The information such as the maximum number of CCs, maximum bandwidth and maximum number of MIMO layers reported by the UE in step 402 is applicable to the air interface and is not of concern to the application server and the core network side. The RAN does not need to forward this information to the AMF, but only needs to indicate to the AMF that the UE is overheated.

[0119] Step 404: The AMF sends a Namf_EventExposure message to the NEF, carrying the UE identifier (i.e., SUPI) and UE overheat information.

[0120] AMF provides the UE overheat event open service and defines the Event ID as "UE overheat event". Therefore, AF has previously subscribed to the UE overheat event through NEF. AMF notifies NEF after receiving the UE overheat information sent by RAN.

[0121] Step 405: The NEF sends Nnef_EventExposure_Notify to the AF to notify the UE of the overheating information.

[0122] Step 406: The AF may adjust the encoding and decoding rate according to the UE overheat information.

[0123] Step 407: The AF may also notify the PCF through the NEF to adjust the QoS policy of the XR service.

[0124] This embodiment of the present invention notifies the AF of UE overheating during immersive services. Using the UE overheating information carried in the event notification message, the codec rate is adjusted during the immersive service and the QoS policy is adaptively adjusted. This enables the disclosure of UE overheating information to applications via 5GS, assisting the AF in adaptively adjusting the codec rate. This provides a better user experience during immersive services and enables better utilization and allocation of network resources.

[0125] Figure 5 This is one of the structural diagrams of the processing device for immersive services provided by the present invention. Figure 5 As shown, the immersive service processing device provided by the embodiment of the present invention is set in the user terminal UE, including: a terminal capability determination module 510, a service initiation module 520 and a data transmission module 530, wherein:

[0126] The terminal capability determination module 510 is configured to determine UE capability information based on the device information of the user terminal.

[0127] The service initiating module 520 is configured to send the UE capability information to the application function AF via the network, so that the AF can determine an initial codec rate.

[0128] The data transmission module 530 is configured to transmit data of the immersive service after determining that the protocol data unit (PDU) session is established.

[0129] The device information includes at least one of the following: the CPU main frequency and number of cores, RAM and storage capacity, DSP operation speed, and the number of transceiver antennas in the user terminal. UE capability information is sent when a PDU session is determined to be used for immersive services. The PDU session is established after the AF determines the initial codec rate.

[0130] Specifically, the terminal capability determination module 510 , the service initiation module 520 and the data transmission module 530 are electrically connected in sequence.

[0131] Before establishing a PDU session, the terminal capability determination module 510 integrates its own device information into UE capability information.

[0132] The service initiation module 520 initiates the PDU session establishment process and forwards the UE capability information to the application function AF in sequence via the unit nodes (ie, RAN, AMF, SMF, PCF) in the network.

[0133] After the PDU session is established, the data transmission module 530 can receive downlink data generated by AF at the initial codec rate, and can also send uplink data to the DN / S-NSSAI for encoding and decoding by AF at the initial codec rate.

[0134] Optionally, the immersive service processing device provided in the user terminal UE further includes: an overheating monitoring module and an overheating reporting module, wherein:

[0135] The overheat monitoring module is used to determine whether the UE is overheated.

[0136] The overheat reporting module is used to notify the access and mobility management function AMF of UE internal overheating through the radio access network RAN, so that the AMF can notify the AF to adjust the codec rate after responding to the UE overheating event.

[0137] Among them, the UE overheat event is a service event opened by AMF based on UE overheating. AF subscribes to the UE overheat event from AMF in advance before the start of the immersive service.

[0138] The immersive service processing device provided in an embodiment of the present invention is used to execute the immersive service processing method of the present invention. Its implementation method is consistent with the implementation method of the immersive service processing method provided by the present invention and can achieve the same beneficial effects, which will not be repeated here.

[0139] This embodiment of the present invention is based on the fact that when the UE establishes a PDU session for immersive services, it reports UE capability information to assist the AF in determining the initial codec rate, completing the PDU session establishment, and then carrying out the immersive service based on this session. This enables the UE's performance processing capability information to be exposed to applications through 5GS, assisting the AF in adapting the codec rate, and providing a better user experience.

[0140] Figure 6 This is the second structural diagram of the processing device for immersive services provided by the present invention. Figure 6 As shown, the immersive service processing device provided by the embodiment of the present invention is set in the application function AF, including: a receiving module 610, a codec rate adaptation module 620 and a feedback module 630, wherein:

[0141] The receiving module 610 is configured to receive a policy authorization request message carrying UE capability information sent by a policy control function PCF after determining that the PDU session is established.

[0142] The codec rate adaptation module 620 is configured to determine an initial codec rate based on UE capability information.

[0143] The feedback module 630 is configured to feed back a policy authorization response message to the PCF to establish a protocol data unit (PDU) session.

[0144] The UE capability information is determined by the user terminal UE based on the device information of the user terminal and sent to the PCF through a session management related message.

[0145] Specifically, the receiving module 610 , the codec rate adaptation module 620 and the feedback module 630 are electrically connected in sequence.

[0146] The receiving module 610 receives a policy authorization request message sent by the PCF, and extracts the UE capability information carried in the message from the message.

[0147] The codec rate adaptation module 620 receives the UE capability information carried in the policy authorization request message, determines the codec rate corresponding to the UE capability information based on the performance processing capability reflected in the UE capability information, and sets an initial codec rate before executing the XR service.

[0148] After determining the initial codec rate adapted to the UE capability, the feedback module 630 responds to the policy authorization request message and feeds back a policy authorization response message to the policy control function PCF, and establishes the PDU session after creating / updating the policy of the PDU session.

[0149] Optionally, the processing device for the immersive service provided in the application function AF further includes: an overheat information acquisition module and a codec rate adjustment module, wherein:

[0150] The overheat information acquisition module is used to obtain the UE overheat event notification message by subscribing to the UE overheat event from the AMF.

[0151] The codec rate adjustment module is used to adjust the codec rate based on the UE overheat information carried in the UE overheat event notification message, and notify the PCF through the NEF to adjust the service quality QoS policy.

[0152] Among them, the UE overheat event is a service event opened by the AMF based on UE overheating.

[0153] The immersive service processing device provided in an embodiment of the present invention is used to execute the immersive service processing method of the present invention. Its implementation method is consistent with the implementation method of the immersive service processing method provided by the present invention and can achieve the same beneficial effects, which will not be repeated here.

[0154] In this embodiment of the present invention, when establishing a PDU session for immersive services, the AF uses the UE capability information carried in session management-related messages transmitted step by step. After determining the initial codec rate, it provides feedback to the PCF to determine the session strategy, complete the PDU session establishment, and provide immersive services based on the initial codec rate. This enables the UE's performance processing capability information to be exposed to applications through 5GS, assisting the AF in adapting the codec rate and providing a better user experience.

[0155] Figure 7 An example of a physical structure diagram of an electronic device is shown below. Figure 7 As shown, the electronic device may include: a processor 710, a communications interface 720, a memory 730, and a communication bus 740, wherein the processor 710, the communications interface 720, and the memory 730 communicate with each other via the communication bus 740. The processor 710 may call the logic instructions in the memory 730 to execute a method for processing an immersive service, the method comprising: determining UE capability information based on device information of a user terminal; sending the UE capability information to an application function AF via a network so that the AF can determine an initial codec rate; and transmitting data for the immersive service after determining that a protocol data unit (PDU) session is established; wherein the device information includes at least one of the CPU main frequency and number of cores, running memory and storage capacity, DSP operation speed, and number of transceiver antennas in the user terminal; the UE capability information is sent when it is determined that the PDU session is used to execute the immersive service; and the PDU session is established after the AF determines the initial codec rate. A method for processing immersive services can also be executed, which includes: when determining the establishment of a PDU session, receiving a policy authorization request message carrying UE capability information sent by a policy control function PCF; determining an initial encoding and decoding rate based on the UE capability information; and feeding back a policy authorization response message to the PCF to establish a protocol data unit PDU session; wherein the UE capability information is determined by the user terminal UE based on the device information of the user terminal, and sent to the PCF through a session management related message.

[0156] In addition, the logic instructions in the above-mentioned memory 730 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0157] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the immersive service processing method provided by the above methods, the method including: determining UE capability information based on the device information of the user terminal; sending the UE capability information to the application function AF through the network, so that the AF can determine the initial encoding and decoding rate; after determining that the protocol data unit PDU session is established, transmitting data for the immersive service; wherein the device information includes at least one of the CPU main frequency and number of cores, running memory and storage capacity, DSP computing speed and number of transceiver antennas in the user terminal; the UE capability information is sent when it is determined that the PDU session is used to execute the immersive service; the PDU session is established after the AF determines the initial encoding and decoding rate. A method for processing immersive services can also be executed, which includes: when determining the establishment of a PDU session, receiving a policy authorization request message carrying UE capability information sent by a policy control function PCF; determining an initial encoding and decoding rate based on the UE capability information; and feeding back a policy authorization response message to the PCF to establish a protocol data unit PDU session; wherein the UE capability information is determined by the user terminal UE based on the device information of the user terminal, and sent to the PCF through a session management related message.

[0158] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a method for processing immersive services provided by the above methods, the method comprising: determining UE capability information based on device information of the user terminal; sending the UE capability information to the application function AF through the network, so that the AF can determine the initial encoding and decoding rate; after determining that the protocol data unit PDU session is established, performing data transmission of the immersive service; wherein the device information includes at least one of the CPU main frequency and number of cores, running memory and storage capacity, DSP computing speed and number of transceiver antennas in the user terminal; the UE capability information is sent when it is determined that the PDU session is used to execute the immersive service; the PDU session is established after the AF determines the initial encoding and decoding rate. A method for processing immersive services can also be executed, which includes: when determining the establishment of a PDU session, receiving a policy authorization request message carrying UE capability information sent by a policy control function PCF; determining an initial encoding and decoding rate based on the UE capability information; and feeding back a policy authorization response message to the PCF to establish a protocol data unit PDU session; wherein the UE capability information is determined by the user terminal UE based on the device information of the user terminal, and sent to the PCF through a session management related message.

[0159] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0160] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, or of course, by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the existing technology can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or certain parts of the embodiments.

[0161] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A method for processing immersive services, applied to a user terminal UE, characterized in that: include: Determine UE capability information based on the device information of the user terminal; Sending the UE capability information to the application function AF through the network, so that the AF can determine the initial codec rate; After confirming that the protocol data unit (PDU) session is established, data transmission of the immersive service is performed; The device information includes at least one of the CPU main frequency and number of cores, running memory and storage capacity, DSP operation speed, and number of transceiver antennas in the user terminal; the UE capability information is sent when it is determined that the PDU session is used to perform immersive services; the PDU session is established after the AF determines the initial codec rate; After determining that the PDU session is established, the method further includes: Determining that the UE is internally overheated; Notifying the access and mobility management function AMF through the radio access network RAN ​​that the UE is internally overheated, so that the AMF notifies the AF to adjust the codec rate in response to the UE overheat event; The UE overheat event is a service event opened by the AMF according to the UE overheat, and the AF subscribes to the UE overheat event from the AMF in advance before the immersive service starts; The sending the UE capability information to the application function AF through the network includes: The UE sends UE capability information to the AMF through the RAN, the AMF sends the UE capability information to the SMF, the SMF sends the UE capability information to the selected PCF, and the PCF sends the UE capability information to the AF.

2. A method for processing immersive services, applied to application function AF, characterized in that: include: When determining that a PDU session is established, receiving a policy authorization request message carrying UE capability information sent by a policy control function PCF; Determining an initial codec rate based on the UE capability information; Feedback a policy authorization response message to the PCF to establish a protocol data unit (PDU) session; Subscribe to UE overheat events from AMF to obtain UE overheat event notification messages; Adjusting the codec rate based on the UE overheat information carried in the UE overheat event notification message, and notifying the PCF through the NEF to adjust the quality of service QoS policy; Among them, the UE capability information is determined by the user terminal UE based on the device information of the user terminal and sent to the PCF through a session management related message, and the UE overheat event is a service event opened by the AMF based on the UE overheat.

3. An immersive service processing device, provided in a user terminal UE, characterized in that: include: A terminal capability determination module, configured to determine UE capability information based on device information of the user terminal; A service initiation module, configured to send the UE capability information to the application function AF via the network, so that the AF can determine an initial codec rate; A data transmission module, configured to transmit data for the immersive service after determining that a protocol data unit (PDU) session is established; Overheat monitoring module, used to determine if the UE is overheated; An overheat reporting module is used to notify the access and mobility management function AMF of UE internal overheating through the radio access network RAN, so that the AMF can notify the AF to adjust the codec rate after responding to the UE overheating event; The device information includes at least one of the CPU main frequency and number of cores, running memory and storage capacity, DSP operation speed, and number of transceiver antennas in the user terminal; the UE capability information is sent when it is determined that the PDU session is used to perform immersive services; the PDU session is established after the AF determines the initial codec rate; The UE overheat event is a service event opened by the AMF based on the UE overheat. The AF subscribes to the UE overheat event from the AMF in advance before the immersive service starts; The sending the UE capability information to the application function AF through the network includes: The UE sends UE capability information to the AMF through the RAN, the AMF sends the UE capability information to the SMF, the SMF sends the UE capability information to the selected PCF, and the PCF sends the UE capability information to the AF.

4. A processing device for immersive services, provided in an application function AF, characterized in that: include: A receiving module, configured to receive a policy authorization request message carrying UE capability information sent by a policy control function PCF when determining that a PDU session is established; A codec rate adaptation module, configured to determine an initial codec rate based on the UE capability information; A feedback module, configured to feed back a policy authorization response message to the PCF to establish a protocol data unit (PDU) session; An overheat information acquisition module is used to obtain UE overheat event notification messages by subscribing to UE overheat events from the AMF; The codec rate adjustment module is used to adjust the codec rate based on the UE overheat information carried in the UE overheat event notification message, and notify the PCF through the NEF to adjust the quality of service QoS policy; Among them, the UE capability information is determined by the user terminal UE based on the device information of the user terminal and sent to the PCF through a session management related message, and the UE overheat event is a service event opened by the AMF based on the UE overheat.

5. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the immersive service processing method according to any one of claims 1 to 2 is implemented.

6. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for processing the immersive service according to any one of claims 1 to 2 is implemented.

7. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method for processing the immersive service according to any one of claims 1 to 2 is implemented.

Images