Video playing jump processing method and device and readable storage medium

Abstract

The invention provides a video playing jump processing method and device and a readable storage medium. The method comprises the following steps: acquiring a message of an XR video playing jump event corresponding to a user terminal; according to the message of the XR video playing jump event, packaging the SO < oRA > information of random access into a GTPU protocol extension header of a downlink message of an XR video stream corresponding to the user terminal, and sending the downlink message carrying the SO < oRA > information to a radio access network (RAN) corresponding to the user terminal; wherein the RAN is used for carrying out scheduling optimization on the flow information corresponding to the XR video playing jump according to the SIoRA information in the received downlink message. According to the invention, identification of XR video playing jump is realized, scheduling optimization is carried out on the XR video playing jump, and the XR experience of a user is improved.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a method, device and readable storage medium for processing video playback jumps. Background Art

[0002] Extended Reality (XR) is the combination of reality and virtuality through computers to create a virtual environment for human-computer interaction. With the development of XR technology, XR services will become an important application scenario for 6G in the future. Currently, many technical studies focus on improving the quality and experience of XR services.

[0003] Among them, video is the main presentation method of XR. When watching, users may adjust the XR video playback progress at any time, such as jumping to a specified time point for playback in advance or rewind. However, the existing technology does not have the ability to recognize XR video playback jumps, and usually there is a large delay, and the picture stagnates waiting for loading, affecting the user's XR experience.

[0004] Therefore, the existing technology cannot identify XR video playback jump events, and thus cannot perform scheduling optimization for XR video playback jumps, affecting the user's XR experience. Summary of the invention

[0005] The present application provides a video playback jump processing method, device and readable storage medium, which solves the technical problem that the prior art cannot identify XR video playback jump events, and thus cannot perform scheduling optimization for XR video playback jumps, affecting the user's XR experience.

[0006] In a first aspect, the present application provides a video playback jump processing method, which is applied to a user plane function UPF. In a scenario where a user adjusts an extended reality XR video playback jump position, the method includes:

[0007] Obtaining a message of an XR video playback jump event corresponding to the user terminal; the message of the XR video playback jump event at least includes stream information corresponding to the XR video playback jump;

[0008] According to the message of the XR video playback jump event, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal, and the downlink message carrying the SIoRA information is sent to the radio access network RAN ​​corresponding to the user terminal; the XR video stream is the video stream indicated by the stream information corresponding to the XR video playback jump or the video stream matching the stream information corresponding to the XR video playback jump;

[0009] The RAN is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message.

[0010] Optionally, the acquiring a message of an XR video playback jump event corresponding to the user terminal includes:

[0011] Receive a message of an XR video playback jump event sent by an application function AF, where the XR video playback jump event is directly subscribed to the AF; or,

[0012] Receive a message of an XR video playback jump event sent by a session management function SMF, where the XR video playback jump event is subscribed by the SMF to the AF; the message of the XR video playback jump event sent by the SMF is sent by the SMF to N4 after the SMF receives the message of the XR video playback jump event sent by the AF, and is sent through N4;

[0013] The message of the XR video playback jump event subscribed to the AF also includes an event identifier Event ID used to indicate the type of the XR video playback jump event.

[0014] Optionally, the message of the XR video playback jump event also includes a user terminal identifier UE ID; and the encapsulating, according to the message of the XR video playback jump event, the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal includes:

[0015] Determining, according to the UE ID, a user terminal corresponding to the jump event;

[0016] If a downlink message of the XR video stream corresponding to the user terminal is received, the stream information corresponding to the XR video playback jump is matched with the XR video stream directly or through the matching strategy provided by AF. If the information of an XR video stream is matched, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message.

[0017] Optionally, the stream information corresponding to the XR video playback jump includes at least one of the following: a sequence number SN on a tuple of an IP protocol message, an SN on a tuple of an IP protocol message and an SN on an RTP protocol header, a timestamp on a tuple of an IP protocol message and a timestamp on an RTP protocol header, an SN and a timestamp on a tuple of an IP protocol message, and an SN and a timestamp on an RTP protocol header; the matching strategy provided directly or through AF to match the stream information corresponding to the XR video playback jump with a data burst XR video data video stream includes:

[0018] Determine whether the information of the data burst XR video data video stream in the stream information corresponding to the XR video playback jump is matched through the sequence number SN on the tuple of the IP protocol message, or the SN on the tuple of the IP protocol message and the SN on the RTP protocol header; and / or,

[0019] Determine whether the information of the data burst XR video data video stream in the stream information corresponding to the XR video playback jump is matched through the timestamp on the tuple of the IP protocol message and the timestamp on the RTP protocol header;

[0020] The information of the data burst XR video data video stream includes any of the following: the first message or the first I frame.

[0021] In the embodiment of the present application, the RAN is notified of the playback jump event by obtaining the playback jump event through AF. Specifically, UPF directly receives the message of the XR video playback jump event sent by AF, or receives the message of the XR video playback jump event sent by SMF (the message of the XR video playback jump event here is sent by the SMF to N4 after receiving the message of the XR video playback jump event sent by AF, and sent through N4), and then determines the UE corresponding to the jump event according to the UE ID in the message of the XR video playback jump event. If the downlink message of the XR video stream corresponding to the UE is received, the XR video stream is matched directly or through the matching strategy provided by AF for the stream information corresponding to the XR video playback jump. If the information of an XR video stream is matched, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message. The SIoRA information is used to instruct RAN to schedule and optimize the stream information corresponding to the XR video playback jump. Therefore, the recognition of the XR video playback jump is realized, and then the scheduling optimization is performed for the XR video playback jump, thereby improving the user's XR experience.

[0022] Optionally, the method further comprises:

[0023] Determine whether an XR video playback jump event occurs according to the received downlink message of the XR video stream corresponding to the user terminal;

[0024] If it is determined that an XR video playback jump event has occurred, the SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message, and the downlink message carrying the SIoRA information is sent to the RAN.

[0025] Optionally, determining whether an XR video playback jump event occurs according to the received downlink message of the XR video stream corresponding to the user terminal includes:

[0026] Obtain the timestamp of the last received downlink message, as well as the time threshold for XR video playback jump or the time period of XR video burst;

[0027] Determine the message time interval according to the timestamp of the current downlink message and the timestamp of the last downlink message obtained;

[0028] If the message time interval is greater than the time threshold of the XR video playback jump or the message time interval is greater than the time period of the XR video burst, it is determined that an XR video playback jump event has occurred; if the message time interval is less than or equal to the time threshold of the XR video playback jump or the message time interval is less than or equal to the time period of the XR video burst, it is determined that no XR video playback jump event has occurred, and the current downlink message is sent to the RAN;

[0029] The time threshold of the XR video playback jump or the time period of the XR video burst is sent by the AF / policy control function PCF, or is configured locally.

[0030] In an embodiment of the present application, first, UPF can identify the time threshold of XR video playback jump, or the burst cycle of XR video from AF or local configuration. Secondly, UPF calculates the time interval (herein, message time interval) between the timestamp in each received downlink message (herein, timestamp) and the timestamp in the last received downlink message, and judges the time interval. If the message time interval exceeds the time threshold of XR video playback jump, or exceeds the burst cycle of XR video, it can be identified that a playback jump event has occurred. Therefore, the playback jump event can be effectively identified.

[0031] Optionally, determining whether an XR video playback jump event occurs according to the received downlink message of the XR video stream corresponding to the user terminal includes:

[0032] If it is detected that the RTP protocol header of the downlink message of the XR video stream contains SIoRA information, it is determined that an XR video playback jump event has occurred; or,

[0033] If it is detected that the RTP protocol extension header of the downlink message of the XR video stream contains SIoRA information, it is determined that an XR video playback jump event has occurred;

[0034] Among them, the SIoRA information included in the RTP protocol header or the SIoRA information included in the RTP protocol extension header is configured by the server of the XR video.

[0035] In an embodiment of the present application, according to the header defined by RFC 3350 Extended Real-time Transport Protocol (RTP for short), the SIoRA information (here the SIoRA identifier) ​​is directly indicated in the RTP header (here the RTP Header). At this time, the server (for example, AS) of the XR video needs to set this identifier directly in the downlink data RTP header according to the service playback jump event (here the XR video playback jump event). After the UPF detects this SIoRA extension header identifier, it is copied to the GTPU protocol extension header. Alternatively, the RTP Header Extension (RTP protocol extension header) defined by 3GPP TS26.522 is extended to directly indicate the SIoRA identifier in the RTP Header Extension header. At this time, the AS needs to set this identifier directly in the RTP Header Extension header of the downlink message according to the service playback jump event. The UPF detects that the RTP Header Extension defined by TS26.522 contains a direct indication of the SIoRA identifier, and then copies it to the GTPU protocol extension header.

[0036] Optionally, the RAN is specifically used for:

[0037] According to the received SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0038] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0039] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0040] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0041] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0042] In the embodiment of the present application, the SIoRA identifier is used to instruct the RAN to optimize the cache and scheduling according to the video playback jump indication. Specifically, the RAN receives the SIoRA indication in the GTPU extension header of the downlink message, or receives the SIoRA indication and XR video stream notified by the SMF update message. According to the above information, the RAN performs the following optimizations: accelerates the clearing of the cache of the corresponding XR video stream (data received before the playback jump); performs real-time (for example, 3 to 5 seconds) scheduling optimization on the video stream, increases the scheduling priority, increases the bandwidth of the stream, etc. This is used to speed up video loading, reduce playback jump delay, and thus optimize the user's XR experience.

[0043] In the second aspect, the present application provides a video playback jump processing method, which is applied to AF and supports UPF to subscribe to XR video playback jump events to the AF, or SMF to subscribe to XR video playback jump events to the AF; in the scenario where the user adjusts the extended reality XR video playback jump position, the method includes:

[0044] Sending a message of an XR video playback jump event corresponding to the user terminal to the UPF directly or through the SMF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0045] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0046] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0047] Optionally, the message of the XR video playback jump event corresponding to the user terminal is sent to the UPF through the SMF by the SMF sending the message of the XR video playback jump event received from the AF to N4, and is sent through N4.

[0048] In the embodiment of the present application, the AF directly or through the SMF sends a message of the XR video playback jump event corresponding to the user terminal to the UPF, and the message of the XR video playback jump event is used to instruct the UPF to encapsulate the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal according to the message of the XR video playback jump event, and send the downlink message carrying the SIoRA information to the wireless access network RAN ​​corresponding to the user terminal. Therefore, the recognition of the XR video playback jump is realized, and then the scheduling optimization is performed for the XR video playback jump, thereby improving the user's XR experience.

[0049] Optionally, the method further comprises:

[0050] Sending a matching strategy for matching the XR video stream with the stream information corresponding to the XR video playback jump to the UPF; the matching strategy includes:

[0051] Determine whether the XR video stream information in the stream information corresponding to the XR video playback jump is matched by the sequence number SN on the tuple of the IP protocol message, or the SN on the tuple of the IP protocol message and the SN on the RTP protocol header; and / or,

[0052] Determine whether the information of the XR video stream in the stream information corresponding to the XR video playback jump is matched through the timestamp on the tuple of the IP protocol message and the timestamp on the RTP protocol header;

[0053] The information of the XR video stream includes any of the following: the first message or the first I frame.

[0054] Optionally, the method further comprises:

[0055] The time threshold of the XR video playback jump or the time period of the XR video burst is sent to the UPF.

[0056] Optionally, the RAN is specifically used for:

[0057] According to the received SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0058] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0059] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0060] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0061] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0062] In the embodiment of the present application, AF can also provide XR video stream playback jump matching features: through the SN on the IP PacketFilter (here refers to the tuple of IP protocol packets) + RTP header (RTP protocol header), the SN can be used to match the first packet of a Data Burst (here refers to matching an XR video stream), and the SIoRA identifier can be added; or, through the Timestamp (here refers to the timestamp) on the IP Packet Filter+RTP Header, the Timestamp can be used to match the first packet of a Data Burst, and the SIoRA identifier can be added; and through the Timestamp+SN on the IP Packet Filter+RTP Header, the Timestamp+SN can be used to match the first packet of a Data Burst, and the SIoRA identifier can be added. The SIoRA identifier is used to instruct the RAN to perform the following optimizations: accelerate the clearing of the cache of the corresponding XR video stream (data received before the playback jump); perform real-time (for example, 3 to 5 seconds) scheduling optimization on the video stream, and increase the scheduling priority to speed up the video loading speed, reduce the playback jump delay, and thus optimize the user's XR experience.

[0063] In a third aspect, the present application provides a video playback jump processing method, which is applied to SMF and supports the SMF to subscribe to XR video playback jump events to AF; in the scenario where the user adjusts the extended reality XR video playback jump position, the method includes:

[0064] Receive a message of an XR video playback jump event corresponding to the user terminal sent by the AF;

[0065] Sending a message of the XR video playback jump event to the UPF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0066] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0067] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0068] Optionally, the sending a message of the XR video playback jump event to the UPF includes:

[0069] Send the message of the XR video playback jump event to N4;

[0070] Sending a message of the XR video playback jump event to the UPF through the N4;

[0071] The message of the XR video playback jump event also includes an event identifier Event ID used to indicate the type of the XR video playback jump event.

[0072] In the embodiment of the present application, SMF receives the message of the XR video playback jump event corresponding to the user terminal sent by AF, sends the message of the XR video playback jump event to N4, and sends the message of the XR video playback jump event to the UPF through N4. The message of the XR video playback jump event is used to instruct the UPF to encapsulate the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal according to the message of the XR video playback jump event, and sends the downlink message carrying the SIoRA information to the wireless access network RAN ​​corresponding to the user terminal. Therefore, the recognition of the XR video playback jump is realized, and then the scheduling optimization is performed for the XR video playback jump, thereby improving the user's XR experience.

[0073] Optionally, the message of the XR video playback jump event also includes a user terminal identifier UE ID; and the method further includes:

[0074] Determining, according to the UE ID, a user terminal corresponding to the jump event;

[0075] An update message is directly sent to the RAN corresponding to the user terminal, or the most recent update message at the current moment is sent to the RAN; the update message carries the SIoRA message and the stream information corresponding to the XR video playback jump.

[0076] In the embodiment of the present application, SMF carries SIoRA information and XR video playback jump flow information in the N2 update message to notify RAN. Specifically, SMF can directly trigger an update message to the corresponding user, or send it to RAN with the most recent update message. The update message is used to indicate that if RAN receives a SIoRA indication in the GTPU extension header of the downlink message, the flow information corresponding to the XR video playback jump (here refers to the flow information corresponding to the XR video playback jump) is scheduled and optimized: accelerate the clearing of the cache of the corresponding XR video stream (data received before the playback jump); perform real-time (for example, 3 to 5 seconds) scheduling optimization on the video stream, and increase the scheduling priority to speed up the video loading speed, reduce the playback jump delay, and thus optimize the user's XR experience.

[0077] In a fourth aspect, the present application provides a video playback jump processing method, which is applied to RAN. In a scenario where a user adjusts an extended reality XR video playback jump position, the method includes:

[0078] Obtain SIoRA information and stream information corresponding to the XR video playback jump; the SIoRA information is encapsulated by any of the methods described above, and the stream information corresponding to the XR video playback jump is obtained by any of the methods described above;

[0079] According to the SIoRA information, the stream information corresponding to the received XR video playback jump is scheduled and optimized.

[0080] Optionally, the scheduling and optimizing the stream information corresponding to the received XR video playback jump according to the SIoRA information includes:

[0081] According to the SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0082] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0083] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0084] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0085] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0086] In an embodiment of the present application, RAN obtains SIoRA information and stream information corresponding to the XR video playback jump, and performs the following optimizations based on the SIoRA information: accelerates the clearing of the cache corresponding to the XR video stream (data received before the playback jump); performs real-time (for example, 3 to 5 seconds) scheduling optimization on the video stream, and increases the scheduling priority to speed up video loading, reduce playback jump delay, and thereby optimize the user's XR experience.

[0087] In a fifth aspect, the present application provides a video playback jump processing device, which is applied to a user plane function UPF. In a scenario where a user adjusts an extended reality XR video playback jump position, the device includes:

[0088] An acquisition unit, configured to acquire a message of an XR video playback jump event corresponding to a user terminal; the message of the XR video playback jump event at least includes stream information corresponding to the XR video playback jump;

[0089] A processing unit is configured to encapsulate the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal according to the message of the XR video playback jump event, and send the downlink message carrying the SIoRA information to the radio access network RAN ​​corresponding to the user terminal; the XR video stream is a video stream indicated by the stream information corresponding to the XR video playback jump or a video stream matching the stream information corresponding to the XR video playback jump;

[0090] The RAN is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message.

[0091] In a sixth aspect, the present application provides a video playback jump processing device, which is applied to AF and supports UPF to subscribe to XR video playback jump events from AF, or SMF to subscribe to XR video playback jump events from AF; in a scenario where a user adjusts the jump position of extended reality XR video playback, the device includes:

[0092] A sending unit, configured to send a message of an XR video playback jump event corresponding to the user terminal to the UPF directly or through the SMF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0093] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0094] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0095] In a seventh aspect, the present application provides a video playback jump processing device, which is applied to SMF and supports the SMF to subscribe to XR video playback jump events to AF; in a scenario where a user adjusts the extended reality XR video playback jump position, the device includes:

[0096] A receiving unit, configured to receive a message of an XR video playback jump event corresponding to a user terminal sent by the AF;

[0097] A sending unit, configured to send a message of the XR video playback jump event to the UPF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0098] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0099] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0100] In an eighth aspect, the present application provides a video playback jump processing device, which is applied to RAN. In a scenario where a user adjusts an extended reality XR video playback jump position, the device includes:

[0101] An acquisition unit, used to acquire SIoRA information and stream information corresponding to the XR video playback jump; the SIoRA information is encapsulated by any of the methods described above, and the stream information corresponding to the XR video playback jump is acquired by any of the methods described above;

[0102] The scheduling optimization unit is used to schedule and optimize the stream information corresponding to the received XR video playback jump according to the SIoRA information.

[0103] In a ninth aspect, the present application provides a video playback jump processing device, which is applied to a user plane function UPF. In a scenario where a user adjusts an extended reality XR video playback jump position, the device includes a memory, a transceiver, and a processor:

[0104] A memory for storing a computer program; a transceiver for transmitting and receiving data under the control of the processor; and a processor for reading the computer program in the memory and performing the following operations:

[0105] Obtaining a message of an XR video playback jump event corresponding to the user terminal; the message of the XR video playback jump event at least includes stream information corresponding to the XR video playback jump;

[0106] According to the message of the XR video playback jump event, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal, and the downlink message carrying the SIoRA information is sent to the radio access network RAN ​​corresponding to the user terminal; the XR video stream is the video stream indicated by the stream information corresponding to the XR video playback jump or the video stream matching the stream information corresponding to the XR video playback jump;

[0107] The RAN is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message.

[0108] In a tenth aspect, the present application provides a video playback jump processing device, which is applied to AF and supports UPF to subscribe to XR video playback jump events from AF, or SMF to subscribe to XR video playback jump events from AF; in a scenario where a user adjusts the jump position of extended reality XR video playback, the device includes: a memory, a transceiver, and a processor:

[0109] A memory for storing a computer program; a transceiver for transmitting and receiving data under the control of the processor; and a processor for reading the computer program in the memory and performing the following operations:

[0110] Sending a message of an XR video playback jump event corresponding to the user terminal to the UPF directly or through the SMF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0111] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0112] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0113] In an eleventh aspect, the present application provides a video playback jump processing device, which is applied to SMF and supports the SMF to subscribe to XR video playback jump events to AF; in a scenario where a user adjusts the jump position of the extended reality XR video playback, the device includes: a memory, a transceiver, and a processor:

[0114] A memory for storing a computer program; a transceiver for transmitting and receiving data under the control of the processor; and a processor for reading the computer program in the memory and performing the following operations:

[0115] Receive a message of an XR video playback jump event corresponding to the user terminal sent by the AF;

[0116] Sending a message of the XR video playback jump event to the UPF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0117] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0118] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0119] In a twelfth aspect, the present application provides a video playback jump processing device, which is applied to RAN. In a scenario where a user adjusts an extended reality XR video playback jump position, the device includes: a memory, a transceiver, and a processor:

[0120] A memory for storing a computer program; a transceiver for transmitting and receiving data under the control of the processor; and a processor for reading the computer program in the memory and performing the following operations:

[0121] Obtain SIoRA information and stream information corresponding to the XR video playback jump; the SIoRA information is encapsulated by any of the methods described above, and the stream information corresponding to the XR video playback jump is obtained by any of the methods described above;

[0122] According to the SIoRA information, the stream information corresponding to the received XR video playback jump is scheduled and optimized.

[0123] In a thirteenth aspect, the present application provides a processor-readable storage medium, wherein the processor-readable storage medium stores a computer program, and the computer program is used to enable the processor to execute the method described in any one of the first aspect or the second aspect.

[0124] The present application provides a method, device and readable storage medium for processing video playback jump, which obtains a message of a video playback jump event, adds a SIoRA identifier to the GTPU protocol extension header of a downlink message according to the message, and sends the downlink message carrying the identifier to the RAN. The SIoRA identifier can effectively identify video playback jump events, and instruct the RAN to perform scheduling optimization based on the received (SIoRA) jump indication, so as to speed up video loading, reduce playback jump delay, and thus optimize the user's XR experience.

[0125] It should be understood that the contents described in the above summary of the invention are not intended to limit the key or important features of the embodiments of the present application, nor are they intended to limit the scope of the present application. Other features of the present application will become easy to understand through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0126] In order to more clearly illustrate the technical solutions in the present application or the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0127] Figure 1 A schematic diagram of a frame of an XR video provided in an embodiment of the present application;

[0128] Figure 2 An interactive schematic diagram of a video playback jump processing method provided in an embodiment of the present application;

[0129] Figure 3 A flowchart of a video playback jump processing method provided in an embodiment of the present application;

[0130] Figure 4 An interactive schematic diagram of a video playback jump processing method provided by another embodiment of the present application;

[0131] Figure 5 A schematic diagram of adding SIoRA to the GTPU extension header provided in an embodiment of the present application;

[0132] Figure 6 An interactive schematic diagram of a video playback jump processing method provided by another embodiment of the present application;

[0133] Figure 7 A schematic diagram of the timestamp information of a message provided in an embodiment of the present application;

[0134] Figure 8 An interactive schematic diagram of a video playback jump processing method provided by another embodiment of the present application;

[0135] Fig. 9 A schematic diagram of the RTP header extension SIoRA identifier defined in RFC 3350 provided in an embodiment of the present application;

[0136] Fig. 10A A schematic diagram of the RTP Header Extension SIoRA identifier defined in 3GPP TS26.522 provided in an embodiment of the present application;

[0137] Fig. 10B A schematic diagram of an RTP Header Extension SIoRA identifier defined in 3GPP TS26.522 provided in another embodiment of the present application;

[0138] Fig.11 An interactive schematic diagram of a video playback jump processing method provided by another embodiment of the present application;

[0139] Fig.12 An interactive schematic diagram of a video playback jump processing method provided by another embodiment of the present application;

[0140] Fig.13 A schematic diagram of the structure of a video playback jump processing device provided in an embodiment of the present application;

[0141] Fig.14A schematic diagram of the structure of a video playback jump processing device provided by another embodiment of the present application;

[0142] Fig.15 A schematic diagram of the structure of a video playback jump processing device provided in yet another embodiment of the present application;

[0143] Fig.16 A schematic diagram of the structure of a video playback jump processing device provided by another embodiment of the present application;

[0144] Fig.17 A schematic diagram of the structure of a video playback jump processing device provided in yet another embodiment of the present application. DETAILED DESCRIPTION

[0145] The term "and / or" in this application describes the association relationship of associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0146] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0147] In order to clearly understand the technical solution of the present application, the solution of the prior art is first introduced in detail. XR video related information: Frame is the basic unit that makes up the video image, and the frame type can be divided into I frame, P frame, and B frame. Usually the I frame is the largest frame in the XRM stream, which is about 5 times the size of the P-type frame and about 20 times the size of the B-type frame. The I frame is usually the first frame of each group of pictures (English: Group of Pictures, abbreviated as: GOP) (a video compression technology used by the Moving Picture Experts Group (English: Moving Picture Experts Group, abbreviated as: MPEG)). It is used as a reference point for random access and can be used as an image. The I frame method is an intra-frame compression method, also known as the "key frame" compression method. It is a fully compressed coded frame; when decoding, the complete image can be reconstructed using only the data of the I frame.

[0148] Among them, frames of XR video data (here refers to XR video stream) are usually sent and transmitted in the form of bursts, that is, a group of multiple protocol data units (English: Protocol Data Unit, referred to as: PDU) generated and sent by the XR application in a short period of time, and this burst has periodic characteristics, such as Figure 1As shown, EoDB stands for End of DataBurst.

[0149] Due to security requirements, parsing of user message content is not allowed in actual access network deployment. Usually, the core network user plane identifies and parses user message services or obtains service information through capability exposure policies, and then notifies the service information (such as EoDB) to the wireless access network (RAN), thereby assisting RAN in scheduling and optimizing specific services.

[0150] The scheduling and forwarding process of RAN includes bandwidth allocation, data caching and processing, Quality of Service (QoS) management and optimization, and data traffic forwarding to meet users' data upload and download needs. Among them, due to the mismatch between the data rate provided by the application layer and the data rate provided by the wireless interface, data caching may be performed in RAN, and the cached data will be forwarded sequentially according to the scheduling cycle and strategy. The existing solution does not have the ability to identify XR video playback jumps, nor does it have a scheduling optimization solution for XR video playback jumps.

[0151] Therefore, the existing technology cannot identify XR video playback jump events, and thus cannot perform scheduling optimization for XR video playback jumps, affecting the user's XR experience.

[0152] The inventors further discovered that the core network (CN) obtains video playback jump information through capability exposure channels or identifies it through user messages, and sends the information (Start Indication of Random Access, SIoRA) to RAN. Based on the received (SIoRA) jump indication, RAN releases the pre-jump cache data of the current video stream and performs real-time scheduling optimization (increasing bandwidth, increasing scheduling priority, etc.) on the stream to speed up video loading, reduce playback jump delay, and optimize the user's XR experience.

[0153] Therefore, based on the creative research of the above-mentioned inventors, a video playback jump processing method proposed in the present application is proposed. In the present application, UPF obtains the message of the XR video playback jump event corresponding to the user terminal, adds the SIoRA identifier in the GTPU protocol extension header of the downlink message according to the message, and sends the downlink message carrying the identifier to RAN. By identifying the identifier, the identification of the XR video playback jump is realized, and the RAN is instructed to perform scheduling optimization based on the received (SIoRA) jump indication through the identifier, so as to speed up the video loading speed, reduce the playback jump delay, and thus optimize the user's XR experience.

[0154] Combination Figure 2 As shown, Figure 2 The interactive schematic diagram of the video playback jump processing method provided in the embodiment of the present application is as follows: Figure 2 As shown, the interaction scenario includes UE, RAN, and core network elements (access and mobility management function (Access and Mobility Management Function, AMF), user plane function (UPF), session management function (SMF), policy control function (PCF), application function (AF) / network exposure function (NEF)).

[0155] In the embodiment of the present application, the preset scenario is: UE requests and obtains XR video playback.

[0156] Optionally, due to the mismatch between the air interface rate and the XR service rate, temporary cache data may be generated during RAN scheduling during XR playback;

[0157] Among them, when there is cached data, RAN will prioritize the forwarding of cached data and then the forwarding of newly received data. Therefore, if a video playback jump occurs and the cached data is outdated, further scheduling and forwarding will affect the latency of subsequent newly received video packets, that is, users will experience service waiting delays.

[0158] During XR video playback, the user adjusts the playback progress bar and specifies the video playback jump position (time point).

[0159] Use the following steps to implement video playback jump processing:

[0160] Phase 1: Obtaining the playback jump event notification RAN. The following is achieved in at least two ways:

[0161] Method 1: Get playback jump event notification RAN through AF

[0162] AF newly supports Event ID (here refers to the event identifier, by identifying the Event ID, it is determined that the event type is the XR video playback jump) as the event type of XR video playback jump, and the subscription and notification extension parameters related to the event, including but not limited to: user XR video stream information (here refers to the UE's XR video stream); XR video playback jump event (time / timestamp) information.

[0163] It should be noted that the embodiments of the present application do not limit how the AF and the DN-side XR server (here, the XR video server) interact to obtain video playback jump information. The NEF may also provide messages of video playback jump events.

[0164] Specifically, for example, AF obtains the message of the video playback jump event from the XR server on the DN side (here refers to the information of the video playback jump event)

[0165] This is accomplished in two ways:

[0166] Method 11: 1a. UPF subscribes to XR video playback jump events directly from AF. SMF can also subscribe and then send them to UPF through N4.

[0167] 2a. UPF adds the SIoRA identifier to the GTPU extension header (here refers to the GTPU protocol extension header) of the downlink message and sends it to the RAN.

[0168] Specifically, UPF first matches the corresponding user based on the information of the XR video jump event notified by AF or provided by SMF.

[0169] After receiving the XR video stream downlink message corresponding to the user, UPF matches it according to the provided XR video stream information (here refers to the XR video stream). If a match is hit, the SIoRA identifier is added to the GTPU extension header of the downlink message.

[0170] The specific matching methods are as follows:

[0171] The SN on the IP Packet Filter+RTP header is used to match the first packet of a Data Burst and then the SIoRA identifier can be added.

[0172] The Timestamp on the IP Packet Filter+RTP Header can be used to match the first packet of a Data Burst and add the SIoRA identifier.

[0173] The Timestamp+SN on the IP Packet Filter+RTP Header can be used to match the first packet of a Data Burst and add the SIoRA identifier.

[0174] Among them, the downlink message notifying the SIoRA indication recommends selecting the first message or I frame of the first burst after receiving the indication, which is conducive to the selection and optimization of the jump video stream reconstruction point. The downlink message itself already contains the flow information, and the SIoRA indication is carried with the downlink message, and there is no need to carry the flow information separately. It should be noted that the embodiment of the present application does not limit the specific format of adding SIoRA in the GTPU extension header.

[0175] Method 12: 1b, SMF directly subscribes to the XR video playback jump event from AF.

[0176] 2b. SMF directly sends SIoRA notification to RAN via update message.

[0177] Specifically, SMF first matches the corresponding user based on the information of the XR video jump event notified by AF.

[0178] SMF can directly trigger an update message to the corresponding user, or send it to RAN along with the latest update message, which carries the SIoRA indication and the corresponding XR video stream information.

[0179] Method 2: Identify the XR video playback jump event through user messages and notify the RAN (the DN side server sends the XR downlink data traffic)

[0180] 1. UPF uses messages to identify video playback jump events. There are several ways to do this:

[0181] Method 1: First, UPF can identify the time threshold of XR video playback jump, or the burst period of XR video from AF or local configuration.

[0182] Secondly, UPF calculates the time interval between the timestamp in each received downlink message and the timestamp in the last received downlink message, and judges the time interval. If the time interval exceeds the threshold of XR video playback jump, or exceeds the burst period, it can be identified as a playback jump event.

[0183] Method 2: According to the header defined by RFC 3350, the SIoRA information (here refers to the SIoRA identifier) ​​is directly indicated in the RTP header (here refers to RTP Header). At this time, the server (for example, AS) that needs XR video directly sets this identifier in the downlink data RTP header according to the service playback jump event (here refers to the XR video playback jump event). After the UPF detects this SIoRA extension header identifier, it is copied to the GTPU protocol extension header.

[0184] Method 3: Extend the RTP Header Extension defined in 3GPP TS26.522 and directly indicate the SIoRA identifier in the RTP Header Extension header. At this time, the AS needs to directly set this identifier in the RTP Header Extension header of the downlink message according to the service playback jump event. The UPF detects that the RTP Header Extension defined in TS26.522 contains the direct indication of the SIoRA identifier and then copies it to the GTPU protocol extension header.

[0185] 2. UPF encapsulates the SIoRA indication into the GTPU extension header of the downlink message and sends it to the RAN.

[0186] Phase 2: RAN optimizes cache and scheduling based on video playback jump instructions

[0187] RAN receives a SIoRA indication in the GTPU extension header of a downlink message, or receives a SIoRA indication and XR video stream information in an SMF update message. Based on the above information, RAN makes the following optimizations:

[0188] 1) Accelerate the clearing of the cache of the corresponding XR video stream (data received before the playback jump).

[0189] 2) Perform real-time (e.g., 3-5 seconds) scheduling optimization on the video stream, increase the scheduling priority, increase the bandwidth of the stream, etc.

[0190] It should be noted that the optimization means of RAN are not limited to the above ones, as long as the optimization is performed according to the SIoRA information indication.

[0191] Among them, after RAN scheduling optimization, the video that is played can be loaded quickly, reducing or even eliminating the jump delay.

[0192] Embodiments of the present application will be described below with reference to the accompanying drawings.

[0193] Figure 3 A flowchart of a video playback jump processing method provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, the execution subject of the video playback jump processing method provided in this embodiment is UPF. In the scenario where the user adjusts the jump position of the extended reality XR video playback, the video playback jump processing method provided in the embodiment of the present application includes the following steps:

[0194] Step 301: Obtain a message of an XR video playback jump event corresponding to a user terminal; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump.

[0195] Among them, the method of obtaining the message of the XR video playback jump event corresponding to the user terminal can be obtained through AF or through SMF.

[0196] Optionally, the acquiring a message of an XR video playback jump event corresponding to the user terminal includes:

[0197] Receive a message of an XR video playback jump event sent by an application function AF, where the XR video playback jump event is directly subscribed to the AF; or,

[0198] Receive a message of an XR video playback jump event sent by a session management function SMF, where the XR video playback jump event is subscribed by the SMF to the AF; the message of the XR video playback jump event sent by the SMF is sent by the SMF to N4 after the SMF receives the message of the XR video playback jump event sent by the AF, and is sent through N4;

[0199] The message of the XR video playback jump event subscribed to the AF also includes an event identifier Event ID used to indicate the type of the XR video playback jump event.

[0200] In the embodiment of the present application, UPF directly subscribes to the XR video playback jump event from AF, or SMF subscribes to AF and then sends it to UPF through N4. Among them, AF newly supports event types with Event ID as XR video playback jump, as well as subscription and notification extension parameters related to the event, including but not limited to: user XR video stream information, XR video playback jump event (time / timestamp) information.

[0201] Step 302: According to the message of the XR video playback jump event, encapsulate the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal, and send the downlink message carrying the SIoRA information to the wireless access network RAN ​​corresponding to the user terminal; the XR video stream is the video stream indicated by the stream information corresponding to the XR video playback jump or the video stream matching the stream information corresponding to the XR video playback jump.

[0202] The RAN is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message.

[0203] In the embodiment of the present application, the UPF adds a SIoRA identifier (here, the identifier included in the SIoRA information or the SIoRA information) to the GTPU protocol extension header of the downlink message according to the message, and sends the downlink message carrying the identifier to the RAN. The RAN performs scheduling optimization based on the received (SIoRA) jump indication to speed up video loading, reduce playback jump delay, and thus optimize the user's XR experience.

[0204] Therefore, this application obtains the message of the video playback jump event, adds the SIoRA identifier in the GTPU protocol extension header of the downlink message according to the message, and sends the downlink message carrying the identifier to the RAN. The SIoRA identifier can effectively identify the video playback jump event, and instruct the RAN to perform scheduling optimization based on the received (SIoRA) jump indication, so as to speed up the video loading speed, reduce the playback jump delay, and thus optimize the user's XR experience.

[0205] Optionally, the message of the XR video playback jump event also includes a user terminal identifier UE ID; and the encapsulating, according to the message of the XR video playback jump event, the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal includes:

[0206] Determining, according to the UE ID, a user terminal corresponding to the jump event;

[0207] If a downlink message of the XR video stream corresponding to the user terminal is received, the stream information corresponding to the XR video playback jump is matched with the XR video stream directly or through the matching strategy provided by AF. If the information of an XR video stream is matched, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message.

[0208] In an embodiment of the present application, UPF first matches the corresponding user based on the information of the XR video jump event notified by AF or provided by SMF.

[0209] After receiving the XR video stream downlink message corresponding to the user, UPF matches it according to the provided XR video stream information (here refers to the XR video stream). If a match is hit, the SIoRA identifier is added to the GTPU extension header of the downlink message.

[0210] Optionally, the stream information corresponding to the XR video playback jump includes at least one of the following: a sequence number SN on a tuple of an IP protocol message, an SN on a tuple of an IP protocol message and an SN on an RTP protocol header, a timestamp on a tuple of an IP protocol message and a timestamp on an RTP protocol header, an SN and a timestamp on a tuple of an IP protocol message, and an SN and a timestamp on an RTP protocol header; the matching of the stream information corresponding to the XR video playback jump directly or through a matching strategy provided by an AF to an XR video stream includes:

[0211] Determine whether the XR video stream information in the stream information corresponding to the XR video playback jump is matched by the sequence number SN on the tuple of the IP protocol message, or the SN on the tuple of the IP protocol message and the SN on the RTP protocol header; and / or,

[0212] Determine whether the information of the XR video stream in the stream information corresponding to the XR video playback jump is matched through the timestamp on the tuple of the IP protocol message and the timestamp on the RTP protocol header;

[0213] The information of the XR video stream includes any of the following: the first message or the first I frame.

[0214] In the embodiment of the present application, the specific matching methods may be as follows:

[0215] The SN on the IP Packet Filter+RTP header is used to match the first packet of a Data Burst and then the SIoRA identifier can be added.

[0216] The Timestamp on the IP Packet Filter+RTP Header can be used to match the first packet of a Data Burst and add the SIoRA identifier.

[0217] The Timestamp+SN on the IP Packet Filter+RTP Header can be used to match the first packet of a Data Burst and add the SIoRA identifier.

[0218] Specifically, the AF obtains the playback jump event notification RAN: UPF directly receives the message of the XR video playback jump event sent by the AF, or receives the message of the XR video playback jump event sent by the SMF (the message of the XR video playback jump event here is sent by the SMF to N4 after receiving the message of the XR video playback jump event sent by the AF, and sent through N4), and then determines the UE corresponding to the jump event according to the UE ID in the message of the XR video playback jump event. If the downlink message of the XR video stream corresponding to the UE is received, the XR video stream is matched directly or through the matching strategy provided by the AF for the stream information corresponding to the XR video playback jump. If the information of an XR video stream is matched, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message. The SIoRA information is used to instruct the RAN to schedule and optimize the stream information corresponding to the XR video playback jump. Therefore, the identification of the XR video playback jump is realized, and then the scheduling optimization is performed for the XR video playback jump, thereby improving the user's XR experience.

[0219] Optionally, the method further comprises:

[0220] Determine whether an XR video playback jump event occurs according to the received downlink message of the XR video stream corresponding to the user terminal;

[0221] If it is determined that an XR video playback jump event has occurred, the SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message, and the downlink message carrying the SIoRA information is sent to the RAN.

[0222] Optionally, determining whether an XR video playback jump event occurs according to the received downlink message of the XR video stream corresponding to the user terminal includes:

[0223] Obtain the timestamp of the last received downlink message, as well as the time threshold for XR video playback jump or the time period of XR video burst;

[0224] Determine the message time interval according to the timestamp of the current downlink message and the timestamp of the last downlink message obtained;

[0225] If the message time interval is greater than the time threshold of the XR video playback jump or the message time interval is greater than the time period of the XR video burst, it is determined that an XR video playback jump event has occurred; if the message time interval is less than or equal to the time threshold of the XR video playback jump or the message time interval is less than or equal to the time period of the XR video burst, it is determined that no XR video playback jump event has occurred, and the current downlink message is sent to the RAN;

[0226] The time threshold of the XR video playback jump or the time period of the XR video burst is sent by the AF / policy control function PCF, or is configured locally.

[0227] In an embodiment of the present application, first, UPF can identify the time threshold of XR video playback jump, or the burst cycle of XR video from AF or local configuration. Secondly, UPF calculates the time interval (herein, message time interval) between the timestamp in each received downlink message (herein, timestamp) and the timestamp in the last received downlink message, and judges the time interval. If the message time interval exceeds the time threshold of XR video playback jump, or exceeds the burst cycle of XR video, it can be identified that a playback jump event has occurred. Therefore, the playback jump event can be effectively identified.

[0228] Optionally, determining whether an XR video playback jump event occurs according to the received downlink message of the XR video stream corresponding to the user terminal includes:

[0229] If it is detected that the RTP protocol header of the downlink message of the XR video stream contains SIoRA information, it is determined that an XR video playback jump event has occurred; or,

[0230] If it is detected that the RTP protocol extension header of the downlink message of the XR video stream contains SIoRA information, it is determined that an XR video playback jump event has occurred;

[0231] Among them, the SIoRA information contained in the RTP protocol header or the SIoRA information contained in the RTP protocol extension header is configured by the server of the XR video.

[0232] In an embodiment of the present application, according to the header defined by RFC 3350 Extended Real-time Transport Protocol (RTP for short), the SIoRA information (here the SIoRA identifier) ​​is directly indicated in the RTP header (here the RTP Header). At this time, the server (for example, AS) of the XR video needs to set this identifier directly in the downlink data RTP header according to the service playback jump event (here the XR video playback jump event). After the UPF detects this SIoRA extension header identifier, it is copied to the GTPU protocol extension header. Alternatively, the RTP Header Extension (RTP protocol extension header) defined by 3GPP TS26.522 is extended to directly indicate the SIoRA identifier in the RTP Header Extension header. At this time, the AS needs to set this identifier directly in the RTP Header Extension header of the downlink message according to the service playback jump event. The UPF detects that the RTP Header Extension defined by TS26.522 contains a direct indication of the SIoRA identifier, and then copies it to the GTPU protocol extension header.

[0233] Optionally, the RAN is specifically used for:

[0234] According to the received SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0235] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0236] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0237] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0238] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0239] The SIoRA information is used to instruct the RAN to clean up the XR video stream received before the XR video playback jump according to the received SIoRA information; and / or to perform scheduling optimization through at least one of the following:

[0240] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0241] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0242] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0243] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0244] In an embodiment of the present application, the SIoRA identifier is used to instruct the RAN to optimize the cache and scheduling according to the video playback jump indication. Specifically, the RAN receives the SIoRA indication in the GTPU extension header of the downlink message, or receives the SIoRA indication and the XR video stream notified by the SMF update message. Based on the above information, the RAN performs the following optimizations: accelerates the clearing of the cache corresponding to the XR video stream (data received before the playback jump); performs real-time (for example, 3 to 5 seconds) scheduling optimization for the video stream, increases the scheduling priority, increases the bandwidth of the stream, etc.

[0245] The following takes obtaining an XR video playback jump event through AF to notify RAN to optimize XR video playback jump as an example to describe the video playback jump processing method in detail.

[0246] For example, in Embodiment 1, UPF obtains the XR video playback jump event through AF to notify RAN to optimize the XR video playback jump. Figure 4 As shown, the video playback jump processing method is described in detail.

[0247] First, AF extension is needed to add support for event types with Event ID as XR video playback jump, as well as extended parameters of subscription and notification interfaces related to the event.

[0248] NF (such as SMF) can subscribe to AF for an event whose Event ID is XR video playback jump of a certain UE (UE ID includes GPSI or SUPI). That is, SMF sends Naf_EventExposure_Subscribe (i.e. event open subscription) (including but not limited to UE ID, Event ID) to AF.

[0249] AF interacts with the XR application service on the DN side (here refers to the server of the XR video) to obtain relevant information about the user's XR video playback jump event. The embodiment of the present application does not limit the method of obtaining this part of the interaction.

[0250] Step 1a: Notify about XR video playback jump event

[0251] AF sends a notification message (i.e. Naf_EventExposure_Notify (i.e. event exposure notification)) to the SMF of the subscribed user's Event ID for the event of XR video playback jump. The message content includes but is not limited to UE ID (user ID), Event ID (event of XR video playback jump), Flow Info (flow information corresponding to XR video playback jump), Timestamp (timestamp information or timestamp of XR video playback jump), etc.

[0252] The content of the flow information includes but is not limited to the following situations: IP Packet Filter, or IP Packet Filter+SN on RTP header, or IP Packet Filter+Timestamp on RTP Header, or IP Packet Filter+Timestamp+SN on RTP Header. This will not be described in detail later.

[0253] SMF converts the received information of the user's XR video playback jump event into an N4 message and notifies the UPF, which triggers the UPF to notify the RAN.

[0254] Specifically, first, the stream corresponding to the XR video playback jump is defined through N4 PDR, and UPF can match the traffic where the playback jump occurs through the PDR strategy; secondly, the playback jump event of the corresponding stream can be indicated through N4 FAR or QER, and UPF can encapsulate the SIoRA information into the GTPU extension header according to the indication of FAR or QER.

[0255] Step 1b, notify the information about the XR video playback jump event (UPF subscribes to AF for an event whose Event ID of a certain UE is XR video playback jump. That is, UPF sends Naf_EventExposure_Subscribe (i.e. event open subscription) to AF (including but not limited to UE ID, Event ID).)

[0256] AF sends a notification message (i.e. Naf_EventExposure_Notify (i.e. event exposure notification)) to the UPF that subscribes to the event of XR video playback jump of the user's Event ID. The message content includes but is not limited to UE ID (user ID), Event ID (event of XR video playback jump), Flow Info (flow information corresponding to XR video playback jump), Timestamp (timestamp information of XR video playback jump), etc.

[0257] UPF needs to generate user flow matching and forwarding rules based on the XR video playback jump information related to the notification message, including user information, flow information, timestamp information, etc., so as to extend SIoRA information for downlink messages according to the rules. This article does not limit the internal implementation of UPF.

[0258] Step 2a: UPF encapsulates the SIoRA indication into the GTPU extension header of the downlink message and sends it to the RAN. The details are as follows:

[0259] UPF receives the downlink message corresponding to the user's XR video playback jump stream, and matches it according to the provided XR video stream information. If a match is hit, the SIoRA identifier is added to the GTPU extension header of the downlink message.

[0260] The specific matching methods are as follows:

[0261] The SN on the IP Packet Filter+RTP header is used to match the first packet of a Data Burst and then the SIoRA identifier can be added.

[0262] The Timestamp on the IP Packet Filter+RTP Header can be used to match the first packet of a Data Burst and add the SIoRA identifier.

[0263] The Timestamp+SN on the IP Packet Filter+RTP Header can be used to match the first packet of a Data Burst and add the SIoRA identifier.

[0264] The SIoRA identifier is added to the GTPU extension header of the downlink message.

[0265] Among them, refer to 3GPP 38.415 5.5.2Frame format for the PDU Session user plane protocol to add the SIoRA parameter field in the GTPU extension header, see Figure 5 As shown, the embodiment of the present application does not limit the specific format of adding SIoRA in the GTPU extension header.

[0266] Step 2b: UPF constructs a dummy DL packet carrying the SIoRA indication in the GTPU extension header and sends it to the RAN.

[0267] UPF can construct a GTPU message without actual data based on the information of the user's XR video playback jump event, and add the SIoRA indication and corresponding video stream information to the GTPU extension header of the message.

[0268] This method can timely notify the RAN of the occurrence of the SIoRA event without relying on waiting for the arrival of the downlink message.

[0269] Step 3: When the RAN receives a SIoRA indication in the GTPU extension header of a downlink message, it optimizes the scheduling of the stream corresponding to the XR video playback jump.

[0270] If the RAN receives a user downlink message, it will be forwarded to the UE normally. If the RAN receives a constructed dummy DL packet, it can be directly discarded after extracting relevant information.

[0271] The following takes the identification of XR video playback jump events through user message streams as an example to describe the video playback jump processing method in detail.

[0272] For example, in Embodiment 2, UPF identifies XR video playback jump events through the time interval of the user message stream, see Figure 6 As shown, the video playback jump processing method is described in detail. Compared with the first embodiment, this embodiment does not need to obtain the information of the XR video playback jump event through the AF method, but identifies the XR video playback jump event by identifying the XR video stream message information in the user plane UPF. After identification, the SIoRA information is encapsulated in the GTPU extension header to notify the RAN, which will not be repeated.

[0273] Among them, the time threshold for judging the jump of XR video playback or the burst period of XR video can be issued through local configuration or policy (AF, PCF), which is not limited in the embodiments of the present application.

[0274] The timestamp information of the message refers to the field carried by the message itself (combined with Figure 7 As shown), for example, the timestamp information timestamp in the RTP message header (RFC 3350).

[0275] Step 1: UPF receives the downlink message of the user's XR video playback;

[0276] Step 2: UPF calculates the time interval between the received downlink message and the last received downlink message:

[0277] Get the timestamp information T1'=T1 of the last message recorded;

[0278] Parse the current message and extract the timestamp information T2 of the current message;

[0279] Record the timestamp information of the current message to the timestamp information of the previous message T1=T2;

[0280] Calculate the interval ΔT between the current message and the previous message = T2-T1';

[0281] Convert the interval into a time unit. The specific method can be found in the following scheme:

[0282] In the RTP message, the timestamp field records the value of the sender's sampling clock, which is usually a time interval expressed in units of sampling frequency. Convert to time units of hours, minutes, and seconds:

[0283] Assume that the sampling frequency is f (Hz), and the value of the timestamp field is T (in clock cycles). Then the time t can be calculated as: t = T / f;

[0284] Usually the timestamp sampling frequency in the video RTP message is 90kHz (i.e. 90000Hz). This is because the video data is usually sampled at a rate of 30 frames per second (30fps), and each frame contains 3000 sampling cycles. This means that the time interval of each sampling cycle is 1 / 90000 seconds.

[0285] Step 3: Determine whether the message time interval exceeds the time threshold of the XR video playback jump or the burst time period (normally the burst period is stable and unchanged, so a little margin can be reserved here. If it exceeds, it can be considered as a playback jump)

[0286] If the time threshold for playback jump is not exceeded, the received downlink message is directly forwarded to the RAN

[0287] If the time threshold of playback jump is exceeded, it is determined that a video playback jump event has occurred, and the SIoRA indication is encapsulated into the GTPU extension header of the current message and then forwarded to the RAN.

[0288] Alternatively, it is possible to further identify whether the current message is a key frame (eg, an I frame). If not, it is possible to decide whether to wait until the key frame is received before notifying the SIoRA event based on a configured identification method.

[0289] For example, in Example 3, UPF identifies XR video playback jump events through user message stream protocol analysis, see Figure 8 Compared with the second embodiment, this embodiment can directly extract SIoRA information from the message header according to the protocol analysis of the received message stream, and then encapsulate the SIoRA information in the GTPU extension header to notify the RAN.

[0290] Step 1: The AS directly sets the SIoRA flag in the downlink data RTP or RTP Header Extension header according to the service playback jump event.

[0291] The following is an example of RTP header / RTP Header Extension. This document does not limit the specific format, as long as the SIoRA indicator is extended in it.

[0292] Among them, combined Fig. 9 , refer to the RTP header extension SIoRA identifier defined in RFC 3350; combined Fig. 10A and Fig. 10B , refer to the RTP Header Extension SIoRA identifier defined in 3GPP TS26.522.

[0293] Step 2: UPF receives the downlink message of the user's XR video playback;

[0294] Step 3: UPF parses the message header to obtain the SIoRA identifier:

[0295] Parse the RTP header or RTP Header Extension header to extract the SIoRA identifier

[0296] Step 4, determine whether the SIoRA identifier is valid (for example, 1 is valid, 0 is invalid). If the SIoRA identifier is invalid, the received downlink message is directly forwarded to the RAN; if the SIoRA identifier is valid, determine that a video playback jump event has occurred, encapsulate the SIoRA indication into the GTPU extension header of the current message, and then forward it to the RAN.

[0297] Another embodiment of the present application provides a video playback jump processing method. The execution subject of the video playback jump processing method provided in this embodiment is AF, and the method supports UPF to subscribe to XR video playback jump events from the AF, or SMF to subscribe to XR video playback jump events from the AF; in the scenario where the user adjusts the extended reality XR video playback jump position, the video playback jump processing method provided in the embodiment of the present application includes the following steps:

[0298] Sending a message of an XR video playback jump event corresponding to the user terminal to the UPF directly or through the SMF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0299] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0300] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0301] Optionally, the message of the XR video playback jump event corresponding to the user terminal is sent to the UPF through the SMF by the SMF sending the message of the XR video playback jump event received from the AF to N4, and is sent through N4.

[0302] In the embodiment of the present application, the AF directly or through the SMF sends a message of the XR video playback jump event corresponding to the user terminal to the UPF, and the message of the XR video playback jump event is used to instruct the UPF to encapsulate the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal according to the message of the XR video playback jump event, and send the downlink message carrying the SIoRA information to the wireless access network RAN ​​corresponding to the user terminal. Therefore, the recognition of the XR video playback jump is realized, and then the scheduling optimization is performed for the XR video playback jump, thereby improving the user's XR experience.

[0303] Optionally, the method further comprises:

[0304] Sending a matching strategy for matching the XR video stream with the stream information corresponding to the XR video playback jump to the UPF; the matching strategy includes:

[0305] Determine whether the XR video stream information in the stream information corresponding to the XR video playback jump is matched by the sequence number SN on the tuple of the IP protocol message, or the SN on the tuple of the IP protocol message and the SN on the RTP protocol header; and / or,

[0306] Determine whether the information of the XR video stream in the stream information corresponding to the XR video playback jump is matched through the timestamp on the tuple of the IP protocol message and the timestamp on the RTP protocol header;

[0307] The information of the XR video stream includes any of the following: the first message or the first I frame.

[0308] In the embodiment of the present application, AF can also provide an XR video stream playback jump matching feature: the SN on the IP PacketFilter (here refers to the tuple of IP protocol packets) + RTP header (RTP protocol header) can be used to match the first packet of a Data Burst (here refers to matching an XR video stream), and the SIoRA identifier can be added; or, the Timestamp (here refers to the timestamp) on the IP Packet Filter+RTP Header can be used to match the first packet of a Data Burst, and the SIoRA identifier can be added; and the Timestamp+SN on the IP Packet Filter+RTP Header can be used to match the first packet of a Data Burst, and the SIoRA identifier can be added.

[0309] Optionally, the method further comprises:

[0310] The time threshold of the XR video playback jump or the time period of the XR video burst is sent to the UPF.

[0311] In an embodiment of the present application, the AF sends the time threshold of the XR video playback jump or the time period of the XR video burst to the UPF, which is used to instruct the UPF to determine the message time interval based on the timestamp of the current downlink message and the timestamp of the previous downlink message obtained; if the message time interval is greater than the time threshold of the XR video playback jump or the message time interval is greater than the time period of the XR video burst, it is determined that an XR video playback jump event has occurred; if the message time interval is less than or equal to the time threshold of the XR video playback jump or the message time interval is less than or equal to the time period of the XR video burst, it is determined that no XR video playback jump event has occurred, and the current downlink message is sent to the RAN; wherein the time threshold of the XR video playback jump or the time period of the XR video burst is sent by the AF / policy control function PCF, or is locally configured.

[0312] Optionally, the RAN is specifically used for:

[0313] According to the received SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0314] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0315] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0316] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0317] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0318] The SIoRA information is used to instruct the RAN to clean up the XR video stream received before the XR video playback jump according to the received SIoRA information; and / or to perform scheduling optimization through at least one of the following:

[0319] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0320] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0321] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0322] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0323] In the embodiment of the present application, the SIoRA identifier is used to instruct the RAN to perform the following optimizations: accelerate the clearing of the cache corresponding to the XR video stream (data received before the playback jump); perform real-time (for example, 3 to 5 seconds) scheduling optimization on the video stream, and increase the scheduling priority to speed up video loading, reduce playback jump delay, and thereby optimize the user's XR experience.

[0324] Another embodiment of the present application provides a video playback jump processing method. The execution subject of the video playback jump processing method provided in this embodiment is SMF, and the method supports the SMF to subscribe to the XR video playback jump event to AF; in the scenario where the user adjusts the extended reality XR video playback jump position, the video playback jump processing method provided in the embodiment of the present application includes the following steps:

[0325] Receive a message of an XR video playback jump event corresponding to the user terminal sent by the AF;

[0326] Sending a message of the XR video playback jump event to the UPF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0327] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0328] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0329] In the embodiment of the present application, SMF receives the message of XR video playback jump event sent by AF, and sends the message of XR video playback jump event to UPF; the message of XR video playback jump event is used to instruct UPF to encapsulate the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal according to the message of XR video playback jump event, and send the downlink message carrying SIoRA information to the wireless access network RAN ​​corresponding to the user terminal. Therefore, the recognition of XR video playback jump is realized, and then the scheduling optimization is performed for XR video playback jump, thereby improving the user's XR experience.

[0330] Optionally, the sending a message of the XR video playback jump event to the UPF includes:

[0331] Send the message of the XR video playback jump event to N4;

[0332] Sending a message of the XR video playback jump event to the UPF through the N4;

[0333] The message of the XR video playback jump event also includes an event identifier Event ID used to indicate the type of the XR video playback jump event.

[0334] In an embodiment of the present application, SMF receives a message of an XR video playback jump event corresponding to a user terminal sent by AF, sends the message of the XR video playback jump event to N4, and sends the message of the XR video playback jump event to the UPF through N4.

[0335] Optionally, the message of the XR video playback jump event also includes a user terminal identifier UE ID; and the method further includes:

[0336] Determining, according to the UE ID, a user terminal corresponding to the jump event;

[0337] An update message is directly sent to the RAN corresponding to the user terminal, or the most recent update message at the current moment is sent to the RAN; the update message carries the SIoRA message and the stream information corresponding to the XR video playback jump.

[0338] In the embodiment of the present application, SMF carries SIoRA information and XR video playback jump flow information in the N2 update message to notify RAN. Specifically, SMF can directly trigger an update message to the corresponding user, or send it to RAN with the most recent update message. The update message is used to indicate that if RAN receives a SIoRA indication in the GTPU extension header of the downlink message, the flow information corresponding to the XR video playback jump (here refers to the flow information corresponding to the XR video playback jump) is scheduled and optimized: accelerate the clearing of the cache of the corresponding XR video stream (data received before the playback jump); perform real-time (for example, 3 to 5 seconds) scheduling optimization on the video stream, and increase the scheduling priority to speed up the video loading speed, reduce the playback jump delay, and thus optimize the user's XR experience.

[0339] The following takes obtaining an XR video playback jump event through AF to notify RAN to optimize XR video playback jump as an example to describe the video playback jump processing method in detail.

[0340] For example, in Embodiment 4, SMF obtains the XR video playback jump event through AF and notifies RAN. Fig.11 As shown, the video playback jump processing method is described in detail. Compared with the first embodiment, this embodiment does not notify the RAN through the UPF user plane, but directly notifies the RAN through the SMF control plane in the form of a signaling message. Among them, SMF sends Naf_EventExposure_Subscribe (i.e. event open subscription) (including but not limited to UE ID, Event ID) to AF; AF interacts with the XR application service on the DN side (here refers to the server of the XR video) to obtain relevant information about the user's XR video playback jump event. The embodiment of the present application does not limit the method of obtaining this part of the interaction.

[0341] Step 1. AF sends a notification message (i.e., Naf_EventExposure_Notify (i.e., event exposure notification)) to the SMF of the subscribed user's Event ID for the event of XR video playback jump. The message content includes but is not limited to UE ID (user ID), Event ID (event of XR video playback jump), Flow Info (flow information corresponding to XR video playback jump), Timestamp (timestamp information or timestamp of XR video playback jump), etc.

[0342] Step 2: SMF updates the message N2 to carry the stream information of SIoRA and XR video playback jump, and notifies RAN.

[0343] The SMF can directly trigger an update message to the corresponding user, or send it to the RAN along with the latest update message.

[0344] Step 3: When the RAN receives a SIoRA indication in the GTPU extension header of a downlink message, it optimizes the scheduling of the stream corresponding to the XR video playback jump.

[0345] Another embodiment of the present application provides a video playback jump processing method. The execution subject of the video playback jump processing method provided in this embodiment is RAN. In the scenario where the user adjusts the jump position of the extended reality XR video playback, the video playback jump processing method provided in the embodiment of the present application includes the following steps:

[0346] Obtain SIoRA information and stream information corresponding to the XR video playback jump; the SIoRA information is encapsulated by any of the methods described above, and the stream information corresponding to the XR video playback jump is obtained by any of the methods described above;

[0347] According to the SIoRA information, the stream information corresponding to the received XR video playback jump is scheduled and optimized.

[0348] In the embodiment of the present application, RAN obtains SIoRA information and the flow information corresponding to the XR video playback jump, and optimizes according to the SIoRA information. The SIoRA information can be encapsulated by the method described in any one of the first aspect, the second aspect, and the third aspect. Therefore, the recognition of the XR video playback jump is realized, and then the scheduling optimization is performed for the XR video playback jump, thereby improving the user's XR experience.

[0349] Optionally, the scheduling and optimizing the stream information corresponding to the received XR video playback jump according to the SIoRA information includes:

[0350] According to the SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0351] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0352] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0353] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0354] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0355] The SIoRA information is used to instruct the RAN to clean up the XR video stream received before the XR video playback jump according to the received SIoRA information; and / or to perform scheduling optimization through at least one of the following:

[0356] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0357] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0358] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0359] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0360] In the embodiment of the present application, RAN performs the following optimizations according to the SIoRA identification indication: accelerates the clearing of the cache corresponding to the XR video stream (data received before the playback jump); performs real-time (for example, 3 to 5 seconds) scheduling optimization on the video stream, and increases the scheduling priority to speed up video loading, reduce playback jump delay, and thereby optimize the user's XR experience.

[0361] The following takes obtaining an XR video playback jump event through AF to notify RAN to optimize XR video playback jump as an example to describe the video playback jump processing method in detail.

[0362] For example, in Embodiment 5, RAN directly obtains the XR video playback jump event through AF, see Fig.12 As shown, the video playback jump processing method is described in detail. Compared with the first and fourth embodiments, this embodiment is based on the scenario where RAN supports service-oriented, and can directly subscribe to the events of AF (i.e., RAN sends Naf_EventExposure_Subscribe (i.e., event open subscription) (including but not limited to UE ID, Event ID) to AF), without indirectly notifying RAN through the core network element, but directly notifying RAN through AF.

[0363] Step 1. AF sends a notification message (i.e., Naf_EventExposure_Notify (i.e., event exposure notification)) to the RAN that subscribes to the event of XR video playback jump, whose Event ID is the XR video playback jump. The message content includes but is not limited to UE ID (user ID), Event ID (event of XR video playback jump), Flow Info (flow information corresponding to XR video playback jump), Timestamp (timestamp information of XR video playback jump), etc.

[0364] Step 2: RAN schedules and optimizes the stream corresponding to the XR video playback jump based on the event information notified by AF.

[0365] For example, in Embodiment 6, RAN performs XR video playback jump optimization, and describes in detail the video playback jump processing method. Compared with Embodiments 1 to 5, this embodiment mainly describes how RAN performs XR video scheduling optimization after receiving SIoRA information to optimize the playback jump effect.

[0366] 1. Accelerate the clearing of the cache of the corresponding XR video stream (data received before playback jump).

[0367] 2. Perform real-time (e.g., 3-5s) scheduling optimization on the video stream, such as taking the following measures:

[0368] Increase scheduling priority;

[0369] Increase the bandwidth of the stream;

[0370] Allocate more resources (time domain resources, frequency resources, spatial domain resources, power resources)

[0371] Reserve resources for a fixed period of time.

[0372] This application can achieve: 1. RAN can obtain XR video playback jump event SIoRA information through the core network, so as to schedule and optimize the video playback jump.

[0373] 2. Based on 1, RAN's scheduling optimization solution includes but is not limited to: accelerating the clearing of the cache of the corresponding XR video stream (data received before the playback jump); performing real-time (for example, 3 to 5 seconds) scheduling optimization on the video stream: raising the scheduling priority; increasing the bandwidth of the stream; allocating more resources (time domain resources, frequency resources, spatial domain resources, power resources); and reserving fixed resources for a period of time.

[0374] 3. Based on 1, the XR video playback jump event information is provided by AF, for example, through subscription and notification.

[0375] AF newly supports event types with Event ID of XR video playback jump, as well as subscription and notification extension parameters related to the event, including but not limited to: user XR video stream information; XR video playback jump event (time / timestamp) information.

[0376] 4. Based on 1 and 3, RAN can obtain XR video playback jump information through the signaling message sent by the core network control plane SMF (for example, the extended SIoRA parameter in the update message), where SMF subscribes to the XR video playback jump event from AF.

[0377] 5. Based on 1 and 3, RAN can obtain XR video playback jump information through the core network user plane UPF, where UPF subscribes to XR video playback jump events from AF, or indirectly obtains the N4 policy related to the XR video playback jump event from SMF.

[0378] 6. Based on 5, AF can directly provide XR video stream SIoRA event information, and can also provide XR video stream playback jump matching features. UPF matches the information provided by AF and indirectly obtains the SIoRA identifier. AF can provide the following XR video stream playback jump matching features:

[0379] The SN on the IP Packet Filter+RTP header is used to match the first packet of a Data Burst and add the SIoRA identifier.

[0380] The Timestamp on the IP Packet Filter+RTP Header is used to match the first packet of a Data Burst and add the SIoRA identifier.

[0381] The Timestamp+SN on the IP Packet Filter+RTP Header can be used to match the first packet of a Data Burst and add the SIoRA identifier.

[0382] 7. Based on 1 and 3, if RAN supports service-oriented capabilities, RAN can subscribe to XR video playback jump events directly from AF.

[0383] 8. Based on 1, RAN can obtain XR video playback jump information through the core network user plane UPF, where UPF identifies XR video playback jump events through XR video stream messages.

[0384] 9. Based on 8, UPF identifies XR video playback jump events based on the XR video stream message. It is necessary to judge the message time interval. If the received message time interval exceeds the threshold, it can be determined that a video playback jump has occurred.

[0385] Among them, the threshold used for judgment can be configured separately as a playback jump time threshold or a reserved margin based on the burst period of the XR video stream as a reference.

[0386] It is necessary to extract the timestamp information in the message (such as the timestamp in RTP) as the basis for calculating the message arrival time interval.

[0387] 10. Based on 8, UPF parses the XR video stream header to obtain the SIoRA identifier and determines whether the SIoRA identifier is valid (for example, 1 is valid and 0 is invalid). If the SIoRA identifier is valid, the current message is identified as an identifier of a video playback jump event.

[0388] 11. Based on 10, it is necessary to extend the XR video stream protocol header to add the SIoRA identifier. For example, in the RTP header or RTP Header Extension header, the SIoRA identifier is extended. The identifier needs to be set to the corresponding header by the application-side AS when it identifies that a video playback jump occurs.

[0389] 12. Based on 5 and 8, the way RAN obtains XR video playback jump information through the core network user plane UPF is that UPF encapsulates SIoRA information in the GTPU extension header of the downlink message and carries it to RAN, including user downlink messages, or dummy downlink messages constructed by UPF.

[0390] Therefore, the present application provides a video playback jump processing method, which reduces lag and latency and improves the user experience of XR video playback jump through network-side optimization technology of XR video playback jump.

[0391] Fig.13 A schematic diagram of the structure of a video playback jump processing device provided in an embodiment of the present application, such as Fig.13 As shown, the video playback jump processing device provided in this embodiment is applied to the user plane function UPF. In the scenario where the user adjusts the extended reality XR video playback jump position, the video playback jump processing device provided in this embodiment includes: a transceiver 1300, which is used to receive and send data under the control of a processor 1310.

[0392] Among them, Fig.13 In the embodiment, the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by processor 1310 and various circuits of memory represented by memory 1320 are linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface. The transceiver 1300 may be a plurality of components, namely, a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium, which transmission medium may include a wireless channel, a wired channel, an optical cable, and other transmission media. The processor 1310 is responsible for managing the bus architecture and general processing, and the memory 1320 may store data used by the processor 1310 when performing operations.

[0393] The processor 1310 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or a complex programmable logic device (CPLD). The processor may also adopt a multi-core architecture.

[0394] In this embodiment, the memory 1320 is used to store a computer program; the transceiver 1300 is used to send and receive data under the control of the processor 1310; the processor 1310 is used to read the computer program in the memory and perform the following operations:

[0395] Obtaining a message of an XR video playback jump event corresponding to the user terminal; the message of the XR video playback jump event at least includes stream information corresponding to the XR video playback jump;

[0396] According to the message of the XR video playback jump event, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal, and the downlink message carrying the SIoRA information is sent to the radio access network RAN ​​corresponding to the user terminal; the XR video stream is the video stream indicated by the stream information corresponding to the XR video playback jump or the video stream matching the stream information corresponding to the XR video playback jump;

[0397] The RAN is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message.

[0398] Optionally, the processor 1310 is configured to, when obtaining a message of an XR video playback jump event corresponding to a user terminal, specifically include:

[0399] Receive a message of an XR video playback jump event sent by an application function AF, where the XR video playback jump event is directly subscribed to the AF; or,

[0400] Receive a message of an XR video playback jump event sent by a session management function SMF, where the XR video playback jump event is subscribed by the SMF to the AF; the message of the XR video playback jump event sent by the SMF is sent by the SMF to N4 after the SMF receives the message of the XR video playback jump event sent by the AF, and is sent through N4;

[0401] The message of the XR video playback jump event subscribed to the AF also includes an event identifier Event ID used to indicate the type of the XR video playback jump event.

[0402] Optionally, the message of the XR video playback jump event also includes a user terminal identifier UE ID; the processor 1310 is configured to, when, according to the message of the XR video playback jump event, encapsulate the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal, specifically including:

[0403] Determining, according to the UE ID, a user terminal corresponding to the jump event;

[0404] If a downlink message of the XR video stream corresponding to the user terminal is received, the stream information corresponding to the XR video playback jump is matched with the XR video stream directly or through the matching strategy provided by AF. If the information of an XR video stream is matched, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message.

[0405] Optionally, the stream information corresponding to the XR video playback jump includes at least one of the following: a sequence number SN on a tuple of an IP protocol message, an SN on a tuple of an IP protocol message and an SN on an RTP protocol header, a timestamp on a tuple of an IP protocol message and a timestamp on an RTP protocol header, an SN and a timestamp on a tuple of an IP protocol message, and an SN and a timestamp on an RTP protocol header; the processor 1310 is configured to match the stream information corresponding to the XR video playback jump with an XR video stream directly or through a matching strategy provided by an AF, specifically including:

[0406] Determine whether the XR video stream information in the stream information corresponding to the XR video playback jump is matched by the sequence number SN on the tuple of the IP protocol message, or the SN on the tuple of the IP protocol message and the SN on the RTP protocol header; and / or,

[0407] Determine whether the information of the XR video stream in the stream information corresponding to the XR video playback jump is matched through the timestamp on the tuple of the IP protocol message and the timestamp on the RTP protocol header;

[0408] The information of the XR video stream includes any of the following: the first message or the first I frame.

[0409] Optionally, the processor 1310 is further configured to perform the following operations:

[0410] Determine whether an XR video playback jump event occurs according to the received downlink message of the XR video stream corresponding to the user terminal;

[0411] If it is determined that an XR video playback jump event has occurred, the SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message, and the downlink message carrying the SIoRA information is sent to the RAN.

[0412] Optionally, the processor 1310 is configured to determine whether an XR video playback jump event occurs according to a received downlink message of an XR video stream corresponding to a user terminal, specifically including:

[0413] Obtain the timestamp of the last received downlink message, as well as the time threshold for XR video playback jump or the time period of XR video burst;

[0414] Determine the message time interval according to the timestamp of the current downlink message and the timestamp of the last downlink message obtained;

[0415] If the message time interval is greater than the time threshold of the XR video playback jump or the message time interval is greater than the time period of the XR video burst, it is determined that an XR video playback jump event has occurred; if the message time interval is less than or equal to the time threshold of the XR video playback jump or the message time interval is less than or equal to the time period of the XR video burst, it is determined that no XR video playback jump event has occurred, and the current downlink message is sent to the RAN;

[0416] The time threshold of the XR video playback jump or the time period of the XR video burst is sent by the AF / policy control function PCF, or is configured locally.

[0417] Optionally, the processor 1310 is configured to determine whether an XR video playback jump event occurs according to a received downlink message of an XR video stream corresponding to a user terminal, specifically including:

[0418] If it is detected that the RTP protocol header of the downlink message of the XR video stream contains SIoRA information, it is determined that an XR video playback jump event has occurred; or,

[0419] If it is detected that the RTP protocol extension header of the downlink message of the XR video stream contains SIoRA information, it is determined that an XR video playback jump event has occurred;

[0420] Among them, the SIoRA information contained in the RTP protocol header or the SIoRA information contained in the RTP protocol extension header is configured by the server of the XR video.

[0421] Optionally, the RAN is specifically used for:

[0422] According to the received SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0423] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0424] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0425] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0426] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0427] It should be noted that the video playback jump processing device provided in this application can achieve Figure 2-Figure 12 All the method steps implemented in the method embodiment shown can achieve the same technical effect, and the parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.

[0428] Fig.14 A schematic diagram of the structure of a video playback jump processing device provided in another embodiment of the present application is shown in FIG. Fig.14 As shown, the video playback jump processing device provided in this embodiment is applied to the user plane function UPF. In the scenario where the user adjusts the jump position of the extended reality XR video playback, the video playback jump processing device 1400 provided in this embodiment includes:

[0429] The acquisition unit 1401 is configured to acquire a message of an XR video playback jump event corresponding to a user terminal; the message of the XR video playback jump event at least includes stream information corresponding to the XR video playback jump;

[0430] The processing unit 1402 is configured to encapsulate the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal according to the message of the XR video playback jump event, and send the downlink message carrying the SIoRA information to the radio access network RAN ​​corresponding to the user terminal; the XR video stream is a video stream indicated by the stream information corresponding to the XR video playback jump or a video stream matching the stream information corresponding to the XR video playback jump;

[0431] The RAN is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message.

[0432] Optionally, the acquisition unit is specifically used to:

[0433] Receive a message of an XR video playback jump event sent by an application function AF, where the XR video playback jump event is directly subscribed to the AF; or,

[0434] Receive a message of an XR video playback jump event sent by a session management function SMF, where the XR video playback jump event is subscribed by the SMF to the AF; the message of the XR video playback jump event sent by the SMF is sent by the SMF to N4 after the SMF receives the message of the XR video playback jump event sent by the AF, and is sent through N4;

[0435] The message of the XR video playback jump event subscribed to the AF also includes an event identifier Event ID used to indicate the type of the XR video playback jump event.

[0436] Optionally, the message of the XR video playback jump event also includes a user terminal identifier UE ID; and the processing unit is specifically configured to:

[0437] Determining, according to the UE ID, a user terminal corresponding to the jump event;

[0438] If a downlink message of the XR video stream corresponding to the user terminal is received, the stream information corresponding to the XR video playback jump is matched with the XR video stream directly or through the matching strategy provided by AF. If the information of an XR video stream is matched, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message.

[0439] Optionally, the stream information corresponding to the XR video playback jump includes at least one of the following: a sequence number SN on a tuple of an IP protocol message, an SN on a tuple of an IP protocol message and an SN on an RTP protocol header, a timestamp on a tuple of an IP protocol message and a timestamp on an RTP protocol header, an SN and a timestamp on a tuple of an IP protocol message, and an SN and a timestamp on an RTP protocol header; the processing unit is specifically configured to:

[0440] Determine whether the XR video stream information in the stream information corresponding to the XR video playback jump is matched by the sequence number SN on the tuple of the IP protocol message, or the SN on the tuple of the IP protocol message and the SN on the RTP protocol header; and / or,

[0441] Determine whether the information of the XR video stream in the stream information corresponding to the XR video playback jump is matched through the timestamp on the tuple of the IP protocol message and the timestamp on the RTP protocol header;

[0442] The information of the XR video stream includes any of the following: the first message or the first I frame.

[0443] Optionally, the processing unit is further configured to:

[0444] Determine whether an XR video playback jump event occurs according to the received downlink message of the XR video stream corresponding to the user terminal;

[0445] When it is determined that an XR video playback jump event has occurred, the SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message, and the downlink message carrying the SIoRA information is sent to the RAN.

[0446] Optionally, the processing unit is further specifically configured to:

[0447] Obtain the timestamp of the last received downlink message, as well as the time threshold for XR video playback jump or the time period of XR video burst;

[0448] Determine the message time interval according to the timestamp of the current downlink message and the timestamp of the last downlink message obtained;

[0449] When the message time interval is greater than the time threshold of the XR video playback jump or the message time interval is greater than the time period of the XR video burst, it is determined that an XR video playback jump event has occurred; when the message time interval is less than or equal to the time threshold of the XR video playback jump or the message time interval is less than or equal to the time period of the XR video burst, it is determined that no XR video playback jump event has occurred, and the current downlink message is sent to the RAN;

[0450] The time threshold of the XR video playback jump or the time period of the XR video burst is sent by the AF / policy control function PCF, or is configured locally.

[0451] Optionally, the processing unit is further configured to:

[0452] When it is detected that the RTP protocol header of the downlink message of the XR video stream contains SIoRA information, it is determined that an XR video playback jump event has occurred; or,

[0453] When it is detected that the RTP protocol extension header of the downlink message of the XR video stream contains SIoRA information, it is determined that an XR video playback jump event occurs;

[0454] Among them, the SIoRA information included in the RTP protocol header or the SIoRA information included in the RTP protocol extension header is configured by the server of the XR video.

[0455] Optionally, the RAN is specifically used for:

[0456] According to the received SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0457] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0458] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0459] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0460] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0461] It should be noted that the video playback jump processing device provided in this application can achieve Figure 2-Figure 12 All the method steps implemented in the method embodiment can achieve the same technical effect, and the parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.

[0462] Fig.15 A schematic diagram of the structure of a video playback jump processing device provided in another embodiment of the present application is shown in FIG. Fig.15 As shown, the video playback jump processing device provided in this embodiment is applied to AF, and supports UPF to subscribe to XR video playback jump events to the AF, or SMF to subscribe to XR video playback jump events to the AF; in the scenario where the user adjusts the extended reality XR video playback jump position, the video playback jump processing device provided in this embodiment includes: a transceiver 1500, which is used to receive and send data under the control of a processor 1510.

[0463] Among them, Fig.15In the embodiment, the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by processor 1510 and various circuits of memory represented by memory 1520 are linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface. The transceiver 1500 may be a plurality of components, namely, a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium, which transmission medium may include a wireless channel, a wired channel, an optical cable, and other transmission media. The processor 1510 is responsible for managing the bus architecture and general processing, and the memory 1520 may store data used by the processor 1510 when performing operations.

[0464] The processor 1510 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or a complex programmable logic device (CPLD). The processor may also adopt a multi-core architecture.

[0465] In this embodiment, the memory 1520 is used to store a computer program; the transceiver 1500 is used to send and receive data under the control of the processor; the processor 1510 is used to read the computer program in the memory and perform the following operations:

[0466] Send a message of an XR video playback jump event corresponding to the user terminal to the UPF directly or through the SMF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0467] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0468] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0469] Optionally, the message of the XR video playback jump event corresponding to the user terminal is sent to the UPF through the SMF by the SMF sending the message of the XR video playback jump event received from the AF to N4, and is sent through N4.

[0470] Optionally, the processor 1510 is further configured to perform the following operations:

[0471] Sending a matching strategy for matching the XR video stream with the stream information corresponding to the XR video playback jump to the UPF; the matching strategy includes:

[0472] Determine whether the XR video stream information in the stream information corresponding to the XR video playback jump is matched by the sequence number SN on the tuple of the IP protocol message, or the SN on the tuple of the IP protocol message and the SN on the RTP protocol header; and / or,

[0473] Determine whether the information of the XR video stream in the stream information corresponding to the XR video playback jump is matched, through the timestamp on the tuple of the IP protocol message and the timestamp on the RTP protocol header;

[0474] The information of the XR video stream includes any of the following: the first message or the first I frame.

[0475] Optionally, the processor 1510 is further configured to perform the following operations:

[0476] The time threshold of the XR video playback jump or the time period of the XR video burst is sent to the UPF.

[0477] Optionally, the RAN is specifically used for:

[0478] According to the received SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0479] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0480] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0481] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0482] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0483] It should be noted that the video playback jump processing device provided in this application can achieve Figure 2 , Figure 4-Figure 12 All the method steps implemented in the method embodiment shown can achieve the same technical effect, and the parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.

[0484] Another embodiment of the present application provides a video playback jump processing device. The video playback jump processing device provided in the embodiment of the present application is applied to AF, and supports UPF to subscribe to XR video playback jump events from the AF, or SMF to subscribe to XR video playback jump events from the AF; in the scenario where the user adjusts the extended reality XR video playback jump position, the video playback jump processing device provided in this embodiment includes:

[0485] A sending unit, configured to send a message of an XR video playback jump event corresponding to the user terminal to the UPF directly or through the SMF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0486] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0487] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0488] Optionally, the message of the XR video playback jump event corresponding to the user terminal is sent to the UPF through the SMF by the SMF sending the message of the XR video playback jump event received from the AF to N4, and is sent through N4.

[0489] Optionally, the device further comprises: a processing unit; the processing unit is configured to:

[0490] Sending a matching strategy for matching the XR video stream with the stream information corresponding to the XR video playback jump to the UPF; the matching strategy includes:

[0491] Determine whether the XR video stream information in the stream information corresponding to the XR video playback jump is matched by the sequence number SN on the tuple of the IP protocol message, or the SN on the tuple of the IP protocol message and the SN on the RTP protocol header; and / or,

[0492] Determine whether the information of the XR video stream in the stream information corresponding to the XR video playback jump is matched, through the timestamp on the tuple of the IP protocol message and the timestamp on the RTP protocol header;

[0493] The information of the XR video stream includes any of the following: the first message or the first I frame.

[0494] Optionally, the processing unit is further configured to:

[0495] The time threshold of the XR video playback jump or the time period of the XR video burst is sent to the UPF.

[0496] Optionally, the RAN is specifically used for:

[0497] According to the received SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0498] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0499] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0500] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0501] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0502] It should be noted that the video playback jump processing device provided in this application can achieve Figure 2 , Figure 4-Figure 12 All the method steps implemented in the method embodiment can achieve the same technical effect, and the parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.

[0503] Fig.16 A schematic diagram of the structure of a video playback jump processing device provided in another embodiment of the present application is shown in FIG. Fig.16 As shown, the video playback jump processing device provided in this embodiment is applied to SMF, and supports the SMF to subscribe to XR video playback jump events to AF; in the scenario where the user adjusts the extended reality XR video playback jump position, the video playback jump processing device provided in this embodiment includes: a transceiver 1600, which is used to receive and send data under the control of a processor 1610.

[0504] Among them, Fig.16In the embodiment, the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by processor 1610 and various circuits of memory represented by memory 1620 are linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface. The transceiver 1600 may be a plurality of components, namely, a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium, which transmission medium may include a wireless channel, a wired channel, an optical cable, and other transmission media. The processor 1610 is responsible for managing the bus architecture and general processing, and the memory 1620 may store data used by the processor 1610 when performing operations.

[0505] The processor 1610 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or a complex programmable logic device (CPLD). The processor may also adopt a multi-core architecture.

[0506] In this embodiment, the memory 1620 is used to store a computer program; the transceiver 1600 is used to send and receive data under the control of the processor; the processor 1610 is used to read the computer program in the memory and perform the following operations:

[0507] Receive a message of an XR video playback jump event corresponding to the user terminal sent by the AF;

[0508] Sending a message of the XR video playback jump event to the UPF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0509] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0510] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0511] Optionally, the processor 1610 is configured to, when sending a message of the XR video playback jump event to the UPF, specifically include:

[0512] Send the message of the XR video playback jump event to N4;

[0513] Sending a message of the XR video playback jump event to the UPF through the N4;

[0514] The message of the XR video playback jump event also includes an event identifier Event ID used to indicate the type of the XR video playback jump event.

[0515] Optionally, the message of the XR video playback jump event also includes a user terminal identifier UE ID; the processor 1610 is further configured to perform the following operations:

[0516] Determining, according to the UE ID, a user terminal corresponding to the jump event;

[0517] An update message is directly sent to the RAN corresponding to the user terminal, or the most recent update message at the current moment is sent to the RAN; the update message carries the SIoRA message and the stream information corresponding to the XR video playback jump.

[0518] It should be noted that the video playback jump processing device provided in this application can achieve Figure 2 , Figure 4-Figure 12 All the method steps implemented in the method embodiment can achieve the same technical effect, and the parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.

[0519] Another embodiment of the present application provides a video playback jump processing device. The video playback jump processing device provided in the embodiment of the present application is applied to SMF and supports the SMF to subscribe to the XR video playback jump event to AF; in the scenario where the user adjusts the extended reality XR video playback jump position, the video playback jump processing device provided in this embodiment includes:

[0520] A receiving unit, configured to receive a message of an XR video playback jump event corresponding to a user terminal sent by the AF;

[0521] A sending unit, configured to send a message of the XR video playback jump event to the UPF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump;

[0522] Wherein, the UPF is used to execute the video playback jump processing method as described in any one of the first aspects;

[0523] The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

[0524] Optionally, the sending unit is specifically configured to:

[0525] Send the message of the XR video playback jump event to N4;

[0526] Sending a message of the XR video playback jump event to the UPF through the N4;

[0527] The message of the XR video playback jump event also includes an event identifier Event ID used to indicate the type of the XR video playback jump event.

[0528] Optionally, the message of the XR video playback jump event also includes a user terminal identifier UE ID; the device also includes: a processing unit; the processing unit is used to:

[0529] Determining, according to the UE ID, a user terminal corresponding to the jump event;

[0530] An update message is directly sent to the RAN corresponding to the user terminal, or the most recent update message at the current moment is sent to the RAN; the update message carries the SIoRA message and the stream information corresponding to the XR video playback jump.

[0531] It should be noted that the video playback jump processing device provided in this application can achieve Figure 2 , Figure 4-Figure 12 All the method steps implemented in the method embodiment can achieve the same technical effect, and the parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.

[0532] Fig.17 A schematic diagram of the structure of a video playback jump processing device provided in another embodiment of the present application is shown in FIG. Fig.17 As shown, the video playback jump processing device provided in this embodiment is applied to RAN. In the scenario where the user adjusts the extended reality XR video playback jump position, the video playback jump processing device provided in this embodiment includes: a transceiver 1700, which is used to receive and send data under the control of a processor 1710.

[0533] Among them, Fig.17In the embodiment, the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by processor 1710 and various circuits of memory represented by memory 1720 are linked together. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and are therefore not further described herein. The bus interface provides an interface. The transceiver 1700 may be a plurality of components, namely, a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium, which transmission medium may include a wireless channel, a wired channel, an optical cable, and other transmission media. The processor 1710 is responsible for managing the bus architecture and general processing, and the memory 1720 may store data used by the processor 1710 when performing operations.

[0534] The processor 1710 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or a complex programmable logic device (CPLD). The processor may also adopt a multi-core architecture.

[0535] In this embodiment, the memory 1720 is used to store a computer program; the transceiver 1700 is used to send and receive data under the control of the processor; the processor 1710 is used to read the computer program in the memory and perform the following operations:

[0536] Obtain SIoRA information and stream information corresponding to the XR video playback jump; the SIoRA information is encapsulated by any of the methods described above, and the stream information corresponding to the XR video playback jump is obtained by any of the methods described above;

[0537] According to the SIoRA information, the stream information corresponding to the received XR video playback jump is scheduled and optimized.

[0538] Optionally, the memory 1720 is used to schedule and optimize the stream information corresponding to the received XR video playback jump according to the SIoRA information, specifically including:

[0539] According to the SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0540] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0541] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0542] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0543] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0544] It should be noted that the video playback jump processing device provided in this application can achieve Figure 2 , Figure 4-Figure 12 All the method steps implemented in the method embodiment can achieve the same technical effect, and the parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.

[0545] Another embodiment of the present application provides a video playback jump processing device. The video playback jump processing device provided in the embodiment of the present application is applied to RAN. In a scenario where a user adjusts an extended reality XR video playback jump position, the video playback jump processing device provided in the embodiment includes:

[0546] An acquisition unit, used to acquire SIoRA information and stream information corresponding to the XR video playback jump; the SIoRA information is encapsulated by any of the methods described above, and the stream information corresponding to the XR video playback jump is acquired by any of the methods described above;

[0547] The scheduling optimization unit is used to schedule and optimize the stream information corresponding to the received XR video playback jump according to the SIoRA information.

[0548] Optionally, the scheduling optimization unit is specifically used to:

[0549] According to the SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following:

[0550] Raise the scheduling priority of the stream information corresponding to the XR video playback jump;

[0551] Increase the bandwidth of the stream information corresponding to the XR video playback jump;

[0552] Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources;

[0553] Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

[0554] It should be noted that the video playback jump processing device provided in this application can achieve Figure 2 , Figure 4-Figure 12 All the method steps implemented in the method embodiment can achieve the same technical effect, and the parts and beneficial effects of this embodiment that are the same as those in the method embodiment will not be described in detail here.

[0555] It should be noted that the division of units in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional unit in each embodiment of the present application may be integrated into a processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0556] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a processor-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program code.

[0557] The embodiment of the present application further provides a processor-readable storage medium. The processor-readable storage medium stores a computer program, and the computer program is used to enable the processor to execute any of the above method embodiments.

[0558] Among them, the processor-readable storage medium can be any available medium or data storage device that can be accessed by the processor, including but not limited to magnetic storage (such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc.), optical storage (such as CD, DVD, BD, HVD, etc.), and semiconductor storage (such as ROM, EPROM, EEPROM, non-volatile memory (NANDFLASH), solid-state drive (SSD)), etc.

[0559] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0560] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer executable instructions. These computer executable instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0561] These processor executable instructions may also be stored in a processor readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the processor readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0562] These processor-executable instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0563] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A video playback jump processing method, characterized in that: The method is applied to a user plane function UPF, and in a scenario where a user adjusts a jump position of an extended reality XR video playback, the method includes: Obtaining a message of an XR video playback jump event corresponding to the user terminal; the message of the XR video playback jump event at least includes stream information corresponding to the XR video playback jump; According to the message of the XR video playback jump event, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal, and the downlink message carrying the SIoRA information is sent to the radio access network RAN ​​corresponding to the user terminal; the XR video stream is the video stream indicated by the stream information corresponding to the XR video playback jump or the video stream matching the stream information corresponding to the XR video playback jump; The RAN is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message.

2. The method according to claim 1, characterized in that The message of obtaining the XR video playback jump event corresponding to the user terminal includes: Receive a message of an XR video playback jump event sent by an application function AF, where the XR video playback jump event is directly subscribed to the AF; or, Receive a message of an XR video playback jump event sent by a session management function SMF, where the XR video playback jump event is subscribed by the SMF to the AF; the message of the XR video playback jump event sent by the SMF is sent by the SMF to N4 after the SMF receives the message of the XR video playback jump event sent by the AF, and is sent through N4; The message of the XR video playback jump event subscribed to the AF also includes an event identifier Event ID used to indicate the type of the XR video playback jump event.

3. The method according to claim 1 or 2, characterized in that: The message of the XR video playback jump event also includes a user terminal identifier UE ID; and according to the message of the XR video playback jump event, encapsulating the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal, including: Determining, according to the UE ID, a user terminal corresponding to the jump event; If a downlink message of the XR video stream corresponding to the user terminal is received, the stream information corresponding to the XR video playback jump is matched with the XR video stream directly or through the matching strategy provided by AF. If the information of an XR video stream is matched, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message.

4. The method according to claim 3, characterized in that The stream information corresponding to the XR video playback jump includes at least one of the following: a sequence number SN on a tuple of an IP protocol message, an SN on a tuple of an IP protocol message and an SN on an RTP protocol header, a timestamp on a tuple of an IP protocol message and a timestamp on an RTP protocol header, an SN and a timestamp on a tuple of an IP protocol message, and an SN and a timestamp on an RTP protocol header; The matching strategy provided directly or through AF, matching the XR video stream to the stream information corresponding to the XR video playback jump, includes: Determine whether the XR video stream information in the stream information corresponding to the XR video playback jump is matched by the sequence number SN on the tuple of the IP protocol message, or the SN on the tuple of the IP protocol message and the SN on the RTP protocol header; and / or, Determine whether the information of the XR video stream in the stream information corresponding to the XR video playback jump is matched, through the timestamp on the tuple of the IP protocol message and the timestamp on the RTP protocol header; The information of the XR video stream includes any of the following: the first message or the first I frame.

5. The method according to claim 1, characterized in that The method further comprises: Determine whether an XR video playback jump event occurs according to the received downlink message of the XR video stream corresponding to the user terminal; If it is determined that an XR video playback jump event has occurred, the SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message, and the downlink message carrying the SIoRA information is sent to the RAN.

6. The method according to claim 5, characterized in that The determining, according to the received downlink message of the XR video stream corresponding to the user terminal, whether an XR video playback jump event occurs includes: Obtain the timestamp of the last received downlink message, as well as the time threshold for XR video playback jump or the time period of XR video burst; Determine the message time interval according to the timestamp of the current downlink message and the timestamp of the last downlink message obtained; If the message time interval is greater than the time threshold of the XR video playback jump or the message time interval is greater than the time period of the XR video burst, it is determined that an XR video playback jump event has occurred; if the message time interval is less than or equal to the time threshold of the XR video playback jump or the message time interval is less than or equal to the time period of the XR video burst, it is determined that no XR video playback jump event has occurred, and the current downlink message is sent to the RAN; The time threshold of the XR video playback jump or the time period of the XR video burst is sent by the AF / policy control function PCF, or is configured locally.

7. The method according to claim 5, characterized in that The determining, according to the received downlink message of the XR video stream corresponding to the user terminal, whether an XR video playback jump event occurs includes: If it is detected that the RTP protocol header of the downlink message of the XR video stream contains SIoRA information, it is determined that an XR video playback jump event has occurred; or, If it is detected that the RTP protocol extension header of the downlink message of the XR video stream contains SIoRA information, it is determined that an XR video playback jump event has occurred; Among them, the SIoRA information included in the RTP protocol header or the SIoRA information included in the RTP protocol extension header is configured by the server of the XR video.

8. The method according to claim 1, characterized in that: The RAN is specifically used for: According to the received SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following: Raise the scheduling priority of the stream information corresponding to the XR video playback jump; Increase the bandwidth of the stream information corresponding to the XR video playback jump; Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources; Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

9. A video playback jump processing method, characterized in that: The method is applied to AF, and supports UPF to subscribe to XR video playback jump events from AF, or SMF to subscribe to XR video playback jump events from AF; In a scenario where a user adjusts the jump position of an extended reality XR video playback, the method includes: Send a message of an XR video playback jump event corresponding to the user terminal to the UPF directly or through the SMF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump; Wherein, the UPF is used to execute the video playback jump processing method according to any one of claims 1 to 8; The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

10. The method according to claim 9, characterized in that The message of the XR video playback jump event corresponding to the user terminal is sent to the UPF through the SMF. The SMF sends the message of the XR video playback jump event received from the AF to N4, and is sent through N4.

11. The method according to claim 9 or 10, characterized in that: The method further comprises: Sending a matching strategy for matching the XR video stream with the stream information corresponding to the XR video playback jump to the UPF; the matching strategy includes: Determine whether the XR video stream information in the stream information corresponding to the XR video playback jump is matched by the sequence number SN on the tuple of the IP protocol message, or the SN on the tuple of the IP protocol message and the SN on the RTP protocol header; and / or, Determine whether the information of the XR video stream in the stream information corresponding to the XR video playback jump is matched, through the timestamp on the tuple of the IP protocol message and the timestamp on the RTP protocol header; The information of the XR video stream includes any of the following: the first message or the first I frame.

12. The method according to claim 9 or 10, characterized in that: The method further comprises: The time threshold of the XR video playback jump or the time period of the XR video burst is sent to the UPF.

13. The method according to claim 9 or 10, characterized in that: The RAN is specifically used for: According to the received SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following: Raise the scheduling priority of the stream information corresponding to the XR video playback jump; Increase the bandwidth of the stream information corresponding to the XR video playback jump; Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources; Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

14. A video playback jump processing method, characterized in that: The method is applied to SMF and supports the SMF to subscribe to the XR video playback jump event from AF; In a scenario where a user adjusts the jump position of an extended reality XR video playback, the method includes: Receive a message of an XR video playback jump event corresponding to the user terminal sent by the AF; Sending a message of the XR video playback jump event to the UPF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump; Wherein, the UPF is used to execute the video playback jump processing method according to any one of claims 1 to 8; The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

15. The method according to claim 14, characterized in that The sending the message of the XR video playback jump event to the UPF includes: Send the message of the XR video playback jump event to N4; Sending a message of the XR video playback jump event to the UPF through the N4; The message of the XR video playback jump event also includes an event identifier Event ID used to indicate the type of the XR video playback jump event.

16. The method according to claim 14 or 15, characterized in that The message of the XR video playback jump event also includes a user terminal identifier UE ID; the method also includes: Determining, according to the UE ID, a user terminal corresponding to the jump event; An update message is directly sent to the RAN corresponding to the user terminal, or the most recent update message at the current moment is sent to the RAN; the update message carries the SIoRA message and the stream information corresponding to the XR video playback jump.

17. A video playback jump processing method, characterized in that: The method is applied to RAN, and in a scenario where a user adjusts the jump position of an extended reality XR video playback, the method includes: Obtain SIoRA information and stream information corresponding to the XR video playback jump; the SIoRA information is encapsulated by the method described in any one of claims 1 to 16, and the stream information corresponding to the XR video playback jump is obtained by the method described in any one of claims 1 to 16; According to the SIoRA information, the stream information corresponding to the received XR video playback jump is scheduled and optimized.

18. The method according to claim 17, characterized in that The scheduling and optimizing of the stream information corresponding to the received XR video playback jump according to the SIoRA information includes: According to the SIoRA information, clear the XR video stream received before the XR video playback jumps; and / or perform scheduling optimization by at least one of the following: Raise the scheduling priority of the stream information corresponding to the XR video playback jump; Increase the bandwidth of the stream information corresponding to the XR video playback jump; Adding allocated resources to the stream information corresponding to the XR video playback jump, where the allocated resources include at least one of the following: time domain resources, frequency resources, spatial domain resources, and power resources; Reserve fixed resources of a preset duration for the stream information corresponding to the XR video playback jump.

19. A video playback jump processing device, characterized in that: The device is applied to a user plane function UPF, and in a scenario where a user adjusts a jump position of an extended reality XR video playback, the device includes: An acquisition unit, configured to acquire a message of an XR video playback jump event corresponding to a user terminal; the message of the XR video playback jump event at least includes stream information corresponding to the XR video playback jump; A processing unit is configured to encapsulate the random access start indication SIoRA information into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal according to the message of the XR video playback jump event, and send the downlink message carrying the SIoRA information to the radio access network RAN ​​corresponding to the user terminal; the XR video stream is a video stream indicated by the stream information corresponding to the XR video playback jump or a video stream matching the stream information corresponding to the XR video playback jump; The RAN is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message.

20. A video playback jump processing device, characterized in that: The device is applied to AF, and supports UPF to subscribe to XR video playback jump event from AF, or SMF to subscribe to XR video playback jump event from AF; In a scenario where a user adjusts a jump position of an extended reality XR video playback, the device includes: A sending unit, configured to send a message of an XR video playback jump event corresponding to the user terminal to the UPF directly or through the SMF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump; Wherein, the UPF is used to execute the video playback jump processing method according to any one of claims 1 to 8; The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

21. A video playback jump processing device, characterized in that: The device is applied to SMF and supports SMF to subscribe to XR video playback jump events from AF; In a scenario where a user adjusts a jump position of an extended reality XR video playback, the device includes: A receiving unit, configured to receive a message of an XR video playback jump event corresponding to a user terminal sent by the AF; A sending unit, configured to send a message of the XR video playback jump event to the UPF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump; Wherein, the UPF is used to execute the video playback jump processing method according to any one of claims 1 to 8; The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

22. A video playback jump processing device, characterized in that: The device is applied to RAN, and in a scenario where a user adjusts a jump position of an extended reality XR video playback, the device includes: An acquisition unit, used to acquire SIoRA information and stream information corresponding to the XR video playback jump; the SIoRA information is encapsulated by the method described in any one of claims 1 to 16, and the stream information corresponding to the XR video playback jump is acquired by the method described in any one of claims 1 to 16; The scheduling optimization unit is used to schedule and optimize the stream information corresponding to the received XR video playback jump according to the SIoRA information.

23. A video playback jump processing device, characterized in that: The device is applied to the user plane function UPF. In the scenario where the user adjusts the jump position of the extended reality XR video playback, the device includes a memory, a transceiver, and a processor: Memory for storing computer programs; a transceiver, for transmitting and receiving data under the control of the processor; A processor is configured to read the computer program in the memory and perform the following operations: Obtaining a message of an XR video playback jump event corresponding to the user terminal; the message of the XR video playback jump event at least includes stream information corresponding to the XR video playback jump; According to the message of the XR video playback jump event, the random access start indication SIoRA information is encapsulated into the GTPU protocol extension header of the downlink message of the XR video stream corresponding to the user terminal, and the downlink message carrying the SIoRA information is sent to the radio access network RAN ​​corresponding to the user terminal; the XR video stream is the video stream indicated by the stream information corresponding to the XR video playback jump or the video stream matching the stream information corresponding to the XR video playback jump; The RAN is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message.

24. A video playback jump processing device, characterized in that: The device is applied to AF, and supports UPF to subscribe to XR video playback jump event from AF, or SMF to subscribe to XR video playback jump event from AF; In the scenario where the user adjusts the jump position of the extended reality XR video playback, the device includes: a memory, a transceiver, and a processor: A memory for storing a computer program; a transceiver for transmitting and receiving data under the control of the processor; and a processor for reading the computer program in the memory and performing the following operations: Send a message of an XR video playback jump event corresponding to the user terminal to the UPF directly or through the SMF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump; Wherein, the UPF is used to execute the video playback jump processing method according to any one of claims 1 to 8; The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

25. A video playback jump processing device, characterized in that: The device is applied to SMF and supports SMF to subscribe to XR video playback jump events from AF; In the scenario where the user adjusts the jump position of the extended reality XR video playback, the device includes: a memory, a transceiver, and a processor: A memory for storing a computer program; a transceiver for transmitting and receiving data under the control of the processor; and a processor for reading the computer program in the memory and performing the following operations: Receive a message of an XR video playback jump event corresponding to the user terminal sent by the AF; Sending a message of the XR video playback jump event to the UPF; the message of the XR video playback jump event includes at least stream information corresponding to the XR video playback jump; Wherein, the UPF is used to execute the video playback jump processing method according to any one of claims 1 to 8; The RAN corresponding to the user terminal is used to schedule and optimize the stream information corresponding to the XR video playback jump according to the SIoRA information received in the downlink message sent by the UPF.

26. A video playback jump processing device, characterized in that: The device is applied to RAN. In the scenario where a user adjusts the jump position of the extended reality XR video playback, the device includes: a memory, a transceiver, and a processor: A memory for storing a computer program; a transceiver for transmitting and receiving data under the control of the processor; and a processor for reading the computer program in the memory and performing the following operations: Obtain SIoRA information and stream information corresponding to the XR video playback jump; the SIoRA information is encapsulated by the method described in any one of claims 1 to 16, and the stream information corresponding to the XR video playback jump is obtained by the method described in any one of claims 1 to 16; According to the SIoRA information, the stream information corresponding to the received XR video playback jump is scheduled and optimized.

27. A processor-readable storage medium, characterized in that: The processor-readable storage medium stores a computer program, and the computer program is used to enable the processor to execute the method according to any one of claims 1 to 18.

Images