Augmented reality (XR) video transmission method, electronic device and computer program product

Abstract

Provided in an embodiment of the present invention are an augmented reality XR video transmission method, an electronic device and a computer program product, by sending a first request to a core network, the first request being used for instructing the core network to establish a transmission channel according to a data transmission mode corresponding to the first request, the data transmission mode comprising broadcast or multicast; performing multi-angle rendering on the XR video based on a data transmission mode corresponding to the first request to obtain a target XR video; and pushing the target XR video to the core network through the transmission channel. The problem that multi-angle rendering and multicast or broadcast transmission of the XR video cannot be realized in the prior art is solved, and the effects of multi-angle rendering and multicast or broadcast transmission of the XR video are realized.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of communications, and more specifically, to an extended reality XR video transmission method, electronic device, and computer program product. Background Technology

[0002] Extended Reality (XR) refers to all environments and human-computer interactions that combine the real and virtual worlds, created through computer technology and wearable devices. It includes Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR).

[0003] XR, through the complete simulation and real-time interaction of visual, auditory, tactile, and olfactory sensory information, expands the user experience and enhances human-computer interaction, creating an immersive and empathetic experience for users. Compared to existing AR / VR services on 5G networks, 6G immersive XR services require higher service characteristics to meet user experience needs. These characteristics include ultra-high resolution, high frame rate, wide color gamut, wide field of view, as well as encoding and compression technologies and transmission methods. Therefore, 6G immersive XR services pose new challenges to terminals, networks, and platforms.

[0004] Especially for networks, immersive XR involves extremely rich service experiences, requiring 5G and 6G networks to provide higher data transmission speeds, lower latency, and more reliable network performance. For example, at 16K resolution, the network transmission rate requirement for immersive XR reaches 0.98 Gbit / s. Simultaneously, to prevent users from experiencing motion sickness while using XR, the end-to-end latency of immersive XR must be lower than the Motion To Photons (MTP) requirement, i.e., less than 20ms.

[0005] XR technology has wide applications in film, concerts, museums, scenic spots, and many other fields. With technological advancements, XR is gradually becoming a significant force changing the way we work and play. However, current XR rendering and delivery are based on a one-person-one-view perspective, requiring each XR terminal to establish a dedicated session and transmission channel for audio and video streams. Currently, the total bandwidth of a single base station is typically between 1G and 10G, which is insufficient for densely populated scenarios, such as simultaneous viewing of games or concerts in an Olympic sports center, or simultaneous training sessions in a large venue, to accommodate a large number of users simultaneously using XR services.

[0006] However, current multicast and broadcast technologies are mainly designed for pushing ordinary 2D videos, such as conferences, sports games, and movies. These technologies cannot achieve multi-angle rendering and multicast or broadcast transmission of XR videos. Summary of the Invention

[0007] This invention provides an extended reality XR video transmission method, electronic device, and computer program product to at least solve the problem in related technologies that it is impossible to render XR videos from multiple angles and transmit them via multicast or broadcast.

[0008] According to an embodiment of the present invention, an extended reality (XR) video transmission method is provided, comprising: sending a first request to a core network, the first request being used to instruct the core network to establish a transmission channel according to a data transmission method corresponding to the first request, the data transmission method including broadcast or multicast; performing multi-angle rendering of an XR video based on the data transmission method corresponding to the first request to obtain a target XR video; and pushing the target XR video to the core network via the transmission channel.

[0009] According to yet another embodiment of the present invention, an electronic device is also provided, including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0010] According to yet another embodiment of the present invention, a computer program product is also provided, comprising a computer program that, when executed by a processor, implements the steps in any of the above method embodiments.

[0011] The above embodiments of the present invention provide an extended reality (XR) video transmission method. This method involves sending a first request to the core network, instructing the core network to establish a transmission channel according to a data transmission method corresponding to the first request, which may be broadcast or multicast. Based on the data transmission method corresponding to the first request, the XR video is rendered from multiple angles to obtain a target XR video. The target XR video is then pushed to the core network via the transmission channel. This solves the problem in related technologies where multi-angle rendering and multicast or broadcast transmission of XR video is not possible, achieving the effect of multi-angle rendering and multicast or broadcast transmission of XR video. Attached Figure Description

[0012] Figure 1 This is a schematic diagram illustrating the principle of XR implementation architecture in related technologies;

[0013] Figure 2 This is a hardware structure block diagram of a computer terminal that runs the XR video transmission method in an embodiment of the present invention;

[0014] Figure 3 This is a flowchart of an XR video transmission method according to an embodiment of the present invention;

[0015] Figure 4This is a schematic diagram of the system architecture of the XR video transmission device according to an embodiment of the present invention;

[0016] Figure 5 This is a schematic diagram illustrating the principle of the XR video broadcast transmission process according to an embodiment of the present invention;

[0017] Figure 6 This is a schematic diagram illustrating the principle of multicast transmission of XR video according to an embodiment of the present invention;

[0018] Figure 7 This is a schematic diagram illustrating the principle of unicast, multicast, and broadcast switching of XR video according to an embodiment of the present invention;

[0019] Figure 8 This is a schematic diagram illustrating the principle of unicast, multicast, and broadcast XR video based on network state switching in an embodiment of the present invention. Detailed Implementation

[0020] The embodiments of the present invention will be described in detail below with reference to the accompanying drawings and examples.

[0021] It should be noted that the terms "first," "second," etc., in the specification, claims, and drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0022] In related technologies, XR rendering and push are based on a one-person-one-viewpoint approach, and each XR terminal needs to establish a dedicated session and transmission channel to transmit audio and video streams. Figure 1 This is a schematic diagram illustrating the principle of XR implementation architecture in related technologies, such as... Figure 1 As shown, the specific processing is as follows:

[0023] 1) First, the XR terminal, such as VR headsets and AR glasses, requests the network to establish a dedicated transmission channel; the XR application platform transmits the XR Quality of Service (QoS) policy requirements, such as 80Mbps, to the Policy Control function (PCF) or Network Exposure Function (NEF), and the core network requests the radio to establish a dedicated channel to ensure this.

[0024] 2) XR terminals use built-in gyroscopes, gravimeters, etc., to sense the user's posture, rotation position, etc., and then upload the sensed information to the XR application platform through 5G / 6G networks.

[0025] 3) The XR application platform obtains the position and rotation angle of the XR terminal from the uplink request, renders the video, and then pushes the video from the current perspective. The video rate is usually 1-100M / s, for example, 80M / s.

[0026] 4) The XR UPF identifies the I-frames of the video and transmits the identified frame information to the radio. The radio then performs scheduling and maintenance based on the identified I-frame information and the allocated dedicated channel.

[0027] Among related technologies, multicast and broadcast technologies are effective for saving bandwidth. For broadcast technology, application platforms, such as television stations, can establish a public broadcast channel within the network, such as 5G. The application platform only needs to transmit one copy of the video data to the core network and the wireless network, which then broadcasts it to all terminals under the base station. This eliminates the need to establish a dedicated channel for each user. Similarly, for multicast, a public multicast channel can be established for each group, such as a conference or training group, allowing group members to share the channel and save resources.

[0028] However, current multicast and broadcast technologies are mainly designed for pushing ordinary 2D videos, such as conferences, sports games, and movies. They cannot perform on-demand unified rendering and switching of different perspectives for XR 3D videos, nor can they be integrated with unicast technology for seamless switching. Therefore, they cannot provide an immersive, multi-sensory experience that combines virtual and real elements.

[0029] The methods and embodiments provided in this application can be executed on a mobile terminal, a computer terminal, or a similar computing device. Taking running on a computer terminal as an example, Figure 2 This is a hardware structure block diagram of a computer terminal running the XR video transmission method according to an embodiment of the present invention. For example... Figure 2 As shown, computer terminal 200 may include one or more ( Figure 2 Only one is shown in the image. A processor 202 (which may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.) and a memory 204 for storing data are also shown. Those skilled in the art will understand that... Figure 2 The structure shown is for illustrative purposes only and does not limit the structure of the computer terminal described above. For example, the computer terminal may also include components that are more complex than those described above. Figure 2 The more or fewer components shown, or having the same Figure 2 The different configurations shown.

[0030] The memory 204 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the XR video transmission method in this embodiment of the invention. The processor 202 executes various functional applications and data processing by running the computer program stored in the memory 204, thereby implementing the above-described method. The memory 204 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 204 may further include memory remotely located relative to the processor 202, and these remote memories can be connected to a computer terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0031] This invention provides an XR video transmission method applicable to XR application platforms. Figure 3 This is a flowchart of an XR video transmission method according to an embodiment of the present invention, such as... Figure 3 As shown, the process includes the following steps:

[0032] Step S302: Send a first request to the core network. The first request is used to instruct the core network to establish a transmission channel according to the data transmission method corresponding to the first request. The data transmission method includes broadcast or multicast.

[0033] In this embodiment of the invention, the above-mentioned data transmission method also includes unicast, that is, the transmission channel also includes unicast transmission channel. However, as a conventional transmission channel, the unicast channel is already established at the beginning of data transmission, especially XR video data transmission, and there is no need to establish the unicast transmission channel again through the first request instruction.

[0034] In one exemplary embodiment, the first request is further used to instruct the core network to trigger the base station to establish a transmission channel according to the data transmission method corresponding to the first request.

[0035] In this embodiment of the invention, the transmission channel for XR video needs to pass through the XR application platform, core network, base station, and XR terminal. Therefore, while the core network establishes the corresponding transmission channel according to the first request, the core network also needs to trigger the base station to establish the corresponding transmission channel based on the first request. The triggering method can be to send a second request to the base station. The second request needs to carry QoS policy information for XR multicast or broadcast.

[0036] In this embodiment of the invention, the first request carries QoS policy information, which includes at least one of the following: QoS information of the XR application platform, service type of the XR application platform, transmission protocol of the XR application platform, and media type of the XR application platform.

[0037] Step S304: Render the XR video from multiple angles based on the data transmission method corresponding to the first request to obtain the target XR video.

[0038] In one exemplary embodiment, rendering an XR video from multiple angles based on the data transmission method corresponding to the first request to obtain a target XR video includes: determining a preset viewpoint of the data transmission method corresponding to the first request, wherein the preset viewpoint is a preset multicast viewpoint and / or a preset broadcast viewpoint; and rendering the XR video from multiple angles based on the preset viewpoint to obtain the target XR video.

[0039] In this embodiment of the invention, the preset viewing angle is set according to the actual situation, such as the actual meeting scenario or other scenarios, as well as the actual angle requirements of the user terminal, etc., which will not be described in detail here.

[0040] In one exemplary embodiment, rendering an XR video from multiple angles based on preset viewpoints to obtain a target XR video includes: in a multicast scenario, rendering an XR video based on at least one preset multicast viewpoint to obtain target XR videos corresponding to different multicasts, wherein each preset multicast viewpoint corresponds to a different video angle; and in a broadcast scenario, rendering an XR video based on a preset broadcast viewpoint to obtain a target XR video corresponding to the broadcast, wherein the preset broadcast viewpoint corresponds to multiple video angles.

[0041] In practical implementation, for multicast scenarios, the XR terminal first requests to join an XR multicast group from the core network. There can be multiple multicast groups, each corresponding to a different video angle. The XR application platform renders the XR spatial video according to the perspective of each multicast group and transmits the target XR video to the core network through the corresponding multicast channel. The core network then sends the target XR video via multicast through the base station, based on the members (XR terminals) that have applied to join the XR group.

[0042] In practical implementation, for broadcast scenarios, there is only one broadcast, and one broadcast can correspond to multiple angles. The XR application platform renders the XR video according to a uniformly set preset viewpoint to obtain the target XR video, and the rendered video is transmitted through a shared broadcast channel. The base station receives the target XR video and broadcasts it uniformly within the base station.

[0043] In actual implementation, the multiple video angles of the broadcast can be moved in six degrees of freedom (6DOF) in "forward, backward, left, right, up, and down" or "nodding up and down, tilting left and right, and shaking forward and backward".

[0044] In actual implementation, XR videos can be rendered using conventional video rendering techniques in this field according to a preset angle, which will not be described in detail here.

[0045] Step S306: Push the target XR video to the core network via the transmission channel.

[0046] In one exemplary embodiment, the method further includes: in the case of a unicast scenario, receiving a first channel switching request from an XR terminal, the first channel switching request being used to indicate a switch from a unicast transmission channel to a multicast transmission channel or a broadcast transmission channel.

[0047] In actual implementation, considering the flexible experience needs of users and the XR video acquisition needs of user terminals at different times or in different scenarios, in order to improve the user experience, in the case of unicast, users can send a first channel switching request to the XR application platform through a one-click request on the XR terminal to switch the XR video transmission channel from the unicast transmission channel to the multicast transmission channel or the broadcast transmission channel.

[0048] In one exemplary embodiment, after receiving the first channel switching request from the XR terminal, the method further includes: if no multicast transmission channel or broadcast transmission channel is established, establishing the multicast transmission channel or broadcast transmission channel indicated by the first channel switching request based on the first channel switching request.

[0049] In actual implementation, when a first channel switching request is received from an XR terminal but no multicast or broadcast transmission channel has been established, the XR application platform triggers the establishment of a multicast or broadcast transmission channel based on the XR terminal's first channel switching request, or the application platform's operation and maintenance management function triggers the establishment of a multicast or broadcast transmission channel.

[0050] In one exemplary embodiment, the method further includes: in the case of a multicast scenario or a broadcast scenario, receiving a second channel switching request from an XR terminal, wherein the second channel switching request is used to indicate a switch from a multicast transmission channel or a broadcast transmission channel to a unicast transmission channel.

[0051] In this embodiment of the invention, considering the randomness and diversity of user needs, for example, when a user attends a meeting, the most advanced meeting group may participate in the multicast format. Later, it may be necessary to flexibly adjust the meeting content and meeting scenario for different users. In such cases, the user can also send a second channel switching request to the XR application platform through a one-click request on the XR terminal. The XR application platform, upon receiving the second channel switching request from the XR terminal, instructs the XR video transmission channel to switch from the multicast transmission channel to the unicast transmission channel.

[0052] In actual implementation, when users participate in broadcast concerts or competitions, considering user experience needs, such as purchasing a membership view to obtain a stage or competition view exclusive to members, users can also send a second channel switching request to the XR application platform through a one-click request on the XR terminal. Upon receiving the second channel switching request from the XR terminal, the XR application platform instructs the XR video transmission channel to switch from the broadcast transmission channel to the unicast transmission channel, so that users can obtain a better viewing experience.

[0053] In one exemplary embodiment, the method further includes: in a unicast scenario where the core network is congested, switching from the unicast transmission channel to the multicast transmission channel or the broadcast transmission channel to push the target XR video based on a preset switching strategy; and when the core network recovers to a non-congested state, switching from the multicast transmission channel or the broadcast transmission channel to the unicast transmission channel based on the third channel switching request of the XR terminal or the preset switching strategy.

[0054] In practical implementation, when an XR terminal performs XR unicast, in addition to considering the channel switching operations corresponding to user needs, the selection and switching of the XR video transmission channel are also affected by the actual network environment. For example, if the Radio Access Network (RAN) or User Plane Function (UPF) detects network congestion, it notifies the XR application platform by sending an uplink message. The XR application platform then switches from unicast to broadcast or multicast mode for XR video rendering and pushing according to a pre-set switching strategy. In one embodiment, after switching the transmission channel according to the pre-set switching strategy due to network congestion, if the network returns to a non-congested state, the XR application platform returns to the unicast state based on the XR terminal's subsequent switching request (i.e., the third channel switching request in the above embodiment); or the XR application platform returns to the unicast state according to the pre-set switching strategy.

[0055] The above steps provide an extended reality (XR) video transmission method. This method involves sending a first request to the core network, instructing the core network to establish a transmission channel based on a data transmission method corresponding to the first request, which may be broadcast or multicast. The XR video is then rendered from multiple angles based on the data transmission method corresponding to the first request to obtain the target XR video. Finally, the target XR video is pushed to the core network via the transmission channel. This method solves the problem in related technologies where multi-angle rendering and multicast or broadcast transmission of XR video is not possible, achieving the desired effect.

[0056] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0057] This embodiment also provides an XR video transmission device for implementing the above embodiments and preferred embodiments; details already described will not be repeated. As used below, the term "module" can refer to a combination of software and / or hardware that performs a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0058] The XR video transmission device provided in this embodiment of the invention can be installed on an XR application platform, including a sending module configured to send a first request to the core network. The first request instructs the core network to establish a transmission channel according to the data transmission method corresponding to the first request, which may include broadcast or multicast. A rendering module is configured to perform multi-angle rendering of the XR video based on the data transmission method corresponding to the first request to obtain the target XR video. A pushing module is configured to push the target XR video to the core network via the transmission channel.

[0059] In this embodiment of the invention, the XR video transmission device may further include different modules, and the naming and functional division of the modules may be selected in different ways according to the actual situation, without specific limitations.

[0060] It should be noted that the above modules can be implemented by software or hardware. For the latter, they can be implemented in the following ways, but are not limited to: all the above modules are located in the same processor; or, the above modules are located in different processors in any combination.

[0061] Embodiments of the present invention also provide a computer-readable storage medium storing a computer program, wherein the computer program is configured to perform the steps in any of the above method embodiments when executed.

[0062] In one exemplary embodiment, the aforementioned computer-readable storage medium may include, but is not limited to, various media capable of storing computer programs, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard disk, magnetic disk, or optical disk.

[0063] Embodiments of the present invention also provide an electronic device including a memory and a processor, the memory storing a computer program and the processor being configured to run the computer program to perform the steps in any of the above method embodiments.

[0064] In one exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0065] This invention also provides a computer program product, including a computer program that, when executed by a processor, implements the steps in any of the above method embodiments.

[0066] In one exemplary embodiment, the computer program product described above includes a non-volatile computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the methods described in various embodiments of this application.

[0067] Specific examples in this embodiment can be found in the examples described in the above embodiments and exemplary implementations, and will not be repeated here.

[0068] It is obvious to those skilled in the art that the modules or steps of the present invention described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. They can be implemented using computer-executable program code, and thus can be stored in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those described herein, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any particular combination of hardware and software.

[0069] To enable those skilled in the art to better understand the technical solutions of the present invention, the following description is provided in conjunction with different embodiments.

[0070] Example 1

[0071] Figure 4This is a schematic diagram of the system architecture of the XR video transmission device according to an embodiment of the present invention, as shown below. Figure 4 As shown, it consists of three parts: XR terminal, 5G / 6G network, and XR application.

[0072] In this embodiment of the invention, the XR terminal type can be AR glasses, VR headsets, glasses-free 3D tablets, or even AI mobile phones, smart cockpits, humanoid robots, etc. The terminal supports receiving XR video via broadcast, multicast, and unicast, and the channel can seamlessly switch between broadcast, multicast, and unicast.

[0073] In this embodiment of the invention, 5G / 6G networks provide low-latency, high-speed transmission of XR video. For example... Figure 4 As shown, the XR-UPF in the core network corresponds to a unicast transmission channel, and its XR terminals are for one person, one view. The Multi-Broadcast UPF (MB-UPF) and XR-UPF in the core network can both correspond to multicast or broadcast transmission channels, and their XR terminals allow for multiple users to view simultaneously. XR-UPF and MB-UPF can be integrated. For example... Figure 4 As shown, the core network includes Policy Control Function (PCF), Network Exposure Function (NEF), Access and Mobility Management Function (AMF), and Session Management Function (SMF).

[0074] In this embodiment of the invention, the XR application platform supports rendering XR videos based on an individual's location and posture, and also supports rendering videos from a unified perspective, such as a preset perspective.

[0075] Based on the system architecture of the XR video transmission device described above, the broadcast transmission process of XR video is introduced.

[0076] When XR live streaming is needed, such as for concerts or sports games, the XR application initiates a broadcast session. Once the session is established, the rendering of the XR video from the broadcast perspective begins. Figure 5 This is a schematic diagram illustrating the principle of the XR video broadcast transmission process according to an embodiment of the present invention, as shown below. Figure 5 As shown, it includes the following steps:

[0077] S501, the XR application initiates the XR broadcast service according to the needs of the application scenario. First, it obtains the XR Temporary Mobile Group Identity (XRTMGI) to be broadcast from the network side (i.e., the core network). Second, it triggers the establishment of the XR broadcast session.

[0078] In this embodiment of the invention, the XR application platform transmits information such as QoS, service type, transmission protocol, and media type of the XR broadcast to the network side.

[0079] S502, MB-SMF triggers an XR broadcast context creation request to AMF and forwards the QoS information of the XR broadcast.

[0080] S503, AMF forwards the request to create an XR broadcast context to RAN.

[0081] S504, the RAN creates a broadcast context for XR and sets the QoS scheduling policy for XR broadcasts.

[0082] S505, RAN returns an XR broadcast context creation response to AMF.

[0083] S506, AMF forwards the broadcast context creation response to MB-SMF.

[0084] S507, MB-SMF sends an XR session update message to MB-UPF. MB-UPF can identify and schedule XR video according to the instructions in the session update message.

[0085] S508, RAN broadcast XR TMGI.

[0086] S509, XR applications render XR videos based on a unified preset perspective, such as "moving forward, backward, left, right, up, and down" using 6DOF or "nodding up and down, tilting left and right, and shaking forward and backward." The unified preset perspective includes multiple video angles.

[0087] In S510-S511, the XR application pushes the rendered target XR video to the RAN, and the RAN continues to push it to the user UE.

[0088] In this embodiment of the invention, rendering XR video based on broadcast can greatly save network resources, especially wireless resources. For example, if each user requires 100 Mbps, 100 users would require 1 Gbps, but now, through broadcasting, only 100 Mbps is needed.

[0089] In the embodiments of the present invention, the types and contents of the process indication messages such as the creation request for the XR broadcast context, the XR broadcast context creation response, the XR session update response, and the XR session update message can all be implemented using message types and contents commonly used in the art, and will not be described one by one here.

[0090] Example 2

[0091] Different XR perspectives are rendered for different application scenarios, such as XR meetings and XR training. For each scenario, not all users need to watch the XR video; only those attending the meeting or training can watch it. Therefore, multicast transmission of the XR video is required. Figure 6 This is a schematic diagram illustrating the principle of multicast transmission of XR video according to an embodiment of the present invention, as shown below. Figure 6 As shown, it includes the following steps:

[0092] S601, the XR application initiates the XR multicast service according to the needs of the application scenario. First, it obtains the XR TMGI that needs to be multicast from the network side (i.e., the core network). Second, it triggers the establishment of the XR multicast session.

[0093] In this embodiment of the invention, the XR application platform transmits information such as QoS, service type, transmission protocol, and media type of XR multicast to the network side.

[0094] S602, the UE initiates an XR multicast join request to the AMF. It can join a certain XR multicast by applying for session modification. The request includes the parameter XR multicast session ID.

[0095] S603, the AMF converts the multicast session request into a multicast context update request and forwards it to the SMF.

[0096] S604, SMF initiates an XR multicast context update request to MB-SMF.

[0097] S605, SMF returns an XR session update response to AMF.

[0098] S606, AMF sends an XR session update message to RAN.

[0099] S607, Establishment of XR multicast channel.

[0100] S608, XR applications render video from different angles according to multicast perspective, such as "moving forward, backward, left, right, up, and down" or "nodding up and down, tilting left and right, and shaking forward and backward" according to 6DOF.

[0101] S609, XR applications push media streams to MB-UPF, pushing the rendered target XR video.

[0102] S610, MB-UPF sends XR media streams to RAN, pushing the rendered target XR video.

[0103] S611, MB-UPF sends XR media streams to RAN via UPF, pushing the rendered target XR video.

[0104] S612, the RAN initiates a multicast push of the target XR video to the UE to send the XR media stream.

[0105] In this embodiment of the invention, by sending media streams to the UE via multicast, it is possible to control that XR media can only be viewed within the group, and the multicast channel can also greatly save network resources.

[0106] In the embodiments of the present invention, the types and contents of the process indication messages such as the XR multicast join request, multicast context update request, XR session update response, and XR session update message can all be implemented using message types and contents commonly used in the art, and will not be described one by one here.

[0107] Example 3

[0108] When a user is using XR services in a dedicated session, they can switch to a broadcast or multicast channel through the UE terminal to receive XR video. Figure 7 This is a schematic diagram illustrating the principle of unicast, multicast, and broadcast switching in XR video according to an embodiment of the present invention, as shown below. Figure 7 As shown, it includes the following steps:

[0109] S701: XR applications push XR videos via a unicast channel.

[0110] S702, the user initiates a first channel switching request for the video transmission channel through the UE terminal (i.e., the XR terminal in the above embodiment), requesting to switch to the multicast or broadcast channel.

[0111] S703 triggers the establishment of a multicast or broadcast XR transmission channel if the XR multicast or broadcast channel has not yet been established. If an XR multicast or broadcast channel has already been created, XR video transmission can be performed through the existing multicast or broadcast channel.

[0112] S704: XR applications switch from unicast to multicast channels to render and push users' XR videos.

[0113] S705: XR applications push media streams to MB-UPF to transmit XR videos.

[0114] S706, MB-UPF sends XR media streams to RAN, transmitting XR video.

[0115] S707, MB-UPF sends XR media streams to RAN via UPF to transmit XR video.

[0116] S708, RAN initiates multicast XR video push to UE.

[0117] In this embodiment of the invention, through seamless switching between unicast, multicast and broadcast, users can freely choose a unique channel or the same perspective of "thousands of people watching at the same time".

[0118] Example 4

[0119] When a user is using XR services in a dedicated session, and there is network congestion, the XR application can switch from a unicast perspective to a multicast or broadcast perspective based on the congestion information. Figure 8 This is a schematic diagram illustrating the principle of unicast, multicast, and broadcast of XR video based on network state switching in an embodiment of the present invention, as shown below. Figure 8 As shown, it includes the following steps:

[0120] S801, XR applications push XR videos through a unicast channel.

[0121] If the S802, RAN, or UPF detects that the network is busy, it will report the congestion information to the XR application platform.

[0122] S803, XR application decisions are transmitted via multicast or broadcast channels.

[0123] In S804, XR applications switch from unicast to multicast or broadcast channels to render and push user videos. If an XR multicast or broadcast channel has not yet been established, the establishment of the multicast or broadcast XR channel is triggered; if an XR multicast or broadcast channel has already been created, XR videos can be pushed through the existing multicast or broadcast channels.

[0124] S805, XR applications push media streams to MB-UPF to transmit XR videos.

[0125] S806, MB-UPF sends XR media streams to RAN to transmit XR video.

[0126] S807, MB-UPF sends XR media streams to RAN via UPF to transmit XR video.

[0127] S808, the RAN initiates multicast or broadcast XR video push to the UE.

[0128] In one embodiment, after the transmission channel is switched according to a preset switching strategy due to congestion, if the network recovers to a non-congested state, the XR application platform returns to the unicast state based on the terminal's renewed switching request (i.e., the third channel switching request in the above embodiment); or returns to the unicast state according to the preset switching strategy.

[0129] In this embodiment of the invention, seamless switching between unicast, multicast, and broadcast based on congestion information can improve user experience and avoid network congestion.

[0130] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, or improvements made within the principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. An extended reality, XR, video transmission method, characterized by, The application is applied to an XR application platform, comprising: sending a first request to a core network, the first request being used to instruct the core network to establish a transmission channel according to a data transmission mode corresponding to the first request, the data transmission mode comprising broadcast or groupcast; performing multi-angle rendering on an XR video based on the data transmission mode corresponding to the first request to obtain a target XR video; pushing the target XR video to the core network through the transmission channel.

2. The method of claim 1, wherein, The multi-angle rendering on the XR video based on the data transmission mode corresponding to the first request to obtain a target XR video comprises: determining a preset viewing angle of the data transmission mode corresponding to the first request, wherein the preset viewing angle is a preset groupcast viewing angle and / or a preset broadcast viewing angle; performing multi-angle rendering on the XR video based on the preset viewing angle to obtain the target XR video.

3. The method of claim 2, wherein, The multi-angle rendering on the XR video based on the preset viewing angle to obtain the target XR video comprises: in a groupcast scenario, performing rendering on the XR video based on at least one preset groupcast viewing angle to obtain the target XR video corresponding to different groupcasts, wherein each preset groupcast viewing angle corresponds to a different video angle; in a broadcast scenario, performing rendering on the XR video based on the preset broadcast viewing angle to obtain the target XR video corresponding to broadcast, wherein the preset broadcast viewing angle corresponds to multiple video angles.

4. The method of claim 1, wherein, Further comprising: in a unicast scenario, receiving a first channel switching request from an XR terminal, the first channel switching request being used to instruct switching from a unicast transmission channel to a groupcast transmission channel or a broadcast transmission channel.

5. The method of claim 4, wherein, After the receiving of the first channel switching request from the XR terminal, the method further comprises: in the absence of establishment of the groupcast transmission channel or the broadcast transmission channel, establishing the groupcast transmission channel or the broadcast transmission channel indicated by the first channel switching request based on the first channel switching request.

6. The method of claim 1, wherein, Further comprising: in a groupcast scenario or a broadcast scenario, receiving a second channel switching request from an XR terminal, the second channel switching request being used to instruct switching from a groupcast transmission channel or a broadcast transmission channel to a unicast transmission channel.

7. The method of claim 1, wherein, Further comprising: in a unicast scenario and in the case of congestion of the core network, switching from a unicast transmission channel to a groupcast transmission channel or a broadcast transmission channel to push the target XR video based on a preset switching strategy; in the case of recovery of the core network to non-congestion, switching from a groupcast transmission channel or a broadcast transmission channel to a unicast transmission channel based on a third channel switching request of an XR terminal or the preset switching strategy.

8. The method of claim 1, wherein: the first request is further used to instruct the core network to trigger a base station to establish the transmission channel according to the data transmission mode corresponding to the first request.

9. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the steps of the method described in any one of claims 1 to 8.

10. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method described in any one of claims 1 to 8.

Images