Service migration method and device for real-time rendering application program

Abstract

The application provides a service migration method and device for a real-time rendering application, relates to the technical field of communication, and is applied to a user end and comprises the following steps: starting the real-time rendering application, sending a session establishment request to a core network in a 5G communication system to establish a first user session between the user end and a source integrated base station and a first cloud session between the source integrated base station and a cloud end; the source integrated base station comprises a source local data network, and the source local data network runs a streaming media service of the real-time rendering application; a control flow data packet is sent to the source integrated base station through the first user session; first video stream data packets fed back by the source integrated base station through the first user session are received, the first video stream data packets are decoded, video streams corresponding to the first video stream data packets are obtained, and the video streams are displayed; and the streaming media service is migrated based on the cloud end after the delay of the first user session is higher than a preset delay threshold.

Description

Technical Field

[0001] This invention relates to the field of communication technology, and in particular to a service migration method and apparatus for real-time rendering applications. Background Technology

[0002] There are various types of rendering. Real-time rendering refers to a rendering scheme that responds to user input and renders and displays the image within a short time, focusing more on the real-time performance and interactivity of the rendering. Due to the real-time nature of real-time rendering, it places relatively high demands on the configuration of user devices. To reduce these requirements, cloud-based real-time rendering has gradually developed. Cloud-based real-time rendering moves the rendering module to the cloud and transmits the rendered image to the user device for output and display.

[0003] Real-time rendering in the cloud typically requires a base station to connect the cloud to the user terminal. If the distance between the user terminal and the cloud is too long, it leads to high latency and degrades the user experience. Currently, edge clouds are generally set up near the user terminal, connected to the user terminal via base stations, and real-time rendering is performed on the edge cloud. However, the requirement for low latency limits the coverage of the edge cloud providing real-time rendering, necessitating service migration when the user moves out of the edge cloud's coverage area. Furthermore, after the user terminal sends data packets to the base station, the base station typically needs to encapsulate the data packets using a generic packet tunneling protocol (GPRS) user plane to obtain tunnel transport packets. These tunnel transport packets are then sent to the User Plane Function (UPF) in the 5G communication system core network for decapsulation to obtain data packets, which are then forwarded to the edge cloud for rendering computation. Summary of the Invention

[0004] This invention provides a service migration method and apparatus for real-time rendering applications, which can improve the utilization efficiency of computing resources and achieve computing power optimization.

[0005] This invention provides a service migration method for a real-time rendering application, applied to the user end, comprising:

[0006] The real-time rendering application is launched, and a session establishment request is sent to the core network of the 5G communication system, so that the core network can establish a first user session between the user terminal and the source integrated base station based on the session establishment request, and establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, and the source local data network runs the streaming media service of the real-time rendering application;

[0007] Send control flow data packets to the source integrated base station through the first user session;

[0008] The system receives a first video stream data packet fed back by the source integrated base station through the first user session, decodes the first video stream data packet to obtain the video stream corresponding to the first video stream data packet, and displays it; the first video stream data packet is obtained by the streaming media service of the source local data network rendering the payload to be rendered.

[0009] If the latency of the first user session exceeds a preset latency threshold, the streaming service is migrated based on the cloud.

[0010] According to a service migration method for a real-time rendering application provided by the present invention, the core network is further configured to determine a target integrated base station after the latency of the first user session exceeds a preset latency threshold, establish a second user session between the user terminal and the target integrated base station, and establish a second cloud session between the target integrated base station and the cloud; the target integrated base station includes a target local data network, and the target local data network runs the streaming media service of the real-time rendering application;

[0011] Migrating the streaming media service based on the cloud specifically includes:

[0012] Receive the second video stream data packet fed back by the target local data network, decode the second video stream data packet, and obtain the video stream corresponding to the second video stream data packet;

[0013] Switch the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet;

[0014] The cloud includes a global state, and the second video stream data packet is obtained by the target local network after restoring the streaming media service based on the global state and performing rendering calculations.

[0015] According to a service migration method for a real-time rendering application provided by the present invention, before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes:

[0016] The frame difference between the video stream corresponding to the first video stream data packet and the video stream corresponding to the second video stream data packet is determined to be within a predetermined range.

[0017] According to a service migration method for a real-time rendering application provided by the present invention, before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes:

[0018] Obtain the first latest video frame of the video stream corresponding to the first video stream data packet, and obtain the second latest video frame of the video stream corresponding to the second video stream data packet;

[0019] The first latest video frame and the second latest video frame are subjected to a weighted linear combination to generate a switching video frame;

[0020] The switched video frame is displayed on the user's device.

[0021] According to a service migration method for a real-time rendering application provided by the present invention, after switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes:

[0022] Within a preset time, the system continues to receive the first video stream data packet fed back from the source local data network, decodes the first video stream data packet, and obtains the video stream corresponding to the first video stream data packet.

[0023] If the preset time ends and the delay of the second user session is lower than the preset delay threshold, the reception of the first video stream data packet fed back by the source local data network is stopped, and the video stream corresponding to the first video stream data packet is released.

[0024] This invention provides a service migration method for real-time rendering applications, applied to an integrated base station, wherein the integrated base station includes a local data network, and the local data network runs a streaming media service for a user-side real-time rendering application, comprising:

[0025] Based on the session establishment request notification sent by the user terminal to the core network of the 5G communication system, the core network cooperates with the user terminal to establish a user session and a cloud session with the cloud.

[0026] Determine the payload to be rendered in the control flow data packet sent by the user terminal through the first user session;

[0027] Obtain the first video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered and the status of the streaming media service in the local data network;

[0028] The video stream data packet is sent to the user terminal through the user session, and the status of the streaming media service in the local data network is sent to the cloud through the cloud session, so that the streaming media service is migrated based on the global status of the streaming media service in the local data network in the cloud after the latency of the user session exceeds a preset latency threshold.

[0029] According to a service migration method for a real-time rendering application provided by the present invention, before obtaining the streaming media service of the local data network to perform rendering calculations on the payload to be rendered to obtain a first video stream data packet, the method further includes:

[0030] It was determined that the control flow data packet needed to be offloaded locally;

[0031] Extract the payload to be rendered from the control flow data packet and send the payload to be rendered to the streaming media service; extract the interaction information from the control flow data packet and pre-store it.

[0032] According to a service migration method for a real-time rendering application provided by the present invention, after obtaining the first video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered, the method further includes:

[0033] Determine the payload to be displayed and the corresponding quality of service stream identifier in the first video stream data packet;

[0034] Based on the service quality flow identifier, the corresponding payload to be displayed is mapped to the corresponding service quality flow;

[0035] The quality of service flow is encapsulated, and the encapsulated quality of service flow is sent to the first user session through a specified interface.

[0036] The present invention also provides a service migration device for a real-time rendering application, applied to a user terminal, comprising:

[0037] The real-time rendering application is launched, and a session establishment request is sent to the core network of the 5G communication system, so that the core network can establish a first user session between the user terminal and the source integrated base station based on the session establishment request, and establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, and the source local data network runs the streaming media service of the real-time rendering application;

[0038] Send control flow data packets to the source integrated base station through the first user session;

[0039] The system receives a first video stream data packet fed back by the source integrated base station through the first user session, decodes the first video stream data packet to obtain the video stream corresponding to the first video stream data packet, and displays it; the first video stream data packet is obtained by the streaming media service of the source local data network rendering the payload to be rendered.

[0040] If the latency of the first user session exceeds a preset latency threshold, the streaming service is migrated based on the cloud.

[0041] The present invention also provides a service migration device for a real-time rendering application, applied to an integrated base station, the integrated base station including a local data network, the local data network running a streaming media service for a user-end real-time rendering application, comprising:

[0042] Based on the session establishment request notification sent by the user terminal to the core network of the 5G communication system, the core network cooperates with the user terminal to establish a user session and a cloud session with the cloud.

[0043] Determine the payload to be rendered in the control flow data packet sent by the user client through the user session;

[0044] Obtain the first video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered and the status of the streaming media service in the local data network;

[0045] The video stream data packet is sent to the user terminal through the user session, and the status of the streaming media service in the local data network is sent to the cloud through the cloud session, so that the streaming media service is migrated based on the global status of the streaming media service in the local data network in the cloud after the latency of the user session exceeds a preset latency threshold.

[0046] Compared to real-time rendering on edge cloud, the service migration method and apparatus for real-time rendering applications provided by this invention starts the real-time rendering application, sends a session establishment request to the core network of the 5G communication system to establish a first user session between the user terminal and the source integrated base station, establishes a first cloud session between the source integrated base station and the cloud, sends control flow data packets to the source integrated base station through the first user session, receives the first video stream data packets fed back by the source integrated base station, and migrates the streaming media service based on the cloud after the latency of the first user session exceeds a preset latency threshold. The source integrated base station includes a source local data network, which runs the streaming media service of the real-time rendering application. The streaming media service can perform rendering calculations on the payload to be rendered in the control flow data packets to obtain the first video stream data packets, which can improve the utilization efficiency of computing resources and achieve computing power optimization. Attached Figure Description

[0047] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0048] Figure 1 This is one of the flowcharts illustrating the service migration method for real-time rendering applications provided by this invention.

[0049] Figure 2 This is the second flowchart illustrating the service migration method for real-time rendering applications provided by this invention.

[0050] Figure 3 This is a schematic diagram of the framework for integrating base station offloading in the service migration method for real-time rendering applications provided by the present invention.

[0051] Figure 4 This is one of the structural schematic diagrams of the service migration device for real-time rendering applications provided by the present invention.

[0052] Figure 5 This is the second structural schematic diagram of the service migration device for real-time rendering applications provided by the present invention.

[0053] Figure 6 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation

[0054] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0055] In real-time rendering on the edge cloud, the base station needs to encapsulate the data uploaded by the user terminal using the user plane of the General Packet Tunneling Protocol (GPTP), decapsulate the data using the user plane function in the 5G communication system core network, and then send the decapsulated data packets to the edge cloud for rendering computation. This process continuously consumes computing resources. To solve the above technical problems, the following section combines... Figures 1-5 This invention describes a service migration method and apparatus for a real-time rendering application.

[0056] Figure 1 This is one of the flowcharts illustrating the service migration method for real-time rendering applications provided by this invention, such as... Figure 1 As shown, this method is applied to the user end and includes:

[0057] Step 101: Start the real-time rendering application and send a session establishment request to the core network of the 5G communication system, so that the core network can establish a first user session between the user terminal and the source integrated base station based on the session establishment request, and establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, and the source local data network runs the streaming media service of the real-time rendering application.

[0058] The user terminal, also known as user equipment (UE), refers to the node representing the user in a 5G communication system. It is understood that, in this embodiment, the source integrated base station and the cloud are also nodes in the 5G communication system.

[0059] 5G (5th Generation Mobile Communication Technology) refers to the fifth generation of mobile communication systems. The core network is the core component of a 5G network, used for core functions such as user authentication, network access control, mobility management, and Quality of Service (QoS) control.

[0060] Real-time rendering applications refer to applications that employ real-time rendering technology, such as cloud gaming, cloud virtual reality, and cloud augmented reality. Real-time rendering means that the application generates images and animations in real time based on user input after receiving it. In this embodiment, the real-time rendering type is similar to real-time cloud rendering. The rendering work is completed in the integrated base station, and the real-time rendering application on the user end receives the rendered image and sound data returned by the integrated base station in the form of a data stream for display.

[0061] The source integrated base station refers to the integrated base station that establishes the first user session with the user terminal. The real-time rendering application on the user terminal displays images to the user based on the video stream data packets fed back by the source integrated base station. It can be understood that the integrated base station also includes a communication network to enable communication between the integrated base station and the user terminal. A session refers to a logical connection between two nodes in a 5G communication system used for data transmission.

[0062] For example, a real-time rendering application may include a global logic module, a rendering module, and a front-end module. After the user terminal starts the front-end module of the real-time rendering application based on user input, it can send a session establishment request to the core network of the 5G communication system to establish a first user session between the user terminal and the source integrated base station running the rendering module of the real-time rendering application, and establish a first cloud session between the user terminal and the cloud running the global logic module of the real-time rendering application. The rendering module may be a streaming media service in the source local data network of the source integrated base station.

[0063] Step 102: Send control flow data packets to the source integrated base station through the first user session.

[0064] Control flow packets refer to data packets encapsulated and obtained from control flow data. Control flow refers to the data stream that characterizes the order of data flow during user interaction with a real-time rendering application.

[0065] For example, the first user session is a PDU session (Protocol Data Unit Session). The real-time rendering application on the user side can obtain user input based on the input encoder to generate control flow data packets, and send the control flow data packets to the source integrated base station through the PDU session.

[0066] Step 103: Receive the first video stream data packet fed back by the source integrated base station through the first user session, decode the first video stream data packet to obtain the video stream corresponding to the first video stream data packet and display it; the first video stream data packet is obtained by the streaming media service of the source local data network rendering the payload to be rendered.

[0067] Local data network refers to the data network within an integrated base station, while source local data network refers to the data network within a source integrated base station. Data network (DN) is the target network carrying user data in a 5G communication system; it serves as the interface between user data and external services. For example, a data network can be the internet, an enterprise intranet, or a cloud service platform.

[0068] Video stream data packets refer to the data packets encapsulated and obtained from video stream data. A video stream refers to the data stream obtained by rendering images from the source local data network based on the payload to be rendered in the control flow. The payload to be rendered can be an HTTP request, video data, etc.

[0069] For example, the real-time rendering application on the user end can receive the first video stream data packet fed back from the source local data network based on the PDU session, obtain the first video stream data from the first video stream data packet through the video decoder, and display the first video stream data to the user frame by frame.

[0070] Step 104: After the latency of the first user session exceeds a preset latency threshold, migrate the streaming media service based on the cloud.

[0071] If the latency of the first user session exceeds the preset latency threshold, it is determined that the Quality of Service (QoS) will deteriorate due to the increased latency, thereby reducing the user experience, and it is necessary to migrate the streaming media service of the real-time rendering application.

[0072] Understandably, the preset latency threshold can be set according to user experience requirements. To present a better user experience, the preset latency threshold can be appropriately lowered, and to reduce application costs, the preset latency threshold can be appropriately increased. The specific preset latency threshold value can be determined according to the on-site working conditions.

[0073] Compared to real-time rendering on the edge cloud, the service migration method for real-time rendering applications provided in this embodiment of the invention starts the real-time rendering application, sends a session establishment request to the core network of the 5G communication system to establish a first user session between the user terminal and the source integrated base station, establishes a first cloud session between the source integrated base station and the cloud, sends control flow data packets to the source integrated base station through the first user session, receives the first video stream data packets fed back by the source integrated base station, and migrates the streaming media service based on the cloud after the latency of the first user session exceeds a preset latency threshold. The source integrated base station includes a source local data network, which runs the streaming media service of the real-time rendering application. The streaming media service can perform rendering calculations on the payload to be rendered in the control flow data packets to obtain the first video stream data packets, which can improve the utilization efficiency of computing resources and achieve computing power optimization.

[0074] Based on the above embodiments, the core network is further configured to determine a target integrated base station after the latency of the first user session is higher than a preset latency threshold, establish a second user session between the user terminal and the target integrated base station, and establish a second cloud session between the target integrated base station and the cloud; the target integrated base station includes a target local data network, and the target local data network runs the streaming media service of the real-time rendering application.

[0075] The target integrated base station refers to the integrated base station that currently establishes a second user session with the user terminal. The streaming media service of the real-time rendering application migrates from the source integrated base station to the target integrated base station. After the migration is complete, the user terminal's real-time rendering application displays images to the user based on the video stream data packets fed back by the target integrated base station.

[0076] For example, after the latency of the first user session exceeds a preset latency threshold, the user terminal can send a service migration request to the migration manager of the core network. After receiving the service migration request sent by the user terminal, the migration manager can determine the target integrated base station based on the latency between the user terminal and its nearby integrated base station, so as to establish a second user session between the user terminal and the target integrated base station, and a second cloud session between the target integrated base station and the cloud.

[0077] In addition, while the source integrated base station feeds back the first video stream data packet to the user end, it also sends the status of the streaming media service of the real-time rendering application in the source local data network to the remote end through the first cloud session, so that after the streaming media service of the real-time rendering application runs in the source local data network of the target integrated base station, the status is synchronized based on the status of the streaming media service of the real-time rendering application in the source local data network.

[0078] Migrating the streaming media service based on the cloud specifically includes:

[0079] Receive the second video stream data packet fed back by the target local data network, decode the second video stream data packet, and obtain the video stream corresponding to the second video stream data packet;

[0080] Switch the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet;

[0081] The cloud includes a global state, and the second video stream data packet is obtained by the target local network after restoring the streaming media service based on the global state and performing rendering calculations.

[0082] The target local data network refers to the data network within the target integrated base station. Global state includes the state of the streaming service for the real-time rendering application in the source local data network and the state of the streaming service for the real-time rendering application in the target local data network.

[0083] For example, the target integrated base station sends video stream data packets to the user terminal. When the user terminal receives the first video stream data packet and the second video stream data packet simultaneously, based on the difference between the state of the streaming media service of the real-time rendering application in the source local data network and the state of the streaming media service of the real-time rendering application in the target local data network, after synchronizing the state of the streaming media service of the real-time rendering application running in the source local data network of the target integrated base station, the user terminal can switch the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet by updating the stream selector configuration.

[0084] Currently, real-time rendering applications involve a large amount of data transmission during the migration of streaming media services from the source edge cloud to the target edge cloud. During the migration, the streaming media service is frozen, causing downtime. The downtime only ends when the streaming media service is reactivated after the migration is complete. In this embodiment, by simultaneously receiving video stream data from both the target and source integrated base stations at the user end, and synchronizing the state of the streaming media service of the real-time rendering application running in the source local data network based on the state of the streaming media service of the real-time rendering application in the source local data network of the target integrated base station, the video stream displayed on the user end is switched to the video stream corresponding to the second video stream data packet. The downtime is only the time required for the video stream switching, significantly reducing downtime and improving the user experience.

[0085] During the downtime, since the two video streams are rendered independently, frame flickering may occur during the video stream switching process. To solve this problem, based on any of the above embodiments, before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: determining that the frame difference between the video stream corresponding to the first video stream data packet and the video stream corresponding to the second video stream data packet is within a predetermined range.

[0086] Frame difference refers to the difference in pixel values ​​between the last frame of the first video stream and the first frame of the second video stream displayed to the user during video stream switching. A predetermined range refers to the range of frame differences that can prevent frame flickering during video stream switching. In practical applications, a specific predetermined range can be set to provide different levels of fault tolerance.

[0087] Specifically, in one embodiment, determining that the frame difference between the video stream corresponding to the first video stream data packet and the video stream corresponding to the second video stream data packet is within a predetermined range includes:

[0088] Determine the structural similarity between each frame of the video stream corresponding to the first video stream data packet and each frame of the video stream corresponding to the second video stream data packet;

[0089] The structural similarity is determined to be within a predetermined range.

[0090] Structural similarity refers to a parameter that characterizes the similarity between two video frames from the perspective of human visual system's perception of image structural information. For example, structural similarity can include brightness, contrast, and structural information, which can include the arrangement of objects and textures in the image.

[0091] For example, the correspondence between each frame in the video stream corresponding to the first video stream data packet and each frame in the video stream corresponding to the second video stream data packet can be determined based on the mean square error. Then, the average brightness difference, average contrast difference, and structural information difference between the corresponding two frames are determined to determine whether the structural similarity between the corresponding two frames is within a predetermined range. The predetermined range can be specifically set in practical applications to provide different error tolerance rates.

[0092] Based on any of the above embodiments, before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes:

[0093] Obtain the first latest video frame of the video stream corresponding to the first video stream data packet, and obtain the second latest video frame of the video stream corresponding to the second video stream data packet;

[0094] The first latest video frame and the second latest video frame are subjected to a weighted linear combination to generate a switching video frame;

[0095] The switched video frame is displayed on the user's device.

[0096] The latest video frame is the video frame that will be displayed on the user's device. During video stream switching, the first latest video frame refers to the video frame in the video stream corresponding to the first video stream data packet that will be displayed on the user's device if no video stream switching occurs. The second latest video frame refers to the video frame in the video stream corresponding to the second video stream data packet that will be displayed on the user's device after video stream switching occurs.

[0097] For example, the first latest video frame and the second latest video frame can be processed by a weighted linear combination according to the following formula:

[0098] F_out = αF_1 + βF_2

[0099] α = min(n / N, 1)

[0100] β = max(1 - n / N, 0)

[0101] Where F_out is the switching video frame, F_1 ​​is the second latest video frame, F_2 is the first latest video frame, N (N=1, 2, 3…) is the size of the sliding window, and n (n=0, 1, 2, 3…) is the sliding number of the video frame.

[0102] The size of the sliding window refers to the time within which the video stream switches are completed (N frames). When N=1, there is no smoothing mechanism; the video stream switches directly. When N is greater than 1, a smoothing mechanism is in place. The specific value can be set based on the specific differences in the image changes. For example, N can be set to 12.

[0103] In this embodiment, by performing a weighted linear combination of the first latest video frame and the second latest video frame, a switching video frame is generated and displayed on the user terminal. Subsequently, video frames in the video stream corresponding to the second video stream data packet are displayed. This can smoothly transition from the video stream corresponding to the first video stream data packet to the video stream corresponding to the second video stream data packet, thereby reducing the risk of frame flicker.

[0104] In one embodiment, the user terminal is provided with at least one video frame buffer, the capacity of which is a single video frame. The video frame buffer corresponds to an integrated base station and only allows the corresponding integrated base station to perform overlay operations. For example, if a first video frame buffer corresponds to a source integrated base station, then the first video frame buffer only stores video frames from the video stream data packets fed back by the source integrated base station, and only allows the next video frame from the video stream data packets fed back by the source integrated base station to overlay the currently stored video frame in the video frame buffer. If a second video frame buffer corresponds to a target integrated base station, then the second video frame buffer only stores video frames from the video stream data packets fed back by the target integrated base station, and only allows the next video frame from the video stream data packets fed back by the target integrated base station to overlay the currently stored video frame in the video frame buffer.

[0105] Displaying the video stream on the user terminal specifically includes: selecting video frames from the target video frame buffer and displaying them on the user terminal.

[0106] In this embodiment, by limiting each buffer to storing only one video frame, it can be ensured that the order in which video frames are read is consistent with the order in which the video frames are generated, thereby avoiding the situation where out-of-order video frames are displayed on the user's end.

[0107] Furthermore, in order to avoid accumulating frame differences caused by network jitter in the video frame buffer, in one embodiment, before the integrated base station performs an overlay operation on the video frame buffer, the method further includes: determining the time difference between the video frames in the video stream data packets fed back by the integrated base station and the video frames in the video frame buffer, and determining that the time difference is less than a preset time threshold.

[0108] In this embodiment, the time difference between the video frames in the video stream data packets fed back by the integrated base station and the video frames in the video frame buffer is used to determine whether there is network jitter between them. Only when there is no network jitter is it allowed to perform an overlay operation on the video frame buffer, which can avoid the accumulation of frame differences caused by network jitter in the video frame buffer.

[0109] The ping-pong effect refers to the phenomenon where service migration is repeatedly performed in accordance with the above steps due to latency changes approaching a preset latency threshold. To avoid the ping-pong effect, based on any of the above embodiments, after switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes:

[0110] Within a preset time, the system continues to receive the first video stream data packet fed back from the source local data network, decodes the first video stream data packet, and obtains the video stream corresponding to the first video stream data packet.

[0111] If the preset time ends and the delay of the second user session is lower than the preset delay threshold, the reception of the first video stream data packet fed back by the source local data network is stopped, and the video stream corresponding to the first video stream data packet is released.

[0112] The preset time can be set to a specific time range according to the actual application conditions. For example, in order to save storage resources, the preset time range can be appropriately shortened.

[0113] For example, a countdown timer can be set on the user end. After the video stream switching is completed, the countdown timer is started. Before the countdown timer ends, the user continues to receive the first video stream data packet fed back from the source local data network, decodes the first video stream data packet, and obtains the video stream corresponding to the first video stream data packet.

[0114] Since the streaming media service status is the same in the source and target integrated base stations, the video stream data packets sent by the source and target integrated base stations to the user end meet the frame difference requirement. In this embodiment, after the video stream switching is completed, the first video stream data packet fed back by the source local data network is continued to be received and the first video stream data packet is decoded to obtain the video stream corresponding to the first video stream data packet. When the user moves back to the range of the source integrated base station, the latency of the user end can be kept at a relatively low level with a short downtime by simply performing video stream switching, thereby enhancing the user experience of using real-time rendering applications while moving.

[0115] In one embodiment, after the video stream switching is triggered within a preset time, the preset time is restarted.

[0116] Figure 2 This is the second flowchart illustrating the service migration method for real-time rendering applications provided by this invention, as shown below. Figure 2 As shown, this method is applied to an integrated base station, which includes a local data network that runs a streaming media service for a real-time rendering application on the user side, including:

[0117] Step 201: Based on the session establishment request notification sent by the user terminal to the core network of the 5G communication system, cooperate with the core network to establish a user session with the user terminal and a cloud session with the cloud.

[0118] Step 202: Determine the payload to be rendered in the control flow data packet sent by the user terminal through the user session;

[0119] Step 203: Obtain the first video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered and the status of the streaming media service in the local data network;

[0120] Step 204: Send the video stream data packet to the user terminal through the user session, and send the status of the streaming media service in the local data network to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network in the cloud after the latency of the user session exceeds a preset latency threshold.

[0121] The session establishment request also includes a service migration request sent by the user terminal to the core network of the 5G communication system after the delay of the first user session exceeds a preset delay threshold.

[0122] The payload to be rendered can be determined by the control flow data packets sent from the user client to the integrated base station through the user session, or by synchronizing the state of the streaming media service in the integrated base station with the global state of the streaming media service in the cloud.

[0123] Compared to real-time rendering on the edge cloud, the service migration method for real-time rendering applications provided in this embodiment of the invention establishes a user session with the user terminal and a cloud session with the cloud in response to a session establishment request notification sent by the user terminal to the core network of the 5G communication system. It then determines the payload to be rendered in the control flow data packet sent by the user terminal through the user session; obtains the first video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered; and sends the video stream data packet to the user terminal through the user session. This enables the control flow data packet sent by the user terminal to be directly offloaded within the integrated base station, avoiding the need to detour through the core network and return to the integrated base station. This saves the encapsulation and decapsulation processes required for data transmission between the integrated base station and the core network, reduces resource consumption, improves the utilization efficiency of computing resources, and achieves computing power optimization.

[0124] Furthermore, in this embodiment, the integrated base station can determine the payload to be rendered by synchronizing the state of the streaming media service in the integrated base station with the global state of the streaming media service in the cloud, obtain the first video stream data packet obtained by the streaming media service of the local data network for rendering the payload to be rendered, and send the video stream data packet to the user terminal through the user session. This makes it convenient for the user terminal to switch the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet when the service is migrated. The downtime is only the video stream switching time, which greatly reduces the downtime and improves the user experience.

[0125] Based on any of the above embodiments, before obtaining the first video stream data packet by the streaming media service of the local data network to perform rendering calculations on the payload to be rendered, the method further includes:

[0126] It was determined that the control flow data packet needed to be offloaded locally;

[0127] Extract the payload to be rendered from the control flow data packet and send the payload to be rendered to the streaming media service; extract the interaction information from the control flow data packet and pre-store it.

[0128] For example, such as Figure 3 As shown, the integrated base station may include a communication network and a local data network. The communication network may include a 5G base station central unit user plane (CU-UP) and an SDAP (Service Data Adaptation Protocol) module. The CU-UP module can receive and parse the first video stream data packet, and send the parsed first video stream data packet to the SDAP module to determine whether local offloading processing is required. If it is determined that the control flow data packet needs local offloading processing, the SDAP module can extract the payload to be rendered and forward it directly to the local data network, so that the streaming media service in the local data network can perform rendering calculations on the payload to be rendered. The communication network may also include a vUPF (Virtual User Plane Function) module. The SDAP module can extract the interaction information and forward it directly to the vUPF module to update the uplink traffic count statistics, so as to achieve fast response and avoid additional resource consumption due to detouring through the core network. Here, the interaction information refers to the information required for interaction with the core network control plane.

[0129] The communication network may also include a GTP-U module. If it is determined that the control flow data packet does not need to be offloaded locally, the SDAP module can send the parsed first video stream data packet to the GTP-U module for encapsulation, and then send the encapsulated data packet to the UPF (User Plane Function) of the core network for centralized processing.

[0130] Based on any of the above embodiments, after obtaining the first video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered, the method further includes:

[0131] Determine the payload to be displayed and the corresponding quality of service stream identifier in the first video stream data packet;

[0132] Based on the service quality flow identifier, the corresponding payload to be displayed is mapped to the corresponding service quality flow;

[0133] The quality of service flow is encapsulated, and the encapsulated quality of service flow is sent to the first user session through a specified interface.

[0134] For example, such as Figure 3As shown, the local data network can send the first video stream data packet obtained from rendering calculations to the vUPF module of the integrated base station's communication network. The vUPF module determines the payload to be displayed and the corresponding Quality of Service Flow Identifier (QFI), adds the QFI to the first video stream data packet, updates downlink traffic statistics, and directly sends the processed first video stream data packet to the SDAP module in the CU-UP module. The SDAP module parses the first video stream data packet to obtain the payload to be displayed and the corresponding QFI, maps different types of payloads to specific QoS flows based on the QFI, and then passes them to the Packet Data Convergence Protocol (PDCP) module for encryption, compression, and other encapsulation processing. The encapsulated QFI is then sent to the first user session via the 5G user plane data transmission (F1-U) interface for forwarding to the user terminal.

[0135] The service migration method for real-time rendering applications provided by this invention can update uplink and downlink traffic statistics through vUPF, perform real-time calculations on time and traffic data, and report resource usage and traffic status to the core network control plane under preset conditions, thereby ensuring the dynamic adjustment of traffic offloading strategies and the coordination of core network global resource management.

[0136] Furthermore, the service migration method for real-time rendering applications provided by this invention strictly follows the standard procedures defined by the Third Generation Partnership Project (3GPP), maintains consistency with the core network control plane, and ensures overall interoperability and scalability.

[0137] To illustrate the functionality of the service migration method for real-time rendering applications provided in this implementation, a specific example is given below.

[0138] A service migration method for a real-time rendering application includes starting the real-time rendering application on a user terminal, sending a session establishment request to the core network of a 5G communication system, the core network establishing a first user session between the user terminal and a source integrated base station based on the session establishment request, and establishing a first cloud session between the source integrated base station and the cloud.

[0139] The user terminal sends control flow data packets to the source integrated base station through the first user session;

[0140] The streaming media service of the source local data network in the source integrated base station performs rendering calculations on the payload to be rendered to obtain the first video stream data packet, and feeds back the first video stream data packet to the user terminal through the first user session;

[0141] The user terminal decodes the first video stream data packet to obtain the video stream corresponding to the first video stream data packet and displays it;

[0142] After the user's movement causes the delay of the first user session to exceed a preset delay threshold, the user terminal sends a service migration request to the core network of the 5G communication system. The core network determines the target integrated base station, establishes a second user session between the user terminal and the target integrated base station, and establishes a second cloud session between the target integrated base station and the cloud.

[0143] The target integrated base station restores the streaming media service of the real-time rendering application based on the global state in the cloud, performs rendering calculations to obtain the second video stream data packet, and feeds back the second video stream data packet to the user terminal through the second user session;

[0144] The user terminal determines that the frame difference between the video stream corresponding to the first video stream data packet and the video stream corresponding to the second video stream data packet is within a predetermined range, obtains the first latest video frame of the video stream corresponding to the first video stream data packet, and obtains the second latest video frame of the video stream corresponding to the second video stream data packet; performs a weighted linear combination process on the first latest video frame and the second latest video frame to generate a switching video frame; displays the switching video frame on the user terminal, and switches the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet.

[0145] The service migration apparatus for real-time rendering applications provided by the present invention is described below. The service migration apparatus for real-time rendering applications described below can be referred to in correspondence with the service migration method for real-time rendering applications described above.

[0146] Figure 4 This is one of the structural schematic diagrams of the service migration device for real-time rendering applications provided by the present invention, such as... Figure 4 As shown, this device is used at the user end and includes:

[0147] The request sending module is used to start the real-time rendering application and send a session establishment request to the core network of the 5G communication system, so that the core network can establish a first user session between the user terminal and the source integrated base station based on the session establishment request, and establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, and the source local data network runs the streaming media service of the real-time rendering application;

[0148] The control flow sending module is used to send control flow data packets to the source integrated base station through the first user session;

[0149] The video stream receiving module is used to receive the first video stream data packet fed back by the source integrated base station through the first user session, decode the first video stream data packet to obtain the video stream corresponding to the first video stream data packet and display it; the first video stream data packet is obtained by the streaming media service of the source local data network rendering the payload to be rendered.

[0150] The migration module is used to migrate the streaming media service based on the cloud after the latency of the first user session exceeds a preset latency threshold.

[0151] Based on any of the above embodiments, the core network is further configured to determine a target integrated base station after the latency of the first user session exceeds a preset latency threshold, establish a second user session between the user terminal and the target integrated base station, and establish a second cloud session between the target integrated base station and the cloud; the target integrated base station includes a target local data network, and the target local data network runs the streaming media service of the real-time rendering application;

[0152] The migration module is specifically used for:

[0153] Receive the second video stream data packet fed back by the target local data network, decode the second video stream data packet, and obtain the video stream corresponding to the second video stream data packet;

[0154] Switch the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet;

[0155] The cloud includes a global state, and the second video stream data packet is obtained by the target local network after restoring the streaming media service based on the global state and performing rendering calculations.

[0156] Based on any of the above embodiments, the service migration apparatus for real-time rendering applications further includes a frame difference determination module, used to determine that the frame difference between the video stream corresponding to the first video stream data packet and the video stream corresponding to the second video stream data packet is within a predetermined range.

[0157] Based on any of the above embodiments, the service migration apparatus for real-time rendering applications further includes a video stream switching and display module, used for:

[0158] Obtain the first latest video frame of the video stream corresponding to the first video stream data packet, and obtain the second latest video frame of the video stream corresponding to the second video stream data packet;

[0159] The first latest video frame and the second latest video frame are subjected to a weighted linear combination to generate a switching video frame;

[0160] The switched video frame is displayed on the user's device.

[0161] Based on any of the above embodiments, the service migration device for real-time rendering applications further includes a delayed release module, which is used to continue receiving the first video stream data packet fed back by the source local data network within a preset time, and to decode the first video stream data packet to obtain the video stream corresponding to the first video stream data packet.

[0162] If the preset time ends and the delay of the second user session is lower than the preset delay threshold, the reception of the first video stream data packet fed back by the source local data network is stopped, and the video stream corresponding to the first video stream data packet is released.

[0163] Figure 5 This is a second structural schematic diagram of the service migration device for real-time rendering applications provided by the present invention, as shown below. Figure 5 As shown, the device is applied to an integrated base station, which includes a local data network that runs a streaming media service for a real-time rendering application on the user side, including:

[0164] The session establishment module is used to cooperate with the core network to establish a user session with the user terminal and a cloud session with the cloud based on the session establishment request notification sent by the user terminal to the core network of the 5G communication system.

[0165] The control flow receiving module is used to determine the payload to be rendered in the control flow data packet sent by the user terminal through the user session;

[0166] The data acquisition module is used to acquire the first video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered and the status of the streaming media service in the local data network.

[0167] The data sending module is used to send the video stream data packet to the user terminal through the user session, and to send the status of the streaming media service in the local data network to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network in the cloud after the latency of the user session exceeds a preset latency threshold.

[0168] Based on any of the above embodiments, the service migration apparatus for real-time rendering applications further includes a local unloading module, used for:

[0169] It was determined that the control flow data packet needed to be offloaded locally;

[0170] Extract the payload to be rendered from the control flow data packet and send the payload to be rendered to the streaming media service; extract the interaction information from the control flow data packet and pre-store it.

[0171] Based on any of the above embodiments, the service migration apparatus for real-time rendering applications further includes a video stream processing module, used to determine the payload to be displayed and the corresponding quality of service stream identifier in the first video stream data packet.

[0172] Based on the service quality flow identifier, the corresponding payload to be displayed is mapped to the corresponding service quality flow;

[0173] The quality of service flow is encapsulated, and the encapsulated quality of service flow is sent to the first user session through a specified interface.

[0174] Figure 6 An example is a schematic diagram of the structure of an electronic device, such as... Figure 6 As shown, the electronic device may include: a processor 510, a communications interface 520, a memory 530, and a communications bus 540, wherein the processor 510, the communications interface 520, and the memory 530 communicate with each other through the communications bus 540. The processor 510 can call logical instructions in the memory 530 to execute a service migration method for a real-time rendering application. This method, applied to a user terminal, includes: starting the real-time rendering application; sending a session establishment request to the core network of the 5G communication system, so that the core network can establish a first user session between the user terminal and the source integrated base station based on the session establishment request; and establishing a first cloud session between the source integrated base station and the cloud. The source integrated base station includes a source local data network running the streaming media service of the real-time rendering application. The processor 510 sends control flow data packets to the source integrated base station through the first user session; receives a first video stream data packet fed back by the source integrated base station through the first user session; decodes the first video stream data packet to obtain and display the video stream corresponding to the first video stream data packet; the first video stream data packet is obtained by the streaming media service of the source local data network rendering the payload to be rendered; and migrating the streaming media service based on the cloud after the latency of the first user session exceeds a preset latency threshold.

[0175] Alternatively, it can be applied to an integrated base station, which includes a local data network running a streaming media service for real-time rendering applications on the user terminal. This includes: cooperating with the core network based on a session establishment request notification sent by the user terminal to the core network of the 5G communication system to establish a user session with the user terminal and a cloud session with the cloud; determining the payload to be rendered in the control flow data packets sent by the user terminal through the user session; obtaining a first video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered and the status of the streaming media service in the local data network; sending the video stream data packet to the user terminal through the user session and sending the status of the streaming media service in the local data network to the cloud through the cloud session, so that after the latency of the user session exceeds a preset latency threshold, the streaming media service is migrated based on the global status of the streaming media service in the local data network in the cloud.

[0176] Furthermore, the logical instructions in the aforementioned memory 530 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0177] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the service migration method for the real-time rendering application provided by the above methods. This method is applied to a user end and includes: starting the real-time rendering application; sending a session establishment request to the core network of the 5G communication system, so that the core network can establish a first user session between the user end and the source integrated base station based on the session establishment request, and establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, which runs the streaming media service of the real-time rendering application; sending control flow data packets to the source integrated base station through the first user session; receiving a first video stream data packet fed back by the source integrated base station through the first user session; decoding the first video stream data packet to obtain and display the video stream corresponding to the first video stream data packet; the first video stream data packet is obtained by the streaming media service of the source local data network rendering the payload to be rendered; and migrating the streaming media service based on the cloud after the latency of the first user session is higher than a preset latency threshold.

[0178] Alternatively, it can be applied to an integrated base station, which includes a local data network running a streaming media service for real-time rendering applications on the user terminal. This includes: cooperating with the core network based on a session establishment request notification sent by the user terminal to the core network of the 5G communication system to establish a user session with the user terminal and a cloud session with the cloud; determining the payload to be rendered in the control flow data packets sent by the user terminal through the user session; obtaining a first video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered and the status of the streaming media service in the local data network; sending the video stream data packet to the user terminal through the user session and sending the status of the streaming media service in the local data network to the cloud through the cloud session, so that after the latency of the user session exceeds a preset latency threshold, the streaming media service is migrated based on the global status of the streaming media service in the local data network in the cloud.

[0179] In another aspect, the present invention also provides a non-transitory computer-readable storage medium storing a computer program thereon. When executed by a processor, the computer program implements a service migration method for the real-time rendering application provided by the above methods. This method is applied to a user terminal and includes: starting the real-time rendering application; sending a session establishment request to the core network of a 5G communication system, so that the core network can establish a first user session between the user terminal and a source integrated base station based on the session establishment request, and establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, which runs a streaming media service of the real-time rendering application; sending control flow data packets to the source integrated base station through the first user session; receiving a first video stream data packet fed back by the source integrated base station through the first user session; decoding the first video stream data packet to obtain and display the video stream corresponding to the first video stream data packet; the first video stream data packet is obtained by the streaming media service of the source local data network rendering the payload to be rendered; and migrating the streaming media service based on the cloud after the latency of the first user session exceeds a preset latency threshold.

[0180] Alternatively, it can be applied to an integrated base station, which includes a local data network running a streaming media service for real-time rendering applications on the user terminal. This includes: cooperating with the core network based on a session establishment request notification sent by the user terminal to the core network of the 5G communication system to establish a user session with the user terminal and a cloud session with the cloud; determining the payload to be rendered in the control flow data packets sent by the user terminal through the user session; obtaining a first video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered and the status of the streaming media service in the local data network; sending the video stream data packet to the user terminal through the user session and sending the status of the streaming media service in the local data network to the cloud through the cloud session, so that after the latency of the user session exceeds a preset latency threshold, the streaming media service is migrated based on the global status of the streaming media service in the local data network in the cloud.

[0181] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0182] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0183] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for service migration of a real-time rendering application, characterized in that, Applied to the user end, including: The real-time rendering application is launched, and a session establishment request is sent to the core network of the 5G communication system, so that the core network can establish a first user session between the user terminal and the source integrated base station based on the session establishment request, and establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, and the source local data network runs the streaming media service of the real-time rendering application; Send control flow data packets to the source integrated base station through the first user session; The system receives a first video stream data packet fed back by the source integrated base station through the first user session, decodes the first video stream data packet to obtain the video stream corresponding to the first video stream data packet, and displays it; the first video stream data packet is obtained by the streaming media service of the source local data network to render the payload. If the latency of the first user session exceeds a preset latency threshold, the streaming media service is migrated based on the cloud. The core network is also used to determine a target integrated base station after the latency of the first user session exceeds a preset latency threshold, establish a second user session between the user terminal and the target integrated base station, and establish a second cloud session between the target integrated base station and the cloud; the target integrated base station includes a target local data network, and the target local data network runs the streaming media service of the real-time rendering application; Migrating the streaming media service based on the cloud specifically includes: Receive the second video stream data packet fed back by the target local data network, decode the second video stream data packet, and obtain the video stream corresponding to the second video stream data packet; Switch the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet; The cloud includes a global state, and the second video stream data packet is obtained by the target local data network after restoring the streaming media service based on the global state and performing rendering calculations. The integrated base station includes a communication network and a local data network. The communication network includes a 5G base station central unit user plane and a vUPF module. The 5G base station central unit user plane includes an SDAP module. The user plane of the central unit of the 5G base station is used to receive and parse control flow data packets, and send the parsed control flow data packets to the SDAP module. The SDAP module is used to determine whether local offloading is required, and if it is determined that the control flow data packet needs to be offloaded locally, it extracts the payload to be rendered and forwards it directly to the local data network. And extract the information required for interaction with the core network control plane from the parsed control flow data packet and forward it directly to the vUPF module; The vUPF module is used to update the uplink traffic count statistics.

2. The service migration method of real-time rendering application according to claim 1, wherein, Before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: The frame difference between the video stream corresponding to the first video stream data packet and the video stream corresponding to the second video stream data packet is determined to be within a predetermined range.

3. The service migration method of real-time rendering application according to claim 2, wherein, Before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: Obtain the first latest video frame of the video stream corresponding to the first video stream data packet, and obtain the second latest video frame of the video stream corresponding to the second video stream data packet; The first latest video frame and the second latest video frame are subjected to a weighted linear combination to generate a switching video frame; The switched video frame is displayed on the user's device.

4. The service migration method for real-time rendering applications according to claim 1, characterized in that, After switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: Within a preset time, the system continues to receive the first video stream data packet fed back from the source local data network, decodes the first video stream data packet, and obtains the video stream corresponding to the first video stream data packet. If the preset time ends and the delay of the second user session is lower than the preset delay threshold, the reception of the first video stream data packet fed back by the source local data network is stopped, and the video stream corresponding to the first video stream data packet is released.

5. A service migration method for a real-time rendering application, characterized in that, Applied to an integrated base station, the integrated base station including a local data network, the local data network running a streaming media service for a real-time rendering application on the user side, including: Based on the session establishment request notification sent by the user terminal to the core network of the 5G communication system, the core network cooperates with the user terminal to establish a user session and a cloud session with the cloud. Determine the payload to be rendered in the control flow data packets sent by the user client through the user session; Obtain the video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered and the status of the streaming media service in the local data network; The video stream data packet is sent to the user terminal through the user session, and the status of the streaming media service in the local data network is sent to the cloud through the cloud session, so that the streaming media service is migrated based on the global status of the streaming media service in the local data network in the cloud after the latency of the user session is higher than a preset latency threshold. The integrated base station includes a communication network and a local data network. The communication network includes a 5G base station central unit user plane and a vUPF module. The 5G base station central unit user plane includes an SDAP module. The user plane of the central unit of the 5G base station is used to receive and parse control flow data packets, and send the parsed control flow data packets to the SDAP module. The SDAP module is used to determine whether local offloading is required, and if it is determined that the control flow data packet needs to be offloaded locally, it extracts the payload to be rendered and forwards it directly to the local data network. And extract the information required for interaction with the core network control plane from the parsed control flow data packet and forward it directly to the vUPF module; The vUPF module is used to update the uplink traffic count statistics.

6. The service migration method for a real-time rendering application according to claim 5, characterized in that, After obtaining the video stream data packet obtained by the streaming media service of the local data network rendering the payload to be rendered, the method further includes: Determine the payload to be displayed and the corresponding quality of service stream identifier in the video stream data packet; Based on the service quality flow identifier, the corresponding payload to be displayed is mapped to the corresponding service quality flow; The quality of service flow is encapsulated, and the encapsulated quality of service flow is sent to the user session through a specified interface.

7. A service migration apparatus for a real-time rendering application, characterized in that, Applied to the user end, including: The request sending module is used to start the real-time rendering application and send a session establishment request to the core network of the 5G communication system, so that the core network can establish a first user session between the user terminal and the source integrated base station based on the session establishment request, and establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, and the source local data network runs the streaming media service of the real-time rendering application; The control flow sending module is used to send control flow data packets to the source integrated base station through the first user session; The video stream receiving module is used to receive the first video stream data packet fed back by the source integrated base station through the first user session, decode the first video stream data packet to obtain the video stream corresponding to the first video stream data packet and display it; the first video stream data packet is obtained by rendering the payload to be rendered by the streaming media service of the source local data network. The migration module is used to migrate the streaming media service based on the cloud after the latency of the first user session exceeds a preset latency threshold. The core network is also used to determine a target integrated base station after the latency of the first user session exceeds a preset latency threshold, establish a second user session between the user terminal and the target integrated base station, and establish a second cloud session between the target integrated base station and the cloud; the target integrated base station includes a target local data network, and the target local data network runs the streaming media service of the real-time rendering application; The migration module is specifically used for: Receive the second video stream data packet fed back by the target local data network, decode the second video stream data packet, and obtain the video stream corresponding to the second video stream data packet; Switch the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet; The cloud includes a global state, and the second video stream data packet is obtained by the target local data network after restoring the streaming media service based on the global state and performing rendering calculations. The integrated base station includes a communication network and a local data network. The communication network includes a 5G base station central unit user plane and a vUPF module. The 5G base station central unit user plane includes an SDAP module. The user plane of the central unit of the 5G base station is used to receive and parse control flow data packets, and send the parsed control flow data packets to the SDAP module. The SDAP module is used to determine whether local offloading is required, and if it is determined that the control flow data packet needs to be offloaded locally, it extracts the payload to be rendered and forwards it directly to the local data network. And extract the information required for interaction with the core network control plane from the parsed control flow data packet and forward it directly to the vUPF module; The vUPF module is used to update the uplink traffic count statistics.

8. A service migration apparatus for a real-time rendering application, characterized in that, Applied to an integrated base station, the integrated base station including a local data network, the local data network running a streaming media service for a real-time rendering application on the user side, including: The session establishment module is used to cooperate with the core network to establish a user session with the user terminal and a cloud session with the cloud based on the session establishment request notification sent by the user terminal to the core network of the 5G communication system. The control flow receiving module is used to determine the payload to be rendered in the control flow data packet sent by the user terminal through the user session; The data acquisition module is used to acquire the video stream data packets obtained by the streaming media service of the local data network rendering the payload to be rendered and the status of the streaming media service in the local data network. The data sending module is used to send the video stream data packet to the user terminal through the user session, and to send the status of the streaming media service in the local data network to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network in the cloud after the latency of the user session is higher than a preset latency threshold. The integrated base station includes a communication network and a local data network. The communication network includes a 5G base station central unit user plane and a vUPF module. The 5G base station central unit user plane includes an SDAP module. The user plane of the central unit of the 5G base station is used to receive and parse control flow data packets, and send the parsed control flow data packets to the SDAP module. The SDAP module is used to determine whether local offloading is required, and if it is determined that the control flow data packet needs to be offloaded locally, it extracts the payload to be rendered and forwards it directly to the local data network. And extract the information required for interaction with the core network control plane from the parsed control flow data packet and forward it directly to the vUPF module; The vUPF module is used to update the uplink traffic count statistics.

Images