Service migration method and device for rendering application program in real time

Abstract

The invention provides a service migration method and device for a real-time rendering application program, and relates to the technical field of communication, and the method is applied to a user side, and comprises the steps: starting the real-time rendering application program, and sending a session establishment request to a core network in a 5G communication system, so as to establish a first user session between the user side and a source integrated base station, establishing a first cloud session between the source integrated base station and the cloud; the source integrated base station comprises a source local data network, and the source local data network runs a streaming media service of a real-time rendering application program; sending a control flow data packet to the source integrated base station through the first user session; receiving a first video stream data packet fed back by the source integrated base station through the first user session, decoding the first video stream data packet to obtain a video stream corresponding to the first video stream data packet, and displaying the video stream; and after the delay of the first user session is higher than a preset delay threshold, migrating the streaming media service based on the cloud.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a service migration method and device for a real-time rendering application program. Background Art

[0002] There are many types of rendering. Real-time rendering refers to a rendering solution that responds to user input for rendering and output display in a short period of time, and pays more attention to the real-time and interactivity of rendering. Due to the real-time characteristics of real-time rendering, real-time rendering has relatively high configuration requirements for user devices. In order to reduce the configuration requirements for user devices, cloud-based real-time rendering has gradually developed. Cloud-based real-time rendering is a rendering solution that moves the rendering module to the cloud and transmits the rendered image to the user device for output display.

[0003] Real-time rendering in the cloud generally requires connecting the cloud to the user end through a base station. If the distance between the user end and the cloud is too long, it will cause high latency and reduce user experience. At present, an edge cloud is generally set up close to the user end, and the edge cloud and the user end are connected through a base station, and real-time rendering is performed on the edge cloud. However, the requirement for low latency limits the coverage of the edge cloud that provides real-time rendering, and service migration is required after the user moves out of the coverage of the edge cloud. And after the user end sends the data packet to the base station, the base station is generally required to encapsulate the data packet through the user plane of the general packet tunneling protocol to obtain a tunnel transmission packet, and send the tunnel transmission packet to the user plane function (UPF) in the core network of the 5G communication system for decapsulation to obtain a data packet, and then forward the data packet to the edge cloud for rendering calculation processing. Summary of the invention

[0004] The present invention provides a service migration method and device for a real-time rendering application program, which can improve the utilization efficiency of computing resources and achieve computing power optimization.

[0005] The present invention provides a service migration method for a real-time rendering application program, which is applied to a user end and includes: Starting the real-time rendering application, sending a session establishment request to a core network in a 5G communication system, so that the core network is used to establish a first user session between the user terminal and a source integrated base station based on the session establishment request, and to establish a first cloud session between the source integrated base station and a cloud; the source integrated base station includes a source local data network, and the source local data network runs a streaming media service of the real-time rendering application; Sending a control flow data packet to the source integrated base station through the first user session; Receive a first video stream data packet fed back by the source integrated base station through the first user session, decode the first video stream data packet, obtain a video stream corresponding to the first video stream data packet and display it; the first video stream data packet is obtained by rendering and calculating the load to be rendered by the streaming media service of the source local data network; After the delay of the first user session is higher than a preset delay threshold, the streaming media service is migrated based on the cloud.

[0006] According to a service migration method for a real-time rendering application provided by the present invention, the core network is also used to determine a target integrated base station after the delay of the first user session is higher than a preset delay threshold, establish a second user session between the user terminal and the target integrated base station, and establish a second cloud session between the target integrated base station and the cloud; the target integrated base station includes a target local data network, and the target local data network runs a streaming media service of the real-time rendering application; Migrating the streaming media service based on the cloud specifically includes: receiving a second video stream data packet fed back by the target local data network, decoding the second video stream data packet, and obtaining a video stream corresponding to the second video stream data packet; Switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet; The cloud includes a global state, and the second video stream data packet is obtained by rendering and calculating after the target local network restores the streaming media service according to the global state.

[0007] According to a service migration method for a real-time rendering application provided by the present invention, before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: Determine whether a frame difference between a video stream corresponding to the first video stream data packet and a video stream corresponding to the second video stream data packet is within a predetermined range.

[0008] According to a service migration method for a real-time rendering application provided by the present invention, before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: Obtain a first latest video frame of a video stream corresponding to the first video stream data packet, and obtain a second latest video frame of a video stream corresponding to the second video stream data packet; Performing weighted linear combination processing on the first latest video frame and the second latest video frame to generate a switching video frame; The switching video frame is displayed on the user terminal.

[0009] According to a service migration method for a real-time rendering application provided by the present invention, after switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: Continue to receive the first video stream data packet fed back by the source local data network within a preset time, decode the first video stream data packet, and obtain a video stream corresponding to the first video stream data packet; When the preset time expires and the delay of the second user session is lower than the preset delay threshold, stop receiving the first video stream data packet fed back by the source local data network, and release the video stream corresponding to the first video stream data packet.

[0010] The present invention provides a service migration method for a real-time rendering application, which is applied to an integrated base station, wherein the integrated base station includes a local data network, and the local data network runs a streaming media service of a user-side real-time rendering application, including: Cooperating with the core network to establish a user session with the user terminal and a cloud session with the cloud based on a session establishment request notification sent by the user terminal to the core network in the 5G communication system; Determine a payload to be rendered in a control stream data packet sent by the client through the first user session; Obtaining a first video stream data packet obtained by performing rendering calculation on the load to be rendered by the streaming media service of the local data network and a state of the streaming media service in the local data network; The video stream data packet is sent to the user terminal through the user session, and the status of the streaming media service in the local data network is sent to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network of the cloud after the delay of the user session is higher than a preset delay threshold.

[0011] According to a service migration method for a real-time rendering application provided by the present invention, before obtaining the streaming media service of the local data network to perform rendering calculation on the load to be rendered to obtain a first video stream data packet, the method further includes: Determining that the control flow data packet needs to be locally unloaded; Extracting the payload to be rendered from the control stream data packet, and sending the payload to be rendered to the streaming media service; extracting the interaction information from the control stream data packet for pre-storage.

[0012] According to a service migration method for a real-time rendering application provided by the present invention, after obtaining a first video stream data packet obtained by the streaming media service of the local data network performing rendering calculation on the load to be rendered, the method further includes: Determine a payload to be displayed and a corresponding quality of service flow identifier in the first video stream data packet; Mapping the corresponding to-be-displayed load to the corresponding quality of service flow based on the quality of service flow identifier; The quality of service flow is encapsulated and sent to the first user session through a designated interface.

[0013] The present invention also provides a service migration device for real-time rendering application program, which is applied to a user end and includes: Starting the real-time rendering application, sending a session establishment request to a core network in a 5G communication system, so that the core network is used to establish a first user session between the user terminal and a source integrated base station based on the session establishment request, and to establish a first cloud session between the source integrated base station and a cloud; the source integrated base station includes a source local data network, and the source local data network runs a streaming media service of the real-time rendering application; Sending a control flow data packet to the source integrated base station through the first user session; Receive a first video stream data packet fed back by the source integrated base station through the first user session, decode the first video stream data packet, obtain a video stream corresponding to the first video stream data packet and display it; the first video stream data packet is obtained by rendering and calculating the load to be rendered by the streaming media service of the source local data network; After the delay of the first user session is higher than a preset delay threshold, the streaming media service is migrated based on the cloud.

[0014] The present invention also provides a service migration device for a real-time rendering application, which is applied to an integrated base station, wherein the integrated base station includes a local data network, and the local data network runs a streaming media service of a user-side real-time rendering application, including: Cooperating with the core network to establish a user session with the user terminal and a cloud session with the cloud based on a session establishment request notification sent by the user terminal to the core network in the 5G communication system; Determining a payload to be rendered in a control stream data packet sent by the client through the user session; Obtaining a first video stream data packet obtained by performing rendering calculation on the load to be rendered by the streaming media service of the local data network and a state of the streaming media service in the local data network; The video stream data packet is sent to the user terminal through the user session, and the status of the streaming media service in the local data network is sent to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network of the cloud after the delay of the user session is higher than a preset delay threshold.

[0015] Compared with real-time rendering on the edge cloud, the service migration method and device of the real-time rendering application provided by the present invention start the real-time rendering application, send a session establishment request to the core network in the 5G communication system to establish a first user session between the user terminal and the source integrated base station, establish a first cloud session between the source integrated base station and the cloud, send a control stream data packet to the source integrated base station through the first user session, receive a first video stream data packet fed back by the source integrated base station, and migrate the streaming media service based on the cloud after the delay of the first user session is higher than a preset delay threshold, wherein the source integrated base station includes a source local data network, and the source local data network runs the streaming media service of the real-time rendering application. The streaming media service can perform rendering calculations on the load to be rendered in the control stream data packet to obtain the first video stream data packet, which can improve the utilization efficiency of computing resources and achieve computing power optimization. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 This is one of the flow charts of the service migration method of the real-time rendering application provided by the present invention.

[0018] Figure 2 This is the second flow chart of the service migration method of the real-time rendering application provided by the present invention.

[0019] Figure 3 It is a schematic diagram of a framework for integrating base station unloading in the service migration method of the real-time rendering application provided by the present invention.

[0020] Figure 4 This is one of the structural schematic diagrams of the service migration device for real-time rendering application provided by the present invention.

[0021] Figure 5 This is the second structural schematic diagram of the service migration device for real-time rendering application provided by the present invention.

[0022] Figure 6 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0024] In the case of real-time rendering on the edge cloud, the base station needs to encapsulate the data uploaded by the user end through the user plane of the general packet tunneling protocol, decapsulate the data through the user plane function in the core network of the 5G communication system, and then send the decapsulated data packets to the edge cloud for rendering calculation processing. This process requires continuous consumption of computing resources. Figure 1-Figure 5 The present invention describes a service migration method and device for a real-time rendering application program.

[0025] Figure 1 is one of the flow charts of the service migration method of the real-time rendering application provided by the present invention, such as Figure 1 As shown, the method is applied to a user terminal, comprising: Step 101: Start the real-time rendering application and send a session establishment request to the core network in the 5G communication system, so that the core network is used to establish a first user session between the user terminal and the source integrated base station based on the session establishment request, and establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, and the source local data network runs the streaming media service of the real-time rendering application.

[0026] The user end, also known as user equipment (UE), refers to a node representing a user in a 5G communication system. It can be understood that in this embodiment, the source integrated base station and the cloud are also nodes in the 5G communication system.

[0027] 5G (5th Generation Mobile Communication Technology) communication system refers to the fifth generation communication system. The core network is the core part of the 5G network, which is used for core functions such as user authentication, network access control, mobility management, and Quality of Service (QoS) control.

[0028] Real-time rendering applications refer to applications that use real-time rendering technology, such as cloud games, cloud virtual reality, and cloud augmented reality. Real-time rendering refers to the rendering method in which an application generates images and animations instantly based on user input after receiving user input. In this embodiment, the real-time rendering type is similar to real-time cloud rendering. The rendering work is completed in the integrated base station. The real-time rendering application at the user end receives the rendered picture and sound data returned by the integrated base station in the form of a data stream for display.

[0029] The source integrated base station refers to the integrated base station that currently establishes the first user session with the user terminal, and the real-time rendering application of the user terminal displays images to the user based on the video stream data packets fed back by the source integrated base station. It can be understood that the integrated base station also includes a communication network to achieve communication between the integrated base station and the user terminal. A session refers to a logical connection between two nodes in a 5G communication system for transmitting data.

[0030] Exemplarily, the real-time rendering application may include a global logic module, a rendering module, and a front-end module. After the user end starts the front-end module of the real-time rendering application according to the user input, a session establishment request may be sent to the core network in the 5G communication system, a first user session may be established between the user end and the source integrated base station running the rendering module of the real-time rendering application, and a first cloud session may be established between the user end and the cloud running the full set of logic modules of the real-time rendering application. The rendering module may be a streaming media service in the source local data network of the source integrated base station.

[0031] Step 102: Send a control flow data packet to the source integrated base station through the first user session.

[0032] A control flow data packet refers to a data packet obtained by encapsulating control flow data. A control flow refers to a data stream that represents the order of data flow during the interaction between a user and a real-time rendering application.

[0033] Exemplarily, the first user session is a PDU session (Protocol Data Unit Session), and the real-time rendering application at the user end can obtain user input based on the input encoder to generate a control stream data packet, and send the control stream data packet to the source integrated base station through the PDU session.

[0034] Step 103: receive the first video stream data packet fed back by the source integrated base station through the first user session, decode the first video stream data packet, obtain the video stream corresponding to the first video stream data packet and display it; the first video stream data packet is obtained by rendering and calculating the load to be rendered by the streaming media service of the source local data network.

[0035] The local data network refers to the data network in the integrated base station, and the source local data network refers to the data network in the source integrated base station. The data network (DN) refers to the target network that carries user data in the 5G communication system and is the interface between user data and external services. For example, the data network can be the Internet, an enterprise internal network, a cloud service platform, etc.

[0036] Video stream data packets refer to data packets obtained by encapsulating video stream data. Video stream refers to the data stream obtained by rendering images on the source local data network according to the payload to be rendered in the control stream. The payload to be rendered can be an HTTP request or video data, etc.

[0037] Exemplarily, a real-time rendering application at the user end may receive a first video stream data packet fed back from a source local data network based on a PDU session, obtain first video stream data from the first video stream data packet through a video decoder, and display the first video stream data to the user frame by frame.

[0038] Step 104: After the delay of the first user session is higher than a preset delay threshold, migrate the streaming media service based on the cloud.

[0039] After the delay of the first user session is higher than a preset delay threshold, it is determined that the quality of service (QoS) will deteriorate due to the increased delay, thereby reducing the user experience, and the streaming media service of the real-time rendering application needs to be migrated.

[0040] It is understandable that the preset delay threshold can be set according to user experience requirements. If you want to present a better user experience, you can appropriately lower the preset delay threshold. If you want to reduce application costs, you can appropriately increase the preset delay threshold. The specific preset delay threshold value can be determined according to on-site working conditions.

[0041] Compared with real-time rendering on the edge cloud, the service migration method of the real-time rendering application provided by the embodiment of the present invention starts the real-time rendering application, sends a session establishment request to the core network in the 5G communication system to establish a first user session between the user terminal and the source integrated base station, establishes a first cloud session between the source integrated base station and the cloud, sends a control stream data packet to the source integrated base station through the first user session, receives a first video stream data packet fed back by the source integrated base station, and migrates the streaming media service based on the cloud after the delay of the first user session is higher than a preset delay threshold, wherein the source integrated base station includes a source local data network, and the source local data network runs the streaming media service of the real-time rendering application. The streaming media service can perform rendering calculations on the load to be rendered in the control stream data packet to obtain the first video stream data packet, which can improve the utilization efficiency of computing resources and achieve computing power optimization.

[0042] Based on the above embodiment, the core network is also used to determine the target integrated base station after the delay of the first user session is higher than a preset delay threshold, establish a second user session between the user terminal and the target integrated base station, and establish a second cloud session between the target integrated base station and the cloud; the target integrated base station includes a target local data network, and the target local data network runs the streaming media service of the real-time rendering application.

[0043] The target integrated base station refers to the integrated base station that currently establishes a second user session with the user terminal, and the streaming media service of the real-time rendering application is migrated from the source integrated base station to the target integrated base station. After the migration is completed, the real-time rendering application of the user terminal displays images to the user based on the video stream data packets fed back by the target integrated base station.

[0044] Exemplarily, after the delay of the first user session is higher than a preset delay threshold, the user terminal may send a service migration request to the migration manager of the core network. After receiving the service migration request sent by the user terminal, the migration manager may determine the target integrated base station based on the delay between the user terminal and its nearby integrated base stations to establish a second user session between the user terminal and the target integrated base station, and a second cloud session between the target integrated base station and the cloud.

[0045] In addition, while the source integrated base station feeds back the first video stream data packet to the user end, it sends the status of the streaming media service of the real-time rendering application in the source local data network to the remote end through the first cloud session, so that after the streaming media service of the real-time rendering application is run in the source local data network of the target integrated base station, the status synchronization is performed based on the status of the streaming media service of the real-time rendering application in the source local data network.

[0046] Migrating the streaming media service based on the cloud specifically includes: receiving a second video stream data packet fed back by the target local data network, decoding the second video stream data packet, and obtaining a video stream corresponding to the second video stream data packet; Switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet; The cloud includes a global state, and the second video stream data packet is obtained by rendering and calculating after the target local network restores the streaming media service according to the global state.

[0047] The target local data network refers to a data network in the target integrated base station. The global state includes a state of a streaming media service for real-time rendering applications in the source local data network and a state of a streaming media service for real-time rendering applications in the target local data network.

[0048] Exemplarily, the target integrated base station sends a video stream data packet to the user terminal. When the user terminal simultaneously receives the first video stream data packet and the second video stream data packet, based on the difference between the state of the streaming media service for the real-time rendering application in the source local data network and the state of the streaming media service for the real-time rendering application in the target local data network, the user terminal synchronizes the state of the streaming media service for the real-time rendering application in the source local data network of the target integrated base station. Then, the video stream displayed on the user terminal can be switched to the video stream corresponding to the second video stream data packet by updating the stream selector configuration.

[0049] At present, in the process of migrating the streaming media service of the source edge cloud to the target edge cloud, the real-time rendering application involves a large amount of data transmission. During the migration process, the streaming media service is frozen and causes downtime. The downtime can only end after the migration is completed and the streaming media service is enabled. In this embodiment, by simultaneously receiving the video stream data sent by the target integrated base station and the source integrated base station at the user end, based on the state of the streaming media service of the real-time rendering application in the source local data network, the state of the streaming media service running the real-time rendering application in the source local data network of the target integrated base station is synchronized, and the video stream displayed on the user end is switched to the video stream corresponding to the second video stream data packet. The downtime time is only the video stream switching time, which greatly reduces the downtime and can improve the user experience.

[0050] During the downtime, since the two video streams are rendered independently, frame flickering may occur during the video stream switching process. In order to solve this problem, based on any of the above embodiments, before switching the video stream displayed on the user end to the video stream corresponding to the second video stream data packet, the method also includes: determining that the frame difference between the video stream corresponding to the first video stream data packet and the video stream corresponding to the second video stream data packet is within a predetermined range.

[0051] Frame difference refers to the difference in pixel values ​​between the last frame of the first video stream data and the first frame of the second video stream data displayed by the user end during the video stream switching process. The predetermined range refers to the frame difference range that can avoid frame flickering caused by video stream switching. In actual application, the specific predetermined range can be set by yourself to provide different fault tolerance rates.

[0052] Specifically, in one embodiment, determining that a frame difference between a video stream corresponding to the first video stream data packet and a video stream corresponding to the second video stream data packet is within a predetermined range specifically includes: Determine the structural similarity between each frame image in the video stream corresponding to the first video stream data packet and each frame image in the video stream corresponding to the second video stream data packet; It is determined that the structural similarity is within a predetermined range.

[0053] Structural similarity refers to a parameter that characterizes the similarity between two video frames from the perspective of the human visual system's perception of image structural information. For example, structural similarity may include brightness, contrast, and structural information, and structural information may include the arrangement of objects and textures in the image.

[0054] For example, the correspondence between each frame image in the video stream corresponding to the first video stream data packet and each frame image in the video stream corresponding to the second video stream data packet can be determined based on the mean square error, and then the average brightness difference, average contrast difference and structural information difference between the two corresponding frames of images are determined to determine whether the structural similarity between the two corresponding frames of images is within a predetermined range. The predetermined range can be set to a specific predetermined range in actual application to provide different fault tolerance rates.

[0055] Based on any of the above embodiments, before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: Obtain a first latest video frame of a video stream corresponding to the first video stream data packet, and obtain a second latest video frame of a video stream corresponding to the second video stream data packet; Performing weighted linear combination processing on the first latest video frame and the second latest video frame to generate a switching video frame; The switching video frame is displayed on the user terminal.

[0056] The latest video frame is the video frame that the video stream will display on the user end. During the video stream switching process, the first latest video frame refers to the video frame in the video stream corresponding to the first video stream data packet that will be displayed on the user end if the video stream switching is not performed. The second latest video frame refers to the video frame in the video stream corresponding to the second video stream data packet that will be displayed on the user end after the video stream switching is performed.

[0057] Exemplarily, the weighted linear combination processing may be performed on the first latest video frame and the second latest video frame according to the following formula: F_out=αF_1+βF_2 α=min(n / N,1) β = max(1-n / N, 0) Among them, F_out is the switching video frame, F_1 ​​is the second latest video frame, F_2 is the first latest video frame, N (N=1, 2, 3...) is the size of the sliding window, and n (n=0, 1, 2, 3...) is the sliding number of the video frame.

[0058] The size of the sliding window refers to the video stream switching completed within N frames. When N=1, it means no smoothing measures are taken and the video stream is switched directly. When N is greater than 1, it means there is a smoothing mechanism, and the specific value can be set based on the specific differences in the picture changes. For example, N can be set to 12.

[0059] In this embodiment, a switching video frame is generated by performing weighted linear combination processing on the first latest video frame and the second latest video frame, and the switching video frame is displayed on the user end. Then, the video frame in the video stream corresponding to the second video stream data packet is displayed. This can smoothly switch the video stream corresponding to the first video stream data packet to the video stream corresponding to the second video stream data packet, thereby reducing the risk of frame flickering.

[0060] In one embodiment, the user terminal is provided with at least one video frame buffer, the capacity of the video frame buffer is a single-frame video frame, the video frame buffer corresponds to the integrated base station, and only the corresponding integrated base station is allowed to perform an overlay operation; for example, the first video frame buffer corresponds to the source integrated base station, then the first video frame buffer only stores the video frames in the video stream data packet fed back by the source integrated base station, and only the next video frame in the video stream data packet fed back by the source integrated base station is allowed to overwrite the video frame currently stored in the video frame buffer; the second video frame buffer corresponds to the target integrated base station, then the second video frame buffer only stores the video frames in the video stream data packet fed back by the target integrated base station, and only the next video frame in the video stream data packet fed back by the target integrated base station is allowed to overwrite the video frame currently stored in the video frame buffer.

[0061] Displaying the video stream on the user terminal specifically includes: selecting a video frame from a target video frame buffer and displaying it on the user terminal.

[0062] In this embodiment, by limiting each buffer to store only one video frame, it can be ensured that the order of selecting and reading video frames is consistent with the order of generating video frames, thereby avoiding the situation where the user terminal displays out-of-order video frames. Furthermore, in order to avoid accumulation of frame differences caused by network jitter in the video frame buffer, in one embodiment, before the integrated base station performs an overwrite operation on the video frame buffer, the method also includes: determining the time difference between the video frame in the video stream data packet fed back by the integrated base station and the video frame in the video frame buffer, and determining that the time difference is less than a preset time threshold.

[0063] In this embodiment, by integrating the time difference between the video frame in the video stream data packet fed back by the base station and the video frame in the video frame buffer, it is determined whether there is network jitter between the two. Only when there is no network jitter, the overwriting operation on the video frame buffer is allowed to avoid the accumulation of frame differences caused by network jitter in the video frame buffer.

[0064] The ping-pong effect refers to a phenomenon in which the above steps are repeatedly performed to migrate services due to a delay variation approaching a preset delay threshold. To avoid the ping-pong effect, based on any of the above embodiments, after the video stream displayed on the user terminal is switched to the video stream corresponding to the second video stream data packet, the method further includes: Continue to receive the first video stream data packet fed back by the source local data network within a preset time, decode the first video stream data packet, and obtain a video stream corresponding to the first video stream data packet; When the preset time expires and the delay of the second user session is lower than the preset delay threshold, stop receiving the first video stream data packet fed back by the source local data network, and release the video stream corresponding to the first video stream data packet.

[0065] The preset time can be set to a specific time range according to the actual application conditions. For example, in order to save storage resources, the time range of the preset time can be appropriately shortened.

[0066] Exemplarily, a countdown timer can be set at the user end. After completing the video stream switching, the countdown timer is started. Before the countdown timer ends, the first video stream data packet fed back by the source local data network continues to be received, the first video stream data packet is decoded, and the video stream corresponding to the first video stream data packet is obtained.

[0067] Since the status of the streaming media service in the source integrated base station and the target integrated base station is the same, the video stream data packets sent by the source integrated base station and the target integrated base station to the user terminal meet the frame difference requirement. In this embodiment, by continuing to receive the first video stream data packet fed back by the source local data network after completing the video stream switching, the first video stream data packet is decoded to obtain the video stream corresponding to the first video stream data packet. When the user moves back to the range of the source integrated base station, only by performing video stream switching, the delay of the user terminal can be kept at a relatively low state when the downtime is short, thereby enhancing the user experience of using real-time rendering applications while on the move.

[0068] In one embodiment, after the video stream switching is triggered within the preset time, the preset time is counted again.

[0069] Figure 2 FIG. 2 is a flow chart of the service migration method of the real-time rendering application provided by the present invention. Figure 2 As shown, the method is applied to an integrated base station, the integrated base station includes a local data network, the local data network runs a streaming media service of a user-side real-time rendering application, including: Step 201: Based on the session establishment request notification sent by the user terminal to the core network in the 5G communication system, the core network is cooperated to establish a user session with the user terminal and a cloud session with the cloud; Step 202: Determine the payload to be rendered in the control stream data packet sent by the user terminal through the user session; Step 203: Obtain a first video stream data packet obtained by performing rendering calculation on the to-be-rendered load by the streaming media service of the local data network and a state of the streaming media service in the local data network; Step 204: Send the video stream data packet to the user terminal through the user session, and send the status of the streaming media service in the local data network to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network of the cloud after the delay of the user session is higher than a preset delay threshold.

[0070] The session establishment request also includes a service migration request sent by the user terminal to the core network in the service migration request 5G communication system after the delay of the first user session exceeds a preset delay threshold.

[0071] The load to be rendered may be determined by a control stream data packet sent by the user end to the integrated base station through a user session, or by synchronizing the state of the streaming media service in the integrated base station through the global state of the streaming media service in the cloud.

[0072] Compared with real-time rendering on the edge cloud, the service migration method of the real-time rendering application provided by the embodiment of the present invention establishes a user session with the user terminal and a cloud session with the cloud by responding to the session establishment request notification sent by the user terminal to the core network in the 5G communication system, and determines the load to be rendered in the control stream data packet sent by the user terminal through the user session; obtains the first video stream data packet obtained by rendering the load to be rendered by the streaming media service of the local data network, and sends the video stream data packet to the user terminal through the user session, thereby realizing direct unloading of the control stream data packet sent by the user terminal in the integrated base station, avoiding the situation of detouring through the core network and then returning to the integrated base station, saving the encapsulation and decapsulation process required for data transmission between the integrated base station and the core network, reducing resource occupation, and being able to improve the utilization efficiency of computing resources and realize computing power optimization.

[0073] Moreover, in the present embodiment, the integrated base station can synchronize the status of the streaming media service in the integrated base station through the global status of the streaming media service in the cloud to determine the load to be rendered, obtain the first video stream data packet obtained by rendering and calculating the load to be rendered by the streaming media service of the local data network, and send the video stream data packet to the user terminal through the user session. This enables the user terminal to switch only the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet when the service is migrated, and the downtime is only the video stream switching time, which greatly reduces the downtime and improves the user experience.

[0074] Based on any of the above embodiments, before obtaining the streaming media service of the local data network to perform rendering calculation on the payload to be rendered to obtain the first video stream data packet, the method further includes: Determining that the control flow data packet needs to be locally unloaded; Extracting the payload to be rendered from the control stream data packet, and sending the payload to be rendered to the streaming media service; extracting the interaction information from the control stream data packet for pre-storage.

[0075] For example, Figure 3 As shown, the integrated base station may include a communication network and a local data network. The communication network may include a 5G base station central unit user plane (CU-UP) and an SDAP (Service Data Adaptation Protocol) module. The CU-UP module may receive and parse the first video stream data packet, and send the parsed first video stream data packet to the SDAP module to determine whether local unloading processing is required. When it is determined that the control stream data packet needs to be locally unloaded, the SDAP module may extract the load to be rendered and directly forward it to the local data network, so that the streaming media service in the local data network can perform rendering calculations on the load to be rendered. The communication network may also include a vUPF (Virtual User Plane Function) module. The SDAP module may extract the interactive information and directly forward it to the vUPF module to update the uplink traffic count statistics to achieve rapid response and avoid additional resource occupation due to detouring the core network. Among them, the interactive information refers to the information required for interaction with the core network control plane.

[0076] The communication network may also include a GTP-U module. When it is determined that the control stream data packet does not need to be locally unloaded, the SDAP module may send the parsed first video stream data packet to the GTP-U module for encapsulation, and send the encapsulated data packet to the UPF (User Plane Function) of the core network for centralized processing.

[0077] Based on any of the above embodiments, after obtaining the first video stream data packet obtained by the streaming media service of the local data network performing rendering calculation on the load to be rendered, the method further includes: Determine a payload to be displayed and a corresponding quality of service flow identifier in the first video stream data packet; Mapping the corresponding to-be-displayed load to the corresponding quality of service flow based on the quality of service flow identifier; The quality of service flow is encapsulated and sent to the first user session through a designated interface.

[0078] For example, Figure 3 As shown, the local data network can send the first video stream data packet obtained by rendering calculation to the vUPF module of the communication network of the integrated base station, determine the load to be displayed and the corresponding service quality flow identifier (QoS Flow Identifier, QFI) in the vUPF module, add the service quality flow identifier to the first video stream data packet and update the downlink traffic statistics, and send the processed first video stream data packet directly to the SDAP module in the CU-UP module. The SDAP module can parse the first video stream data packet to obtain the load to be displayed and the corresponding service quality flow identifier, and map different types of loads to be displayed to specific QoS flows according to the QFI, and then pass it to the Packet Data Convergence Protocol (PDCP) module for encryption, compression and other encapsulation processing. The encapsulated service quality is sent to the first user session through the 5G user plane data transmission (F1-U) interface to be forwarded to the user end.

[0079] The service migration method for real-time rendering applications provided by the present invention can update the uplink traffic and downlink traffic statistics through vUPF, and perform real-time calculations on time and traffic data, so as to report resource usage and traffic status to the core network control plane when preset conditions are met, thereby ensuring the dynamic adjustment of traffic offloading strategies and the coordination of global resource management of the core network.

[0080] Furthermore, the service migration method of the real-time rendering application provided by the present invention strictly follows the standard process defined by the Third Generation Partnership Project (3GPP), maintains consistency with the core network control plane, and ensures overall interoperability and scalability.

[0081] In order to specifically illustrate the function of the service migration method of the real-time rendering application provided by this embodiment, a specific example is provided below.

[0082] A service migration method for a real-time rendering application comprises starting the real-time rendering application at a user end, sending a session establishment request to a core network in a 5G communication system, wherein the core network establishes a first user session between the user end and a source integrated base station based on the session establishment request, and establishes a first cloud session between the source integrated base station and a cloud; The user terminal sends a control flow data packet to the source integrated base station through the first user session; The streaming media service of the source local data network in the source integrated base station performs rendering calculation on the load to be rendered to obtain a first video stream data packet, and feeds back the first video stream data packet to the user terminal through the first user session; The user end decodes the first video stream data packet, obtains the video stream corresponding to the first video stream data packet, and displays the video stream; After the user movement causes the delay of the first user session to be higher than a preset delay threshold, the user terminal sends a service migration request to the core network in the 5G communication system, and the core network determines a target integrated base station, establishes a second user session between the user terminal and the target integrated base station, and establishes a second cloud session between the target integrated base station and the cloud; The target integrated base station restores the streaming media service of the real-time rendering application according to the global state of the cloud, performs rendering calculation to obtain a second video stream data packet, and feeds back the second video stream data packet to the user terminal through the second user session; The user end determines that the frame difference between the video stream corresponding to the first video stream data packet and the video stream corresponding to the second video stream data packet is within a predetermined range, obtains the first latest video frame of the video stream corresponding to the first video stream data packet, and obtains the second latest video frame of the video stream corresponding to the second video stream data packet; performs weighted linear combination processing on the first latest video frame and the second latest video frame to generate a switching video frame; displays the switching video frame on the user end, and switches the video stream displayed on the user end to the video stream corresponding to the second video stream data packet.

[0083] The service migration device of the real-time rendering application provided by the present invention is described below. The service migration device of the real-time rendering application described below and the service migration method of the real-time rendering application described above can be referred to each other.

[0084] Figure 4 is one of the structural diagrams of the service migration device for real-time rendering application provided by the present invention, such as Figure 4 As shown, the device is applied to a user end and includes: A request sending module, configured to start the real-time rendering application, and send a session establishment request to a core network in a 5G communication system, so that the core network is configured to establish a first user session between the user terminal and a source integrated base station based on the session establishment request, and to establish a first cloud session between the source integrated base station and a cloud; the source integrated base station includes a source local data network, and the source local data network runs a streaming media service of the real-time rendering application; A control flow sending module, configured to send a control flow data packet to the source integrated base station through the first user session; A video stream receiving module is used to receive a first video stream data packet fed back by the source integrated base station through the first user session, decode the first video stream data packet, obtain a video stream corresponding to the first video stream data packet and display it; the first video stream data packet is obtained by the streaming media service of the source local data network rendering and calculating the load to be rendered; A migration module is used to migrate the streaming media service based on the cloud after the delay of the first user session exceeds a preset delay threshold.

[0085] Based on any of the above embodiments, the core network is further used to determine a target integrated base station after the delay of the first user session is higher than a preset delay threshold, establish a second user session between the user terminal and the target integrated base station, and establish a second cloud session between the target integrated base station and the cloud; the target integrated base station includes a target local data network, and the target local data network runs a streaming media service of the real-time rendering application; Migration module, specifically for: receiving a second video stream data packet fed back by the target local data network, decoding the second video stream data packet, and obtaining a video stream corresponding to the second video stream data packet; Switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet; The cloud includes a global state, and the second video stream data packet is obtained by rendering and calculating after the target local network restores the streaming media service according to the global state.

[0086] Based on any of the above embodiments, the service migration device for real-time rendering application further includes a frame difference determination module, which is used to determine that the frame difference between the video stream corresponding to the first video stream data packet and the video stream corresponding to the second video stream data packet is within a predetermined range.

[0087] Based on any of the above embodiments, the service migration device for real-time rendering application further includes a video stream switching display module, which is used to: Obtain a first latest video frame of a video stream corresponding to the first video stream data packet, and obtain a second latest video frame of a video stream corresponding to the second video stream data packet; Performing weighted linear combination processing on the first latest video frame and the second latest video frame to generate a switching video frame; The switching video frame is displayed on the user terminal.

[0088] Based on any of the above embodiments, the service migration device for real-time rendering application further includes a delayed release module, which is used to continue to receive the first video stream data packet fed back by the source local data network within a preset time, decode the first video stream data packet, and obtain a video stream corresponding to the first video stream data packet; When the preset time expires and the delay of the second user session is lower than the preset delay threshold, stop receiving the first video stream data packet fed back by the source local data network, and release the video stream corresponding to the first video stream data packet.

[0089] Figure 5 FIG. 2 is a second structural diagram of a service migration device for real-time rendering application provided by the present invention. Figure 5 As shown, the device is applied to an integrated base station, the integrated base station includes a local data network, and the local data network runs a streaming media service of a user-side real-time rendering application, including: A session establishment module, configured to cooperate with the core network to establish a user session with the user terminal and a cloud session with the cloud based on a session establishment request notification sent by the user terminal to the core network in the 5G communication system; A control stream receiving module, used to determine a payload to be rendered in a control stream data packet sent by the user terminal through the user session; A data acquisition module, used for acquiring a first video stream data packet obtained by the streaming media service of the local data network performing rendering calculation on the load to be rendered and a state of the streaming media service in the local data network; A data sending module is used to send the video stream data packet to the user terminal through the user session, and to send the status of the streaming media service in the local data network to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network of the cloud after the delay of the user session is higher than a preset delay threshold.

[0090] Based on any of the above embodiments, the service migration device for real-time rendering application further includes a local uninstallation module, which is used to: Determining that the control flow data packet needs to be locally unloaded; Extracting the payload to be rendered from the control stream data packet, and sending the payload to be rendered to the streaming media service; extracting the interaction information from the control stream data packet for pre-storage.

[0091] Based on any of the above embodiments, the service migration device for real-time rendering application further includes a video stream processing module, which is used to determine the load to be displayed in the first video stream data packet and the corresponding service quality flow identifier; Mapping the corresponding to-be-displayed load to the corresponding quality of service flow based on the quality of service flow identifier; The quality of service flow is encapsulated and sent to the first user session through a designated interface.

[0092] Figure 6 An example of a structural diagram of an electronic device is shown in FIG. Figure 6 As shown, the electronic device may include: a processor (processor) 510, a communication interface (Communications Interface) 520, a memory (memory) 530 and a communication bus 540, wherein the processor 510, the communication interface 520, and the memory 530 communicate with each other through the communication bus 540. The processor 510 can call the logic instructions in the memory 530 to execute the service migration method of the real-time rendering application, which is applied to the user end, including: starting the real-time rendering application, sending a session establishment request to the core network in the 5G communication system, so that the core network is used to establish a first user session between the user end and the source integrated base station based on the session establishment request, and establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, and the source local data network runs the streaming media service of the real-time rendering application; sending a control stream data packet to the source integrated base station through the first user session; receiving a first video stream data packet fed back by the source integrated base station through the first user session, decoding the first video stream data packet, obtaining a video stream corresponding to the first video stream data packet and displaying it; the first video stream data packet is obtained by the streaming media service of the source local data network rendering the load to be rendered; after the delay of the first user session is higher than the preset delay threshold, migrating the streaming media service based on the cloud; Alternatively, it is applied to an integrated base station, which includes a local data network, and the local data network runs a streaming media service for real-time rendering of an application program on a user terminal, including: cooperating with the core network to establish a user session with the user terminal and a cloud session with the cloud based on a session establishment request notification sent by the user terminal to the core network in the 5G communication system; determining the load to be rendered in the control stream data packet sent by the user terminal through the user session; obtaining a first video stream data packet and a status of the streaming media service in the local data network obtained by rendering the load to be rendered by the streaming media service of the local data network; sending the video stream data packet to the user terminal through the user session, and sending the status of the streaming media service in the local data network to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network in the cloud after the delay of the user session is higher than a preset delay threshold.

[0093] In addition, the logic instructions in the above-mentioned memory 530 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0094] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the service migration method of the real-time rendering application provided by the above methods. The method is applied to a user end, including: starting the real-time rendering application, sending a session establishment request to a core network in a 5G communication system, so that the core network is used to establish a first user session between the user end and a source integrated base station based on the session establishment request, and to establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, and the source local data network runs a streaming media service of the real-time rendering application; sending a control stream data packet to the source integrated base station through the first user session; receiving a first video stream data packet fed back by the source integrated base station through the first user session, decoding the first video stream data packet, obtaining a video stream corresponding to the first video stream data packet and displaying it; the first video stream data packet is obtained by the streaming media service of the source local data network rendering and calculating the load to be rendered; after the delay of the first user session is higher than a preset delay threshold, migrating the streaming media service based on the cloud; Alternatively, it is applied to an integrated base station, which includes a local data network, and the local data network runs a streaming media service for real-time rendering of an application program on a user terminal, including: cooperating with the core network to establish a user session with the user terminal and a cloud session with the cloud based on a session establishment request notification sent by the user terminal to the core network in the 5G communication system; determining the load to be rendered in the control stream data packet sent by the user terminal through the user session; obtaining a first video stream data packet and a status of the streaming media service in the local data network obtained by rendering the load to be rendered by the streaming media service of the local data network; sending the video stream data packet to the user terminal through the user session, and sending the status of the streaming media service in the local data network to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network in the cloud after the delay of the user session is higher than a preset delay threshold.

[0095] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which is implemented by a processor to execute the service migration method of the real-time rendering application provided by the above methods when the computer program is executed. The method is applied to a user end, comprising: starting the real-time rendering application, sending a session establishment request to a core network in a 5G communication system, so that the core network is used to establish a first user session between the user end and a source integrated base station based on the session establishment request, and to establish a first cloud session between the source integrated base station and the cloud; the source integrated base station includes a source local data network, and the source local data network runs a streaming media service of the real-time rendering application; sending a control stream data packet to the source integrated base station through the first user session; receiving a first video stream data packet fed back by the source integrated base station through the first user session, decoding the first video stream data packet, obtaining a video stream corresponding to the first video stream data packet and displaying it; the first video stream data packet is obtained by the streaming media service of the source local data network rendering and calculating the load to be rendered; after the delay of the first user session is higher than a preset delay threshold, migrating the streaming media service based on the cloud; Alternatively, it is applied to an integrated base station, which includes a local data network, and the local data network runs a streaming media service for real-time rendering of an application program on a user terminal, including: cooperating with the core network to establish a user session with the user terminal and a cloud session with the cloud based on a session establishment request notification sent by the user terminal to the core network in the 5G communication system; determining the load to be rendered in the control stream data packet sent by the user terminal through the user session; obtaining a first video stream data packet and a status of the streaming media service in the local data network obtained by rendering the load to be rendered by the streaming media service of the local data network; sending the video stream data packet to the user terminal through the user session, and sending the status of the streaming media service in the local data network to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network in the cloud after the delay of the user session is higher than a preset delay threshold.

[0096] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0097] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0098] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A service migration method for a real-time rendering application, characterized in that: Applied to the user side, including: Starting the real-time rendering application, sending a session establishment request to a core network in a 5G communication system, so that the core network is used to establish a first user session between the user terminal and a source integrated base station based on the session establishment request, and to establish a first cloud session between the source integrated base station and a cloud; the source integrated base station includes a source local data network, and the source local data network runs a streaming media service of the real-time rendering application; Sending a control flow data packet to the source integrated base station through the first user session; Receive a first video stream data packet fed back by the source integrated base station through the first user session, decode the first video stream data packet, obtain a video stream corresponding to the first video stream data packet and display it; the first video stream data packet is obtained by performing rendering calculation on a streaming media service of the source local data network to perform rendering load; After the delay of the first user session is higher than a preset delay threshold, the streaming media service is migrated based on the cloud.

2. The service migration method of the real-time rendering application according to claim 1, characterized in that: The core network is further configured to determine a target integrated base station after the delay of the first user session is higher than a preset delay threshold, establish a second user session between the user terminal and the target integrated base station, and establish a second cloud session between the target integrated base station and the cloud; the target integrated base station includes a target local data network, and the target local data network runs a streaming media service of the real-time rendering application; Migrating the streaming media service based on the cloud specifically includes: receiving a second video stream data packet fed back by the target local data network, decoding the second video stream data packet, and obtaining a video stream corresponding to the second video stream data packet; Switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet; The cloud includes a global state, and the second video stream data packet is obtained by rendering and calculating after the target local network restores the streaming media service according to the global state.

3. The service migration method of the real-time rendering application according to claim 2, characterized in that: Before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: Determine whether a frame difference between a video stream corresponding to the first video stream data packet and a video stream corresponding to the second video stream data packet is within a predetermined range.

4. The service migration method of the real-time rendering application according to claim 3, characterized in that: Before switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: Obtain a first latest video frame of a video stream corresponding to the first video stream data packet, and obtain a second latest video frame of a video stream corresponding to the second video stream data packet; Performing weighted linear combination processing on the first latest video frame and the second latest video frame to generate a switching video frame; The switching video frame is displayed on the user terminal.

5. The service migration method of the real-time rendering application according to claim 2, characterized in that: After switching the video stream displayed on the user terminal to the video stream corresponding to the second video stream data packet, the method further includes: Continue to receive the first video stream data packet fed back by the source local data network within a preset time, decode the first video stream data packet, and obtain a video stream corresponding to the first video stream data packet; When the preset time expires and the delay of the second user session is lower than the preset delay threshold, stop receiving the first video stream data packet fed back by the source local data network, and release the video stream corresponding to the first video stream data packet.

6. A service migration method for a real-time rendering application, characterized in that: Applied to an integrated base station, the integrated base station includes a local data network, the local data network runs a streaming media service of a user-side real-time rendering application, including: Cooperating with the core network to establish a user session with the user terminal and a cloud session with the cloud based on a session establishment request notification sent by the user terminal to the core network in the 5G communication system; Determine a payload to be rendered in a control stream data packet sent by the user terminal through a first user session; Obtaining a first video stream data packet obtained by performing rendering calculation on the load to be rendered by the streaming media service of the local data network and a state of the streaming media service in the local data network; The video stream data packet is sent to the user terminal through the user session, and the status of the streaming media service in the local data network is sent to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network of the cloud after the delay of the user session is higher than a preset delay threshold.

7. The service migration method of the real-time rendering application according to claim 6, characterized in that: Before obtaining the streaming media service of the local data network to perform rendering calculation on the load to be rendered to obtain the first video stream data packet, the method further includes: Determining that the control flow data packet needs to be locally unloaded; Extracting the payload to be rendered from the control stream data packet, and sending the payload to be rendered to the streaming media service; extracting the interaction information from the control stream data packet for pre-storage.

8. The service migration method of the real-time rendering application according to claim 6, characterized in that: After obtaining the first video stream data packet obtained by performing rendering calculation on the load to be rendered by the streaming media service of the local data network, the method further includes: Determine a payload to be displayed and a corresponding quality of service flow identifier in the first video stream data packet; Mapping the corresponding to-be-displayed load to the corresponding quality of service flow based on the quality of service flow identifier; The quality of service flow is encapsulated and sent to the first user session through a designated interface.

9. A service migration device for real-time rendering application, characterized in that: Applied to the user side, including: A request sending module, configured to start the real-time rendering application, and send a session establishment request to a core network in a 5G communication system, so that the core network is configured to establish a first user session between the user terminal and a source integrated base station based on the session establishment request, and to establish a first cloud session between the source integrated base station and a cloud; the source integrated base station includes a source local data network, and the source local data network runs a streaming media service of the real-time rendering application; A control flow sending module, configured to send a control flow data packet to the source integrated base station through the first user session; A video stream receiving module is used to receive a first video stream data packet fed back by the source integrated base station through the first user session, decode the first video stream data packet, obtain a video stream corresponding to the first video stream data packet and display it; the first video stream data packet is obtained by performing rendering calculation on a streaming media service of the source local data network to perform rendering load; A migration module is used to migrate the streaming media service based on the cloud after the delay of the first user session exceeds a preset delay threshold.

10. A service migration device for real-time rendering application, characterized in that: Applied to an integrated base station, the integrated base station includes a local data network, the local data network runs a streaming media service of a user-side real-time rendering application, including: A session establishment module, configured to cooperate with the core network to establish a user session with the user terminal and a cloud session with the cloud based on a session establishment request notification sent by the user terminal to the core network in the 5G communication system; A control stream receiving module, used to determine a payload to be rendered in a control stream data packet sent by the user terminal through the user session; A data acquisition module, used for acquiring a first video stream data packet obtained by the streaming media service of the local data network performing rendering calculation on the load to be rendered and a state of the streaming media service in the local data network; A data sending module is used to send the video stream data packet to the user terminal through the user session, and to send the status of the streaming media service in the local data network to the cloud through the cloud session, so as to migrate the streaming media service based on the global status of the streaming media service in the local data network of the cloud after the delay of the user session is higher than a preset delay threshold.

Images