Network panoramic video stream data caching and shunting method and device and computer equipment

Abstract

The invention discloses a network panoramic video stream data caching and shunting method and device and computer equipment. The method comprises the following steps: acquiring network topology, flow condition and real-time state information of a panoramic video stream segment requested by a user by using an SDN technology to obtain initial data; an optimization problem is constructed based on the initial data, the optimization problem is used for maximizing the user experience quality, and base station storage limitation and link bandwidth constraint are considered; decomposing the optimization problem into a maximum cache configuration sub-problem and an optimal routing forwarding strategy sub-problem, and respectively solving the sub-problems to obtain an optimal cache and routing scheme; and sending to a base station, so that the base station guides caching and data distribution of the video clips. By implementing the method provided by the invention, the panoramic video stream data can be cached and shunted in a plurality of base stations by using the SDN controller on the basis of improving QoE under the condition of limited network resources, so that a plurality of users can obtain better panoramic video watching experience.

Description

Technical Field

[0001] The present invention relates to a video processing method, and more specifically to a network panoramic video stream data caching and diversion method, device and computer equipment. Background Art

[0002] Amidst the rapid advancement of technology, new multimedia technologies such as ultra-high-definition video, virtual reality / augmented reality, and 3D video are rapidly emerging, offering users unprecedented experiences. VR / AR technology, in particular, has attracted significant attention from major global technology companies, research institutions, and investment and financial institutions due to its wide range of potential applications. Panoramic video, an early mature form of VR / AR technology, is also seen as one of the new multimedia applications most likely to gain widespread market acceptance. Research into this type of immersive video, also known as 360-degree video, is not only crucial for promoting and developing the AR / VR industry but also holds significant socioeconomic value.

[0003] However, from a technical perspective, the main challenge facing panoramic videos is the sheer volume of raw data, which places enormous strain on storage and transmission. Adopting new-generation video compression standards, such as HEVC, VVC, and AVS, can alleviate these challenges to a certain extent. Despite this, efficiently transmitting panoramic video streams over shared networks with limited bandwidth remains a significant challenge. New-generation mobile network communication technologies are improving user experience by increasing bandwidth and speed, making them particularly suitable for high-traffic mobile broadband scenarios such as 3D / UHD live video streaming, VR / AR applications, and high-speed mobile internet access. These advancements are making it possible to smoothly play panoramic videos in mobile environments.

[0004] Therefore, it is necessary to design a new method to achieve the goal of caching and distributing panoramic video stream data among multiple base stations using SDN controllers under limited network resource conditions, based on the improvement of QoE, so that multiple users can obtain a better panoramic video viewing experience. Summary of the Invention

[0005] The purpose of the present invention is to overcome the defects of the prior art and provide a method, device and computer equipment for caching and diverting network panoramic video stream data.

[0006] To achieve the above objectives, the present invention adopts the following technical solution: a method for caching and offloading network panoramic video stream data, comprising:

[0007] Obtaining the network topology, traffic conditions, and real-time status information of the user's request for the panoramic video stream segment to obtain initial data;

[0008] constructing an optimization problem based on the initial data, wherein the optimization problem is used to maximize user experience quality while considering base station storage limitations and link bandwidth constraints;

[0009] Decomposing the optimization problem into a maximizing cache configuration subproblem and an optimal routing and forwarding strategy subproblem, and solving them separately to obtain the optimal cache and routing solutions;

[0010] The optimal caching and routing solution is sent to a base station, so that the base station guides caching and data distribution of video segments according to the optimal caching and routing solution.

[0011] A further technical solution is that the acquisition of network topology, traffic conditions and real-time status information of user-requested panoramic video stream segments to obtain initial data includes:

[0012] SDN technology is used to obtain the network topology, traffic conditions and real-time status information of user-requested panoramic video stream segments to obtain initial data.

[0013] A further technical solution is: constructing an optimization problem based on the initial data includes:

[0014] Determine and organize a user set, a base station set, a link set, and a set of on-demand panoramic video stream segments based on the initial data, establish a user on-demand video segment request matrix and a user falling into a base station service area mapping matrix to obtain a mathematical quantity;

[0015] Based on the mathematical quantity, the link utilization from the user to the base station where the cache is located and the size of the video stream segment are set as key variables, and an optimization function is formulated with the goal of maximizing the user experience quality gain;

[0016] Define the upper limit of base station storage capacity and link bandwidth limit as constraints;

[0017] Combine all key variables of mathematical quantities, target optimization functions and constraints to generate an optimization problem.

[0018] A further technical solution is: the constraints include that the total size of video clips that can be cached by the base station cannot be larger than the base station's inherent storage space, and the total link utilization cannot exceed its bandwidth.

[0019] Its further technical solution is: the maximum cache configuration sub-problem is expressed as: Where I is the set of all base stations, E is the set of all X2 links, and U is the set of users; u∈U, m∈M, M is the set of on-demand panoramic video stream segments; the cache space size of base station i is i∈I.

[0020] Its further technical solution is: the optimal routing forwarding strategy sub-problem is expressed as:

[0021] A further technical solution is as follows: the optimal caching and routing solution includes:

[0022] When c i,m =0 and When a user in the area of ​​base station i requests segment m, it needs to go through the backbone network and cannot be diverted by the X2 link;

[0023] When c i,m =0 and When a user in the jurisdiction of base station i requests segment m, it can be diverted from other base stations via the X2 link. The base station information is given;

[0024] When c i,m =1 and When a user in the jurisdiction of base station i requests segment m, it is directly provided by this base station without the need for backbone network and X2 link offload.

[0025] The present invention also provides a network panoramic video stream data caching and diversion system, comprising:

[0026] An acquisition unit, configured to acquire network topology, traffic conditions, and real-time status information of a user-requested panoramic video stream segment to obtain initial data;

[0027] a construction unit, configured to construct an optimization problem based on the initial data, wherein the optimization problem is configured to maximize user quality of experience while taking into account base station storage limitations and link bandwidth constraints;

[0028] A solving unit, configured to decompose the optimization problem into a maximizing cache configuration sub-problem and an optimal routing and forwarding strategy sub-problem, and solve them separately to obtain an optimal cache and routing solution;

[0029] The sending unit is configured to send the optimal caching and routing solution to a base station, so that the base station performs caching and data distribution of the video segments as directed by the base station.

[0030] A further technical solution is: the acquisition unit is used to adopt SDN technology to acquire network topology, traffic conditions and real-time status information of user-requested panoramic video stream segments to obtain initial data.

[0031] The present invention further provides a computer device, comprising a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the above method when executing the computer program.

[0032] Compared with existing technologies, this invention offers the following advantages: It uses an SDN controller to obtain network topology, traffic conditions, and real-time status information about user-requested panoramic video stream segments as initial data. It then constructs an optimization problem designed to maximize user experience quality while accounting for base station storage and link bandwidth limitations. This problem is broken down into two subproblems: maximizing cache allocation and optimizing routing and forwarding strategies, each of which is solved separately to develop an optimal cache and routing solution. Ultimately, this solution is distributed to each base station, guiding intelligent caching of video segments and efficient data diversion, thereby ensuring a high-quality panoramic video viewing experience for multiple users. This approach leverages a centralized control mechanism to dynamically adapt to network changes, optimize resource allocation, and improve overall service efficiency and user satisfaction.

[0033] The present invention will be further described below with reference to the accompanying drawings and specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0035] Figure 1 A schematic diagram of an application scenario of the method for caching and offloading network panoramic video stream data provided by an embodiment of the present invention;

[0036] Figure 2 A schematic diagram of a flow chart of a method for caching and offloading network panoramic video stream data provided by an embodiment of the present invention;

[0037] Figure 3 A schematic diagram of a sub-process of a method for caching and offloading network panoramic video stream data provided by an embodiment of the present invention;

[0038] Figure 4 A schematic block diagram of a network panoramic video stream data caching and diversion device provided by an embodiment of the present invention;

[0039] Figure 5 A schematic block diagram of a construction unit of a network panoramic video stream data caching and diversion device provided by an embodiment of the present invention;

[0040] Figure 6 A schematic block diagram of a computer device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0041] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0042] It will be understood that when used in this specification and the appended claims, the terms “comprises” and “comprising” indicate the presence of described features, integers, steps, operations, elements and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0043] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the present invention. As used in the specification and appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0044] It should be further understood that the term "and / or" used in the present description and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0045] See also Figure 1 and Figure 2 , Figure 1 A schematic diagram of an application scenario of the network panoramic video stream data caching and offloading method provided by an embodiment of the present invention. Figure 2 A schematic flow chart of a method for caching and diverting network panoramic video stream data provided by an embodiment of the present invention. By utilizing SDN technology to collect network topology, traffic conditions, and user request information, the optimization problem is constructed and decomposed into two sub-problems: maximizing cache configuration and optimal routing forwarding strategy, which are solved separately to obtain the best cache and routing solutions. This method takes into account the base station storage limitations and link bandwidth constraints to ensure that under limited network resource conditions, the caching and data diversion decisions of video clips are effectively guided. Specifically, an optimization function is formulated based on parameters such as the user's on-demand video clip request matrix and the user's base station service area mapping matrix, and an optimization problem is generated in combination with the constraints, ultimately achieving efficient provision of the required panoramic video clips to users through the backbone network or X2 link, thereby improving the viewing experience of multiple users. In this way, without significantly increasing the network burden, effective allocation and utilization of resources are achieved, and the overall service quality is enhanced.

[0046] Figure 2 FIG. 1 is a flow chart of a method for caching and splitting network panoramic video stream data provided by an embodiment of the present invention. Figure 2 As shown, the method includes the following steps S110 to S140.

[0047] S110 , obtaining network topology, traffic conditions, and real-time status information of user-requested panoramic video stream segments to obtain initial data.

[0048] In this embodiment, initial data specifically refers to a set of data about network status and user behavior acquired through SDN technology. This data is the basis for establishing and solving subsequent optimization problems and formulating caching and traffic diversion strategies. Specifically, initial data includes but is not limited to the following aspects:

[0049] Network topology information:

[0050] Base station and EPC information: includes the location, service range, and connection relationship of each base station (BSs); the status and configuration of the core network (Evolved Packet Core, EPC).

[0051] Link information: describes the connection status between different network nodes, including specific parameters of the X2 interface (communication link between base stations) and the S1 interface (communication link between base stations and EPC), such as bandwidth and latency.

[0052] Traffic status information:

[0053] Real-time traffic data: records the traffic load of each link in the current network, including but not limited to key performance indicators such as bandwidth utilization, transmission rate, and packet loss rate.

[0054] Historical traffic patterns: Based on traffic trends over a period of time, they help predict future network demand and potential bottlenecks.

[0055] Real-time status information of a user-requested panoramic video stream segment:

[0056] User request details: includes the user's unique identifier, user location (i.e., the service area of ​​the base station to which they belong), requested panoramic video stream segment ID and timestamp, etc.

[0057] Viewing behavior data: For example, user play, pause, fast-forward, or rewind behavior, which helps understand user viewing habits and preferences, thereby making more accurate caching decisions.

[0058] QoE-related feedback: This may also include direct user feedback on quality of experience, such as video loading time and buffering frequency, to evaluate the effectiveness of existing caching and forwarding strategies and guide optimization.

[0059] Specifically, SDN technology is used to obtain the network topology, traffic conditions and real-time status information of user-requested panoramic video stream segments to obtain initial data.

[0060] Software-defined networking (SDN) technology collects and manages various network information through a centralized control plane. The SDN controller can dynamically obtain the topology of the entire network, including base stations, the core network (EPC), and the connections between nodes.

[0061] As the network changes, such as the addition of new devices or changes in the status of existing devices, the SDN controller can promptly update the network topology map to ensure the accuracy and timeliness of the data.

[0062] Monitoring points deployed across the network collect real-time link traffic data, including key performance indicators such as bandwidth usage, latency, and packet loss. This raw data is sent to the SDN controller for analysis and processing to assess the current network load and health, providing a basis for subsequent optimization decisions.

[0063] When a user requests a panoramic video stream segment, the system parses the request content, including the user's identity, the requested video segment ID, and timestamp. The system also tracks the user's viewing behavior, such as playback progress and pause times, to more accurately predict user needs and make better caching decisions.

[0064] The information collected above forms the core of this method—the data foundation required to build the optimization problem. This data not only helps identify the set of users, base stations, links, and available panoramic video segments, but also creates important mathematical quantities such as the matrix of user on-demand video segment requests and the matrix mapping users to base station service areas. Only by accurately understanding the actual network operating status and specific user needs can we develop effective strategies that both meet the goal of improving user quality of experience (QoE) and address resource constraints.

[0065] In summary, step S110 uses SDN technology to comprehensively and meticulously obtain network topology, traffic conditions, and real-time status information of user-requested panoramic video stream segments, providing solid data support for subsequent steps. It is the key first step in realizing QoE-oriented intelligent caching and diversion of panoramic video stream data.

[0066] S120: Construct an optimization problem based on the initial data, wherein the optimization problem is used to maximize user experience quality while considering base station storage limitations and link bandwidth constraints.

[0067] In this embodiment, the optimization problem refers to a mathematical model that aims to maximize the user experience quality (QoE) by adjusting and allocating network resources (such as base station buffer space and link bandwidth) while complying with certain physical limitations and constraints.

[0068] In one embodiment, see Figure 3 , the above-mentioned step S120 may include steps S121 to S124.

[0069] S121. Determine and organize a user set, a base station set, a link set, and a set of on-demand panoramic video stream segments based on the initial data, establish a user on-demand video segment request matrix and a user falling into a base station service area mapping matrix to obtain a mathematical quantity.

[0070] In this embodiment, the mathematical quantity refers to:

[0071] User set (U): A set containing all users.

[0072] Base station set (I): includes the set of all base stations providing services.

[0073] Link set (E): includes the set of communication links such as all X2 interfaces and S1 interfaces.

[0074] On-demand panoramic video stream segment set (M): a set containing all panoramic video stream segments that can be requested.

[0075] User video segment request matrix: represents the user's request for video segments. If the user requests a video segment, the user video segment request matrix = 1; otherwise, it is 0.

[0076] User falls into the base station service area mapping matrix: Indicates whether the user is located in the service area of ​​base station ii. If the user is in the service area of ​​the base station, the user falls into the base station service area mapping matrix = 1; otherwise, it is 0.

[0077] These mathematical quantities are the basis for establishing optimization models. They quantify the relationships between users, base stations, links, and video streams, providing data support for further analysis.

[0078] S122: Based on the mathematical quantity, the link utilization from the user to the base station where the cache is located and the size of the video stream segment are set as key variables, and an optimization function is formulated with the goal of maximizing the user experience quality gain.

[0079] In this embodiment, based on the above mathematical quantities, the link utilization from the user to the base station where the cache is located (QoS component) and the video stream segment size (QoC component) are used as key variables, and with the goal of maximizing the user experience quality gain, an optimization function is formulated:

[0080] S123: Define the upper limit of base station storage capacity and link bandwidth limit as constraints.

[0081] The constraints include that the total size of video clips that can be cached by the base station cannot be larger than the base station's inherent storage space, and the total link utilization cannot exceed its bandwidth.

[0082] The total size of video clips that each base station can cache cannot exceed its inherent storage space. For base station i, the set of video clips it caches is , then: The cache space size of base station i is i∈I.

[0083] The total utilization of each link cannot exceed its maximum bandwidth. For link e, the total utilization is Then it satisfies: r e (P1,…,P |I| )≤B e , Among them, B e is the bandwidth of link e.

[0084] S124. Generate an optimization problem by combining all key mathematical variables, target optimization functions, and constraints.

[0085] By combining all mathematical quantities, key variables, target optimization functions, and constraints, we ultimately generated a complete optimization problem that guides the efficient allocation of network resources, thereby enhancing the user experience of panoramic video viewing. This problem can be solved using specific algorithms (such as the knapsack problem or water filling) to obtain the optimal cache allocation and routing strategy. This not only improves resource efficiency but also enhances user satisfaction.

[0086] S130 , decomposing the optimization problem into a maximizing cache configuration sub-problem and an optimal routing forwarding strategy sub-problem, and solving them separately to obtain optimal cache and routing solutions.

[0087] In this embodiment, the optimal caching and routing solution dynamically optimizes data caching locations and routing through intelligent analysis of content popularity and network status, achieving efficient, low-latency data distribution and improving service quality. Combining these two aspects, the optimal caching and routing solution aims to build an efficient, flexible, and reliable video distribution system that not only meets users' demands for a high-quality streaming experience, but also takes into account the cost-effectiveness and technical feasibility of operator implementation. This solution typically requires the use of advanced algorithms and technologies, such as machine learning and software-defined networking (SDN), to adjust and optimize caching and transmission strategies in real time.

[0088] In this embodiment, the maximization cache configuration sub-problem is expressed as: Where I is the set of all base stations, E is the set of all X2 links, and U is the set of users; u∈U, m∈M, M is the set of on-demand panoramic video stream segments; the cache space size of base station i is i∈I.

[0089] The optimal routing forwarding strategy sub-problem is expressed as:

[0090] The optimal caching and routing solutions include:

[0091] When c i,m =0 and When a user in the area of ​​base station i requests segment m, it needs to go through the backbone network and cannot be diverted by the X2 link;

[0092] When c i,m =0 and When a user in the jurisdiction of base station i requests segment m, it can be diverted from other base stations via the X2 link. The base station information is given;

[0093] When c i,m =1 and When a user in the jurisdiction of base station i requests segment m, it is directly provided by this base station without the need for backbone network and X2 link offload.

[0094] Based on the solutions to the above two sub-problems, the optimal caching and routing scheme can be determined as follows:

[0095] The backbone network is required: If and only if the video clip requested by the user is not in the cache of the neighboring base station or the local base station, data transmission must be carried out through the backbone network.

[0096] X2 link offload: If the video clip requested by the user is in the cache of a neighboring base station but not in the local base station, the data can be obtained from the neighboring base station via the X2 link.

[0097] Directly provided by the local base station: If the video clip requested by the user is already in the local base station cache, the data can be obtained directly from the local base station without using the X2 link or backbone network.

[0098] This approach not only effectively utilizes limited network resources, but also significantly improves the panoramic video viewing experience of multiple users, thereby achieving the goal of network resource allocation oriented towards improving user experience quality.

[0099] S140: Send the optimal caching and routing solution to a base station, so that the base station guides caching and data distribution of video segments according to the optimal caching and routing solution.

[0100] In this embodiment, a specific caching and routing solution is generated based on the solutions to the maximizing cache allocation subproblem and the optimal routing and forwarding strategy subproblem. This solution specifies which video clips should be cached in which base stations, and when a user requests a specific video clip, which path should be used for data transmission (directly from the base station, from a neighboring base station via an X2 link, or via the backbone network).

[0101] Using software-defined networking (SDN) technology, all base stations and related communication entities (such as EPCs) are controlled by a centralized SDN controller. This controller is responsible for collecting information from the entire network and making decisions based on it. Once the optimal caching and routing solution is determined, the SDN controller sends specific control instructions to each relevant base station. These instructions include a list of video clips that each base station should cache, their corresponding cache locations, and how to select the optimal route for each possible data request.

[0102] After receiving the instructions, each base station updates its cache status accordingly. This includes deleting old, no longer needed video clips and downloading and storing new, recommended video clips. When a user initiates a video streaming request, the base station uses pre-defined rules to determine whether to serve the video from its local cache, request resources from a neighboring base station via the X2 link, or obtain the required content from the backbone network. This intelligent traffic diversion mechanism helps reduce network congestion and improve service quality.

[0103] Given that network conditions and user needs may change over time, the SDN controller must continuously monitor network status and dynamically adjust caching and transmission strategies based on actual conditions. Base stations must be able to provide feedback to the SDN controller to ensure timely detection and resolution of any potential issues, such as cache failures or link congestion, ensuring efficient and stable operation of the entire system.

[0104] Through the above process, step S140 not only realizes the process of converting the theoretically optimal caching and routing solution into an actual action plan, but also ensures that a high-quality panoramic video viewing experience can still be provided to users in a complex and changing network environment.

[0105] In this embodiment, the method of this embodiment aims to improve the quality of user experience (QoE) standards under limited network resource conditions, and use a software-defined network (SDN) controller to intelligently cache and optimize the distribution of panoramic video stream data among multiple base stations, thereby improving the panoramic video viewing experience of multiple users.

[0106] SDN technology is used to control multiple communication entities in the network (such as base stations and EPCs) to obtain information such as device configuration information, data link communication status, network topology, network traffic, and the real-time status of user requests for panoramic video stream segments. Based on the collected information, a mathematical model is constructed, covering multiple aspects such as the user set, base station set, link set, and on-demand video stream segment set, and these elements are transformed into an optimization problem. This problem is guided by maximizing QoE and takes into account constraints such as base station storage capacity and link bandwidth limitations. The above optimization problem is decomposed into two sub-problems: maximizing cache and optimizing routing and forwarding strategies. The optimal cache configuration and video segment forwarding strategy for each base station are solved respectively. Based on the solution results, instructions are issued to the base station through the SDN controller to guide the reasonable cache location of video segments and the efficient forwarding path of the link.

[0107] The method of this embodiment is aimed at the on-demand panoramic video streaming scenario under the new generation mobile communication network. It uses SDN technology to realize dynamic monitoring and adjustment of network communication status, and establishes and solves the optimization problem with the goal of maximizing QoE. This process not only improves the viewing experience of a single user, but also improves the overall satisfaction of multiple users when on-demand panoramic videos. Figure 5 As shown, software-defined networking (SDN) technology is used to dynamically and flexibly configure multiple communication entities in the network (including base stations and EPCs). By updating or releasing new network policies, protocols, and services, different network topologies and traffic routing controls can be implemented without changing hardware deployment. When multiple users request panoramic videos on the network, the process involves accessing the network through the wireless interface provided by the base station, connecting to the internet via the EPC backbone network, and ultimately obtaining the required data stream from the multimedia server.

[0108] Base stations are interconnected via X2 links. If a user's requested resources are cached in a neighboring base station, the data is typically transmitted directly to the user via the X2 link based on optimal scheduling, without having to be downloaded from a remote server via the backbone network. This approach aims to provide a high-quality panoramic video viewing experience for multiple users within limited network resources. To optimize user experience quality, intelligently scheduling the routing of video stream data within the network is one of the most direct and effective methods. Therefore, using an SDN controller to manage the caching and distribution of panoramic video stream data across multiple base stations is particularly important and feasible, ensuring efficient resource utilization and an improved user experience. This approach not only reduces unnecessary bandwidth consumption but also significantly improves the quality and smoothness of video playback, meeting the high demands of multiple users.

[0109] Let I be the set of all base stations, E be the set of all X2 links, U be the set of users, and M be the set of panoramic video stream segments that can be ordered by the server. u,m )∈{0,1} |U|×|M| is the on-demand request of each user for each video stream segment, when α u,m =1, u∈U, m∈M, it means user u requests to play segment m on demand. u,i )∈{0,1} |U|×|I| is the mapping matrix of each user falling into the jurisdiction of each base station, when d u,i =1, u∈U, i∈I, indicating that user u is within the jurisdiction of base station i. When the segment m requested by user u is cached in base station i and can be offloaded by X2 link e, the QoE gain can be expressed as follows: Among them, QoE (QoS, QoC) is the QoE score obtained by the QoE evaluation model established above under the conditions of inputting QoS and QoC. To simplify the problem, consider the QoE gain The utilization rate r of the X2 link e from user u to the base station i where the cache is located e ,e∈E(QoS part) and segment m size s m (QoC part) is related, and the relationship is recorded as This functional relationship can be easily fitted by the QoE evaluation model. Then the caching and traffic diversion problem can be described as:

[0110] There are two main constraints: first, the total size of video clips that the base station can cache cannot be larger than the base station's inherent storage space; second, the X2 link utilization r e The sum cannot exceed its bandwidth. The cache size of base station i is i∈I, the set of cached video clips is Then the first constraint can be expressed as:

[0111] To calculate r e , it is necessary to determine which X2 links the base station where the user is located uses to obtain the video clips cached on other base stations. i ,i∈I is the routing matrix for obtaining video clips cached by other base stations from base station i: in, Can only take the value 1 or 0. , it means that when base station i wants to obtain segment m, it needs to go through link e. Then, the total utilization of link e can be calculated as follows:

[0112] Thus, the second constraint can be expressed as: e (P1,…,P |I| )≤B e , Among them B e is the bandwidth of link e.

[0113] In fact, solving the cache offload problem can be broken down into two sub-problems: the first is maximizing cache; the second is configuring the optimal routing and forwarding strategy to maximize link utilization and thus maximize QoE gains. The first problem can be described as follows:

[0114] Solving the above problems can get the optimal cache configuration of video clips at each base station For the second question, it can be described as: in,

[0115] Solving the above problems can get With P i , their combination determines the cache and forwarding strategy, specifically:

[0116] When c i,m =0 and When a user in the area of ​​base station i requests segment m, it needs to go through the backbone network and cannot be diverted by the X2 link;

[0117] When c i,m =0 and When a user in the jurisdiction of base station i requests segment m, it can be diverted from other base stations via the X2 link. The base station information is given;

[0118] When c i,m =1 and When a user in the jurisdiction of base station i requests segment m, it is directly provided by this base station without the need for backbone network and X2 link offload.

[0119] The method of this embodiment intends to use the knapsack problem algorithm and the water injection method to solve the optimization problem given above. The knapsack problem is a classic combinatorial optimization problem, and its basic form is: given a group of items, each item has its own weight and value, within the limited total weight, select which items can maximize their total value. In this context, we can regard the base station as a "knapsack" and the video stream data as an "item". The amount of data (size) of each video stream is equivalent to the weight of the item, while the quality of the video or user satisfaction can be regarded as the value of the item. Through the knapsack problem algorithm, it can be determined which video streams should be cached in the base station to maximize the overall user experience quality (QoE) without exceeding the storage capacity limit of the base station.

[0120] Water-Filling Algorithms are commonly used in resource allocation problems, particularly for power allocation in communication systems. This method can be figuratively compared to injecting water into different containers (representing different resources or service requirements) until all containers reach the same level (resource utilization is balanced). In this case, the water-filling algorithm can be used to optimize the allocation of network resources, such as bandwidth allocation, to ensure that all users' panoramic video viewing experience is as balanced as possible. Specifically, the bandwidth resources allocated to each user can be dynamically adjusted based on their current quality of service and network conditions, so that the QoE of all users can reach a relatively fair and optimized level under limited network resources.

[0121] First, based on the current network status and user requests, the video content that should be cached at each base station is preliminarily determined. This step can be achieved using a knapsack problem algorithm. Next, a water injection method is used to fine-tune network resources. For example, the bandwidth available to each user can be flexibly adjusted based on factors such as the actual video resolution being viewed and the current level of network congestion. This entire process requires real-time monitoring of network status and user feedback, continuously adjusting video caching strategies and resource allocation plans to address changes in the network environment and fluctuations in user demand.

[0122] In this way, the effective utilization of base station storage space (knapsack problem) is taken into consideration, and the reasonable allocation of network resources (water injection method) is achieved, thereby effectively improving the overall experience quality of panoramic video viewing in a multi-user environment.

[0123] The aforementioned method for caching and offloading panoramic video stream data in a network uses an SDN controller to obtain network topology, traffic conditions, and real-time status information about user-requested panoramic video stream segments as initial data. It then constructs an optimization problem designed to maximize user experience quality while accounting for base station storage and link bandwidth constraints. This problem is broken down into two subproblems: maximizing cache allocation and optimizing routing and forwarding strategies, each of which is solved separately to develop the optimal caching and routing solution. Ultimately, this solution is distributed to each base station, guiding the intelligent caching of video segments and efficient data offloading, ensuring a high-quality panoramic video viewing experience for multiple users. This method leverages a centralized control mechanism to dynamically adapt to network changes, optimize resource allocation, and improve overall service efficiency and user satisfaction.

[0124] Figure 4 FIG is a schematic block diagram of a network panoramic video stream data caching and diversion device 300 provided by an embodiment of the present invention. Figure 4 As shown, corresponding to the above network panoramic video stream data cache diversion method, the present invention also provides a network panoramic video stream data cache diversion device 300. The network panoramic video stream data cache diversion device 300 includes a unit for executing the above network panoramic video stream data cache diversion method, and the device can be configured in a server. Specifically, please refer to Figure 4 The network panoramic video stream data caching and diversion device 300 includes an acquisition unit 301, a construction unit 302, a solution unit 303 and a sending unit 304.

[0125] An acquisition unit 301 is configured to acquire network topology, traffic conditions, and real-time status information of user-requested panoramic video stream segments to obtain initial data; a construction unit 302 is configured to construct an optimization problem based on the initial data, wherein the optimization problem is configured to maximize user experience quality while taking into account base station storage limitations and link bandwidth constraints; a solution unit 303 is configured to decompose the optimization problem into a maximization cache configuration sub-problem and an optimal routing forwarding strategy sub-problem, and solve them separately to obtain an optimal cache and routing solution; a sending unit 304 is configured to send the optimal cache and routing solution to the base station so that the base station caches and distributes data according to the base station-guided video segment.

[0126] In one embodiment, the acquisition unit 301 is configured to acquire network topology, traffic conditions, and real-time status information of user-requested panoramic video stream segments using SDN technology to obtain initial data.

[0127] In one embodiment, if Figure 5 As shown, the construction unit 302 includes a mathematical quantity determination subunit 3021, a formulation subunit 3022, a constraint condition definition subunit 3023 and a combination subunit 3024.

[0128] The mathematical quantity determination subunit 3021 is used to determine and organize the user set, base station set, link set and on-demand panoramic video stream segment set based on the initial data, establish a user on-demand video segment request matrix and a user falling into the base station service area mapping matrix to obtain the mathematical quantity; the formulation subunit 3022 is used to set the link utilization rate from the user to the base station where the cache is located and the video stream segment size as key variables based on the mathematical quantity, and formulate an optimization function with the goal of maximizing the user experience quality gain; the constraint condition definition subunit 3023 is used to define the base station storage capacity upper limit and the link bandwidth limit as constraints; the combination subunit 3024 is used to combine all the key variables of the mathematical quantity, the target optimization function and the constraints to generate an optimization problem.

[0129] The above-mentioned network panoramic video stream data caching and diversion device 300 can be implemented in the form of a computer program. The computer program can be used in the following ways: Figure 6 Runs on the computer device shown.

[0130] See also Figure 6 , Figure 6 1 is a schematic block diagram of a computer device provided in an embodiment of the present application. The computer device 500 may be a server, wherein the server may be an independent server or a server cluster composed of multiple servers.

[0131] See Figure 6 The computer device 500 includes a processor 502 , a memory, and a network interface 505 connected via a system bus 501 , wherein the memory may include a non-volatile storage medium 503 and an internal memory 504 .

[0132] The non-volatile storage medium 503 can store an operating system 5031 and a computer program 5032. The computer program 5032 includes program instructions, which, when executed, can enable the processor 502 to execute a method for caching and offloading network panoramic video stream data.

[0133] The processor 502 is used to provide computing and control capabilities to support the operation of the entire computer device 500.

[0134] The internal memory 504 provides an environment for the operation of the computer program 5032 in the non-volatile storage medium 503. When the computer program 5032 is executed by the processor 502, the processor 502 can execute a network panoramic video stream data caching and diversion method.

[0135] The network interface 505 is used to communicate with other devices through the network. Figure 6The structure shown in the figure is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the computer device 500 to which the solution of the present application is applied. The specific computer device 500 may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0136] The processor 502 is configured to execute a computer program 5032 stored in the memory to implement the following steps:

[0137] Acquiring real-time status information on network topology, traffic conditions, and user requests for panoramic video stream segments to obtain initial data; constructing an optimization problem based on the initial data, wherein the optimization problem is used to maximize user experience quality while considering base station storage limitations and link bandwidth constraints; decomposing the optimization problem into a maximization cache configuration subproblem and an optimal routing forwarding strategy subproblem, and solving each of these subproblems to obtain an optimal cache and routing solution; and transmitting the optimal cache and routing solution to a base station so that the base station guides caching and data diversion of video segments according to the optimal cache and routing solution.

[0138] The maximization cache configuration sub-problem is expressed as: Where I is the set of all base stations, E is the set of all X2 links, and U is the set of users; u∈U, m∈M, M is the set of on-demand panoramic video stream segments; the cache space size of base station i is i∈I.

[0139] The optimal routing forwarding strategy sub-problem is expressed as:

[0140] The optimal caching and routing solutions include:

[0141] When c i,m =0 and When a user in the area of ​​base station i requests segment m, it needs to go through the backbone network and cannot be diverted by the X2 link;

[0142] When c i,m =0 and When a user in the jurisdiction of base station i requests segment m, it can be diverted from other base stations via the X2 link. The base station information is given;

[0143] When c i,m =1 and When a user in the jurisdiction of base station i requests segment m, it is directly provided by this base station without the need for backbone network and X2 link offload.

[0144] In one embodiment, when the processor 502 implements the step of obtaining the network topology, traffic status, and real-time status information of the user-requested panoramic video stream segment to obtain the initial data, the processor 502 specifically implements the following steps:

[0145] SDN technology is used to obtain the network topology, traffic conditions and real-time status information of user-requested panoramic video stream segments to obtain initial data.

[0146] In one embodiment, when implementing the step of constructing the optimization problem based on the initial data, the processor 502 specifically implements the following steps:

[0147] Based on the initial data, the user set, base station set, link set and on-demand panoramic video stream segment set are determined and organized, and a user on-demand video segment request matrix and a user falling into the base station service area mapping matrix are established to obtain mathematical quantities; based on the mathematical quantities, the link utilization rate from the user to the base station where the cache is located and the size of the video stream segment are set as key variables, and an optimization function is formulated with the goal of maximizing the user experience quality gain; the base station storage capacity upper limit and the link bandwidth limit are defined as constraints; and all the key variables of the mathematical quantities, the target optimization function and the constraints are combined to generate an optimization problem.

[0148] The constraints include that the total size of video clips that can be cached by the base station cannot be larger than the base station's inherent storage space, and the total link utilization cannot exceed its bandwidth.

[0149] It should be understood that in the embodiment of the present application, the processor 502 may be a central processing unit (CPU), and the processor 502 may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0150] Those skilled in the art will appreciate that all or part of the steps in the method of the above-described embodiment can be implemented by instructing the relevant hardware through a computer program. The computer program includes program instructions, which can be stored in a storage medium that is computer-readable. The program instructions are executed by at least one processor in the computer system to implement the steps in the method of the above-described embodiment.

[0151] Therefore, the present invention also provides a storage medium. The storage medium may be a computer-readable storage medium. The storage medium stores a computer program, wherein when the computer program is executed by a processor, the processor performs the following steps:

[0152] Acquiring real-time status information on network topology, traffic conditions, and user requests for panoramic video stream segments to obtain initial data; constructing an optimization problem based on the initial data, wherein the optimization problem is used to maximize user experience quality while considering base station storage limitations and link bandwidth constraints; decomposing the optimization problem into a maximization cache configuration subproblem and an optimal routing forwarding strategy subproblem, and solving each of these subproblems to obtain an optimal cache and routing solution; and transmitting the optimal cache and routing solution to a base station so that the base station guides caching and data diversion of video segments according to the optimal cache and routing solution.

[0153] The maximization cache configuration sub-problem is expressed as: Where I is the set of all base stations, E is the set of all X2 links, and U is the set of users; u∈U, m∈M, M is the set of on-demand panoramic video stream segments; the cache space size of base station i is i∈I.

[0154] The optimal routing forwarding strategy sub-problem is expressed as:

[0155] The optimal caching and routing solutions include:

[0156] When c i,m =0 and When a user in the area of ​​base station i requests segment m, it needs to go through the backbone network and cannot be diverted by the X2 link;

[0157] When c i,m =0 and When a user in the jurisdiction of base station i requests segment m, it can be diverted from other base stations via the X2 link. The base station information is given;

[0158] When c i,m =1 and When a user in the jurisdiction of base station i requests segment m, it is directly provided by this base station without the need for backbone network and X2 link offload.

[0159] In one embodiment, when the processor executes the computer program to implement the step of obtaining the network topology, traffic status, and real-time status information of the user-requested panoramic video stream segment to obtain the initial data, the processor specifically implements the following steps:

[0160] SDN technology is used to obtain the network topology, traffic conditions and real-time status information of user-requested panoramic video stream segments to obtain initial data.

[0161] In one embodiment, when the processor executes the computer program to implement the step of constructing the optimization problem based on the initial data, the processor specifically implements the following steps:

[0162] Based on the initial data, the user set, base station set, link set and on-demand panoramic video stream segment set are determined and organized, and a user on-demand video segment request matrix and a user falling into the base station service area mapping matrix are established to obtain mathematical quantities; based on the mathematical quantities, the link utilization rate from the user to the base station where the cache is located and the size of the video stream segment are set as key variables, and an optimization function is formulated with the goal of maximizing the user experience quality gain; the base station storage capacity upper limit and the link bandwidth limit are defined as constraints; and all the key variables of the mathematical quantities, the target optimization function and the constraints are combined to generate an optimization problem.

[0163] The constraints include that the total size of video clips that can be cached by the base station cannot be larger than the base station's inherent storage space, and the total link utilization cannot exceed its bandwidth.

[0164] The storage medium may be any computer-readable storage medium that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a magnetic disk, or an optical disk.

[0165] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the above description has generally described the composition and steps of each example according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0166] In the several embodiments provided herein, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the various units is merely a logical functional division, and actual implementation may employ other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be omitted or not implemented.

[0167] The steps in the methods of the embodiments of the present invention may be adjusted in order, combined, or deleted as needed. The units in the devices of the embodiments of the present invention may be combined, divided, or deleted as needed. Furthermore, the functional units in the various embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit.

[0168] If this integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the existing technology, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, terminal, or network device, etc.) to execute all or part of the steps of the method described in various embodiments of the present invention.

[0169] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and such modifications or substitutions are intended to be within the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be subject to the scope of protection of the claims.

Claims

1. A method for caching and distributing network panoramic video stream data, characterized in that: include: Obtaining the network topology, traffic conditions, and real-time status information of the user's request for the panoramic video stream segment to obtain initial data; constructing an optimization problem based on the initial data, wherein the optimization problem is used to maximize user experience quality while considering base station storage limitations and link bandwidth constraints; Decomposing the optimization problem into a maximizing cache configuration subproblem and an optimal routing and forwarding strategy subproblem, and solving them separately to obtain the optimal cache and routing solutions; The optimal caching and routing solution is sent to a base station, so that the base station guides caching and data distribution of video segments according to the optimal caching and routing solution.

2. The method for caching and distributing network panoramic video stream data according to claim 1, characterized in that: The acquisition of network topology, traffic conditions, and real-time status information of user-requested panoramic video stream segments to obtain initial data includes: SDN technology is used to obtain the network topology, traffic conditions and real-time status information of user-requested panoramic video stream segments to obtain initial data.

3. The method for caching and distributing network panoramic video stream data according to claim 1, wherein: The constructing of the optimization problem based on the initial data includes: Determine and organize a user set, a base station set, a link set, and a set of on-demand panoramic video stream segments based on the initial data, establish a user on-demand video segment request matrix and a user falling into a base station service area mapping matrix to obtain a mathematical quantity; Based on the mathematical quantity, the link utilization from the user to the base station where the cache is located and the size of the video stream segment are set as key variables, and an optimization function is formulated with the goal of maximizing the user experience quality gain; Define the upper limit of base station storage capacity and link bandwidth limit as constraints; Combine all key variables of mathematical quantities, target optimization functions and constraints to generate an optimization problem.

4. The method for caching and distributing network panoramic video stream data according to claim 3, wherein: The constraints include that the total size of video clips that can be cached by the base station cannot be larger than the base station's inherent storage space, and the total link utilization cannot exceed its bandwidth.

5. The method for caching and distributing network panoramic video stream data according to claim 3, characterized in that: The maximization cache configuration subproblem is expressed as: Where I is the set of all base stations, E is the set of all X2 links, and U is the set of users; u∈U, m∈M, M is the set of on-demand panoramic video stream segments; the cache space size of base station i is i∈I.

6. The method for caching and offloading network panoramic video stream data according to claim 5, characterized in that: The optimal routing forwarding strategy sub-problem is expressed as:

7. The method for caching and offloading network panoramic video stream data according to claim 6, characterized in that: The optimal caching and routing solutions include: When c i,m =0 and When a user in the area of ​​base station i requests segment m, it needs to go through the backbone network and cannot be diverted by the X2 link; When c i,m =0 and When a user in the jurisdiction of base station i requests segment m, it can be diverted from other base stations via the X2 link. The base station information is given; When c i,m =1 and When a user in the jurisdiction of base station i requests segment m, it is directly provided by this base station without the need for backbone network and X2 link offload.

8. Network panoramic video stream data cache and diversion system, characterized by: include: An acquisition unit, configured to acquire network topology, traffic conditions, and real-time status information of a user-requested panoramic video stream segment to obtain initial data; a construction unit, configured to construct an optimization problem based on the initial data, wherein the optimization problem is configured to maximize user quality of experience while taking into account base station storage limitations and link bandwidth constraints; A solving unit, configured to decompose the optimization problem into a maximizing cache configuration sub-problem and an optimal routing and forwarding strategy sub-problem, and solve them separately to obtain an optimal cache and routing solution; The sending unit is configured to send the optimal caching and routing solution to a base station, so that the base station performs caching and data distribution of the video segments as directed by the base station.

9. The network panoramic video stream data caching and diversion system according to claim 8, characterized in that: The acquisition unit is used to adopt SDN technology to acquire network topology, traffic status and real-time status information of user-requested panoramic video stream segments to obtain initial data.

10. A computer device, characterized in that: The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the method according to any one of claims 1 to 7 when executing the computer program.

Images