Network transmission control optimization method and system based on traffic demand

Abstract

The invention discloses a network transmission control optimization method and system based on a traffic demand, and relates to the technical field of network transmission, and the method comprises the steps: obtaining a video data stream, carrying out the track type division and region importance evaluation of the video data stream, generating a track demand, and mapping the track demand into a track demand table; link state information is extracted from the transmission link, corresponding mapping is carried out on the link state information according to the track demand table to form a demand link relation, a matching range is delineated according to the demand link relation, and a link performance value of the transmission link is determined through the link state information; performing screening matching on the track demand quantity and the link performance value in the matching range to form a link binding result; and establishing a time synchronization relationship of the video tracks, and writing the time synchronization relationship into scheduling data of a link binding result. According to the invention, track type division and regional importance evaluation are carried out on the video data stream, so that the transmission efficiency and the user experience are improved.

Description

Technical Field

[0001] This invention relates to the field of network transmission technology, and in particular to a network transmission control optimization method and system based on traffic demand. Background Technology

[0002] In modern network environments, the demand for multimedia data transmission, especially real-time video streaming, is rapidly increasing, prompting network transmission control technology to develop towards refinement and intelligence. Video streaming is characterized by its track-based nature, time sensitivity, and significant differences in regional importance, placing high demands on network bandwidth resources, link performance, and scheduling strategies. By classifying video streaming into track types and assessing regional importance, track demand can be generated, providing a quantitative basis for the dynamic allocation of network resources. Network transmission control, by mapping and matching link status information with track demand, achieves link binding optimization and controls the transmission order and rate of scheduled data through time synchronization mechanisms. This ensures the continuity and consistency of video streaming during transmission, improving overall network transmission efficiency and service quality.

[0003] Existing network transmission control methods typically lack a precise matching mechanism between track demand and link performance when processing multi-track video data streams. This makes it difficult for link resource allocation to fully meet the dynamic transmission needs of different tracks, thus affecting the continuity and transmission stability of video data streams. Existing technologies usually use fixed priority scheduling or pre-allocation of overall bandwidth for resource scheduling, which has the problems of coarse scheduling granularity and delayed response to changes in link status. Summary of the Invention

[0004] In view of the aforementioned existing problems, the present invention is proposed.

[0005] Therefore, this invention provides a network transmission control optimization method based on traffic demand to solve the problems of coarse scheduling granularity and delayed response to changes in link status.

[0006] To solve the above-mentioned technical problems, the present invention provides the following technical solution: In a first aspect, the present invention provides a network transmission control optimization method based on traffic demand, comprising, Acquire video data streams, classify video data streams by track type and assess regional importance, generate track demand quantities and map them to a track demand table; Link status information is extracted from the transmission link, and the link status information is mapped to the track demand table to form a demand link relationship. The matching range is defined based on the demand link relationship. The link performance value of the transmission link is determined through the link status information. Within the matching range, the track demand and the link performance value are filtered and matched to form a link binding result. The transmission link is the communication path that carries the transmission of video data stream in the network environment. Establish the time synchronization relationship of the video track and write it into the scheduling data of the link binding result. Use the time synchronization relationship to control the sending order and sending rate of the scheduling data to obtain the track transmission control set. The transmission status is obtained from the track transmission control center, the consistency between the transmission status and the time synchronization is verified, and the scheduling data in the link binding result is corrected based on the verification result to obtain the transmission control result.

[0007] As a preferred embodiment of the network transmission control optimization method based on traffic demand described in this invention, the track type division is to classify the video frame data, audio data, and timestamp data in the video data stream according to the differences in the type of video data stream, and divide them into data streams of different video track types; The regional importance assessment involves determining the importance of each frame region in the video data stream, converting the importance value of each frame region into a regional priority label, and then aggregating the regional priority labels according to the track type division results to generate track demand.

[0008] As a preferred embodiment of the network transmission control optimization method based on traffic demand described in this invention, wherein: the formation of demand link relationships specifically refers to, Extract the track demand quantity and track type identifier from the track demand table, and arrange them in chronological order to form a sequence of track demand items; Link status information is obtained from the transmission links and arranged sequentially according to the source order of the transmission links to form a link status sequence; The link status information in the link status sequence is aligned to the time position corresponding to the track demand item sequence according to the timestamp, thus generating a time-aligned link sequence. In the time-aligned link sequence, the bandwidth status and delay status in the link status information are compared item by item with the track demand in the track demand item sequence to filter out the link status information that meets the track demand constraint and form qualified link status information. The track demand quantity in the track demand item sequence is matched with the qualified link status information to form a demand link relationship.

[0009] As a preferred embodiment of the network transmission control optimization method based on traffic demand described in this invention, wherein: the step of defining the matching range and determining the link performance value of the transmission link specifically involves, The qualified link status information in the demand link relationship is grouped according to the track demand, and the qualified link status information corresponding to the same track demand is arranged into a continuous time sequence. Based on a continuous time sequence, link status information of the same transmission link at consecutive time locations is spliced ​​together to form a continuous link segment. Perform continuity checks on consecutive link segments, remove link status information corresponding to time interruption locations, and use the remaining link status information as the matching range; The bandwidth status and delay status in the remaining link status information are jointly determined to form the link performance value of the transmission link.

[0010] As a preferred embodiment of the network transmission control optimization method based on traffic demand described in this invention, wherein: the formation of the link binding result specifically refers to, Within the matching range, the link performance value is partitioned and constrained according to the track demand, and the link performance value is divided into multiple continuous performance intervals according to the bandwidth status and latency status. Within multiple continuous performance intervals, the track demand and link performance values ​​are used to determine the continuous performance intervals that satisfy the track demand. Perform continuity checks across time locations for continuous performance intervals, and retain link performance values ​​that remain consistent across multiple time locations; A range mapping is performed between the track demand and the reserved link performance values ​​to form the link binding result.

[0011] As a preferred embodiment of the network transmission control optimization method based on traffic demand described in this invention, the establishment of the time synchronization relationship of video tracks involves reading the timestamp data corresponding to each video track from the video data stream, aligning the time positions of each video track one by one according to the timestamp data, and uniformly associating the time positions of each video track corresponding to the same timestamp during the alignment process to form a time synchronization relationship between video tracks.

[0012] As a preferred embodiment of the network transmission control optimization method based on traffic demand described in this invention, the method of controlling the transmission order of scheduling data involves sorting the scheduling data according to the time synchronization relationship and adjusting the order of the sorting results according to the delay status in the link status information. The method of controlling the transmission rate of the scheduling data involves dividing the scheduling data into segments according to the time synchronization relationship, and dynamically allocating and limiting the transmission rhythm of each segment of the scheduling data based on the bandwidth status in the link status information.

[0013] As a preferred embodiment of the network transmission control optimization method based on traffic demand described in this invention, the consistency verification involves comparing the time position in the transmission state with the time position in the time synchronization relationship item by item, and identifying and marking the offset of inconsistent time positions.

[0014] As a preferred embodiment of the network transmission control optimization method based on traffic demand described in this invention, the step of correcting the scheduling data in the link binding result is to align and correct the time position offset in the scheduling data by using difference markers, and to adjust the sending order and sending rate of the corresponding time position in the scheduling data in a linked constraint.

[0015] Secondly, the present invention provides a network transmission control optimization system based on traffic demand, comprising, The demand module is used to acquire video data streams, classify the video data streams into track types and assess the importance of regions, generate track demand quantities and map them into a track demand table. The matching module is used to extract link status information from the transmission link, map the link status information to the track demand table to form a demand link relationship, define the matching range based on the demand link relationship, determine the link performance value of the transmission link through the link status information, and filter and match the track demand quantity with the link performance value within the matching range to form a link binding result. The transmission link is the communication path that carries the transmission of video data stream in the network environment. The control module is used to establish the time synchronization relationship of the video track and write it into the scheduling data of the link binding result. It performs transmission order control and transmission rate control on the scheduling data through the time synchronization relationship to obtain the track transmission control set. The correction module is used to obtain the transmission status from the track transmission control center, perform consistency verification between the transmission status and the time synchronization relationship, and correct the scheduling data in the link binding result based on the verification result to obtain the transmission control result.

[0016] The beneficial effects of this invention are as follows: By classifying video data streams by track type and assessing regional importance, it achieves refined classification and priority quantification of video frame data, audio data, and timestamp data, mapping the importance of different screen regions to track demand, thereby forming a track demand table. Using this track demand table, it performs targeted mapping and matching of link states, enabling priority transmission of video frames and audio information in critical tracks and high-priority areas, ensuring consistency in transmission order and time synchronization, thus improving the continuity and stability of video data streams in the network environment. Through this technique, network resources can be flexibly scheduled according to track demand, significantly reducing the risk of losing critical frames, improving transmission efficiency and user experience, and optimizing the accuracy and reliability of video transmission control. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a flowchart of a network transmission control optimization method based on traffic demand.

[0019] Figure 2 This is a schematic diagram of a network transmission control optimization system based on traffic demand.

[0020] Figure 3 A flowchart for determining the demand link relationships and link performance values.

[0021] Figure 4 A flowchart for link binding, transmission control, and correction. Detailed Implementation

[0022] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0023] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the invention. Therefore, the invention is not limited to the specific embodiments disclosed below.

[0024] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in different places in this specification does not necessarily refer to the same embodiment, nor is it a single or selective embodiment that is mutually exclusive with other embodiments.

[0025] Reference Figures 1-4 This is one embodiment of the present invention, which provides a network transmission control optimization method based on traffic demand, including the following steps: S1. Acquire video data stream, classify the video data stream into track types and assess regional importance, generate track demand and map it into a track demand table.

[0026] S1. Establish a data access channel from the video data source and receive continuously transmitted video data streams, where the video data source includes the video encoded stream output by the real-time acquisition device, the video file encapsulation stream, and the media stream data transmitted over the network; during the receiving process, uniformly encapsulate and identify the video frame data, audio data, and timestamp data in the video data stream, and arrange them sequentially according to the increasing order of the timestamp data to form a video data stream sequence with a continuous time relationship.

[0027] When forming a video data stream sequence, the frame type identifier, resolution information, and encoding format of the video frame data are parsed and recorded, the sampling rate information and encoding format of the audio data are parsed and recorded, and the timestamp data is uniformly converted into time position marks under the same time base, thereby generating a video data stream with consistent time sequence, clear data structure, and which can be used for subsequent track type division and regional importance assessment.

[0028] S1.1 Track type classification categorizes video frame data, audio data, and timestamp data within a video data stream according to their type, dividing them into different video track types. Region importance assessment determines the importance of each frame region within the video data stream, converting the importance value of each region into a region priority label. These region priority labels are then aggregated according to the track type classification results to generate track demand. Specifically... In the video data stream sequence, data classification rules are established based on the differences in the field structure of video frame data, audio data, and timestamp data. The part containing the image pixel matrix and frame type identifier is divided into the video frame data track, the part containing the audio channel sampling sequence and sampling rate information is divided into the audio data track, and the part containing the time position mark is divided into the timestamp data track, thus forming the video frame data track, audio data track, and timestamp data track.

[0029] Within the video frame data track, each frame image is divided into a fixed-size grid of picture areas according to the spatial resolution of the video frame data. The size of the grid is determined proportionally to the resolution of the video frame data. For example, the width and height are divided into several equal parts to form regular rectangular areas.

[0030] The intensity of pixel changes and the degree of edge changes in each frame area are jointly determined. The intensity of pixel changes is determined by the magnitude of the pixel difference in the corresponding frame area in the video frame data of adjacent time positions, and the degree of edge changes is determined by the pixel gradient changes in the frame area. The importance value of the frame area is formed by normalizing the intensity of pixel changes and the degree of edge changes.

[0031] The importance value is determined by a combination of pixel change intensity and edge change intensity, expressed as: ; In the formula, This represents the numerical value indicating the importance of a particular area in the image. This represents the weighting coefficient of pixel change intensity in the importance value. The weighting coefficients for edge change intensity in the importance value are as follows: pixel change intensity corresponds to the pixel difference amplitude within the same frame area of ​​video frame data at adjacent time positions, while edge change intensity corresponds to the pixel gradient change amplitude within the current frame area. The weighting coefficients are determined based on the dominance of temporal change amplitude and spatial structure change amplitude. When temporal change amplitude is dominant, the weighting coefficient corresponding to pixel change intensity is higher to highlight inter-frame change information; when spatial structure change is dominant, the weighting coefficient corresponding to edge change intensity is higher to highlight image contour and detail information. The pixel change intensity is the average of the absolute values ​​of the differences between all pixels within the same frame region in two adjacent video frames. The edge variation is the average value of the pixel gradient magnitude within the current image area. The pixel gradient is obtained by combining the differences between adjacent pixels in the horizontal and vertical directions.

[0032] It should be noted that the pixel difference in pixel change intensity refers to establishing a one-to-one pairing relationship between positions with the same pixel coordinates within the same frame area in two adjacent time frames. The pixel value at the pixel coordinates of the video frame data at the previous time position is processed by the difference between the pixel value at the pixel coordinates of the video frame data at the next time position, thus obtaining the pixel difference at the corresponding pixel coordinate position. The pixel gradient in edge change degree refers to the difference processing of the gray value of each pixel coordinate position within the current frame area with the gray values ​​of adjacent pixel coordinate positions in the horizontal and vertical directions, and the combination of the difference results in the two directions to obtain the pixel gradient magnitude at that pixel coordinate position. The magnitude of the importance value is positively correlated with the combined result of the pixel difference and pixel gradient magnitude. When the pixel difference and pixel gradient magnitude increase as a whole, it indicates that the temporal and spatial structural changes of the frame area are more obvious, thus corresponding to a higher importance value.

[0033] The importance values ​​of screen regions are mapped to region priority markers according to their numerical values. The region priority markers are divided into high priority, medium priority, and low priority. High priority corresponds to the importance value of the top 30% of the total importance values ​​of all screen regions, which is used for priority resource allocation. Medium priority corresponds to the middle range, which is used for normal resource allocation. Low priority corresponds to the bottom 30% of the range, which is used to reduce resource allocation.

[0034] After completing the regional priority marking, the corresponding regional priority marks are collected according to the video frame data track, audio data track, and timestamp data track. Combining the distribution density and priority ratio of each track in the time sequence, the regional priority marks are converted into track demand. The track demand is determined by the proportion of high priority marks and the length of the continuous time distribution. Finally, the track demand corresponding to the video frame data track, audio data track, and timestamp data track is registered one-to-one with the track type identifier to form a track demand table with a unified structure and time sequence index.

[0035] It should be noted that the track requirement for video frame data tracks is determined based on the numerical value of regional importance, the track requirement for audio data tracks is determined based on the sampling rate and the length of the continuous temporal distribution, and the track requirement for timestamp data tracks is determined based on the density of time position markers. The track requirement for each track is determined independently.

[0036] S2. Extract link status information from the transmission link and map the link status information to the track demand table to form a demand link relationship. Determine the matching range based on the demand link relationship. Determine the link performance value of the transmission link through the link status information. Within the matching range, filter and match the track demand quantity with the link performance value to form a link binding result. The transmission link is the communication path that carries the transmission of video data streams in the network environment.

[0037] S2.1 Extract the track demand quantity and track type identifier from the track demand table, and arrange them in chronological order to form a track demand item sequence; obtain the link status information from the transmission link, and arrange the link status information in the order of the transmission link source to form a link status sequence; align the link status information in the link status sequence to the time position corresponding to the track demand item sequence according to the timestamp to generate a time-aligned link sequence.

[0038] S2.2 In the time-aligned link sequence, the bandwidth status and delay status in the link status information are compared item by item with the track demand in the track demand item sequence. Link status information that meets the track demand constraints is selected to form qualified link status information. Specifically, In the time-aligned link sequence, a one-to-one correspondence is established between the link status information at each time position and the track demand quantity in the track demand item sequence. The bandwidth and delay values ​​in the track demand quantity are used as the criteria for judgment. The bandwidth status value in the link status information is compared with the bandwidth value, and the delay status value in the link status information is compared with the delay value. The bandwidth value is obtained by mapping the proportion of high-priority markers corresponding to the track demand quantity and the length of the continuous time distribution. The delay value is obtained by mapping the length of the continuous time distribution corresponding to the track demand quantity in reverse.

[0039] When the bandwidth status value in the link status information is greater than or equal to the required bandwidth value, and the delay status value in the link status information is less than or equal to the required delay value, the link status information at the current time position is determined to meet the track demand constraint and is retained; when the bandwidth status value in the link status information is less than the required bandwidth value or the delay status value in the link status information is greater than the required delay value, the link status information at the current time position is determined to not meet the track demand constraint and is removed.

[0040] After completing the item-by-item comparison of all time locations, all link status information that meets the track requirement constraints is collected in chronological order to form qualified link status information.

[0041] It should be noted that the track requirement for video frame data tracks is determined based on the numerical value of regional importance, the track requirement for audio data tracks is determined based on the sampling rate and the length of the continuous temporal distribution, and the track requirement for timestamp data tracks is determined based on the density of time position markers. The track requirement for each track is determined independently.

[0042] The required bandwidth value for the video frame data track is determined by the amount of data per unit time and the length of the continuous time distribution, while the required latency value is determined by the length of the continuous time distribution.

[0043] S2.3 Match the track demand quantities in the track demand item sequence with the qualified link status information to form a demand link relationship. Specifically, Under a unified time sequence, a time-location consistent correspondence is established between the track demand quantity at each time position in the track demand item sequence and the link status information at the same time position in the qualified link status information.

[0044] When multiple qualified link status information exist at the same time and location, the difference between the bandwidth status value and the required bandwidth value in the link status information is used as the priority matching criterion, and the difference between the delay status value and the required delay value in the link status information is used as the auxiliary judgment criterion. The link status information with the smallest difference between the bandwidth status value and the required bandwidth value and the smallest difference between the delay status value and the required delay value is selected as the target matching link status information.

[0045] When only one qualified link status information exists at the same time location, a matching relationship is established between the qualified link status information at that time location and the track demand at the corresponding time location.

[0046] If no qualified link status information exists at the same time location, the track demand at the corresponding time location will be marked as unmatched, and the corresponding time location will be reserved for subsequent processing.

[0047] After completing the item-by-item matching of all time locations, the track demand, corresponding matching link status information, and matching status of each time location are associated and registered to form a demand link relationship organized in chronological order.

[0048] It should be noted that when there are multiple track requirements at the same time location, they are allocated according to the size of the track requirements. Unmatched track requirements will continue to be matched at subsequent time locations or undergo transmission rate compression processing.

[0049] S2.4. Group the qualified link status information in the demand link relationship according to the track demand, and arrange the qualified link status information corresponding to the same track demand into a continuous time series, specifically as follows: Using the track demand quantity in the track demand item sequence as the group identifier, the qualified link status information corresponding to the track demand quantity at each time position in the demand link relationship is grouped into a set with the same track demand quantity identifier. Then, the qualified link status information with completely identical track demand quantity values ​​is merged to form multiple group sets based on the track demand quantity as the distinguishing criterion.

[0050] Within each group set, qualified link status information is sequentially arranged according to time position markers, and the continuity of adjacent time positions is determined. The time continuity determination is determined by judging whether the time interval between adjacent time positions is equal to the basic time interval in the video data stream sequence. When the time interval between adjacent time positions is equal to the basic time interval, the corresponding qualified link status information is connected to form a time continuous sequence. When the time interval between adjacent time positions is greater than the basic time interval, the sequence is segmented at the time interval breakpoint. One or more time continuous sequences arranged by consecutive time positions are formed within each track demand group set.

[0051] S2.5. Based on a continuous time sequence, link state information of the same transmission link at consecutive time locations is spliced ​​together to form continuous link segments. Specifically, In a continuous time sequence, the link status information with the same transmission link identifier and continuous time position is merged and organized based on the transmission link identifier.

[0052] Under the same transmission link identifier, the link status information is arranged in ascending order of time position, and the time interval between adjacent time positions is determined one by one. When the time interval between adjacent time positions is equal to the basic time interval in the video data stream sequence, the link status information of the corresponding time position is connected in sequence to form a link segment. When the time interval between adjacent time positions is greater than the basic time interval, the current link segment ends at the time interval breakpoint and a new link segment connection starts from the time position after the breakpoint.

[0053] During the connection process, the bandwidth status value and delay status value corresponding to each time position are recorded one by one, forming a continuous link segment that is divided according to the transmission link identifier and is continuous in time position.

[0054] S2.6 Perform continuity checks on continuous link segments, remove link status information corresponding to time interruption locations, and use the remaining link status information as the matching range. Specifically, In each continuous link segment, the link status information is checked item by item in ascending order of time position, and a consistency determination is performed on the time interval between adjacent time positions. The time interval consistency determination is achieved by comparing the time difference between adjacent time positions with the basic time interval in the video data stream sequence. When the time difference between adjacent time positions is equal to the basic time interval, it is determined to be continuous; when the time difference between adjacent time positions is greater than the basic time interval, it is determined to be a time interruption.

[0055] For locations identified as time interruptions, the link status information corresponding to the time interruption location, as well as the link status information from the time interruption location until the next consecutive time location, are all removed. Only the link status information that remains continuous at the time location and has not experienced a time interruption is retained.

[0056] After completing the item-by-item verification of all continuous link segments, the link status information of all those that have not been eliminated and meet the time continuity is collected in chronological order, which serves as the matching range for subsequent track demand and link performance value matching processing.

[0057] S2.7. Jointly determine the bandwidth status and delay status in the remaining link status information to form the link performance value of the transmission link, specifically, It should be noted that before dividing the interval, the link performance value is compared with the required bandwidth value and the required latency value item by item, and only the link status information that meets the required bandwidth value and the required latency value is retained to participate in the interval division.

[0058] In the remaining link status information, the bandwidth status value and the delay status value are evaluated item by item in order of time position, and the bandwidth status value and delay status value at the same time position are combined into the link performance value judgment object.

[0059] When performing dual-condition judgment processing for each time position, the bandwidth status value is divided into high bandwidth interval and low bandwidth interval according to the numerical value pattern, and the latency status value is divided into low latency interval and high latency interval according to the numerical value pattern. The high bandwidth interval corresponds to the bandwidth status value located in the first 30% interval of the bandwidth status value distribution of all remaining link status information, and the low bandwidth interval corresponds to the last 30% interval. The low latency interval corresponds to the latency status value located in the first 30% interval of the latency status value distribution of all remaining link status information, and the high latency interval corresponds to the last 30% interval.

[0060] It should be noted that the division between the first 30% interval and the last 30% interval is determined based on the sorting results of the bandwidth status value sequence and the delay status value sequence of the remaining link status information within the current continuous time range. After sorting the bandwidth status value sequence and the delay status value sequence from largest to smallest and from smallest to largest, the corresponding proportion intervals are extracted respectively, thereby forming a numerical interval with relative advantages and disadvantages in distinguishing performance within the current continuous time range, so that the bandwidth status value and the delay status value have a unified comparison scale between different time positions.

[0061] When the bandwidth status value is in the high bandwidth range and the latency status value is in the low latency range, the link performance value at the corresponding time position is determined to be in a high performance state. When the bandwidth status value is in the low bandwidth range or the latency status value is in the high latency range, the link performance value at the corresponding time position is determined to be in a low performance state. When both the bandwidth status value and the latency status value are in the middle range, the link performance value at the corresponding time position is determined to be in a medium performance state.

[0062] After completing the item-by-item determination of all time positions, the link performance value status corresponding to each time position is associated with the transmission link identifier and registered to form the link performance value of the transmission link at each time position.

[0063] It should be noted that the link performance value of the transmission link is determined by the combination of the bandwidth status value range and the delay status value range in the remaining link status information at each time position. At each time position, the bandwidth status value is divided into high bandwidth, medium bandwidth, and low bandwidth ranges, and the delay status value is divided into low delay, medium delay, and high delay ranges. When the bandwidth status value is in the high bandwidth range and the delay status value is in the low delay range, the corresponding time position is determined to be in a high performance state. When the bandwidth status value is in the low bandwidth range or the delay status value is in the high delay range, the corresponding time position is determined to be in a low performance state. When the bandwidth status value is in the medium bandwidth range and the delay status value is in the medium delay range, the corresponding time position is determined to be in a medium performance state. The determination results of each time position are registered with the transmission link identifier to form the link performance value representation result of the transmission link in the time dimension.

[0064] S2.8 Within the matching range, the link performance value is partitioned according to the track demand, and the link performance value is divided into multiple continuous performance intervals based on bandwidth and latency status. Specifically, Within the matching range, using the track demand quantity in the track demand item sequence as the constraint benchmark, the link performance values ​​in the matching range are compared item by item according to time position. An alignment relationship is established between the link performance value status at each time position and the track demand quantity at the corresponding time position. The link performance value status is constrained and filtered according to the required bandwidth value and required delay value in the track demand quantity. When the bandwidth status value corresponding to the link performance value status meets the required bandwidth value and the delay status value meets the required delay value, the corresponding time position is marked as a valid time position that meets the constraints. When the link performance value status does not meet either of the above conditions, the corresponding time position is marked as a constraint failure time position.

[0065] After marking is completed, all valid time positions are continuously connected in ascending order of time position. The link performance values ​​of adjacent time positions that are all valid time positions and whose time interval is equal to the basic time interval in the video data stream sequence are sequentially spliced ​​to form a continuous performance interval. When there is a constraint failure time position between adjacent time positions or the time interval is greater than the basic time interval, the continuous performance interval is broken at the corresponding position and a new continuous performance interval is restarted.

[0066] In the process of forming continuous performance intervals, the bandwidth state value and delay state value within each continuous performance interval are recorded in intervals to obtain multiple continuous performance intervals composed of bandwidth state values ​​and delay state values ​​that are continuous at multiple time positions and simultaneously meet the track demand constraints.

[0067] S2.9. Within multiple continuous performance intervals, the track demand and link performance values ​​are used to determine the intervals that satisfy the track demand. Specifically, Each continuous performance interval in the multiple continuous performance intervals is expanded according to its time position, and the bandwidth state value sequence and delay state value sequence within the continuous performance interval are compared with the required bandwidth value and required delay value in the track requirement item sequence.

[0068] A consistency check is performed on all time locations within the same continuous performance interval. When the bandwidth status values ​​of all time locations within the continuous performance interval are greater than or equal to the required bandwidth value and the delay status values ​​of all time locations are less than or equal to the required delay value, the current continuous performance interval is marked as a continuous performance interval that meets the track requirements.

[0069] If the bandwidth status value at any time point in the continuous performance interval is less than the required bandwidth value or the delay status value at any time point is greater than the required delay value, then the current continuous performance interval is split according to the time point where the condition is not met. The splitting process uses the time point where the constraint of the required bandwidth value or the required delay value is not met as the dividing point, breaks the continuous performance interval at the corresponding time point, and treats the consecutive time segments formed before and after the break as independent continuous performance intervals for subsequent consistency verification.

[0070] The consistency check is re-executed for each of the sub-intervals obtained from the division, and only the sub-intervals that simultaneously meet the requirements for bandwidth and latency values ​​at all time points are retained; all continuous performance intervals that pass the consistency check are aggregated in chronological order as continuous performance intervals that meet the track requirements.

[0071] S2.10. Perform continuity checks across time locations on continuous performance intervals, retaining link performance values ​​that remain consistent across multiple time locations. Specifically, Following the time position sequence of the continuous performance interval, the bandwidth status value interval division results and the delay status value interval division results corresponding to adjacent time positions are read one by one. The interval division results of the previous time position and the next time position are paired and compared. When the bandwidth status value interval division results and the delay status value interval division results are consistent, the corresponding time positions are included in the same stable interval.

[0072] When the bandwidth status value interval division result changes or the delay status value interval division result changes at any time position, the corresponding time position is used as the dividing point to break the original continuous performance interval and form a new continuous time segment. The above pairing comparison is performed on all continuous time segments, and only the continuous time segments in which the bandwidth status value interval division result and the delay status value interval division result do not change at all time positions are retained. The retained continuous time segments are used as the link performance values ​​that remain consistent across multiple time positions.

[0073] S2.11. Perform interval mapping between track demand and reserved link performance values ​​to form link binding results, specifically, Each time position in the track demand item sequence is matched with the time segment containing the reserved link performance value. When there are multiple time segments containing link performance values ​​at the same time position, the differences between the bandwidth status value and the required bandwidth value, as well as the differences between the delay status value and the required delay value, are compared for each time segment. The time segment with the smallest difference between the bandwidth status value and the required bandwidth value, and the smallest difference between the delay status value and the required delay value is selected as the mapping object.

[0074] When there is only one continuous time segment containing a link performance value at the same time location, a mapping relationship between the track demand and the corresponding continuous time segment is directly established; when there is no continuous time segment containing a link performance value at the same time location, the track demand at the corresponding time location is marked as unmapped and the corresponding time location is retained.

[0075] After matching all time locations, the track demand at each time location is associated with the start and end time locations of the corresponding continuous time segments, as well as the bandwidth status value interval division results and the delay status value interval division results, to form a link binding result.

[0076] S3. Establish the time synchronization relationship of the video track and write it into the scheduling data of the link binding result. Use the time synchronization relationship to control the sending order and sending rate of the scheduling data to obtain the track transmission control set.

[0077] S3.1 Establishing the time synchronization relationship of video tracks involves reading the timestamp data corresponding to each video track from the video data stream, aligning the time position of each video track one by one according to the timestamp data, and uniformly associating the time positions of each video track corresponding to the same timestamp during the alignment process to form a time synchronization relationship between video tracks; the time synchronization relationship and the time position in the transmission status are both generated by timestamp data under a unified time base and are kept consistent.

[0078] S3.2. The transmission order control sorts the scheduled data according to the time synchronization relationship and adjusts the order of the sorting results according to the delay status in the link status information. The transmission rate control divides the scheduled data into segments according to the time synchronization relationship and dynamically allocates and limits the transmission rhythm of each segment of scheduled data according to the bandwidth status in the link status information.

[0079] Furthermore, based on the time position association results of each video track in the time synchronization relationship, the transmission time markers in the scheduling data are aligned and organized, scheduling data with the same time position markers are grouped into the same time group, and the initial transmission order is formed according to the ascending order of the time position markers.

[0080] In the initial transmission sequence, the delay status value in the link status information is introduced into the scheduling data in each time group as the basis for order adjustment. The delay status values ​​corresponding to each scheduling data in the same time group are compared. When multiple scheduling data correspond to different transmission links, the scheduling data with smaller delay status values ​​are arranged first, and the scheduling data with larger delay status values ​​are moved to the back. When the delay status values ​​in the same time group are the same, the original order formed by the time synchronization relationship remains unchanged, thus obtaining the transmission sequence after delay status adjustment.

[0081] Based on the time position markers in the time synchronization relationship, the adjusted scheduling data is divided into segments according to continuous time positions. The criterion for determining continuous time positions is that the time interval between adjacent time positions is equal to the basic time interval in the video data stream sequence, and the scheduling data corresponding to continuous time positions are grouped into the same transmission segment.

[0082] For the scheduled data in each transmission segment, the transmission rhythm is allocated according to the bandwidth status value of the corresponding transmission link. The scheduled data corresponding to the transmission link with the higher bandwidth status value is assigned a higher transmission frequency, and the scheduled data corresponding to the transmission link with the lower bandwidth status value is assigned a lower transmission frequency. The allocation of transmission frequency is based on the proportion of the bandwidth status value of each transmission link in the current transmission segment, thereby dynamically allocating and limiting the transmission rhythm of the scheduled data in each transmission segment.

[0083] After completing all transmission sequence adjustments and transmission rhythm allocations, the scheduling data arranged in chronological order and marked with transmission rhythms will be associated and registered to form a track transmission control set.

[0084] S4. Obtain the transmission status from the track transmission control center, verify the consistency between the transmission status and the time synchronization relationship, and correct the scheduling data in the link binding result based on the verification result to obtain the transmission control result.

[0085] S4.1. Consistency check involves comparing the time position in the transmission state with the time position in the time synchronization relationship item by item, and identifying and marking the offset of inconsistent time positions.

[0086] Furthermore, the transmission result information corresponding to each time position is read sequentially from the track transmission control center. This transmission result information includes a transmission time position marker, a transmission sequence position marker, and a transmission rate marker. The transmission time position marker is used as the time position in the transmission state. The time positions in the transmission state are compared one-to-one with the time positions in the time synchronization relationship in chronological order. The offset is determined by calculating the time difference between the time positions in the transmission state and the time positions in the time synchronization relationship. When the time difference is zero, it is considered a consistent time position; when the time difference is not zero, it is considered an inconsistent time position. The time difference is then used as the time position offset.

[0087] The expression for the time position offset is: ; In the formula, This is the time position offset. For the time position in the transmission status, This refers to the time position in the time synchronization relationship. The time position value is a numerical marker used to represent a specific time point in a video data stream under a unified time base. The time position value is derived from timestamp data and is uniformly converted into a numerical form under the same time base during the video data stream processing.

[0088] It should be noted that when When the time position in the transmission status matches the time position in the time synchronization relationship, it is determined that the time position is consistent. When the time position in the transmission status lags behind the time position in the time synchronization relationship, it is determined that the transmission status is out of sync. When determining that the time position in the transmission state is ahead of the time position in the time synchronization relationship; the absolute value of the time position offset. This indicates the degree of offset and is used as a basis for alignment correction in subsequent scheduling data correction processing.

[0089] When a time position is determined to be inconsistent, the time position offset of the corresponding time position is associated with the time position mark to form a difference mark. At the same time, the positive and negative directions of the time position offset are retained to represent whether the time position in the transmission state is ahead or behind the time position in the time synchronization relationship, thereby completing the consistency verification and offset identification of the time position.

[0090] S4.2 Correcting the scheduling data in the link binding result involves aligning and correcting the time position offset in the scheduling data using difference markers, and adjusting the sending order and sending rate of the corresponding time position in the scheduling data in a linked constraint.

[0091] Furthermore, based on the time position markers and time position offsets recorded in the difference markers, time position alignment correction processing is performed on the scheduling data in the link binding result. The time position value of the scheduling data corresponding to each time position is corrected according to the time position offset. The correction method is to perform time position shift processing on the time position value in the scheduling data according to the direction and degree of the time position offset. When the time position offset is positive, the time position value in the scheduling data is shifted to the time advance direction by the corresponding offset degree. When the time position offset is negative, the time position value in the scheduling data is shifted to the time retrace direction by the corresponding offset degree, so that the time position in the scheduling data is aligned with the time position in the time synchronization relationship.

[0092] After completing the time position alignment correction, the corrected scheduling data is rearranged according to time position. Within the same time position range, the transmission order is re-sorted based on the delay status value in the link status information. The scheduling data with smaller delay status values ​​is arranged first, and the scheduling data with larger delay status values ​​is arranged last. When the delay status values ​​are the same, the original order after time position alignment correction is maintained.

[0093] For the scheduling data whose order has been adjusted, the transmission rate is adjusted based on the bandwidth status value in the link status information within a continuous time range. The transmission rate corresponding to the scheduling data with higher bandwidth status values ​​is increased, and the transmission rate corresponding to the scheduling data with lower bandwidth status values ​​is decreased. The adjustment range of the transmission rate is proportionally mapped according to the proportion of the bandwidth status value at each time position within the current time range, thereby realizing the linkage constraint adjustment between the transmission order and the transmission rate.

[0094] After completing time alignment correction, transmission order adjustment, and transmission rate adjustment for all time positions, the corrected scheduling data is associated and registered according to the time position order to form the transmission control result.

[0095] This embodiment also provides a network transmission control optimization system based on traffic demand, including: The demand module is used to acquire video data streams, classify the video data streams into track types and assess the importance of regions, generate track demand quantities and map them into a track demand table. The matching module is used to extract link status information from the transmission link, map the link status information to the track demand table to form demand link relationships, define the matching range based on the demand link relationships, determine the link performance value of the transmission link through the link status information, filter and match the track demand quantity with the link performance value within the matching range to form a link binding result. The transmission link is the communication path that carries video data stream transmission in the network environment. The control module is used to establish the time synchronization relationship of the video track and write it into the scheduling data of the link binding result. It performs transmission order control and transmission rate control on the scheduling data through the time synchronization relationship to obtain the track transmission control set. The correction module is used to obtain the transmission status from the track transmission control center, perform consistency verification between the transmission status and the time synchronization relationship, and correct the scheduling data in the link binding result based on the verification result to obtain the transmission control result.

[0096] This embodiment also provides a computer device applicable to the network transmission control optimization method based on traffic demand, comprising: a memory and a processor; the memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions to implement the network transmission control optimization method based on traffic demand as proposed in the above embodiment.

[0097] The computer device can be a terminal, comprising a processor, memory, communication interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, carrier networks, NFC (Near Field Communication), or other technologies. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad on the computer device's casing, or an external keyboard, touchpad, or mouse.

[0098] This embodiment also provides a storage medium storing a computer program that, when executed by a processor, implements the network transmission control optimization method based on traffic demand as proposed in the above embodiments. The storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Red-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0099] In summary, this invention achieves refined classification and priority quantification of video frame data, audio data, and timestamp data by classifying video data streams into track types and assessing regional importance. This maps the importance of different screen regions to track demand, forming a track demand table. The track demand table is then used to specifically map and match link states, ensuring priority transmission of video frames and audio information in critical tracks and high-priority areas. This guarantees consistency in transmission order and time synchronization, thereby improving the continuity and stability of the video data stream in the network environment. Through this technique, network resources can be flexibly scheduled based on track demand, significantly reducing the risk of losing critical frames, improving transmission efficiency and user experience, and optimizing the accuracy and reliability of video transmission control.

[0100] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A network transmission control optimization method based on traffic demand, characterized in that: include, Acquire video data streams, classify video data streams by track type and assess regional importance, generate track demand quantities and map them to a track demand table; Link status information is extracted from the transmission link, and the link status information is mapped to the track demand table to form a demand link relationship. The matching range is defined based on the demand link relationship. The link performance value of the transmission link is determined through the link status information. Within the matching range, the track demand and the link performance value are filtered and matched to form a link binding result. The transmission link is the communication path that carries the transmission of video data stream in the network environment. Establish the time synchronization relationship of the video track and write it into the scheduling data of the link binding result. Use the time synchronization relationship to control the sending order and sending rate of the scheduling data to obtain the track transmission control set. The transmission status is obtained from the track transmission control center, the consistency between the transmission status and the time synchronization is verified, and the scheduling data in the link binding result is corrected based on the verification result to obtain the transmission control result.

2. The network transmission control optimization method based on traffic demand as described in claim 1, characterized in that: The track type classification is based on the differences in the video data stream type, which categorizes the video frame data, audio data, and timestamp data in the video data stream into different video track types. The regional importance assessment involves determining the importance of each frame region in the video data stream, converting the importance value of each frame region into a regional priority label, and then aggregating the regional priority labels according to the track type division results to generate track demand.

3. The network transmission control optimization method based on traffic demand as described in claim 1, characterized in that: The formation of the demand chain relationship specifically refers to... Extract the track demand quantity and track type identifier from the track demand table, and arrange them in chronological order to form a sequence of track demand items; Link status information is obtained from the transmission links and arranged sequentially according to the source order of the transmission links to form a link status sequence; The link status information in the link status sequence is aligned to the time position corresponding to the track demand item sequence according to the timestamp, thus generating a time-aligned link sequence. In the time-aligned link sequence, the bandwidth status and delay status in the link status information are compared item by item with the track demand in the track demand item sequence to filter out the link status information that meets the track demand constraint and form qualified link status information. The track demand quantity in the track demand item sequence is matched with the qualified link status information to form a demand link relationship.

4. The network transmission control optimization method based on traffic demand as described in claim 1, characterized in that: The process of defining the matching range and determining the link performance value of the transmission link specifically involves: The qualified link status information in the demand link relationship is grouped according to the track demand, and the qualified link status information corresponding to the same track demand is arranged into a continuous time sequence. Based on a continuous time sequence, link status information of the same transmission link at consecutive time locations is spliced ​​together to form a continuous link segment. Perform continuity checks on consecutive link segments, remove link status information corresponding to time interruption locations, and use the remaining link status information as the matching range; The bandwidth status and delay status in the remaining link status information are jointly determined to form the link performance value of the transmission link.

5. The network transmission control optimization method based on traffic demand as described in claim 2 or 4, characterized in that: The formation of the link binding result is specifically as follows: Within the matching range, the link performance value is partitioned and constrained according to the track demand, and the link performance value is divided into multiple continuous performance intervals according to the bandwidth status and latency status. Within multiple continuous performance intervals, the track demand and link performance values ​​are used to determine the continuous performance intervals that satisfy the track demand. Perform continuity checks across time locations for continuous performance intervals, and retain link performance values ​​that remain consistent across multiple time locations; A range mapping is performed between the track demand and the reserved link performance values ​​to form the link binding result.

6. The network transmission control optimization method based on traffic demand as described in claim 1, characterized in that: The process of establishing the time synchronization relationship between video tracks involves reading the timestamp data corresponding to each video track from the video data stream, aligning the time positions of each video track one by one according to the timestamp data, and uniformly associating the time positions of video tracks with the same timestamp during the alignment process to form a time synchronization relationship between video tracks.

7. The network transmission control optimization method based on traffic demand as described in claim 1, characterized in that: The method of controlling the transmission order of scheduling data involves sorting the scheduling data according to the time synchronization relationship and adjusting the order of the sorting results based on the delay status in the link status information. The method of controlling the transmission rate of the scheduling data involves dividing the scheduling data into segments according to the time synchronization relationship, and dynamically allocating and limiting the transmission rhythm of each segment of the scheduling data based on the bandwidth status in the link status information.

8. The network transmission control optimization method based on traffic demand as described in claim 1, characterized in that: The consistency check involves comparing the time position in the transmission state with the time position in the time synchronization relationship item by item, and identifying and marking the offsets of inconsistent time positions.

9. The network transmission control optimization method based on traffic demand as described in claim 1, characterized in that: The correction of the scheduling data in the link binding result is achieved by aligning and correcting the time position offset in the scheduling data using difference markers, and by adjusting the sending order and sending rate of the corresponding time position in the scheduling data in a linked constraint.

10. A network transmission control optimization system based on traffic demand, based on the network transmission control optimization method based on traffic demand according to any one of claims 1 to 9, characterized in that: include, The demand module is used to acquire video data streams, classify the video data streams into track types and assess the importance of regions, generate track demand quantities and map them into a track demand table. The matching module is used to extract link status information from the transmission link, map the link status information to the track demand table to form a demand link relationship, define the matching range based on the demand link relationship, determine the link performance value of the transmission link through the link status information, and filter and match the track demand quantity with the link performance value within the matching range to form a link binding result. The transmission link is the communication path that carries the transmission of video data stream in the network environment. The control module is used to establish the time synchronization relationship of the video track and write it into the scheduling data of the link binding result. It performs transmission order control and transmission rate control on the scheduling data through the time synchronization relationship to obtain the track transmission control set. The correction module is used to obtain the transmission status from the track transmission control center, perform consistency verification between the transmission status and the time synchronization relationship, and correct the scheduling data in the link binding result based on the verification result to obtain the transmission control result.

Images