High-quality and low-latency transmission method based on 5G wide area network

Abstract

The present invention discloses a high-definition and low-latency transmission method based on a 5G wide area network. The present invention relates to the field of video transmission technology, and solves the problem that some unclear frame images inside a video stream are not processed relatedly when the time processing is optimized, and only low latency can be guaranteed but high image quality cannot be guaranteed. The present invention analyzes and processes several frame images in the video to determine the unclear related images in the frame images, and then identifies the controllable delay of the front-end image of the image based on the position of such images, and determines the controllable delay of the front-end image to ensure that the image can be fully optimized. Not only the frame images inside the entire video are fully optimized, but also the transmission delay of the video during transmission is controlled and minimized, thereby ensuring the overall transmission effect of high image quality and low latency.

Description

Technical Field

[0001] The present invention relates to the field of video transmission technology, and specifically to a high-quality and low-latency transmission method based on a 5G wide area network. Background Art

[0002] 5G network is the fifth generation of mobile communication network. Its peak theoretical transmission speed can reach 20Gbps, or 2.5GB per second, which is more than 10 times faster than the transmission speed of 4G network. For example, a 1G movie can be downloaded in 1 second.

[0003] The application with publication number CN111314778A discloses a video encoding and decoding fusion processing method, system, and device based on multiple compression formats, aiming to solve the problem that a single video compression technology cannot simultaneously meet the requirements of high-quality and low-latency transmission within a domain and interconnection and intercommunication with third-party network devices across domains. This system method includes: selecting a decoding method according to a preset decoding method selection rule as a first decoding method; based on the first decoding method, obtaining a corresponding encoding method as a first encoding method; obtaining data encoded by the first encoding method at the encoding end as the first encoded data of the data to be transmitted; obtaining the first encoded data at the decoding end, and decoding it using the first decoding method. The present invention achieves high-quality and low-latency transmission effects through multiple compression methods, can interconnect and intercommunication with third-party network devices across domains, and can perform encoding and decoding on demand, saving network resources.

[0004] When its 5G wide area network is transmitting high-definition and low-latency videos, it generally transmits the determined video stream based on the determined transmission protocol, and gradually optimizes the delay by adjusting the transmission protocol. However, the original processing method is to simply transmit the video stream. Some unclear frames in the video stream are not processed without time processing optimization. It can only guarantee low latency but not high image quality, and the video stream processing effect is not good. Summary of the invention

[0005] In view of the shortcomings of the prior art, the present invention provides a high-definition and low-latency transmission method based on 5G wide area network, which solves the problem that some unclear frame images within the video stream are not processed relatedly when the time processing is optimized, which can only ensure low latency but not high image quality.

[0006] To achieve the above objectives, the present invention is implemented through the following technical solutions: a high-quality, low-latency transmission method based on a 5G wide area network, comprising the following steps:

[0007] S1), determining the associated video item to be transmitted this time, based on different frames in the associated video item, according to the picture clarity of different frames, locking low-definition pictures from a plurality of groups of different frames, and marking them in the original frame arrangement, the specific sub-steps are:

[0008] S11, confirm the different frames in the associated video item, and confirm the picture clarity Q of each group of frames i , where i represents different frames;

[0009] S12, set the picture clarity to Q i Compare with the preset value Y1, where Y1 is the preset value. i When Q is less than Y1, the frame is marked as a low-definition frame and the order of the original frame remains unchanged. i When ≥Y1, no treatment is performed;

[0010] S2) confirming the clarity of the low-definition images in the sorted plurality of frame groups, identifying the minimum optimization rate from the past clarity optimization parameters, and determining the optimization time for optimizing the low-definition images to meet the standards based on the determined minimum optimization rate, in the following specific manner:

[0011] S21, determining the definition Q corresponding to the low-definition picture i , confirm the clarity difference Cz between this clarity and the preset value Y1 i , where Cz i =Y1-Q i ;

[0012] S22. From the past clarity optimization parameters, identify the set of parameters with the slowest optimization rate per unit time and calibrate it as Vmin. Use CZ i ÷Vmin=T i Confirm the optimization time T for this low-definition image i ;

[0013] S3), based on the transmitter and receiver of the associated video item to be transmitted this time, relevant confirmation of controllable delay is performed from the past low-latency transmission data of the two parties, and the corresponding controllable delay interval is determined, wherein the past low-latency transmission data includes the transmission capacity per unit time and the transmission delay corresponding to the corresponding transmission capacity, and the specific method is as follows:

[0014] S31, determining different transmission delays corresponding to different transmission capacities per unit time from past low-latency transmission data, and generating a data delay variation curve, where the horizontal coordinate of the curve is the transmission capacity and the vertical coordinate is the transmission delay;

[0015] S32, starting from the initial point of the data delay variation curve, identifying the transmission delay difference YC of adjacent points k , where k represents the adjacent segments of different adjacent points, and YC k = data delay of the next bit - data delay of the previous bit, and the confirmed transmission delay difference YC k According to the sorting method of related points, the points are sorted forward and backward to determine the transmission delay difference sequence;

[0016] S33, confirm the same type of associated differences in the transmission delay difference sequence, and identify whether the adjacent transmission delay differences satisfy: |YC j -YC j+1 |<Y2, where Y2 is a preset value, where j∈k, if k=1, 2, ..., n, where j≤n-1, if it satisfies, the corresponding transmission delay difference is calibrated as the same type of associated difference, and each group of transmission delays in the transmission delay difference sequence is subjected to difference processing, and several groups of different types of associated differences are confirmed. If the adjacent transmission delay differences do not satisfy: |YC j -YC j+1 When |<Y2, no calibration is performed;

[0017] S34, marking the adjacent segments associated with the same type of associated differences as the same type of segments, identifying the segment lengths of each different same type of segments, and selecting the same type of segment with the longest segment as the standard segment, identifying the transmission capacity associated with the standard segment to determine the transmission capacity interval, and then determining the minimum value and the maximum value from the several groups of transmission delays associated with the standard segment to lock the controllable delay interval;

[0018] S4), based on the low-definition picture marked in the associated video item and the optimization time required for this picture, the transmission delay of other pictures that are preferentially transmitted in front of this low-definition picture is controlled, and the controlled transmission delay belongs to the controllable delay interval. Based on the processing results analyzed in sequence, the transmission rule of this associated video item is confirmed and executed; the specific sub-steps are:

[0019] S41, determining the specific position of the low-definition picture in a plurality of frames, identifying the number of frames G existing in front of the low-definition picture, and then determining the optimization time T of the low-definition picture i ;

[0020] S42, based on the determined controllable delay interval, determine the maximum delay value Ymax and the minimum delay value Ymin from the controllable delay interval, use G×Ymax=ZD and G×Ymin=ZX to determine the maximum transmission time ZD and the minimum transmission time ZX, identify T i Whether it satisfies: ZX≤T i ≤ZD:

[0021] If not satisfied, identify T i Satisfied: T i > ZD, if it is satisfied, the determined maximum transmission time ZD is used as the control delay of the frame picture existing in front of the low-definition picture; if it is not satisfied, the transmission delay of the frame picture existing in front of the low-definition picture is not controlled;

[0022] If T i Satisfy ZX≤T i ≤ZD, using T i ÷G=F i Confirm the control delay F of the frame image in front of this low-definition image i ;

[0023] S43, after the low-definition picture is processed, other low-definition pictures are processed, and the control delay of the frame picture in front of the other low-definition pictures is determined. If there are multiple control delays in a group of frames, the control delays are sorted from large to small and marked in the transmission log of this frame picture;

[0024] S44, transmitting the processed frames, determining the maximum control delay after the corresponding frames are sorted, and determining the associated transmission capacity for transmission. When the low-definition picture associated with the maximum control delay is processed, the subsequent sorting control delay is executed, and so on. When there is no control delay for the corresponding frame, the maximum transmission capacity is executed to reduce the transmission delay to the minimum, and the sequential transmission process of the frames is completed.

[0025] The present invention provides a high-quality, low-latency transmission method based on 5G wide area network. Compared with the prior art, it has the following beneficial effects:

[0026] The present invention identifies different transmission delays corresponding to different transmission capacities from past transmission delay data, and then uniformly analyzes the data to identify the variation rules of the transmission delays corresponding to different transmission capacities, selects relevant segments with relatively consistent variation characteristics, and performs determination and analysis on the relevant segments, locking the delay interval with the smallest fluctuation as a controllable interval, thereby ensuring that the delay control of the subsequent picture transmission process is sufficiently up to standard and ensuring the relevant accuracy of numerical processing;

[0027] Analyze and process several frames in this video to determine the unclear related images in the frames, and then identify the controllable delay of the front-end image of this image based on the location of such images. Determine the controllable delay of the front-end image to ensure that this image can be fully optimized. Not only are the frames within the entire video fully optimized, but the transmission delay of the video is also controlled and minimized during transmission, ensuring the overall transmission effect of high image quality and low latency. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is a schematic diagram of the process of the present invention;

[0029] Figure 2 It is a schematic diagram of determining the control delay of the present invention. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0031] Example 1

[0032] See also Figure 1 , this application provides a high-quality, low-latency transmission method based on a 5G wide area network, comprising the following steps:

[0033] S1) determining the associated video item to be transmitted this time, based on different frames in the associated video item and according to the picture clarity of different frames, locking low-definition pictures from a number of different frames, and marking them in the original frame arrangement. Specifically, the video is composed of a series of continuous image frames, each frame is a static image, and continuous frames are played at a specific rate to form a dynamic video, and the picture clarity corresponding to each group of frames may be different or the same. If there are related frames with lower clarity, based on the related transmission time of other pictures, the clarity can be optimized to ensure the overall quality of the picture. Among them, the specific sub-steps of performing relevant processing on the frame pictures are:

[0034] S11, confirm the different frames in the associated video item, and confirm the picture clarity Q of each group of frames i , where i represents different frames;

[0035] S12, set the picture clarity to Q i Compare with the preset value Y1, where Y1 is the preset value, and its specific value is determined by the operator based on experience. i ≥Y1, no processing is performed. i When <Y1, the frame is marked as a low-definition picture, and the order of the original frame remains unchanged. The original frame corresponds to different frames at different moments. According to the output direction of the video, the frame is pre-sorted. After the low-definition picture is marked, the original order is not changed.

[0036] S2), confirming the clarity of the low-definition pictures in the sorted plurality of frame pictures, identifying the minimum optimization rate from the past clarity optimization parameters, and determining the optimization time for optimizing the low-definition pictures to meet the standards based on the determined minimum optimization rate, wherein the specific method for determining the optimization time is:

[0037] S21, determining the definition Q corresponding to the low-definition picture i , confirm the clarity difference Cz between this clarity and the preset value Y1 i , where Cz i =Y1-Q i ;

[0038] S22. From the past clarity optimization parameters, identify the set of parameters with the slowest optimization rate per unit time and calibrate it as Vmin. Use CZ i ÷Vmin=T i Confirm the optimization time T for this low-definition image i , because it is common to optimize the picture in the existing technology, generally, the low-definition picture is optimized to a high-definition picture by using technologies such as fast denoising, optimizing image texture details and lossless amplification, so that the low-definition picture can be optimized to a high-definition picture, which will not be described in detail here;

[0039] S3), based on the transmitter and receiver of the associated video item to be transmitted this time, confirm the controllable delay in the past low-latency transmission data of the two from the 5G wide area network, and determine the corresponding controllable delay interval. Specifically, the controllable delay interval is to ensure that the transmission delay of the high-definition picture in front of the low-definition picture is controlled during the transmission of the entire video, so that the low-definition picture has enough time for relevant optimization to ensure the overall transmission effect of high image quality and low latency, wherein the past low-latency transmission data includes the transmission capacity per unit time and the transmission delay corresponding to the corresponding transmission capacity, and the unit of the transmission capacity is bit. Specifically, the transmission delays here are all corresponding low delays, which are all related delays that can be received during the transmission process, and do not affect the normal playback process of the corresponding video. The relevant units are generally ms, wherein the specific method of determining the controllable delay interval is:

[0040] S31. Determine different transmission delays corresponding to different transmission capacities per unit time from past low-latency transmission data, and generate a data delay variation curve, where the horizontal coordinate of the curve is the transmission capacity, and the vertical coordinate is the transmission delay, and the transmission capacity is gradually sorted from small to large;

[0041] S32, starting from the initial point of the data delay variation curve, identifying the transmission delay difference YC of adjacent points k, where k represents the adjacent segments of different adjacent points, and YC k = data delay of the next bit - data delay of the previous bit, and the confirmed transmission delay difference YC k According to the sorting method of related points, the points are sorted forward and backward to determine the transmission delay difference sequence;

[0042] S33, confirm the same type of associated differences in the transmission delay difference sequence, and identify whether the adjacent transmission delay differences satisfy: |YC j -YC j+1 |<Y2, where Y2 is a preset value, and its specific value is determined by the operator based on experience, where j∈k, if k=1, 2, ..., n, where j≤n-1, if it is satisfied, the corresponding transmission delay difference is calibrated as the same type of associated difference, and each group of transmission delays in the transmission delay difference sequence is subjected to difference processing, and several groups of different types of associated differences are confirmed. If it is not satisfied, no calibration processing is performed;

[0043] S34, marking the adjacent segments associated with the same type of associated differences as the same type of segments, identifying the segment lengths of each different same type of segments, and selecting the same type of segment with the longest segment as the standard segment, identifying the transmission capacity associated with the standard segment to determine the transmission capacity interval, and then determining the minimum value and the maximum value from the several groups of transmission delays associated with the standard segment to lock the controllable delay interval;

[0044] Specifically, different transmission capacities correspond to different transmission delays. When the transmission capacity is changed, the associated delays will also be different. When the transmission capacity is large, the transmission delay will be small. When the transmission capacity is gradually changing, the transmission delay will also change in proportion. Then the change process is linear. There is a related law when this type of delay changes.

[0045] In order to better identify better regular segments, the relevant differences in the change differences are evaluated based on the change differences of the nodes between the corresponding regular segments. When there is no large difference in the change difference, it means that the previous and subsequent values ​​are linear when changing. Then the corresponding controllable delay can be locked, and the corresponding controllable delay can be guaranteed by adjusting the transmission capacity of the transmission channel to ensure that the corresponding low-definition image can be fully optimized.

[0046] Example 2

[0047] In the specific implementation process of this embodiment, compared with the above embodiment, the first embodiment is a data processing process before corresponding transmission, and this embodiment mainly processes the high-quality and low-latency transmission method of the corresponding picture;

[0048] The following steps are also included:

[0049] S4), based on the low-definition picture marked in the associated video item and the optimization time required for the picture, the transmission delay of other pictures that are preferentially transmitted in front of the low-definition picture is controlled, and the controlled transmission delay belongs to the controllable delay interval. Based on the processing results analyzed in sequence, the transmission rule of the associated video item is confirmed and executed, wherein the specific sub-steps of determining the transmission rule are:

[0050] S41, determine the specific position of the low-definition picture in a plurality of frames, identify the number of frames G in front of the low-definition picture (the so-called frames in front are the high-definition frames that are preferentially transmitted), and then determine the optimization time T of the low-definition picture. i ;

[0051] S42, Combination Figure 2 Based on the determined controllable delay interval, the maximum delay value Ymax and the minimum delay value Ymin are determined from the controllable delay interval, and the maximum transmission time ZD and the minimum transmission time ZX are determined by using G×Ymax=ZD and G×Ymin=ZX, and T is identified. i Whether it satisfies: ZX≤T i ≤ZD:

[0052] If satisfied, use T i ÷G=F i Confirm the control delay F of the frame image in front of this low-definition image i ;

[0053] If not satisfied, identify T i Satisfied: T i > ZD, if it is satisfied, the determined maximum transmission time ZD is used as the control delay of the frame image in front of the low-definition image. If it is not satisfied (that is, T i <ZX), the transmission delay of the frame image in front of the low-definition image is not controlled (when T i When <ZX, it means that no matter how the front frame is transmitted, the low-definition image behind it can be optimized after the front frame is transmitted. There is no need to control the front frame. The low-definition image can complete the relevant definition optimization process by itself. When T i >ZD, that is, after the transmission of the front frame images is completed, the current image cannot complete the relevant optimization process, so it can only select the maximum control delay to ensure that the low-definition image behind can get the longest optimization processing process, so that the corresponding low-definition image can achieve the best image optimization effect within a limited time);

[0054] S43, after the low-definition picture is processed, other low-definition pictures are processed, and the control delay of the frame picture in front of the other low-definition pictures is determined. If there are multiple control delays in a group of frames, the control delays are sorted from large to small and marked in the transmission log of this frame picture;

[0055] S44, here is 0 related formulation: transmit several frames after processing, determine the maximum control delay after the corresponding frame is sorted, and determine the associated transmission capacity for transmission. When the low-definition picture associated with this maximum control delay is processed, execute the subsequent sorting control delay, and so on. When there is no control delay for the corresponding frame, the maximum transmission capacity is executed to reduce the transmission delay to the minimum, and the sequential transmission process of several frames is completed. Here, it is understood in combination with an example: a group of videos has ten groups of frames: Z1, Z2, Z3, Z4, Z5, Z6, Z7, Z8, Z9, and Z10, among which Z6 and Z10 are low-latency pictures, then the front The frame images of Z6 are all limited to the relevant control delay. When optimizing, the slowest optimization rate is adopted when performing relevant calculations. However, in the actual processing process, the optimization rate is generally faster than the slowest optimization rate. Therefore, Z1 is the first to transmit, and its transmission delay estimation execution determined control delay remains unchanged. When it reaches Z5, Z6 may have completed the relevant optimization process, so the control delay determined by Z10 is executed. When it reaches Z8, Z10 has completed the overall image optimization process, so Z8 does not need to execute the relevant control delay, and the lowest transmission delay and the highest transmission capacity are adopted to transmit the image to ensure the overall transmission effect of high image quality and low delay of the entire image.

[0056] Using this transmission rule for related transmission can not only make the transmitted image delay reach the optimal state, but also control the related delay. If the optimal delay can be used, it will be used to ensure the overall transmission control effect.

[0057] Example 3

[0058] The specific implementation process of this embodiment includes the entire implementation process of the above two groups of embodiments.

[0059] Some of the data in the above formulas are dimensionless and numerically calculated. Meanwhile, the contents not described in detail in this specification belong to the prior art known to those skilled in the art.

[0060] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.

Claims

1. A high-quality, low-latency transmission method based on 5G wide area network, characterized in that: The following steps are involved: S1), determining the associated video item to be transmitted this time, based on different frames in the associated video item and according to the picture clarity of different frames, locking low-definition pictures from a plurality of groups of different frames, and marking them in the original frame arrangement; S2), confirming the clarity of the low-definition pictures in the sorted groups of frames, identifying the minimum optimization rate from past clarity optimization parameters, and determining the optimization time for optimizing the low-definition pictures to meet the standards based on the determined minimum optimization rate; S3), based on the transmitter and receiver of the associated video item to be transmitted this time, confirm the controllable delay from the past low-latency transmission data of the two parties, and determine the corresponding controllable delay interval, wherein the past low-latency transmission data includes the transmission capacity per unit time and the transmission delay corresponding to the corresponding transmission capacity; S4), based on the low-definition picture marked in the associated video item and the optimization time required for this picture, the transmission delay of other pictures that are preferentially transmitted in front of this low-definition picture is controlled, and the controlled transmission delay belongs to the controllable delay interval. Based on the processing results analyzed in sequence, the transmission rule of this associated video item is confirmed and executed. The specific sub-steps are: S41, determining the specific position of the low-definition picture in a plurality of frames, identifying the number of frames G existing in front of the low-definition picture, and then determining the optimization time T of the low-definition picture i ; S42, based on the determined controllable delay interval, determine the maximum delay value Ymax and the minimum delay value Ymin from the controllable delay interval, use G×Ymax=ZD and G×Ymin=ZX to determine the maximum transmission time ZD and the minimum transmission time ZX, identify T i Whether it satisfies: ZX≤T i ≤ZD: If not satisfied, identify T i Satisfied: T i > ZD, if it is satisfied, the determined maximum transmission time ZD is used as the control delay of the frame picture existing in front of the low-definition picture; if it is not satisfied, the transmission delay of the frame picture existing in front of the low-definition picture is not controlled; If T i Satisfy ZX≤T i ≤ZD, using T i ÷G=F i Confirm the control delay F of the frame image in front of this low-definition image i ; S43, after the low-definition picture is processed, other low-definition pictures are processed, and the control delay of the frame picture in front of the other low-definition pictures is determined. If there are multiple control delays in a group of frames, the control delays are sorted from large to small and marked in the transmission log of this frame picture; S44, transmitting the processed frames, determining the maximum control delay after the corresponding frames are sorted, and determining the associated transmission capacity for transmission. When the low-definition picture associated with the maximum control delay is processed, the subsequent sorting control delay is executed, and so on. When there is no control delay for the corresponding frame, the maximum transmission capacity is executed to reduce the transmission delay to the minimum, and the sequential transmission process of the frames is completed.

2. The high-quality, low-latency transmission method based on 5G wide area network according to claim 1 is characterized in that: In step S1, the specific sub-steps of performing relevant processing on the frame picture are: S11, confirm the different frames in the associated video item, and confirm the picture clarity Q of each group of frames i , where i represents different frames; S12, set the picture clarity to Q i Compare with the preset value Y1, where Y1 is the preset value. i When <Y1, the frame is marked as a low-definition frame and the order of the original frame remains unchanged.

3. The high-quality, low-latency transmission method based on 5G wide area network according to claim 2 is characterized in that: In step S12, when Q i When ≥Y1, no processing is performed.

4. The high-quality, low-latency transmission method based on 5G wide area network according to claim 1 is characterized in that: In step S2, the specific method of determining the optimization time is: S21, determining the definition Q corresponding to the low-definition picture i , confirm the clarity difference Cz between this clarity and the preset value Y1 i , where Cz i =Y1-Q i ; S22. From the past clarity optimization parameters, identify the set of parameters with the slowest optimization rate per unit time and calibrate it as Vmin. Use CZ i ÷Vmin=T i Confirm the optimization time T for this low-definition image i .

5. The high-quality, low-latency transmission method based on 5G wide area network according to claim 1 is characterized in that: In step S3, the specific method of determining the controllable delay interval is: S31, determining different transmission delays corresponding to different transmission capacities per unit time from past low-latency transmission data, and generating a data delay variation curve, where the horizontal coordinate of the curve is the transmission capacity and the vertical coordinate is the transmission delay; S32, starting from the initial point of the data delay variation curve, identifying the transmission delay difference YC of adjacent points k , where k represents the adjacent segments of different adjacent points, and YC k = data delay of the next bit - data delay of the previous bit, and the confirmed transmission delay difference YC k According to the sorting method of related points, the points are sorted forward and backward to determine the transmission delay difference sequence; S33, confirm the same type of associated differences in the transmission delay difference sequence, and identify whether the adjacent transmission delay differences satisfy: |YC j -YC j+1 |<Y2, where Y2 is a preset value, where j∈k, if k=1, 2, ..., n, where j≤n-1, if satisfied, the corresponding transmission delay difference is calibrated as a similar associated difference, and each group of transmission delays in the transmission delay difference sequence is subjected to difference processing to confirm several groups of similar associated differences of different classifications; S34. The adjacent segments associated with the same type of associated differences are marked as the same type of segments, the segment lengths of each different same type of segments are identified, and the same type of segment with the longest segment is selected as the standard segment. The transmission capacity associated with the standard segment is identified to determine the transmission capacity interval, and then the minimum and maximum values ​​are determined from several groups of transmission delays associated with the standard segment to lock the controllable delay interval.

6. The high-quality, low-latency transmission method based on 5G wide area network according to claim 5 is characterized in that: In step S33, if the difference in transmission delay between the adjacent transmissions does not satisfy: j -YC j+1 When |<Y2, no calibration is performed.

Images