A video coding parameter processing method, system, device and storage medium

By determining the target code rate and frame rate based on real-time bandwidth and cache information in video encoding, and using mapping relationship information of fixed step ladder configuration, the problem of frequent adjustment of video encoding frame rate is solved, and the stability and user experience of video encoding are improved.

CN114501014BActive Publication Date: 2025-03-18BIGO TECH PTE LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210160160.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-02-22
Publication Date
2025-03-18
Estimated Expiration
2042-02-22

AI Technical Summary

Technical Problem

In video encoding scenarios, frequent adjustment of video encoding frame rate in the prior art leads to a decrease in encoding efficiency and encoding frame loss problems, affecting the video transmission effect.

Method used

By determining the target code rate based on the real-time bandwidth and cache information, the target frame rate is determined based on the target code rate query pre-constructed mapping relationship information, the frame rate value is configured in a fixed step step, and the coded frame rate is determined based on the target frame rate to use the coded frame rate to perform video encoding of the current encoding period.

Benefits of technology

It improves the stability of video encoding frame rate decisions, avoids frequent changes in coded frame rate, and improves the smoothness of video playback and user viewing experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114501014B_ABST
    Figure CN114501014B_ABST
Patent Text Reader

Abstract

The embodiments of the present application disclose a video encoding parameter processing method, system, device and storage medium. The technical solution provided by the embodiments of the present application determines the target bit rate according to the real-time bandwidth and cache information; determines the corresponding target frame rate based on the target bit rate query mapping relationship information, the mapping relationship information is pre-constructed according to different bit rate intervals and corresponding frame rate values, and the frame rate values ​​are configured in a fixed step ladder; determines the encoding frame rate based on the target frame rate, and uses the encoding frame rate to perform video encoding in the current encoding cycle. By adopting the above-mentioned technical means, the encoding frame rate is decided by determining the frame rate values ​​corresponding to different bit rate intervals, so as to avoid frequent modifications of the encoding frame rate due to the influence of bandwidth, improve the stability of the encoding frame rate, and then improve the smoothness of video playback, and optimize the user's viewing experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of video coding technology, and in particular to a video coding parameter processing method, system, device and storage medium. Background Art

[0002] At present, in video encoding scenarios, in order to facilitate video encoding, a code table is usually pre-set to determine video encoding parameters such as resolution, bit rate, and frame rate based on factors such as real-time bandwidth and send buffer accumulation. Generally speaking, when using the code table to determine video encoding parameters, if the bandwidth is sufficient, high bit rate and high frame rate will be selected for encoding so that the receiving end user can have a high-definition video experience. When the bandwidth is low, the bit rate and frame rate will be reduced to ensure that the video data can be transmitted normally and to ensure the basic viewing needs of users. Continuously different frame rate parameters are configured in the code table to select the corresponding encoding frame rate for video encoding based on the fluctuations of factors such as real-time bandwidth and send buffer accumulation.

[0003] However, since the frame rate parameters in the code table are configured continuously, once the bandwidth fluctuates slightly, the encoding frame rate adjustment will be triggered according to the code table. After the frame rate adjustment, the encoder needs to be reset. Frequent encoder resets will affect the video encoding efficiency and cause encoding frame loss problems, which will in turn affect the video encoding transmission effect. Summary of the invention

[0004] The embodiments of the present application provide a video encoding parameter processing method, system, device and storage medium, which can improve the stability of video encoding frame rate decision-making and solve the technical problem of frequent adjustment of video encoding frame rate.

[0005] In a first aspect, an embodiment of the present application provides a video coding parameter processing method, including:

[0006] Determine the target bitrate based on real-time bandwidth and cache information;

[0007] Based on the target bit rate, the mapping relationship information is queried to determine the corresponding target frame rate, where the mapping relationship information is pre-constructed according to different bit rate intervals and corresponding frame rate values, and the frame rate values ​​are configured in a fixed step ladder;

[0008] An encoding frame rate is determined based on the target frame rate, so as to use the encoding frame rate to perform video encoding in a current encoding cycle.

[0009] In a second aspect, an embodiment of the present application provides a video coding parameter processing system, including:

[0010] A target bit rate determination module, configured to determine a target bit rate according to real-time bandwidth and cache information;

[0011] A target frame rate determination module is configured to determine a corresponding target frame rate based on a target bit rate query mapping relationship information, the mapping relationship information is pre-constructed according to different bit rate intervals and corresponding frame rate values, and the frame rate values ​​are configured in a fixed step ladder;

[0012] The encoding frame rate determination module is configured to determine the encoding frame rate based on the target frame rate, so as to use the encoding frame rate to perform video encoding in the current encoding cycle.

[0013] In a third aspect, an embodiment of the present application provides a video coding parameter processing device, including:

[0014] memory and one or more processors;

[0015] The memory is configured to store one or more programs;

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the video encoding parameter processing method as described in the first aspect.

[0017] In a fourth aspect, an embodiment of the present application provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are configured to execute the video encoding parameter processing method as described in the first aspect.

[0018] The embodiment of the present application determines the target bit rate according to the real-time bandwidth and cache information; based on the target bit rate, the mapping relationship information is queried to determine the corresponding target frame rate, the mapping relationship information is pre-constructed according to different bit rate intervals and corresponding frame rate values, and the frame rate values ​​are configured in fixed step sizes; based on the target frame rate, the encoding frame rate is determined to use the encoding frame rate for video encoding in the current encoding cycle. The above-mentioned technical means are used to determine the frame rate values ​​corresponding to different bit rate intervals to make decisions on the encoding frame rate, so as to avoid frequent modifications of the encoding frame rate due to the influence of bandwidth, improve the stability of the encoding frame rate, and then improve the smoothness of video playback and optimize the user's viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a flow chart of a video encoding parameter processing method provided by an embodiment of the present application;

[0020] Figure 2 is a flowchart of mapping relationship information construction in an embodiment of the present application;

[0021] Figure 3 It is a usage diagram of the mapping relationship between frame rate and bit rate in the embodiment of the present application;

[0022] Figure 4 is a flow chart of determining the encoding bit rate in an embodiment of the present application;

[0023] Figure 5 is a video coding parameter decision flow chart in an embodiment of the present application;

[0024] Figure 6 It is a structural diagram of a video encoding parameter processing system provided by an embodiment of the present application;

[0025] Figure 7 It is a structural diagram of a video encoding parameter processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical scheme and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for the convenience of description, only the part related to the present application but not all the contents are shown in the accompanying drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow chart describes each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. The process can be terminated when its operation is completed, but it can also have additional steps not included in the accompanying drawings. The process can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.

[0027] The present application provides a method for making a decision on the encoding frame rate based on the mapping relationship information constructed based on different bit rate intervals and corresponding frame rate values, so as to improve the stability of the encoding frame rate decision, avoid the situation where the target bit rate fluctuates due to slight fluctuations in bandwidth, and then frequently change the encoding frame rate, and optimize the video encoding transmission effect. For the traditional video encoding decision scheme based on the code table, the code table constructs a mapping relationship between continuously different frame rate parameters and corresponding bit rate parameters to determine the corresponding bit rate parameters according to the fluctuations of factors such as real-time bandwidth and sending buffer accumulation, and then selects the corresponding encoding frame rate for video encoding. When video encoding is performed based on the code table, when the bandwidth of the sending end fluctuates slightly, the frame rate adjustment is often triggered. After the frame rate adjustment, the encoder needs to be reset. Frequent resetting of the encoder will affect the video encoding efficiency and cause the problem of encoding frame loss. In fact, when watching videos, users are not sensitive to the frame rate change of 1-2fps, and the video freeze caused by frame loss is more easily perceived by users. Based on this, a video encoding parameter processing method of the present application embodiment is provided to solve the technical problem of frequent adjustment of the video encoding frame rate when the existing video encoding is performed based on the code table.

[0028] Example:

[0029] Figure 1 A flowchart of a video coding parameter processing method provided in an embodiment of the present application is given. The video coding parameter processing method provided in this embodiment can be executed by a video coding parameter processing device, and the video coding parameter processing device can be implemented by software and / or hardware. The video coding parameter processing device can be composed of two or more physical entities, or can be composed of one physical entity. Generally speaking, the video coding parameter processing device can be an encoding device of a video transmitter or a video encoding server.

[0030] The following description is made by taking the video coding parameter processing device as an example to implement the video coding parameter processing method. Figure 1 , the video encoding parameter processing method specifically includes:

[0031] S110: Determine a target bit rate according to the real-time bandwidth and cache information.

[0032] When performing video encoding, the embodiment of the present application constructs mapping relationship information to facilitate subsequent decisions on encoding frame rate. The essence of the mapping relationship information is a code table for making encoding parameter decisions for video encoding. Based on the mapping relationship between frame rate and bit rate provided in the mapping relationship information, the embodiment of the present application first determines the target bit rate for the current video encoding, so as to query the mapping relationship according to the target bit rate to make an encoding frame rate decision.

[0033] The embodiment of the present application determines the target bit rate based on the real-time bandwidth and cache information. It can be understood that when the real-time bandwidth is sufficient and there is less data to be sent in the cache, a higher bit rate can be selected for video encoding. On the contrary, if the real-time bandwidth is low and there is more data to be sent, a lower bit rate needs to be selected for video encoding. Based on this, the embodiment of the present application presets the relationship formula between the real-time bandwidth, cache information and video encoding bit rate parameters to determine a video encoding bit rate parameter based on the real-time bandwidth and cache information, and defines the bit rate parameter as the target bit rate. There are many implementation methods for determining the video encoding bit rate parameters based on the real-time bandwidth and the cache information of the video data. The embodiment of the present application does not impose fixed restrictions and will not be elaborated here.

[0034] It should be noted that the above target bit rate is the encoding bit rate parameter expected for the current video encoding. Video encoding at this target bit rate can achieve a better video encoding transmission effect. However, since the encoding bit rate parameter may also be affected by the video encoding frame rate, it is necessary to determine the encoding bit rate of the current video encoding according to different scene adaptability to avoid excessive fluctuations in the encoding bit rate between the previous and next video encoding cycles. Since the mapping relationship information pre-constructs the mapping relationship between the frame rate parameter and the bit rate range, the current target frame rate can be determined based on the target bit rate by querying the mapping relationship information.

[0035] S120, query mapping relationship information based on the target bit rate to determine the corresponding target frame rate, the mapping relationship information is pre-constructed according to different bit rate intervals and corresponding frame rate values, and the frame rate values ​​are configured in a fixed step ladder.

[0036] It is understandable that the mapping relationship between the frame rate value and the bit rate range is pre-constructed in the mapping relationship information. When the target bit rate has been determined, a corresponding frame rate value can be determined by querying the mapping relationship information, and the frame rate value is defined as the target frame rate. The target frame rate is the encoding frame rate parameter expected for the current video encoding. Video encoding at the target frame rate can adapt to real-time bandwidth and data caching, and achieve better video encoding transmission effect. However, since the sudden change of frame rate will affect the audience's viewing experience, the encoding frame rate used for the current video encoding also needs to consider the encoding frame rate of the previous encoding cycle. Therefore, it is necessary to determine the encoding frame rate of the current video encoding according to different scene adaptability. That is, the process of encoding frame rate decision needs to first determine the target frame rate, and then adjust it according to the target frame rate to obtain the encoding frame rate of the current video encoding.

[0037] Specifically, before this, the mapping relationship information needs to be pre-built. Figure 2 ,The mapping relationship information construction process includes:

[0038] S1001, determining a frame rate set and a bit rate set;

[0039] S1002: Use the data in the frame rate set and the bit rate set to perform quadratic function fitting to construct mapping relationship information.

[0040] When the bandwidth fluctuates, in order to ensure the video transmission effect, the bit rate will also fluctuate. Once the frame rate of video encoding fluctuates frequently, it will affect the audience's viewing experience. Therefore, when constructing the mapping relationship, a frame rate value will construct a corresponding mapping relationship with a bit rate range. When encoding the video in this way, if the bit rate fluctuates within a fixed range, the encoding frame rate will not fluctuate easily. On the contrary, when the bandwidth fluctuates greatly, causing the target bit rate to change greatly (jumping from one bit rate range to another), then another target frame rate value can be queried according to the mapping relationship. By making decisions on the encoding frame rate in this way, the stability of the encoding frame rate decision can be improved and repeated changes in the encoding frame rate can be avoided. Figure 3 As shown, relative to the code table scheme that constructs a mapping relationship between a frame rate value and a corresponding bit rate value, the embodiment of the present application constructs a mapping relationship between a frame rate value and a corresponding bit rate range. Then, by determining a target bit rate, querying the mapping relationship information to determine the bit rate range in which the target bit rate is located, and then determining the frame rate value mapped to the bit rate range, which is the target frame rate of the current video encoding.

[0041] Furthermore, when constructing the mapping relationship, the frame rate set and code rate set for quadratic function fitting are first constructed. Unlike the traditional code table scheme that takes continuous frame rate values ​​to construct the frame rate set, in order to resist the frame rate fluctuation caused by small bandwidth fluctuations, the frame rate values ​​of the frame rate set are configured in a fixed step size ladder. Figure 3 , through the step-by-step configuration of the frame rate value, it corresponds to different bit rate ranges, so that as the fixed step value increases, the range of the bit rate range becomes wider.

[0042] For example, in the traditional code table solution, the frame rate value of the frame rate set is F = [1, 2, ..., 24]. After the frame rate set is configured by fixed step size ladder, the frame rate value of the frame rate set is limited to F = [k, 2k, ..., nk], that is, the frame rate value can only be an integer multiple of k. For example, if k is 3, the frame rate value of the frame rate set is F = [3, 6, ..., 3n]. In this way, the code rate range is wider, thereby resisting the frame rate jitter caused by small bandwidth fluctuations.

[0043] When further constructing the bit rate set, by determining the signal-to-noise power ratios of multiple different video encodings and giving a maximum bit rate value, the signal-to-noise power ratio is determined for video encoding based on different bit rate and frame rate parameter combinations; based on the maximum bit rate value, the signal-to-noise power ratio, the bit rate and frame rate parameter combination, and the maximum drop value of the signal-to-noise power ratio, the various bit rate values ​​of the bit rate set are determined through a preset relationship formula.

[0044] Specifically, when determining the signal-to-noise power ratio of different video encodings, an offline test method is adopted. In different scenarios, video encoding is performed according to different bit rate and frame rate parameter combinations, and then the corresponding PSNR value (i.e., signal-to-noise power ratio) is calculated as a judgment standard for the video encoding quality in the corresponding scenario. Then, according to the PSNR value under each bit rate and frame rate parameter combination, by giving a maximum bit rate value and the maximum drop value of the signal-to-noise power ratio, the respective bit rate values ​​of the bit rate set can be determined using a pre-set relationship formula according to the maximum bit rate value, the signal-to-noise power ratio, the bit rate and frame rate parameter combination, and the maximum drop value of the signal-to-noise power ratio. Among them, the maximum bit rate value is set according to actual needs, which is the maximum value of the bit rate value in the bit rate and frame rate parameter combination. The maximum drop value of the signal-to-noise power ratio is the maximum value of the signal-to-noise power ratio allowed to drop, indicating the maximum degree of the video encoding quality allowed to drop. If it exceeds this range, the video encoding quality will fluctuate too much, thus affecting the video encoding transmission effect.

[0045] More specifically, the relationship is:

[0046] P(F i , B i )-P(F i , Bi-1 )≤ΔP

[0047] Where i∈[1,n], B n =B max , B max is the maximum bit rate value, F i is the frame rate parameter of the bit rate and frame rate parameter combination, B i is the bit rate parameter of the bit rate and frame rate parameter combination, P is the corresponding signal-to-noise power ratio, and ΔP is the maximum drop value, such as 1.

[0048] Based on this relationship, in B n If it is determined, query the bit rate and frame rate parameter combination to determine the corresponding frame rate parameter F n , the bit rate parameter B n and frame rate parameter F n Substituting into the above relationship formula, we can determine B i-1 Then query the bit rate and frame rate parameter combination to determine the corresponding bit rate parameter B i-1 The frame rate parameter F n-1 , the bit rate parameter B n-1 and frame rate parameter F n-1 Substituting into the above relationship formula, we can determine B i-2 By analogy, the final code rate set B = [B1, B2, ..., B n ].

[0049] Then, based on the above frame rate set F and bit rate set B, the function B can be obtained by fitting (F, B) using a quadratic function: i =f(F i ), and the function is used as the mapping relationship information. Subsequently, according to the target bit rate determined in the above step S110, it is substituted into the above mapping relationship information to determine the value of the target frame rate.

[0050] S130: Determine an encoding frame rate based on the target frame rate, so as to use the encoding frame rate to perform video encoding in a current encoding cycle.

[0051] Furthermore, according to the determined target frame rate, when determining the encoding frame rate based on the target frame rate, in order to avoid the problem of poor user viewing experience caused by a sudden drop in frame rate when the bandwidth suddenly drops, the embodiment of the present application adds an exponential smoothing strategy when lowering the frame rate. The target frame rate is not directly used as the encoding frame rate, but the encoding frame rate of the current encoding cycle is determined based on the comparison result of the encoding frame rate of the previous encoding cycle with the target frame rate.

[0052] It is understandable that in order to avoid excessive fluctuations in the encoding frame rate, when determining the encoding frame rate of the current cycle, it is necessary to refer to the video encoding frame rate of the previous cycle so that the difference between the encoding frame rates of the previous and next cycles will not be too large. In the case of sudden changes in bandwidth, the change in the encoding frame rate is controlled within an appropriate range.

[0053] Specifically, the formula for determining the encoding frame rate of the current encoding period is:

[0054]

[0055]

[0056] in, is the encoding frame rate of the current encoding cycle, F target is the target frame rate, is the encoding frame rate of the previous encoding cycle, α is the weight coefficient, and K is the fixed step size.

[0057] When determining the value of the encoding frame rate, the target frame rate and the encoding frame rate of the previous encoding cycle are compared to adaptively determine the encoding frame rate for both the increase and decrease of the frame rate.

[0058] Among them, for the situation where the frame rate drops, it is necessary to avoid the situation where the frame rate drops too much suddenly, and also to avoid the situation where the bit rate drops sharply when the bandwidth drops suddenly without adaptively adjusting the frame rate. When the bit rate drops sharply and the frame rate remains almost unchanged, obvious block effects will appear in the video. Therefore, in the embodiment of the present application, when the target frame rate is less than the encoding frame rate of the previous cycle, that is, when the frame rate drops, refer to the above-mentioned encoding frame rate determination formula, combine the target frame rate and the encoding frame rate of the previous cycle, and use the preset weight coefficient to calculate the encoding frame rate of the current cycle. The weight coefficient represents the weight of the influence of the encoding frame rate of the previous cycle on the encoding frame rate of the current cycle. The weight coefficient should avoid the situation where the frame rate drops too much suddenly, and also avoid the situation where the bit rate drops sharply when the bandwidth drops suddenly without adaptively adjusting the frame rate, so it should not be too large. In the embodiment of the present application, the weight coefficient is 0.5. Corresponding to the above encoding frame rate determination formula, the influence weights of the target frame rate and the encoding frame rate of the previous cycle on the encoding frame rate of the current cycle are both 50%. This ensures that when the frame rate drops, a suitable encoding frame rate is determined based on the encoding frame rate of the previous cycle and the target frame rate for video encoding of the current cycle.

[0059] In addition, for the case of an increase in frame rate, considering that when the bandwidth fluctuates near a certain bit rate interval breakpoint, the target frame rate will also fluctuate back and forth. In order to limit the back and forth fluctuations of the frame rate in this case, it is necessary to add more stringent restrictions to the case of an increase in frame rate. Based on this, in an embodiment of the present application, when the target frame rate is greater than the sum of the encoding frame rate of the previous cycle and the fixed step length, the target frame rate is directly used as the encoding frame rate of the current cycle. Otherwise, the encoding frame rate of the current cycle of the encoding frame rate of the previous cycle is directly used. That is, the encoding frame rate of the current cycle will only be increased when the target frame rate exceeds the encoding frame rate of the previous cycle by a fixed step length. In this way, the encoding frame rate of the current cycle can be prevented from fluctuating easily, which in turn causes fluctuations in the encoding frame rate for several consecutive encoding cycles, affecting the audience's video viewing experience.

[0060] Based on the above encoding frame rate decision scheme, an encoding frame rate parameter that adapts to the current bandwidth and cache environment while avoiding frequent frame rate fluctuations can be obtained. This can be used to encode the video in the current period, which can ensure the audience's viewing experience and avoid frame loss in the video.

[0061] Optionally, the embodiment of the present application also provides a coding rate decision scheme. Different from the traditional scheme that the coding rate is completely determined by the coding frame rate, the embodiment of the present application decouples the coding frame rate and the coding rate to avoid the fluctuation of the two parameter values ​​from excessively affecting each other.

[0062] Among them, refer to Figure 4 , the decision process of encoding bit rate includes:

[0063] S1401, query mapping relationship information according to the encoding frame rate of the current encoding period to determine the target bit rate range;

[0064] S1402: Determine the encoding rate of the current encoding period based on the comparison result between the target rate interval and the target rate.

[0065] When making coding rate decisions, first refer to the above mapping information formula B i =f(F i ), substitute the encoding frame rate of the current period into the formula. Since one frame rate value of the mapping relationship information corresponds to one bit rate interval, the bit rate interval corresponding to the encoding frame rate of the current period can be queried. Then, the maximum value of the bit rate interval is compared with the encoding bit rate determined in the above step S110. According to the comparison result, the minimum value of the two is selected as the encoding bit rate of the current encoding period.

[0066] Specifically, the formula for determining the encoding bit rate of the current encoding period is:

[0067] B encode =min(B target ,f(F encode )max )

[0068] Among them, B encode is the encoding bit rate of the current encoding cycle, B target is the target bit rate, f(F encode ) max is the maximum value of the target bitrate range.

[0069] It is understandable that, since the target bit rate is a bit rate parameter adaptively determined to adapt to the current real-time bandwidth and cache information, video encoding at the target bit rate can achieve a better video encoding transmission effect. In order to avoid the encoding bit rate determined based on the encoding frame rate decision being too large and exceeding the target bit rate value, thereby affecting the video encoding transmission effect, the embodiment of the present application compares the encoding bit rate value determined based on the encoding frame rate decision and the target bit rate to determine the minimum value between the two, so as to adaptively select the optimal bit rate parameter for video encoding.

[0070] It should be noted that the decision cycle of the above-mentioned video encoding parameters can be set according to actual encoding requirements, or a new round of video encoding cycle can be triggered when the bandwidth change reaches a set threshold to make new decisions on video encoding parameters such as encoding frame rate and encoding bit rate.

[0071] Optionally, decisions on video encoding parameters such as encoding resolution can be made based on real-time bandwidth and cache information, or the encoding resolution can be adaptively adjusted according to the encoding frame rate and encoding rate to make the video encoding parameters match each other and optimize the video encoding transmission effect.

[0072] For example, refer to Figure 5 , providing the video encoding decision process of a1-a9. When starting a new video encoding cycle, first detect the current real-time network bandwidth, and determine the cache information based on the cache accumulation of the data packets to be sent, so as to decide the target bit rate of the current video encoding cycle. Then, query the pre-built mapping relationship information according to the target bit rate, determine the target frame rate, and decide the encoding frame rate based on the target frame rate. After determining the encoding frame rate, further combine the encoding frame rate, mapping relationship information and target bit rate to decide the encoding bit rate. After completing the decision on the encoding frame rate and encoding bit rate, the encoding frame rate and encoding bit rate can be used for video encoding. While making video encoding parameter decisions based on the real-time bandwidth and cache information of this video, frequent fluctuations in the encoding frame rate and encoding bit rate are avoided, thereby improving the stability of video encoding parameter decisions.

[0073] As described above, the target bit rate is determined based on the real-time bandwidth and cache information; the corresponding target frame rate is determined based on the target bit rate query mapping relationship information, the mapping relationship information is pre-constructed based on different bit rate intervals and corresponding frame rate values, and the frame rate values ​​are configured in fixed step sizes; the encoding frame rate is determined based on the target frame rate, so as to use the encoding frame rate for video encoding in the current encoding cycle. By adopting the above technical means, the encoding frame rate is decided by determining the frame rate values ​​corresponding to different bit rate intervals, so as to avoid frequent changes in the encoding frame rate due to the influence of bandwidth, improve the stability of the encoding frame rate, and then improve the smoothness of video playback and optimize the user's viewing experience.

[0074] Based on the above embodiments, Figure 6 A schematic diagram of the structure of a video encoding parameter processing system provided by this application. Figure 6 The video encoding parameter processing system provided in this embodiment specifically includes: a target bit rate determination module 21, a target frame rate determination module 22 and an encoding frame rate determination module 23.

[0075] Wherein, the target bit rate determination module 21 is configured to determine the target bit rate according to the real-time bandwidth and the cache information;

[0076] The target frame rate determination module 22 is configured to determine the corresponding target frame rate based on the target bit rate query mapping relationship information, the mapping relationship information is pre-constructed according to different bit rate intervals and corresponding frame rate values, and the frame rate values ​​are configured in a fixed step ladder;

[0077] The construction process of mapping relationship information includes:

[0078] Determine a frame rate set and a bit rate set;

[0079] The data in the frame rate set and the bit rate set are used to perform quadratic function fitting and construct mapping relationship information.

[0080] Determining the frame rate set and bit rate set includes:

[0081] Determine a signal-to-noise power ratio for a plurality of different video encodings, and given a maximum bit rate value, the signal-to-noise power ratio is determined for video encoding according to different bit rate and frame rate parameter combinations;

[0082] Based on the maximum bit rate value, the signal-to-noise power ratio value, the bit rate and frame rate parameter combination and the maximum drop value of the signal-to-noise power ratio value, each bit rate value of the bit rate set is determined by a preset relationship formula.

[0083] The relationship formula is:

[0084] P(F i , B i )-P(F i , B i-1 )≤ΔP

[0085] Where i∈[1,n], B n =B max , B max is the maximum bit rate value, F i is the frame rate parameter of the bit rate and frame rate parameter combination, B i is the bit rate parameter of the bit rate and frame rate parameter combination, P is the corresponding signal-to-noise power ratio, and △P is the maximum drop value.

[0086] The encoding frame rate determining module 23 is configured to determine the encoding frame rate based on the target frame rate, so as to use the encoding frame rate to perform video encoding in the current encoding cycle.

[0087] Specifically, the encoding frame rate determining module 23 determines the encoding frame rate of the current encoding cycle according to a comparison result between the encoding frame rate of the previous encoding cycle and the target frame rate.

[0088] The formula for determining the encoding frame rate of the current encoding period is:

[0089]

[0090]

[0091] in, is the encoding frame rate of the current encoding cycle, F target is the target frame rate, is the encoding frame rate of the previous encoding cycle, α is the weight coefficient, and K is the fixed step size.

[0092] Specifically, the video encoding parameter processing system is further configured as follows:

[0093] Query mapping relationship information according to the encoding frame rate of the current encoding period to determine the target bit rate range;

[0094] The encoding bit rate of the current encoding cycle is determined based on the comparison result between the target bit rate interval and the target bit rate. The encoding bit rate of the current encoding cycle is determined by the formula:

[0095] B encode =min(B target ,f(F encode ) max )

[0096] Among them, B encode is the encoding bit rate of the current encoding cycle, B target is the target bit rate, f(F encode ) max is the maximum value of the target bitrate range.

[0097] As described above, the target bit rate is determined based on the real-time bandwidth and cache information; the corresponding target frame rate is determined based on the target bit rate query mapping relationship information, the mapping relationship information is pre-constructed based on different bit rate intervals and corresponding frame rate values, and the frame rate values ​​are configured in fixed step sizes; the encoding frame rate is determined based on the target frame rate, so as to use the encoding frame rate for video encoding in the current encoding cycle. By adopting the above technical means, the encoding frame rate is decided by determining the frame rate values ​​corresponding to different bit rate intervals, so as to avoid frequent changes in the encoding frame rate due to the influence of bandwidth, improve the stability of the encoding frame rate, and then improve the smoothness of video playback and optimize the user's viewing experience.

[0098] The video coding parameter processing system provided in the embodiment of the present application can be configured to execute the video coding parameter processing method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0099] Based on the above practical example, the embodiment of the present application also provides a video encoding parameter processing device, referring to Figure 7 , the video encoding parameter processing device includes: a processor 31, a memory 32, a communication module 33, an input device 34 and an output device 35. The memory 32, as a computer-readable storage medium, can be configured to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the video encoding parameter processing method described in any embodiment of the present application (for example, a target bit rate determination module, a target frame rate determination module and an encoding frame rate determination module in a video encoding parameter processing system). The communication module 33 is configured to perform data transmission. The processor 31 executes various functional applications and data processing of the device by running the software programs, instructions and modules stored in the memory, that is, to implement the above-mentioned video encoding parameter processing method. The input device 34 can be configured to receive input digital or character information, and generate key signal input related to the user settings and function control of the device. The output device 35 may include a display device such as a display screen. The video encoding parameter processing device provided above can be configured to execute the video encoding parameter processing method provided in the above-mentioned embodiment, and has corresponding functions and beneficial effects.

[0100] On the basis of the above embodiments, the embodiments of the present application further provide a storage medium containing computer executable instructions, wherein the computer executable instructions are configured to execute a video encoding parameter processing method when executed by a computer processor, and the storage medium may be any of various types of memory devices or storage devices. Of course, the storage medium containing computer executable instructions provided in the embodiments of the present application, whose computer executable instructions are not limited to the video encoding parameter processing method described above, may also execute related operations in the video encoding parameter processing method provided in any embodiment of the present application.

Claims

1. A video coding parameter processing method, characterized in that: include: Determine the target bitrate based on real-time bandwidth and cache information; Based on the target bit rate, the mapping relationship information is searched to determine the corresponding target frame rate, the mapping relationship information is pre-constructed according to different bit rate intervals and corresponding frame rate values, and the frame rate values ​​are configured in a fixed step ladder; The construction process of the mapping relationship information includes: Constructing a frame rate set based on a plurality of said frame rate values ​​configured in a fixed step ladder; Determine a plurality of signal-to-noise power ratios for different video encodings and give a maximum bit rate value, wherein the signal-to-noise power ratio is determined for video encoding according to different bit rate and frame rate parameter combinations; Based on the maximum bit rate value, the signal-to-noise power ratio value, the bit rate and frame rate parameter combination, and the maximum drop value of the signal-to-noise power ratio value, each bit rate value is determined by a preset relationship formula, and a bit rate set is constructed based on each determined bit rate value, wherein the bit rate set includes a plurality of bit rate intervals that do not overlap with each other, and the bit rate interval includes a plurality of bit rate values; The data in the frame rate set and the bit rate set are used to perform quadratic function fitting to construct the mapping relationship information; the relationship formula is: P(F i ,B i )-P(F i ,B i-1 )≤ΔP Where i∈[1,n], B n =B max , B max is the maximum bit rate value, F i is the frame rate parameter of the bit rate and frame rate parameter combination, B i is the bit rate parameter of the bit rate and frame rate parameter combination, P is the corresponding signal-to-noise power ratio, and ΔP is the maximum drop value; An encoding frame rate is determined based on the target frame rate, so as to use the encoding frame rate to perform video encoding in a current encoding cycle.

2. The video encoding parameter processing method according to claim 1, characterized in that: The determining the encoding frame rate based on the target frame rate comprises: The encoding frame rate of the current encoding cycle is determined according to a comparison result between the encoding frame rate of the previous encoding cycle and the target frame rate.

3. The video encoding parameter processing method according to claim 2, characterized in that: The formula for determining the encoding frame rate of the current encoding cycle is: in, is the encoding frame rate of the current encoding cycle, F target is the target frame rate, is the encoding frame rate of the previous encoding cycle, α is the weight coefficient, and K is the fixed step size.

4. The video encoding parameter processing method according to claim 1, characterized in that: After determining the encoding frame rate based on the target frame rate, the method further includes: Query mapping relationship information according to the encoding frame rate of the current encoding period to determine the target bit rate range; The encoding rate of the current encoding cycle is determined based on a comparison result between the target rate interval and the target rate.

5. The video encoding parameter processing method according to claim 4, characterized in that: The formula for determining the encoding rate of the current encoding cycle is: B encode =min(B target ,f(F encode ) max ) Among them, B encode is the encoding bit rate of the current encoding cycle, B target is the target bit rate, f(F encode ) max is the maximum value of the target bit rate range.

6. A video coding parameter processing system, characterized in that: include: A target bit rate determination module, configured to determine a target bit rate according to real-time bandwidth and cache information; A target frame rate determination module is configured to query mapping relationship information based on the target bit rate to determine a corresponding target frame rate, wherein the mapping relationship information is pre-constructed according to different bit rate intervals and corresponding frame rate values, and the frame rate values ​​are configured in a fixed step size ladder; The construction process of the mapping relationship information includes: Constructing a frame rate set based on a plurality of said frame rate values ​​configured in a fixed step ladder; Determine a plurality of signal-to-noise power ratios for different video encodings and give a maximum bit rate value, wherein the signal-to-noise power ratio is determined for video encoding according to different bit rate and frame rate parameter combinations; Based on the maximum bit rate value, the signal-to-noise power ratio value, the bit rate and frame rate parameter combination, and the maximum drop value of the signal-to-noise power ratio value, determine each bit rate value of the bit rate set by a preset relationship formula, and construct a bit rate set based on each determined bit rate value, wherein the bit rate set includes a plurality of bit rate intervals that do not overlap with each other, and the bit rate interval includes a plurality of bit rate values; The data in the frame rate set and the bit rate set are used to perform quadratic function fitting to construct the mapping relationship information; the relationship formula is: P(F i ,B i )-P(F i ,B i-1 )≤ΔP Where i∈[1,n], B n =B max , B max is the maximum bit rate value, F i is the frame rate parameter of the bit rate and frame rate parameter combination, B i is the bit rate parameter of the bit rate and frame rate parameter combination, P is the corresponding signal-to-noise power ratio, and ΔP is the maximum drop value; The encoding frame rate determination module is configured to determine the encoding frame rate based on the target frame rate, so as to use the encoding frame rate to perform video encoding in a current encoding cycle.

7. A video encoding parameter processing device, characterized in that: include: memory and one or more processors; The memory is configured to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the video encoding parameter processing method as described in any one of claims 1-5.

8. A storage medium containing computer executable instructions, characterized in that: When the computer executable instructions are executed by a computer processor, they are configured to execute the video encoding parameter processing method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Frame extracting method, device, apparatus and computer-readable storage medium

    CN109168013A

  • Ultrahigh-definition video high-quality wireless transmission method and system

    CN110602548A

  • Image coding apparatus and method therefor

    JP2004007619A