A video bitrate adjustment method and apparatus for multi-channel mobile wireless environments

Abstract

This invention proposes a video bitrate adjustment method and apparatus for multi-channel mobile wireless environments. The method includes: real-time acquisition of current channel parameter information under multi-channel conditions; construction of a channel characteristic parameter model based on the channel parameters of various channels; construction of a video bitrate hierarchical model based on the carrying capacity of each channel under multi-channel conditions; matching the acquired current channel parameter information with the channel characteristic parameter model to determine the maximum rate attribute value suitable for the current channel; and matching the maximum rate attribute value with the video bitrate hierarchical model to determine a video communication strategy or media parameter configuration suitable for the current channel. This invention, by constructing a channel characteristic parameter model and a video bitrate hierarchical model and matching them with real-time channel conditions, generates media parameter configurations for the current channel. This improves the efficiency and accuracy of media parameter generation after sudden network changes (efficiency improvement: tens of milliseconds to seconds), reduces poor video quality under adverse conditions, and enhances the user's video communication experience.

Description

Technical Field

[0001] This invention relates to the field of video communication technology, and in particular to a video bitrate adjustment method and apparatus for multi-channel mobile wireless environments. Background Technology

[0002] In specialized industry sectors, video service systems are often deployed privately in dedicated network environments. Compared to general video applications, dedicated network environments are more complex, primarily in two aspects:

[0003] 1) Multiple channel switching leads to sudden changes in speed: In order to achieve communication capability backup, the private network environment has multiple network channels (e.g., 4G / 5G / various satellites / radio stations, etc.), and the channels will switch at any time according to the actual situation. Since the network characteristic parameters of each channel are different (bandwidth, latency, packet loss rate, jitter, degree of influence from objective environment, etc.), the video service system needs to use different media parameters under different channels to ensure good video communication effect. General video service systems are often decoupled from network channels, making it difficult to directly obtain network channel information. Instead, they rely on active detection or estimation based on message transmission and reception to sense changes in network status and then gradually adjust media parameter configurations. This iterative process of sensing and adjustment takes time and is difficult to meet the efficiency requirements of multi-channel switching scenarios. For example, when the network channel switches from a high-bandwidth, low-latency channel (such as 5G) to a low-bandwidth, high-latency channel (such as some satellites), ideally, the transmission buffer should be cleared immediately and the coding bitrate should be accurately reduced. However, because the specific channel information at the underlying level is not automatically obtained, the video service system cannot control the bitrate accurately and in a timely manner, resulting in channel congestion and causing video image stuttering, increased screen latency, or even screen tearing.

[0004] 2) Dynamic changes in the mobile wireless network environment: When in a static state, the communication network is relatively stable. However, during mobile operations, the network bandwidth is more easily affected by the surrounding environment. For example, satellite signals may be blocked by trees while moving, continuous tunnels may cause network interruptions, and 4G / 5G base station switching may cause network jitter. This poses a severe challenge to the network perception capability and rapid adjustment and adaptation capability of video applications. Summary of the Invention

[0005] The technical problem to be solved by this invention is how to address the issues of video image unstability and slow adjustment and recovery caused by sudden changes in video rate due to multi-channel switching and dynamic changes in the mobile wireless network environment. In view of this, this invention provides a video bitrate adjustment method and apparatus for multi-channel mobile wireless environments.

[0006] The technical solution adopted in this invention is a video bitrate adjustment method for multi-channel mobile wireless environments, comprising:

[0007] Step S1: Obtain the current channel parameter information under multi-channel environment;

[0008] Step S2: Construct a channel characteristic parameter model based on the channel parameters of various channels;

[0009] Step S3: Based on the carrying capacity of each channel in a multi-channel environment, construct a video bitrate hierarchical model;

[0010] Step S4: Based on the real-time acquired current channel parameter information, match it with the channel feature parameter model to determine the maximum rate attribute value suitable for the current channel;

[0011] Step S5: The maximum rate attribute value is matched with the video bitrate hierarchical model to determine the media parameter configuration suitable for the current channel;

[0012] Step S6: Based on the media parameter configuration suitable for the current channel, determine the current video communication strategy for the current channel.

[0013] In one embodiment, step S1 includes:

[0014] The channel parameters obtained include channel type and latitude and longitude, acquired through methods including active querying, monitoring and reporting, and manual configuration.

[0015] In one implementation, step S2 includes:

[0016] The channel parameters for various channels are listed using XML format, and the maximum rate of the corresponding channel is determined based on these parameters.

[0017] In one implementation, step S3 includes:

[0018] The video bitrate hierarchical model is configured based on multiple parameters, including encoding bitrate, encoding format, resolution, frame rate, keyframe interval, and forward error correction strategy.

[0019] In one implementation, step S5 includes:

[0020] The maximum rate attribute value is matched with the rate in the video bitrate layering model to determine the layer in the video bitrate layering model that is equal to the current maximum rate attribute value or the closest layer is taken down, and the rate of that layer is obtained.

[0021] Another aspect of the present invention provides a video bitrate adjustment device for multi-channel mobile wireless environments, comprising:

[0022] The acquisition unit is configured to acquire current channel parameter information in a multi-channel environment;

[0023] The channel feature parameter model unit is configured to construct a channel feature parameter model based on the channel parameters of various channels.

[0024] The video bitrate hierarchical model unit is configured to construct a video bitrate hierarchical model based on the carrying capacity of each channel in a multi-channel environment.

[0025] The first matching unit is configured to match the channel feature parameter model with the real-time acquired current channel parameter information to determine the maximum rate attribute value suitable for the current channel.

[0026] The second matching unit is configured to use the maximum rate attribute value to match the video bitrate hierarchical model to determine the media parameter configuration suitable for the current channel;

[0027] The decision unit is configured to determine the video communication strategy for the current channel based on the media parameter configuration suitable for the current channel.

[0028] Another aspect of the present invention provides an electronic device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the video bitrate adjustment method for a multi-channel mobile wireless environment as described in any of the preceding claims.

[0029] Another aspect of the present invention provides a computer storage medium storing a computer program that, when executed by a processor, implements the steps of the video bitrate adjustment method for a multi-channel mobile wireless environment as described in any of the preceding claims.

[0030] Compared with the prior art, the present invention has at least the following advantages:

[0031] This invention constructs a channel characteristic parameter model and a video bitrate hierarchical model, which are matched with the real-time channel state to quickly generate the media parameter configuration under the current channel. Compared with the traditional strategy of first detecting the network state and then dynamically adjusting the media parameters, it significantly improves the efficiency and accuracy of media parameter generation after sudden network changes (efficiency improvement: tens of milliseconds to seconds), effectively reduces or avoids poor video effects under adverse channel conditions, and improves the user's video communication experience. Attached Figure Description

[0032] Figure 1 This is a schematic flowchart of a video bitrate adjustment method for a multi-channel mobile wireless environment according to an embodiment of the present invention;

[0033] Figure 2 This is a schematic diagram of the video bitrate adjustment method in a multi-channel mobile wireless environment according to an embodiment of the present invention;

[0034] Figure 3 This is a schematic diagram of a channel feature parameter model according to an embodiment of the present invention;

[0035] Figure 4 This is a schematic diagram of a video bitrate layering model according to an embodiment of the present invention;

[0036] Figure 5 This is a schematic diagram of the composition structure of a video bitrate adjustment device for a multi-channel mobile wireless environment according to an embodiment of the present invention;

[0037] Figure 6 This is a schematic diagram of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0038] To further illustrate the technical means and effects of the present invention in achieving its intended purpose, the present invention will be described in detail below with reference to the accompanying drawings and preferred embodiments.

[0039] Unless otherwise specified, all terms used herein (including technical and scientific terms) shall have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. It should also be understood that terms (e.g., those defined in common dictionaries) shall be interpreted as having the meaning consistent with their meaning in the context of the relevant art and shall not be interpreted in an idealized or overly formal sense unless expressly so specified herein.

[0040] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. This application will now be described in detail with reference to the accompanying drawings and embodiments.

[0041] This invention provides a video bitrate adjustment method for multi-channel mobile wireless environments, such as... Figure 1 As shown, it includes:

[0042] Step S1: Obtain the current channel parameter information under multi-channel environment;

[0043] Step S2: Construct a channel characteristic parameter model based on the channel parameters of various channels;

[0044] Step S3: Based on the carrying capacity of each channel in a multi-channel environment, construct a video bitrate hierarchical model;

[0045] Step S4: Based on the real-time acquired current channel parameter information, match it with the channel feature parameter model to determine the maximum rate attribute value suitable for the current channel;

[0046] Step S5: The maximum rate attribute value is matched with the video bitrate hierarchical model to determine the media parameter configuration suitable for the current channel;

[0047] Step S6: Based on the media parameter configuration suitable for the current channel, determine the current video communication strategy for the current channel.

[0048] refer to Figure 2 The method provided in this embodiment will be described in detail step by step below.

[0049] Step S1: Obtain the current channel parameter information in a multi-channel environment.

[0050] Specifically, in multi-channel scenarios, the current channel type, latitude and longitude, or other relevant information can be obtained through active querying, monitoring and reporting, or manual configuration. Note: This is also one of the differences between the method presented in this paper and general video service systems, which, to maintain loose coupling, try to decouple from other service systems.

[0051] Obtaining the channel type determines the maximum capacity of the current channel, providing a basis for timely and accurate adjustment of the video bitrate. Satellite channel rates are related to latitude and longitude; therefore, obtaining latitude and longitude provides support for satellite rate estimation.

[0052] Step S2: Construct a channel characteristic parameter model based on the channel parameters of various channels.

[0053] refer to Figure 3 For multi-channel scenarios, in order to achieve a unified description of channel feature parameters and construct a channel feature parameter model, a relatively simple way is to describe each channel based on XML format, as shown in the figure below. Each line in the ChannelParamModel tag represents a channel, which is represented by Channel and contains several attribute tags. Among them, the ChannelType tag indicates the channel type, and the MaxRate tag indicates the maximum rate.

[0054] Because the characteristic parameters of each channel are not uniform, in addition to the ChannelType and MaxRate labels, a channel can also have other attribute labels depending on the actual situation. For example, the satellite channel rate is related to longitude, latitude, and elevation angle. Therefore, in the figure below, the satellite channel has Lon, Lat, and Elevation labels.

[0055] The channel characteristic parameter model uniformly describes all channels in the system. Therefore, based on the channel type and related attributes, the channel can be uniquely identified, and thus the corresponding MaxRate value of the channel can be determined.

[0056] Step S3: Based on the carrying capacity of each channel in a multi-channel environment, construct a video bitrate hierarchical model.

[0057] Specifically, in multi-channel scenarios, due to the different carrying capacities of each channel, media parameters such as video bitrate, resolution, and frame rate also vary significantly under different channels. For example, the bitrate under a 5G channel may be as high as 2M, which can transmit 1080P high-definition video, while the bitrate under a satellite channel may be as low as 500K, which can only transmit 720P or lower resolution video. In addition, there may be network packet loss under satellite, requiring different forward error correction (FEC) strategies to be set.

[0058] like Figure 4 As shown, in order to quickly generate media parameters that conform to the current channel under different channel bandwidth conditions, including coding bitrate, coding format, resolution, frame rate, keyframe interval, forward error correction strategy, etc., a bitrate hierarchical model is constructed.

[0059] List the encoding bitrates from largest to smallest in a hierarchical manner (based on XML format). The hierarchy is represented by Layer, and each hierarchy represents a set of media parameters, including encoding bitrate, video encoding method (vc), resolution (width, height), frame rate, keyframe interval (igap), forward error correction strategy (fec), etc. The specific parameter values ​​are determined according to the actual situation. For example, the encoding formats supported by the system may be AVC (H.264), HEVC (H.265), VP8, VP9, ​​etc. Other media parameters can also be added as needed.

[0060] The number of layers needs to be determined based on the actual situation. First, the bitrate range needs to be determined, that is, the maximum and minimum supported video encoding bitrate. Second, the interval between bitrates needs to be set.

[0061] The model defines the step size or granularity for adjusting the coding bitrate. Video services can match one of the levels as the current media parameters according to the actual channel conditions. When the channel carrying capacity increases, such as switching from a satellite channel to a 5G channel, it can be adjusted upward to the corresponding level. When the channel carrying capacity decreases, such as switching from a 5G channel to a satellite channel, it can be adjusted downward to the corresponding level.

[0062] Step S4: Based on the real-time acquired current channel parameter information, match it with the channel feature parameter model to determine the maximum rate attribute value suitable for the current channel.

[0063] In this embodiment, after obtaining channel-related information through real-time status monitoring, the channel type is matched with the channel characteristic parameter model, that is, the channel characteristic parameter model is traversed layer by layer to obtain a certain channel and its attributes. Assume that the obtained MaxRate attribute value is R. M .

[0064] Step S5: The maximum rate attribute value is matched with the video bitrate hierarchical model to determine the media parameter configuration suitable for the current channel.

[0065] In this embodiment, R M Matching the rate in the video bitrate layering model, that is, by traversing the video bitrate layering model, determining whether the rate of each layer matches R. M If equal values ​​exist, the parameter of that layer is used as the new media application parameter. If no equal value exists, the nearest value is taken, for example, R. M =310000, matching the video bitrate layering model yields the closest layer with a rate of 256000, which is called layer L. Match .

[0066] Step S6: Based on the media parameter configuration suitable for the current channel, determine the current video communication strategy for the current channel.

[0067] For example, it can be done in at least one of the following ways:

[0068] (1) Set the maximum channel rate R M The signaling message is sent to the other end of the video communication, allowing the other end to quickly respond according to R. M Video encoding is performed to ensure that the video stream sent from the communication peer meets the channel capability requirements, thus providing support for maintaining a smooth video image seen by the local end.

[0069] (2) To ensure audio priority, audio bandwidth resources are reserved. Assume the audio bandwidth requirement is R. A (For example, OPUS encoding can be set to 24Kbps / 48Kbps, etc.), therefore the available bandwidth of the video can be expressed as (R... M -R A (Note: This value does not take into account the impact of other business operations);

[0070] (3) Service layer bandwidth estimation: Based on the size and transmission / reception timing of RTP / RTCP packets, the actual channel bandwidth R can be estimated. W This value takes into account the impact of other business operations; theoretically, R W <R M However, this value is estimated based on the data that has been sent and received. Its accuracy and timeliness are related to the size of the estimated sample space. The larger the sample space, the more accurate the average bandwidth rate is, but the timeliness is poor. Conversely, the smaller the sample space, the higher the timeliness is, but the lower the accuracy.

[0071] (4) Available video bandwidth is in, This is a correction factor used to eliminate the influence of other overheads, based on a certain time period (R). W / R M Determined by the average value between )

[0072] (5) The local end clears the transmit buffer and controls the encoder, setting the bit rate to R. U Other parameters such as resolution and frame rate are based on L Match set up.

[0073] Compared with the prior art, this embodiment has at least the following advantages:

[0074] This invention addresses the issue of stuttering and slow recovery of real-time video services in complex, mobile wireless network environments during multi-channel switching and dynamic network changes. The method provided in this invention can generate media parameters that conform to channel characteristics in a timely and accurate manner. Compared to the traditional iterative process of sensing first and then adjusting, this method offers higher efficiency in adaptive video adjustment after sudden network changes (efficiency improvement: tens of milliseconds to seconds), effectively reducing or avoiding video stuttering, accelerating smooth recovery, and significantly improving the user's video communication experience.

[0075] The second embodiment of the present invention, corresponding to the first embodiment, introduces a video bitrate adjustment device for a multi-channel mobile wireless environment, such as... Figure 5 As shown, it includes the following components:

[0076] The acquisition unit is configured to acquire current channel parameter information in a multi-channel environment;

[0077] The channel feature parameter model unit is configured to construct a channel feature parameter model based on the channel parameters of various channels.

[0078] The video bitrate hierarchical model unit is configured to construct a video bitrate hierarchical model based on the carrying capacity of each channel in a multi-channel environment.

[0079] The first matching unit is configured to match the channel feature parameter model with the real-time acquired current channel parameter information to determine the maximum rate attribute value suitable for the current channel.

[0080] The second matching unit is configured to use the maximum rate attribute value to match the video bitrate hierarchical model to determine the media parameter configuration suitable for the current channel;

[0081] The decision unit is configured to determine the video communication strategy for the current channel based on the media parameter configuration suitable for the current channel.

[0082] According to a third embodiment of the present invention, an electronic device can be understood as a physical device, such as... Figure 6As shown, it includes a processor and memory storing processor-executable instructions. When the instructions are executed by the processor, the following operations are performed:

[0083] Step S1: Obtain the current channel parameter information under multi-channel environment;

[0084] Step S2: Construct a channel characteristic parameter model based on the channel parameters of various channels;

[0085] Step S3: Based on the carrying capacity of each channel in a multi-channel environment, construct a video bitrate hierarchical model;

[0086] Step S4: Based on the real-time acquired current channel parameter information, match it with the channel feature parameter model to determine the maximum rate attribute value suitable for the current channel;

[0087] Step S5: The maximum rate attribute value is matched with the video bitrate hierarchical model to determine the media parameter configuration suitable for the current channel;

[0088] Step S6: Based on the media parameter configuration suitable for the current channel, determine the current video communication strategy for the current channel.

[0089] In the fourth embodiment of the present invention, the video bitrate adjustment method for a multi-channel mobile wireless environment follows the same process as the first, second, or third embodiments. The difference lies in the engineering implementation: this embodiment can be implemented using software plus necessary general-purpose hardware platforms. While hardware implementation is also possible, the former is often a preferred method. Based on this understanding, the method of the present invention can be embodied in the form of a computer software product stored in a storage medium (such as ROM / RAM, magnetic disk, or optical disk), including several instructions to cause a device to execute the method described in the embodiments of the present invention.

[0090] Through the description of specific embodiments, a more in-depth and specific understanding should be gained of the technical means and effects adopted by the present invention to achieve the intended purpose. However, the accompanying drawings are only provided for reference and illustration and are not intended to limit the present invention.

Claims

1. A video bitrate adjustment method for a multi-channel mobile wireless environment, characterized in that, include: Step S1: Obtain the current channel parameter information under multi-channel environment; Step S2: Construct a channel characteristic parameter model based on the channel parameters of various channels; Step S3: Based on the carrying capacity of each channel in a multi-channel environment, construct a video bitrate hierarchical model; Step S4: Based on the real-time acquired current channel parameter information, match it with the channel feature parameter model to determine the maximum rate attribute value suitable for the current channel; Step S5: The maximum rate attribute value is matched with the video bitrate hierarchical model to determine the media parameter configuration suitable for the current channel. Step S6: Based on the media parameter configuration suitable for the current channel, determine the video communication strategy for the current channel; Step S2 includes: The parameters of each channel are listed in XML format, and the maximum rate of the corresponding channel is determined based on the parameters of each channel. Step S3 includes: The video bitrate hierarchical model is configured based on multiple parameters, including encoding bitrate, encoding format, resolution, frame rate, keyframe interval, and forward error correction strategy.

2. The video bitrate adjustment method for a multi-channel mobile wireless environment according to claim 1, characterized in that, Step S1 includes: The channel parameters obtained include channel type and latitude and longitude, acquired through methods including active querying, monitoring and reporting, and manual configuration.

3. The video bitrate adjustment method for multi-channel mobile wireless environments according to claim 1, characterized in that, Step S5 includes: The maximum rate attribute value is matched with the encoding bitrate in the video bitrate layering model to determine the layer in the video bitrate layering model that is equal to the current maximum rate attribute value or the layer that is closest to it, and the rate of that layer is obtained.

4. A video bitrate adjustment device for a multi-channel mobile wireless environment, characterized in that, include: The acquisition unit is configured to acquire current channel parameter information in a multi-channel environment; The channel feature parameter model unit is configured to construct a channel feature parameter model based on the channel parameters of various channels. The video bitrate hierarchical model unit is configured to construct a video bitrate hierarchical model based on the carrying capacity of each channel in a multi-channel environment. The first matching unit is configured to match the channel feature parameter model with the real-time acquired current channel parameter information to determine the maximum rate attribute value suitable for the current channel. The second matching unit is configured to use the maximum rate attribute value to match the video bitrate hierarchical model to determine the media parameter configuration suitable for the current channel; The decision unit is configured to determine the video communication strategy for the current channel based on the media parameter configuration suitable for the current channel. The channel feature parameter model unit is specifically configured as follows: The parameters of each channel are listed in XML format, and the maximum rate of the corresponding channel is determined based on the parameters of each channel. The specific configuration of the video bitrate hierarchical model unit is as follows: The video bitrate hierarchical model is configured based on multiple parameters, including encoding bitrate, encoding format, resolution, frame rate, keyframe interval, and forward error correction strategy.

5. An electronic device, characterized in that, The electronic device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the video bitrate adjustment method for a multi-channel mobile wireless environment as described in any one of claims 1 to 3.

6. A computer storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the steps of the video bitrate adjustment method for a multi-channel mobile wireless environment as described in any one of claims 1 to 3.

Images