Video code rate adjusting method and device for multi-channel maneuvering wireless environment

Abstract

The invention provides a video code rate adjusting method and device in a multi-channel maneuvering wireless environment. The method comprises the following steps: acquiring current channel parameter information in the multi-channel environment in real time; constructing a channel characteristic parameter model based on channel parameters of various channels; constructing a video code rate layering model based on the bearing capacity of each channel in a multi-channel environment; based on the obtained current channel parameter information, matching with a channel characteristic parameter model to determine a maximum rate attribute value suitable for the current channel; and matching the maximum rate attribute value with the video code rate hierarchical model, and determining a video communication strategy or media parameter configuration suitable for the current channel. According to the method, the channel characteristic parameter model and the video code rate layering model are constructed to be matched with the real-time channel state, the media parameter configuration under the current channel is generated, the efficiency and accuracy of media parameter generation after network sudden change can be improved (the efficiency is improved from dozens of milliseconds to seconds), the situation that the video effect is poor under the severe condition is reduced, and the user experience is improved. And the video communication experience of the user is improved.

Description

Technical Field

[0001] The present invention relates to the field of video communication technology, and in particular to a method and device for adjusting video bit rate in a multi-channel mobile wireless environment. Background Art

[0002] In special industries, video service systems are often privately deployed in private network environments. Compared with general video applications, private network environments are more complex, mainly in two aspects:

[0003] 1) Multi-channel switching leads to sudden changes in rate: In order to achieve communication capability backup, the private network environment has multiple network channels (for example: 4G / 5G / various satellites / radio stations, etc.), and the channels will switch at any time according to actual conditions. Since the network characteristic parameters of each channel are different (bandwidth, latency, packet loss rate, jitter, degree of influence by the objective environment, etc.), the video service system needs to use different media parameters under different channels to ensure good video communication effects. General video service systems are often decoupled from network channels, and it is difficult to directly obtain network channel information. Instead, they perceive changes in network status through active detection or estimation based on message sending and receiving conditions, and then gradually adjust media parameter configurations. This cyclic iterative process of perception and adjustment takes a certain amount of time and is difficult to meet the efficiency requirements in multi-channel switching scenarios. For example, when the network channel switches from a high-bandwidth, low-latency channel (such as 5G) to a low-bandwidth, high-latency channel (such as some satellites), the ideal situation is to immediately clear the send buffer and accurately reduce the encoding bit rate. However, since the specific channel information at the bottom layer is not automatically obtained, it is difficult for the video service system to control the bit rate in a timely and accurate manner, resulting in channel congestion, and then video image freezes, increased picture delays, and even screen distortion.

[0004] 2) Dynamic changes in the mobile wireless network environment: When in a static state, the communication network state is relatively stable. However, during mobile operations, the network bandwidth is more easily affected by the surrounding environment. For example, satellite signals are blocked by trees during movement, continuous tunnels cause intermittent network connections, and 4G / 5G base station switching causes network jitters. These pose severe challenges to the network perception and rapid adjustment and adaptation capabilities of video applications. Summary of the invention

[0005] The technical problem to be solved by the present invention is how to solve the problem of video service rate sudden change due to multi-channel switching and dynamic change of mobile wireless network environment, which leads to unsmooth video image and slow adjustment and recovery. In view of this, the present invention provides a video bit rate adjustment method and device in a multi-channel mobile wireless environment.

[0006] The technical solution adopted by the present invention is a video bit rate adjustment method in a multi-channel mobile wireless environment, comprising:

[0007] Step S1, obtaining current channel parameter information in a multi-channel environment;

[0008] Step S2, constructing a channel characteristic parameter model based on channel parameters of various channels;

[0009] Step S3, constructing a video bit rate hierarchical model based on the carrying capacity of each channel in a multi-channel environment;

[0010] Step S4, matching the current channel parameter information acquired in real time with the channel characteristic parameter model to determine a maximum rate attribute value suitable for the current channel;

[0011] Step S5, using the maximum rate attribute value to match the video bit rate layering model to determine a media parameter configuration suitable for the current channel;

[0012] Step S6: determining a video communication strategy for the current channel based on the media parameter configuration suitable for the current channel.

[0013] In one embodiment, step S1 includes:

[0014] The channel parameters obtained include channel type, longitude and latitude through acquisition methods including active query, monitoring report, and manual configuration.

[0015] In one embodiment, step S2 includes:

[0016] Channel parameters of various channels are listed based on the XML format, and the maximum rate of the corresponding channel is determined according to the parameters of the various channels.

[0017] In one embodiment, step S3 includes:

[0018] The video bit rate hierarchical model is configured based on multiple parameters including encoding bit rate, encoding format, resolution, frame rate, key frame interval, and forward error correction strategy.

[0019] In one embodiment, step S5 includes:

[0020] The maximum rate attribute value is matched with the rate in the video bit rate layering model, a layer in the video bit rate layering model that is equal to the current maximum rate attribute value or is closest to the current maximum rate attribute value is determined, and the rate of the layer is obtained.

[0021] Another aspect of the present invention further provides a video bit rate adjustment device in a multi-channel mobile wireless environment, comprising:

[0022] An acquisition unit configured to acquire current channel parameter information in a multi-channel environment;

[0023] A channel characteristic parameter model unit, configured to construct a channel characteristic parameter model based on channel parameters of various channels;

[0024] A video bit rate hierarchical model unit configured to construct a video bit rate hierarchical model based on the carrying capacity of each channel in a multi-channel environment;

[0025] A first matching unit is configured to match the channel characteristic parameter model based on the current channel parameter information acquired in real time, so as to determine a maximum rate attribute value suitable for the current channel;

[0026] A second matching unit is configured to use the maximum rate attribute value to match the video bit rate layering model to determine a media parameter configuration suitable for a current channel;

[0027] The decision unit is configured to determine a video communication strategy for the current channel based on the media parameter configuration suitable for the current channel.

[0028] Another aspect of the present invention provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the video bit rate adjustment method for a multi-channel mobile wireless environment as described in any one of the above items.

[0029] Another aspect of the present invention further provides a computer storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the method for adjusting the video bit rate in a multi-channel mobile wireless environment as described in any one of the above items are implemented.

[0030] Compared with the prior art, the present invention has at least the following advantages:

[0031] The present invention constructs a channel characteristic parameter model and a video bit rate layering model to match the real-time channel status and quickly generates the media parameter configuration under the current channel. Compared with the traditional strategy of first sensing the network status through detection and then dynamically adjusting the media parameters, the efficiency and accuracy of media parameter generation after a sudden network change are greatly improved (efficiency improvement: tens of milliseconds to seconds), effectively reducing or avoiding poor video effects under harsh channel conditions, and improving the user's video communication experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 A schematic flow chart of a method for adjusting video bit rate in a multi-channel mobile wireless environment according to an embodiment of the present invention;

[0033] Figure 2 A logical schematic diagram of a method for adjusting a video bit rate in a multi-channel mobile wireless environment according to an embodiment of the present invention;

[0034] Figure 3 A schematic diagram of a channel characteristic parameter model according to an embodiment of the present invention;

[0035] Figure 4 A schematic diagram of a video bit rate layering model according to an embodiment of the present invention;

[0036] Figure 5 A schematic diagram of the structure of a video bit rate adjustment device for a multi-channel mobile wireless environment according to an embodiment of the present invention;

[0037] Figure 6 FIG. 1 is a schematic diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0038] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined purpose, the present invention is described in detail below in conjunction with the accompanying drawings and preferred embodiments.

[0039] Unless otherwise defined, all terms (including technical terms and scientific terms) used in this article have the same meaning as commonly understood by ordinary technicians in the field to which this application belongs. It should also be understood that terms (such as terms defined in commonly used dictionaries) should be interpreted as having the same meaning as their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined in this article.

[0040] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0041] The embodiment of the present invention provides a method for adjusting the video bit rate in a multi-channel mobile wireless environment. Figure 1 As shown, including:

[0042] Step S1, obtaining current channel parameter information in a multi-channel environment;

[0043] Step S2, constructing a channel characteristic parameter model based on channel parameters of various channels;

[0044] Step S3, constructing a video bit rate hierarchical model based on the carrying capacity of each channel in a multi-channel environment;

[0045] Step S4, matching the current channel parameter information acquired in real time with the channel characteristic parameter model to determine a maximum rate attribute value suitable for the current channel;

[0046] Step S5, using the maximum rate attribute value to match the video bit rate layering model to determine a media parameter configuration suitable for the current channel;

[0047] Step S6: determining a video communication strategy for the current channel based on the media parameter configuration suitable for the current channel.

[0048] refer to Figure 2 , the method provided in this embodiment will be described in detail step by step below.

[0049] Step S1, obtaining current channel parameter information in a multi-channel environment.

[0050] Specifically, in a multi-channel scenario, the current channel type, longitude and latitude, or other related information can be obtained by active query, monitoring and reporting, manual configuration, etc. Note: This is also one of the differences between the method in this paper and the general video service system. In order to maintain loose coupling, the general video service system will try to decouple from other service systems.

[0051] Once the channel type is obtained, the maximum carrying capacity of the current channel is determined, providing a basis for timely and accurate adjustment of the video bit rate. The satellite channel rate is related to longitude and latitude, so obtaining longitude and latitude provides support for satellite rate estimation.

[0052] Step S2: construct a channel characteristic parameter model based on channel parameters of various channels.

[0053] refer to Figure 3 For multi-channel scenarios, in order to achieve a unified description of channel characteristic parameters and build a channel characteristic parameter model, a relatively simple way is to describe each channel based on the XML format, as shown in the following figure. Each line in the label ChannelParamModel represents a channel. The channel is represented by Channel and contains several attribute tags, among which the ChannelType label represents the channel type and the MaxRate label represents the maximum rate.

[0054] Since the characteristic parameters of each channel are not uniform, in addition to the ChannelType and MaxRate tags, Channel can also have other attribute tags based on actual conditions. For example, the satellite channel rate is related to longitude, latitude, and elevation. Therefore, in the figure below, the satellite channel has Lon, Lat, and Elevation tags.

[0055] The channel characteristic parameter model uniformly describes all channels in the system. Therefore, according to the channel type and related attributes, the Channel can be uniquely determined, and then the MaxRate value corresponding to the Channel can be determined.

[0056] Step S3: construct a video bit rate layering model based on the carrying capacity of each channel in a multi-channel environment.

[0057] Specifically, in a multi-channel scenario, due to the different carrying capacities of each channel, media parameters such as video bit rate, resolution, frame rate, etc. in different channels are also quite different. For example, the bit rate in a 5G channel may be as high as 2M, and 1080P high-definition video can be transmitted at this time, while the bit rate in a satellite channel may be as low as 500K, and only 720P or lower resolution video can be transmitted at this time. In addition, there may be network packet loss in the satellite, and different forward error correction strategies (FEC) need to be set.

[0058] like Figure 4 As shown, in order to quickly generate media parameters that meet the current channel under different channel bandwidth conditions, including encoding bit rate, encoding format, resolution, frame rate, key frame interval, forward error correction strategy, etc., a bit rate layering model is constructed.

[0059] The encoding bit rates are listed from large to small in a hierarchical manner (based on XML format). The hierarchies are represented by Layer. Each layer represents a set of media parameters, including encoding bit rate (rate), video encoding mode (vc), resolution (w width, h height), frame rate (frame), key frame interval (igap), forward error correction strategy (fec) and other parameters. The specific parameter values ​​are determined according to the actual situation. For example, the encoding formats supported by the system may include avc (H.264), hevc (H.265), VP8, VP9, ​​etc. Other media parameters can also be added as needed.

[0060] The number of layers needs to be determined based on actual conditions. First, the bit rate range must be determined, that is, the maximum and minimum video encoding bit rates supported, and secondly, the interval between bit rates must be set.

[0061] This model defines the step or granularity for adjusting the encoding bit rate up and down. Video services can match one of the levels as the current media parameter based on the actual channel conditions. When the channel carrying capacity increases, such as switching from a satellite channel to a 5G channel, it can be adjusted upward to the corresponding level. When the channel carrying capacity decreases, such as switching from a 5G channel to a satellite channel, it can be adjusted downward to the corresponding level.

[0062] Step S4, based on the current channel parameter information acquired in real time, matching with the channel characteristic parameter model is used to determine the maximum rate attribute value suitable for the current channel.

[0063] In this embodiment, after obtaining channel related information through real-time status monitoring, the channel type is matched with the channel characteristic parameter model, that is, the channel characteristic parameter model is traversed layer by layer to obtain a certain channel Channel and its attributes. Assume that the MaxRate attribute value obtained is R M .

[0064] Step S5: using the maximum rate attribute value to match the video bit rate layering model to determine a media parameter configuration suitable for the current channel.

[0065] In this embodiment, R M Match the rate in the video bit rate layering model, that is, by traversing the video bit rate layering model, determine whether the rate of each layer is consistent with R M If the layers are equal, then the layer parameters are used as the new media application parameters. If there are no equal values, then the closest value is taken downwards, such as R M =310000, and the closest layer is obtained by matching the video bit rate layering model, whose rate is 256000, and this layer is called L Match .

[0066] Step S6: determining a video communication strategy for the current channel based on the media parameter configuration suitable for the current channel.

[0067] For example, at least one of the following methods may be used:

[0068] (1) Set the maximum channel rate R M The signaling message is sent to the video communication peer, so that the video communication peer can also quickly respond to R M Perform video encoding so that the video stream sent by the communication peer to the local end meets the channel capacity requirements, providing support for the video image seen by the local end to remain smooth;

[0069] (2) To ensure audio priority, reserve audio bandwidth resources. Assume that the audio bandwidth requirement is R A (For example, OPUS encoding can be set to 24Kbps / 48Kbps, etc.), so the available video bandwidth can be expressed as (R M -R A ) (Note: This value does not take into account the impact of other businesses);

[0070] (3) Service layer bandwidth estimation: Based on the size and sending and receiving timing of RTP / RTCP packets, the actual channel bandwidth R can be estimated. W , this value takes into account the impact of other services. In theory, R W <R M , but this value is estimated based on the received and sent data, and its accuracy and timeliness are related to the size of the estimated sample space. The larger the sample space, the more accurate the average bandwidth rate, but the less timeliness; conversely, the smaller the sample space, the higher the timeliness and the less accurate it is;

[0071] (4) The available video bandwidth is in, is a correction factor used to eliminate the impact of other expenses, according to a certain period of time (R W / R M ) is determined by the average value between

[0072] (5) The local end clears the send buffer and controls the encoder to set the bit rate to R U Other parameters such as resolution, frame rate, etc. are based on L Match set up.

[0073] Compared with the prior art, this embodiment has at least the following effects:

[0074] The present invention aims at complex mobile wireless network environments. During multi-channel switching and dynamic network changes, real-time video services are prone to freezes and slow smooth recovery problems. Based on this, the method provided by the present invention can timely and accurately generate media parameters that meet channel characteristics. Compared with the traditional cyclic iterative process of first sensing and then adjusting, the video adaptive adjustment efficiency after sudden network changes is higher (efficiency improvement: tens of milliseconds to seconds), which effectively reduces or avoids video freezes, speeds up smooth recovery efficiency, and greatly improves the user's video communication experience.

[0075] The second embodiment of the present invention corresponds to the first embodiment. This embodiment introduces a video bit rate adjustment device for a multi-channel mobile wireless environment, such as Figure 5 As shown, it includes the following components:

[0076] An acquisition unit configured to acquire current channel parameter information in a multi-channel environment;

[0077] A channel characteristic parameter model unit, configured to construct a channel characteristic parameter model based on channel parameters of various channels;

[0078] A video bit rate hierarchical model unit configured to construct a video bit rate hierarchical model based on the carrying capacity of each channel in a multi-channel environment;

[0079] A first matching unit is configured to match the channel characteristic parameter model based on the current channel parameter information acquired in real time, so as to determine a maximum rate attribute value suitable for the current channel;

[0080] A second matching unit is configured to use the maximum rate attribute value to match the video bit rate layering model to determine a media parameter configuration suitable for a current channel;

[0081] The decision unit is configured to determine a video communication strategy for the current channel based on the media parameter configuration suitable for the current channel.

[0082] A third embodiment of the present invention is an electronic device, which can be understood as a physical device, such as Figure 6As shown, it includes a processor and a memory storing instructions executable by the processor. When the instructions are executed by the processor, the following operations are performed:

[0083] Step S1, obtaining current channel parameter information in a multi-channel environment;

[0084] Step S2, constructing a channel characteristic parameter model based on channel parameters of various channels;

[0085] Step S3, constructing a video bit rate hierarchical model based on the carrying capacity of each channel in a multi-channel environment;

[0086] Step S4, matching the current channel parameter information acquired in real time with the channel characteristic parameter model to determine a maximum rate attribute value suitable for the current channel;

[0087] Step S5, using the maximum rate attribute value to match the video bit rate layering model to determine a media parameter configuration suitable for the current channel;

[0088] Step S6: determining a video communication strategy for the current channel based on the media parameter configuration suitable for the current channel.

[0089] The fourth embodiment of the present invention, the process of the video bit rate adjustment method for a multi-channel mobile wireless environment of this embodiment is the same as that of the first, second or third embodiment, the difference is that, in terms of engineering implementation, this embodiment can be implemented by means of software plus a necessary general hardware platform, of course, it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the method of the present invention can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, disk, optical disk), including a number of instructions for a device to execute the method described in the embodiment of the present invention.

[0090] Through the description of the specific implementation methods, a deeper and more specific understanding of the technical means and effects adopted by the present invention to achieve the predetermined purpose should be obtained. However, the accompanying drawings are only for reference and illustration purposes and are not intended to limit the present invention.

Claims

1. A video bit rate adjustment method in a multi-channel mobile wireless environment, characterized in that: include: Step S1, obtaining current channel parameter information in a multi-channel environment; Step S2, constructing a channel characteristic parameter model based on channel parameters of various channels; Step S3, constructing a video bit rate hierarchical model based on the carrying capacity of each channel in a multi-channel environment; Step S4, matching the current channel parameter information acquired in real time with the channel characteristic parameter model to determine a maximum rate attribute value suitable for the current channel; Step S5, using the maximum rate attribute value to match the video bit rate layering model to determine a media parameter configuration suitable for the current channel; Step S6: determining a video communication strategy for the current channel based on the media parameter configuration suitable for the current channel.

2. The video bit rate adjustment method in a multi-channel mobile wireless environment according to claim 1, characterized in that: The step S1 comprises: The channel parameters obtained include channel type, longitude and latitude through acquisition methods including active query, monitoring report, and manual configuration.

3. The video bit rate adjustment method in a multi-channel mobile wireless environment according to claim 2, characterized in that: The step S2 comprises: The parameters of each channel are listed based on the XML format, and the maximum rate of the corresponding channel is determined according to the parameters of each channel.

4. The video bit rate adjustment method in a multi-channel mobile wireless environment according to claim 1, characterized in that: The step S3 comprises: The video bit rate hierarchical model is configured based on multiple parameters including encoding bit rate, encoding format, resolution, frame rate, key frame interval, and forward error correction strategy.

5. The video bit rate adjustment method in a multi-channel mobile wireless environment according to claim 4, characterized in that: The step S5 comprises: The maximum rate attribute value is matched with the rate in the video bit rate layering model, a layer in the video bit rate layering model that is equal to the current maximum rate attribute value or is closest to the current maximum rate attribute value is determined, and the rate of the layer is obtained.

6. A video bit rate adjustment device for a multi-channel mobile wireless environment, characterized in that: include: An acquisition unit configured to acquire current channel parameter information in a multi-channel environment; A channel characteristic parameter model unit, configured to construct a channel characteristic parameter model based on channel parameters of various channels; A video bit rate hierarchical model unit configured to construct a video bit rate hierarchical model based on the carrying capacity of each channel in a multi-channel environment; A first matching unit is configured to match the channel characteristic parameter model based on the current channel parameter information acquired in real time, so as to determine a maximum rate attribute value suitable for the current channel; A second matching unit is configured to use the maximum rate attribute value to match the video bit rate layering model to determine a media parameter configuration suitable for a current channel; The decision unit is configured to determine a video communication strategy for the current channel based on the media parameter configuration suitable for the current channel.

7. An electronic device, characterized in that: The electronic device comprises: a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the video bit rate adjustment method for a multi-channel mobile wireless environment as described in any one of claims 1 to 5.

8. A computer storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the video bit rate adjustment method for a multi-channel mobile wireless environment as claimed in any one of claims 1 to 5.

Images