Frame rate self-adaptive method and device based on large-screen video transmission and intelligent terminal

Abstract

The application discloses a frame rate self-adaptive method and device based on large-screen video transmission, and an intelligent terminal, and the method comprises the following steps: acquiring the coding frame rate of audio and video real-time transmission; detecting whether there is a frame rate update request; when the frame rate update request is detected, controlling the new request frame rate and the coding frame rate threshold of the current encoder to perform frame rate self-adaptive threshold judgment, and judging whether the new request frame rate exceeds the current coding frame rate threshold; when the new request frame rate is within the current coding frame rate threshold range, controlling not to adjust the frame rate; and when the new request frame rate exceeds the current coding frame rate threshold range, controlling to update the self-adaptive threshold and configure the new frame rate. The application provides a self-adaptive adjustment method of the coding frame rate, dynamically controls the frame rate by using the threshold, adjusts only when the frame rate exceeds the expectation, thus simultaneously meeting the adjustment requirement of the bandwidth self-adaptation, the control is relatively accurate, and the disadvantages caused by the frequent adjustment of the coding frame rate are avoided.

Description

Technical Field

[0001] This invention relates to the field of large-screen video transmission technology, and in particular to a frame rate adaptive method, apparatus, smart terminal, and storage medium based on large-screen video transmission. Background Technology

[0002] With the development of technology and the continuous improvement of people's living standards, the use of various smart terminals is becoming increasingly widespread, and smart terminals have become an indispensable entertainment and leisure tool in people's lives. Current smart terminals all utilize large-screen video transmission technology.

[0003] In real-time (RTC) video transmission, due to changes in the image source or to adapt to changes in the transmission network, it is necessary to dynamically adjust the encoder's frame rate and bit rate according to a strategy to achieve better transmission results. However, existing implementations of dynamically adjusting the encoder's frame rate and bit rate have the following problems: they can easily lead to excessive keyframe output and deterioration of the encoded video quality.

[0004] Therefore, existing technologies still need improvement and development. Summary of the Invention

[0005] The technical problem to be solved by the present invention is to provide a frame rate adaptive method, device, smart terminal and storage medium based on large screen video transmission, which addresses the above-mentioned defects of the prior art. The present invention can adaptively and dynamically adjust the encoding frame rate, ensure that the bandwidth control strategy can work correctly, and improve the quality of the encoded video.

[0006] The technical solution adopted by this invention to solve the problem is as follows: This invention provides a frame rate adaptive method for large-screen video transmission, wherein the method includes: Obtain the encoding frame rate of real-time audio and video transmission; Check for frame rate update requests; When a frame rate update request is detected, the control will perform a frame rate adaptive threshold determination by comparing the new requested frame rate with the current encoder's encoding frame rate threshold to determine whether the new requested frame rate exceeds the current encoding frame rate threshold. If the new requested frame rate is within the current encoding frame rate threshold range, the frame rate will not be adjusted. When a new request frame rate exceeds the current encoding frame rate threshold range, the adaptive threshold is updated and a new frame rate is configured.

[0007] The frame rate adaptive method based on large-screen video transmission, wherein the step of obtaining the encoded frame rate of real-time audio and video transmission includes the following: The encoder initial frame rate is preset, and the corresponding initial frame rate threshold is set through adaptive parameters.

[0008] The frame rate adaptive method based on large-screen video transmission, wherein the step of obtaining the encoded frame rate of real-time audio and video transmission includes the following: Each encoder's encoding frame rate is pre-set to correspond to an encoding frame rate threshold.

[0009] The frame rate adaptive method based on large-screen video transmission, wherein the step of obtaining the encoded frame rate of real-time audio and video transmission includes: Obtain the encoding frame rate of real-time audio and video transmission, which is the current encoding frame rate, and obtain a current encoding frame rate threshold corresponding to the current encoding frame rate.

[0010] The frame rate adaptive method based on large-screen video transmission includes the step of, when a frame rate update request is detected, controlling the comparison between the new requested frame rate and the current encoder's encoding frame rate threshold to determine whether the new requested frame rate exceeds the current encoding frame rate threshold: When a frame rate update request is detected, the control performs a frame rate adaptive threshold determination by comparing the new requested frame rate and bit rate with the current encoder's encoding frame rate threshold to determine whether the new requested frame rate exceeds the current encoding frame rate threshold.

[0011] The frame rate adaptive method based on large-screen video transmission, wherein the step of controlling the frame rate not to be adjusted when the new requested frame rate is within the current encoding frame rate threshold range includes: When the new requested frame rate is within the current encoding frame rate threshold range, the control will convert the new requested frame rate, requested bit rate and current encoding frame rate proportionally according to the same average frame size to obtain the corresponding bit rate without changing the frame rate, and control will adjust the target and / or peak bit rate based on this bit rate.

[0012] The frame rate adaptive method based on large-screen video transmission, wherein the step of controlling the update of the adaptive threshold and configuring the new frame rate when the new requested frame rate exceeds the current encoding frame rate threshold range includes: When the new requested frame rate exceeds the current encoded frame rate threshold range, the control will input the new requested frame rate, the current encoded frame rate, and the current encoded frame rate threshold into the pre-set adaptive threshold update equation to update the threshold; and the control will configure the new frame rate and bit rate to the encoder, and the encoder will restart the stream.

[0013] A frame rate adaptive device for large-screen video transmission, wherein the device comprises: The acquisition module is used to acquire the encoding frame rate of real-time audio and video transmission; The detection module is used to detect whether there is a frame rate update request; The adaptive threshold determination module is used to determine whether the new requested frame rate exceeds the current encoding frame rate threshold when a frame rate update request is detected. The first control module is used to control the frame rate not to be adjusted when the new requested frame rate is within the current encoding frame rate threshold range; The second control module is used to update the adaptive threshold and configure a new frame rate when the new requested frame rate exceeds the current encoding frame rate threshold range.

[0014] A smart terminal includes a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs comprising the method for performing any one of the methods.

[0015] A non-transitory computer-readable storage medium, wherein, when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform any of the methods described above.

[0016] The beneficial effects of the present invention are as follows: The embodiments of the present invention provide an adaptive adjustment method for the encoding frame rate, which dynamically controls the frame rate with a threshold and adjusts it only when it exceeds the expectation. This satisfies the requirement for adaptive bandwidth adjustment, provides more accurate control, and avoids the drawbacks of frequently adjusting the encoding frame rate. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a flowchart illustrating the frame rate adaptive method for large-screen video transmission provided in an embodiment of the present invention.

[0019] Figure 2 This is a flowchart illustrating a specific application embodiment of the frame rate adaptive method for large-screen video transmission provided by the present invention.

[0020] Figure 3 This is a schematic diagram of the frame rate adaptive device based on large-screen video transmission provided in an embodiment of the present invention.

[0021] Figure 4 This is a block diagram illustrating the internal structure of a smart terminal provided in an embodiment of the present invention. Detailed Implementation

[0022] To make the objectives, technical solutions, and advantages of this invention clearer and more explicit, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0023] It should be noted that if the embodiments of the present invention involve directional indicators (such as up, down, left, right, front, back, etc.), the directional indicators are only used to explain the relative positional relationship and movement of the components in a certain specific posture (as shown in the figure). If the specific posture changes, the directional indicators will also change accordingly.

[0024] In real-time transmission of RTC video (real-time audio and video), due to changes in the image source or to adapt to changes in the transmission network, it is necessary to dynamically adjust the frame rate and bit rate of the encoder according to the strategy in order to achieve better transmission results.

[0025] The existing technical implementation schemes are mainly: The first approach reconfigures the encoder's input / output parameters during frame rate adjustments, and the encoder should only accept input types that match the currently configured output type. Changing the frame rate requires restarting the encoder's stream, which in turn generates a keyframe upon stream restart. This is unfavorable for RTCs that frequently adjust the encoded frame rate, leading to excessive keyframe outputs and degraded encoded video quality.

[0026] The second approach is to configure the frame rate only during encoder initialization, without adjusting the encoded frame rate in subsequent frame rate update requests (to avoid stream restarts). The new frame rate and bitrate are proportionally converted to the initial frame rate using the same average frame size to obtain the corresponding bitrate without changing the frame rate. This bitrate is then used to adjust the target / peak bitrate (without requiring a stream restart) to simulate the increase or decrease in average frame size. However, this approach amplifies the target / peak bitrate range when the requested frame rate is lower than the initial frame rate, causing the encoded output frame size to deviate from the desired target / peak range, thus affecting the normal operation of the bandwidth control strategy.

[0027] To address the problems of existing technologies, this invention provides a frame rate adaptive method based on large-screen video transmission. In the embodiments of the invention, an adaptive adjustment scheme for the encoded frame rate is designed, which dynamically controls the frame rate with a threshold, adjusting it only when it exceeds the expected value. This satisfies the bandwidth adaptive adjustment requirements, provides more accurate control, and avoids the drawbacks of frequently adjusting the encoded frame rate.

[0028] Exemplary methods like Figure 1As shown in the illustration, this embodiment of the invention provides a frame rate adaptive method for large-screen video transmission. This method can be applied to smart terminals and is primarily used for adaptive adjustment of the device encoding frame rate during large-screen video transmission. In this embodiment, the method includes the following steps: Step S100: Obtain the encoding frame rate of real-time audio and video transmission; In this embodiment of the invention, the receiving end can obtain the acquisition frame rate and encoding frame rate of real-time audio and video transmission: the invention mainly performs adaptive frame rate adjustment on the encoding frame rate of the encoder.

[0029] In practice, the encoder initial frame rate can be preset, and the corresponding initial frame rate threshold can be set through adaptive parameters. For each encoder, the present invention will preset a frame rate threshold corresponding to the encoding frame rate of each encoder. The so-called frame rate threshold is the critical value of the encoding frame rate.

[0030] In this embodiment of the invention, the encoding frame rate of real-time audio and video transmission is obtained as the current encoding frame rate, and a current encoding frame rate threshold corresponding to the current encoding frame rate is obtained. Here, the frame rate is the number of image frames transmitted in one second.

[0031] In practice, each encoder sets an initial frame rate and sets a corresponding initial frame rate threshold and a corresponding current encoding frame rate threshold through adaptive parameters.

[0032] Step S200: Detect if there is a frame rate update request.

[0033] In real-time transmission of RTC video (real-time audio and video), due to changes in the image source or to adapt to changes in the transmission network, it is necessary to dynamically adjust the frame rate and bit rate of the encoder according to the strategy in order to achieve better transmission results. Therefore, in the specific implementation of this invention, it will detect in real time whether there is a frame rate update request.

[0034] Step S300: When a frame rate update request is detected, the control will perform frame rate adaptive threshold determination by comparing the new requested frame rate with the current encoder's encoding frame rate threshold to determine whether the new requested frame rate exceeds the current encoding frame rate threshold. In embodiments of the present invention, such as Figure 2 As shown, when a frame rate update request is detected, the control will perform a frame rate adaptive threshold determination by comparing the new requested frame rate, the requested bit rate, and the current encoder's encoding frame rate threshold to determine whether the new requested frame rate exceeds the current encoding frame rate threshold.

[0035] In practice, when a frame rate update request is received, the new requested frame rate and bit rate can be substituted into the frame rate adaptive threshold determination formula for threshold determination. For example, the new requested frame rate can be compared with the current encoding frame rate threshold to determine whether the new requested frame rate is within the current encoding frame rate threshold range or exceeds the current encoding frame rate threshold.

[0036] The following is an example of how the encoding frame rate threshold is determined in a specific implementation of this invention: m(ti) represents the deviation between the requested frame rate and the current encoded frame rate; Let R(ti-1) represent the current adaptive threshold; Then the formula is m(ti) = configured_framerate - requested_framerate; Where requested_framerate represents the requested frame rate, and configured_framerate represents the current encoded frame rate; When |m(ti)| <= R(ti-1), it means that the new request frame rate is within the threshold range; and proceed to step S400; When |m(ti)|>R(ti-1), it indicates that the new request frame rate exceeds the threshold range, and proceed to step S500.

[0037] Step S400: When the new requested frame rate is within the current encoding frame rate threshold range, control the frame rate not to be adjusted; In embodiments of the present invention, such as Figure 2 As shown, when the new requested frame rate is within the current encoding frame rate threshold range, the steps to control the frame rate from being adjusted include: When the new requested frame rate is within the current encoding frame rate threshold range, the control will convert the new requested frame rate, requested bit rate and current encoding frame rate proportionally according to the same average frame size to obtain the corresponding bit rate without changing the frame rate, and control will adjust the target and / or peak bit rate based on this bit rate.

[0038] In practice, when the frame rate is within the threshold range, the requested frame rate, requested bitrate, and current encoded frame rate are converted proportionally to the same average frame size to obtain the corresponding bitrate without changing the frame rate. The target / peak bitrate is then adjusted based on this bitrate. For example, the following formula can be used for conversion: requested_framerate, requested_bitrate, configured_framerate, and target_bitrate.

[0039] Then the target bitrate = the current encoded frame rate configured_framerate Requested bitrate / Requested framerate; Step S500: When the new requested frame rate exceeds the current encoding frame rate threshold range, control the update adaptive threshold and configure the new frame rate.

[0040] In embodiments of the present invention, such as Figure 2 As shown, the step of controlling the update of the adaptive threshold and configuring the new frame rate when the new requested frame rate exceeds the current encoding frame rate threshold range includes: When the new requested frame rate exceeds the current encoding frame rate threshold range, the control substitutes the new requested frame rate, the current encoding frame rate, and the current encoding frame rate threshold into the pre-set adaptive threshold update equation to update the threshold; and the control configures the new frame rate and bit rate to the encoder, and the encoder restarts the stream.

[0041] For example, when the frame rate exceeds the threshold range: the control will input the requested frame rate, the current encoded frame rate, and the current threshold into the adaptive threshold update equation to update the threshold; the new frame rate and bit rate will be configured to the encoder, and the encoder will restart the stream.

[0042] For example, let m(ti) represent the deviation between the requested frame rate and the current encoded frame rate; Let R(ti-1): represent the current encoding frame rate threshold; Let R(ti) represent the new threshold; Let K(ti) represent the adaptive threshold update weights; The deviation between the requested frame rate and the current encoded frame rate, m(ti), is calculated as: current encoded frame rate (configured_framerate) - requested frame rate (requested_framerate). Then update the threshold R(ti) = R(ti-1) + K(ti)(|m(ti)|- R(ti-1))(1).

[0043] Equation (1) is the adaptive threshold update equation of this invention.

[0044] In this way, when the frame rate exceeds the threshold range, the present invention can control the input of the requested frame rate, the current encoded frame rate, and the current threshold into the adaptive threshold update equation to update the threshold; configure the new frame rate and bit rate to the encoder, and restart the encoder stream.

[0045] Thus, through the above steps, the present invention can achieve adaptive adjustment of the device encoding frame rate for large-screen video transmission, and can adaptively and dynamically adjust the encoding frame rate to ensure that the bandwidth control strategy works correctly and improve the quality of the encoded video.

[0046] Exemplary device like Figure 3 As shown in the figure, an embodiment of the present invention provides a frame rate adaptive device based on large-screen video transmission, the device comprising: The acquisition module 310 is used to acquire the encoding frame rate of real-time audio and video transmission; Detection module 320 is used to detect whether there is a frame rate update request; The adaptive threshold determination module 330 is used to determine whether the new requested frame rate exceeds the current encoding frame rate threshold when a frame rate update request is detected. The first control module 340 is used to control the frame rate not to be adjusted when the new requested frame rate is within the current encoding frame rate threshold range. The second control module 350 is used to control the update of the adaptive threshold and configure a new frame rate when the new requested frame rate exceeds the current encoding frame rate threshold range, as described above.

[0047] Based on the above embodiments, the present invention also provides a smart terminal, the principle block diagram of which can be as follows: Figure 4 As shown, the smart terminal includes a processor, memory, network interface, and display screen connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements a frame rate adaptive method based on large-screen video transmission. The display screen can be an LCD screen or an e-ink screen, and the camera is pre-installed within the smart terminal.

[0048] Those skilled in the art will understand that Figure 4 The block diagram shown is merely a partial structural diagram related to the present invention and does not constitute a limitation on the smart terminal to which the present invention is applied. A specific smart terminal may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0049] In one embodiment, a smart terminal is provided, including a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors. The one or more programs include instructions for performing the following operations: Obtain the encoding frame rate of real-time audio and video transmission; Check for frame rate update requests; When a frame rate update request is detected, the control will perform a frame rate adaptive threshold determination by comparing the new requested frame rate with the current encoder's encoding frame rate threshold to determine whether the new requested frame rate exceeds the current encoding frame rate threshold. If the new requested frame rate is within the current encoding frame rate threshold range, the frame rate will not be adjusted. When a new requested frame rate exceeds the current encoding frame rate threshold range, the adaptive threshold is updated and a new frame rate is configured, as described above.

[0050] The step of obtaining the encoded frame rate for real-time audio and video transmission includes the following prior steps: The encoder initial frame rate is preset, and the corresponding initial frame rate threshold is set through adaptive parameters.

[0051] The step of obtaining the encoded frame rate for real-time audio and video transmission includes the following prior steps: Each encoder's encoding frame rate is pre-set to correspond to an encoding frame rate threshold.

[0052] The step of obtaining the encoded frame rate for real-time audio and video transmission includes: Obtain the encoding frame rate of real-time audio and video transmission, which is the current encoding frame rate, and obtain a current encoding frame rate threshold corresponding to the current encoding frame rate.

[0053] The step of controlling the frame rate update request to perform an adaptive frame rate threshold determination by comparing the new requested frame rate with the current encoder's encoding frame rate threshold, and determining whether the new requested frame rate exceeds the current encoding frame rate threshold, when a frame rate update request is detected: When a frame rate update request is detected, the control performs a frame rate adaptive threshold determination by comparing the new requested frame rate and bit rate with the current encoder's encoding frame rate threshold to determine whether the new requested frame rate exceeds the current encoding frame rate threshold.

[0054] The step of controlling not to adjust the frame rate when the new requested frame rate is within the current encoding frame rate threshold range includes: When the new requested frame rate is within the current encoding frame rate threshold range, the control will convert the new requested frame rate, requested bit rate and current encoding frame rate proportionally according to the same average frame size to obtain the corresponding bit rate without changing the frame rate, and control will adjust the target and / or peak bit rate based on this bit rate.

[0055] The step of controlling the update of the adaptive threshold and configuring the new frame rate when the new requested frame rate exceeds the current encoding frame rate threshold range includes: When the new requested frame rate exceeds the current encoded frame rate threshold range, the control will input the new requested frame rate, the current encoded frame rate, and the current encoded frame rate threshold into the pre-set adaptive threshold update equation to update the threshold; and the control will configure the new frame rate and bit rate to the encoder, and the encoder will restart the stream.

[0056] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided by this invention can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0057] In summary, this invention discloses a frame rate adaptive method, apparatus, smart terminal, and storage medium for large-screen video transmission. The method acquires the encoded frame rate of real-time audio and video transmission; detects whether there is a frame rate update request; when a frame rate update request is detected, it controls the comparison of the new requested frame rate with the current encoder's encoded frame rate threshold to determine if the new requested frame rate exceeds the current encoded frame rate threshold; if the new requested frame rate is within the current encoded frame rate threshold range, it controls not to adjust the frame rate; if the new requested frame rate exceeds the current encoded frame rate threshold range, it controls to update the adaptive threshold and configure a new frame rate. This invention provides an adaptive adjustment method for the encoded frame rate, dynamically controlling the frame rate with a threshold, adjusting only when it exceeds expectations. This simultaneously satisfies the bandwidth adaptive adjustment requirements, provides more accurate control, and avoids the drawbacks of frequent adjustments to the encoded frame rate.

[0058] It should be understood that the application of this invention is not limited to the examples described above. Those skilled in the art can make improvements or modifications based on the above description, such as using the average or weighted frame rate of the forward reference time as a reference factor for threshold determination, or using the minimum interval time as the trigger condition for frame rate adjustment instead of determining the adaptive threshold. All such improvements and modifications should fall within the protection scope of the appended claims.

Claims

1. A frame rate adaptive method based on large-screen video transmission, characterized in that, The method includes: Obtain the encoding frame rate of real-time audio and video transmission; Check for frame rate update requests; When a frame rate update request is detected, the control will perform a frame rate adaptive threshold determination by comparing the new requested frame rate and bit rate with the current encoder's encoding frame rate threshold to determine whether the new requested frame rate exceeds the current encoding frame rate threshold. When the new requested frame rate is within the current encoding frame rate threshold range, the control will convert the new requested frame rate, the requested bit rate and the current encoding frame rate proportionally according to the same average frame size to obtain the corresponding bit rate without changing the frame rate, and control will adjust the target bit rate based on this bit rate. The following formula is used for conversion: Requested_framerate, Requested_bitrate, Current encoded framerate, Configured_framerate, Target_bitrate. Therefore, Target_bitrate = Current encoded framerate, Configured_framerate. Requested bitrate / Requested framerate; When the new requested frame rate exceeds the current encoded frame rate threshold, the control substitutes the new requested frame rate, the current encoded frame rate, and the current encoded frame rate threshold into the pre-set adaptive threshold update equation to update the threshold. The updated threshold R(ti) = R(ti) 1)+K(ti)(|m(ti)| R(ti 1)), m(ti) represents the deviation between the requested frame rate and the current encoded frame rate, m(ti) = current encoded frame rate configured_framerate Requested framerate, R(ti 1) represents the current encoding frame rate threshold, R(ti) represents the new threshold, and K(ti) represents the adaptive threshold update weight; and controls the configuration of the new requested frame rate and requested bit rate to the encoder, and the encoder restarts the stream.

2. The frame rate adaptive method based on large-screen video transmission according to claim 1, characterized in that, The step of obtaining the encoded frame rate of real-time audio and video transmission includes the following: The encoder initial frame rate is preset, and the corresponding initial frame rate threshold is set through adaptive parameters.

3. The frame rate adaptive method based on large-screen video transmission according to claim 1, characterized in that, The step of obtaining the encoded frame rate of real-time audio and video transmission includes the following: Each encoder's encoding frame rate is pre-set to correspond to an encoding frame rate threshold.

4. The frame rate adaptive method based on large-screen video transmission according to claim 1, characterized in that, The step of obtaining the encoded frame rate for real-time audio and video transmission includes: Obtain the encoding frame rate of real-time audio and video transmission, which is the current encoding frame rate, and obtain a current encoding frame rate threshold corresponding to the current encoding frame rate.

5. A frame rate adaptive device based on large-screen video transmission, characterized in that, The frame rate adaptive device based on large-screen video transmission is used to implement the frame rate adaptive method based on large-screen video transmission as described in any one of claims 1-4, and the device includes: The acquisition module is used to acquire the encoding frame rate of real-time audio and video transmission; The detection module is used to detect whether there is a frame rate update request; The adaptive threshold determination module is used to determine whether the new requested frame rate exceeds the current encoding frame rate threshold when a frame rate update request is detected. The first control module is used to control the frame rate not to be adjusted when the new requested frame rate is within the current encoding frame rate threshold range; The second control module is used to update the adaptive threshold and configure a new frame rate when the new requested frame rate exceeds the current encoding frame rate threshold range.

6. A smart terminal, characterized in that, It includes a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors to implement the method as described in any one of claims 1-4.

7. A non-transitory computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is able to perform the method as described in any one of claims 1-4.

Images