Video stream transmission method and system based on multistage coding

Abstract

The invention provides a video stream transmission method and system based on multistage coding. The video stream transmission method based on multi-level coding comprises the following steps: coding an original video stream by using a high-quantization-level coder to obtain coded data; setting the stage number of multi-stage encoding by using the residual error value of the encoder with the high quantization level, and arranging a multi-stage residual error encoder according to the stage number of the multi-stage encoding; performing data transmission by using the multi-stage encoder, and controlling a data receiving end to perform video reconstruction; and the network bandwidth is adaptively adjusted in the data transmission process. The system comprises modules corresponding to the steps of the method.

Description

Technical Field

[0001] The invention provides a video stream transmission method and system based on multi-level coding, belonging to the technical field of video stream transmission. Background Art

[0002] Directly encode a video stream of a certain resolution and bit rate, transmit the video stream data over the network, and the client directly decodes it; or encode data with multiple resolutions and bit rates, and the client decodes it on demand according to its own capabilities. The link status of the network is complex, and the decoding capabilities of the clients are also different. The client may not be able to cope with high-quality video stream data, and encoding data with multiple resolutions and bit rates may have high requirements for server resources and network bandwidth. Summary of the invention

[0003] The present invention provides a video stream transmission method and system based on multi-level coding, which is used to solve the problem that the prior art cannot cope with high-quality video stream data, and encoding data with multiple resolutions and bit rates may have high requirements on server resources and network bandwidth. The technical solutions adopted are as follows:

[0004] A video stream transmission method based on multi-level coding, the video stream transmission method based on multi-level coding comprising:

[0005] Encode the original video stream using a high quantization level encoder to obtain encoded data;

[0006] Using the residual value of the encoder at the high quantization level to set the number of levels of multi-level coding, and arranging the multi-level residual encoder according to the number of levels of the multi-level coding;

[0007] Using the multi-stage encoder to transmit data, and controlling the data receiving end to perform video reconstruction;

[0008] Adaptively adjust network bandwidth during data transmission.

[0009] Furthermore, the original video stream is encoded using a high quantization level encoder, including:

[0010] Extract data transmission requirements for video streaming;

[0011] Call a high quantization level encoder according to data transmission requirements;

[0012] The original video stream is encoded using an encoder with a high quantization level to obtain encoded data.

[0013] Further, the residual value of the encoder at the high quantization level is used to set the number of levels of multi-level coding, and the multi-level residual encoder is arranged according to the number of levels of the multi-level coding, including:

[0014] Extracting the encoded data output by the high quantization level encoder;

[0015] Compare the coded data output by the high quantization level encoder with the original video frame to obtain a residual value of the high quantization level encoder;

[0016] Using the residual value of the encoder at the high quantization level to set the number of levels of the multi-level residual encoder;

[0017] The level of the multi-level coding is obtained by the following formula:

[0018] M=[1+sqrt[exp(min(C,C0) / max(C,C0))+ln[1+(C-C0) / C0]]]×M0

[0019] Wherein, M represents the level of multi-level coding, and is rounded up; M0 represents a preset level number reference value; C represents the residual value of the current encoder of the high quantization level; C0 represents a preset residual threshold;

[0020] The multi-stage residual encoders are arranged according to the number of stages of the multi-stage encoding.

[0021] Further, the multi-stage encoder is used to transmit data, and a data receiving end is controlled to perform video reconstruction, including:

[0022] Using the multi-stage encoder to encode the original video stream data stage by stage to obtain encoded video stream data;

[0023] The encoded video stream data is sent to a data receiving end, and the specific steps include:

[0024] Step A1: Use formula (1) to obtain the transmission efficiency of the video stream data according to various information of the video stream data.

[0025]

[0026] Among them, E represents the amount of data successfully transmitted per unit time during the transmission process of video stream data; D represents the size of the successfully transmitted video stream data (bits); T represents the time required for transmission (seconds); P represents the packet loss rate (between 0 and 1); C represents the channel capacity (bits / second); β represents the network congestion coefficient, which reflects the degree of network congestion; γ represents the coding efficiency coefficient of the video stream, which reflects the quality and compression effect of video coding;

[0027] Step A2: Use formula (2) to predict the video stream delay duration based on the video stream data status

[0028]

[0029] Where L is the delay time of the video stream; D is the data size of the video stream (bits); C is the channel capacity (bits / second); P is the packet loss rate (between 0 and 1); α is the network delay gain coefficient (reflecting the stability of the network) E d Indicates the decoding time (seconds), which depends on the decoding capability of the receiving end; E c represents the encoding time (seconds), which depends on the encoding capability of the sender; δ represents the additional processing delay (seconds), such as buffering and processing time;

[0030] Step A3: Use formula (3) to control the state of the encoding rate according to the video stream data transmission efficiency and the video stream delay duration to achieve the effect of adaptive stream control

[0031]

[0032] Where S represents the coding rate in the adaptive flow control strategy; R h ,R m ,R l Respectively represent high, medium and low coding rates; E target represents the desired transmission efficiency target; L min ,L max Represent the lowest and highest acceptable delays respectively; E threshold Indicates the threshold of energy or efficiency; L threshold represents the load threshold; and represents and;

[0033] After receiving the encoded video stream data, the data receiving end decodes the encoded video stream data to obtain preliminary video frame data corresponding to the original video stream data;

[0034] Inputting the preliminary video frame data into a multi-level residual decoder having the same number of levels as the multi-level residual encoder to obtain multi-level residual data;

[0035] The preliminary video frame data is combined with the multi-level residual data to perform video reconstruction to obtain restored video stream data.

[0036] Furthermore, the network bandwidth is adaptively adjusted during the data transmission process, including:

[0037] The initial network bandwidth is set according to the number of stages of the multi-stage residual encoder; wherein the initial network bandwidth is obtained by the following formula:

[0038] B=[1+(M-M0) / M]×B0

[0039] Wherein, B represents the initial network bandwidth; B0 represents the preset reference bandwidth value; M represents the level of multi-level coding, and is rounded up; M0 represents the preset level number reference value; C represents the residual value of the current high quantization level encoder; C0 represents the preset residual threshold;

[0040] Real-time monitoring of network packet loss rate and latency;

[0041] The network bandwidth is adaptively adjusted during the data transmission process according to the packet loss rate and the delay.

[0042] A video stream transmission system based on multi-level coding, the video stream transmission system based on multi-level coding comprising:

[0043] A coding data acquisition module is used to encode the original video stream using a high quantization level encoder to obtain coding data;

[0044] A multi-level residual encoder parameter module, used to set the number of levels of multi-level encoding using the residual value of the encoder at the high quantization level, and arrange the multi-level residual encoder according to the number of levels of the multi-level encoding;

[0045] A video reconstruction execution module, used to use the multi-stage encoder to perform data transmission and control the data receiving end to perform video reconstruction;

[0046] The adaptive adjustment module is used to adaptively adjust the network bandwidth during data transmission.

[0047] Furthermore, the coded data acquisition module includes:

[0048] A data transmission requirement extraction module, used for extracting data transmission requirements of video stream transmission;

[0049] The encoder calling module is used to call an encoder with a high quantization level according to data transmission requirements;

[0050] The coding data acquisition execution module is used to encode the original video stream using a high quantization level encoder to obtain coding data.

[0051] Furthermore, the multi-stage residual encoder parameter module includes:

[0052] A coded data extraction execution module, used to extract the coded data output by the high quantization level encoder;

[0053] A comparison and residual value acquisition module, used for comparing the coded data output by the high quantization level encoder with the original video frame to obtain the residual value of the high quantization level encoder;

[0054] A multi-stage residual encoder level setting module, used to set the level of the multi-stage residual encoder using the residual value of the encoder at the high quantization level;

[0055] The level of the multi-level coding is obtained by the following formula:

[0056] M=[1+sqrt[exp(min(C,C0) / max(C,C0))+ln[1+(C-C0) / C0]]]×M0

[0057] Wherein, M represents the level of multi-level coding, and is rounded up; M0 represents a preset level number reference value; C represents the residual value of the current encoder of the high quantization level; C0 represents a preset residual threshold;

[0058] The multi-stage residual encoder arrangement module is used to arrange the multi-stage residual encoder according to the number of stages of the multi-stage encoding.

[0059] Furthermore, the adaptive adjustment module includes:

[0060] A step-by-step encoding module, used to use the multi-stage encoder to encode the original video stream data step-by-step to obtain encoded video stream data;

[0061] The video stream data sending module is used to send the encoded video stream data to the data receiving end, and its specific steps include:

[0062] Step A1: Use formula (1) to obtain the transmission efficiency of the video stream data according to various information of the video stream data.

[0063]

[0064] Among them, E represents the amount of data successfully transmitted per unit time during the transmission process of video stream data; D represents the size of the successfully transmitted video stream data (bits); T represents the time required for transmission (seconds); P represents the packet loss rate (between 0 and 1); C represents the channel capacity (bits / second); β represents the network congestion coefficient, which reflects the degree of network congestion; γ represents the coding efficiency coefficient of the video stream, which reflects the quality and compression effect of video coding;

[0065] Step A2: Use formula (2) to predict the video stream delay duration based on the video stream data status

[0066]

[0067] Where L is the delay time of the video stream; D is the data size of the video stream (bits); C is the channel capacity (bits / second); P is the packet loss rate (between 0 and 1); α is the network delay gain coefficient (reflecting the stability of the network) Ed Indicates the decoding time (seconds), which depends on the decoding capability of the receiving end; E c represents the encoding time (seconds), which depends on the encoding capability of the sender; δ represents the additional processing delay (seconds), such as buffering and processing time;

[0068] Step A3: Use formula (3) to control the state of the encoding rate according to the video stream data transmission efficiency and the video stream delay duration to achieve the effect of adaptive stream control

[0070]

[0071] Where S represents the coding rate in the adaptive flow control strategy; R h ,R m ,R l Respectively represent high, medium and low coding rates; E target represents the desired transmission efficiency target; L min ,L max Represent the lowest and highest acceptable delays respectively; E threshold Indicates the threshold of energy or efficiency; L threshold represents the load threshold; and represents and;

[0072] A preliminary video frame data acquisition module is used for the data receiving end to decode the encoded video stream data after receiving the encoded video stream data to obtain preliminary video frame data corresponding to the original video stream data;

[0073] A multi-level residual data acquisition module, used for inputting the preliminary video frame data into a multi-level residual decoder having the same number of levels as the multi-level residual encoder, to obtain multi-level residual data;

[0074] The video stream restoration module is used to combine the preliminary video frame data with the multi-level residual data to perform video reconstruction and obtain restored video stream data.

[0075] Furthermore, the adaptive adjustment module includes:

[0076] The initial network bandwidth setting module is used to set the initial network bandwidth according to the number of stages of the multi-stage residual encoder; wherein the initial network bandwidth is obtained by the following formula:

[0077] B=[1+(M-M0) / M]×B0

[0078] Wherein, B represents the initial network bandwidth; B0 represents the preset reference bandwidth value; M represents the level of multi-level coding, and is rounded up; M0 represents the preset level number reference value; C represents the residual value of the current high quantization level encoder; C0 represents the preset residual threshold;

[0079] Packet loss rate and delay real-time monitoring module, used to monitor the packet loss rate and delay of the network in real time;

[0080] The adaptive adjustment execution module is used to adaptively adjust the network bandwidth during the data transmission process according to the packet loss rate and delay.

[0081] Beneficial effects of the present invention:

[0082] The video stream transmission method and system based on multi-level coding proposed by the present invention use a high quantization level encoder to encode the video stream to obtain data with more distortion, and then use multiple encoders with lower quantization levels to encode the residual between the data encoded by the high quantization level encoder and the actual data, and transmit the data encoded by these encoders on the network. The video stream transmission method and system based on multi-level coding proposed by the present invention will not bring higher bandwidth requirements, and clients with insufficient capabilities do not need to decode all data, but only need to decode the video stream data and part of the residual data as required. When the decoding capability is insufficient or the network conditions are poor, a relatively low-quality video can still be obtained. BRIEF DESCRIPTION OF THE DRAWINGS

[0083] Figure 1 is a flow chart of the method of the present invention;

[0084] Figure 2 The system block diagram of the system of the present invention. DETAILED DESCRIPTION

[0085] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0086] The embodiment of the present invention proposes a video stream transmission method based on multi-level coding, such as Figure 1 As shown, the video stream transmission method based on multi-level coding includes:

[0087] S1, using a high quantization level encoder to encode the original video stream to obtain encoded data;

[0088] S2, using the residual value of the encoder of the high quantization level to set the level of multi-level coding, and arranging the multi-level residual encoder according to the level of the multi-level coding;

[0089] S3, using the multi-stage encoder to transmit data, and controlling the data receiving end to perform video reconstruction;

[0090] S4. Adaptively adjust the network bandwidth during data transmission.

[0091] The working principle of the above technical solution is as follows: High quantization level encoding (step S1): First, the original video stream is encoded by a high quantization level encoder. At a high quantization level, the video encoder places more emphasis on data compression, and usually loses some details to reduce the data size.

[0092] Multi-level coding level (step S2): Then, the residual data of the high quantization level encoder is used to set the level of multi-level coding. In multi-level coding, different encoders can use different quantization levels, allowing the video to be transmitted at multiple levels of detail.

[0093] Multi-level residual encoder arrangement: For different encoding levels, the system arranges multi-level residual encoders. These residual encoders are used to process residual data at high quantization levels to provide more details at each level.

[0094] Data transmission and video reconstruction (step S3): The original coded data and different levels of residual data are transmitted through a multi-level encoder. The receiving end receives and decodes these data, and then uses the decoded data to reconstruct the video. Due to the presence of multi-level residual coding, the video can be reconstructed at different quality levels.

[0095] Adaptive network bandwidth adjustment (step S4): During the entire data transmission process, the system monitors the network bandwidth in real time. If the network bandwidth decreases, the system can adaptively adjust the encoding level to ensure that video transmission can still be carried out effectively under low bandwidth conditions. This improves the stability and adaptability of video transmission.

[0096] The effects of the above technical solution are: Quality and bandwidth balance: This method allows balancing video quality and bandwidth consumption according to network conditions and needs. Under high bandwidth conditions, higher quality videos can be provided, while under low bandwidth conditions, videos with moderate quality can still be transmitted.

[0097] Gradual transmission of details: Multi-level encoding allows the transmission of video details in a gradual manner, which is helpful for gradually improving the user experience or gradually adapting to the network load.

[0098] Adaptability: The system's adaptability ensures that video transmission remains effective under different network conditions and reduces freezes and interruptions in video transmission.

[0099] In summary, this technical solution aims to provide more adaptive video streaming to meet the needs under different network conditions and provide a better user experience when bandwidth fluctuates.

[0100] An embodiment of the present invention uses a high quantization level encoder to encode the original video stream, including:

[0101] S101, extracting data transmission requirements for video stream transmission;

[0102] S102, calling a high quantization level encoder according to data transmission requirements;

[0103] S103: Encode the original video stream using a high quantization level encoder to obtain encoded data.

[0104] The working principle of the above technical solution is as follows: Extracting data transmission requirements (step S101): First, the system extracts the data transmission requirements of the video stream transmission from the relevant parameters. This may include information such as the required transmission quality, bandwidth requirements, and transmission rate. These requirements can be determined based on network conditions and user experience.

[0105] Retrieving a high quantization level encoder (step S102): According to data transmission requirements, the system selects or retrieves a high quantization level encoder. A high quantization level encoder usually encodes the video at a higher compression rate, so the quality of the generated encoded data is lower.

[0106] Encoding using a high quantization level encoder (step S103): The selected high quantization level encoder is used to encode the original video stream, which will generate encoded data having a smaller data size but may have a certain degree of loss in quality.

[0107] The effects of the above technical solution are: Data compression: Encoding the original video using an encoder with a high quantization level can significantly reduce the size of the encoded data. This is very helpful for transmitting video under limited bandwidth, because smaller data volumes can be more easily transmitted over the network.

[0108] Save bandwidth: High quantization level encoding results in smaller encoded data, thus occupying less bandwidth on the network. This helps achieve better video transmission when network bandwidth is limited.

[0109] Sacrifice video quality to ensure transmission: This method ensures transmission by sacrificing video quality, because high quantization level encoding usually reduces video details and clarity. This is a trade-off to adapt to the needs between network bandwidth and demand.

[0110] In short, the goal of this technical solution is to meet specific data transmission requirements through high quantization level encoding so as to effectively transmit video under limited bandwidth conditions. This is very useful when you need to save bandwidth or when the network load is heavy.

[0111] In one embodiment of the present invention, the residual value of the encoder at the high quantization level is used to set the number of levels of multi-level coding, and the multi-level residual encoder is arranged according to the number of levels of the multi-level coding, including:

[0112] S201, extracting the encoded data output by the high quantization level encoder;

[0113] S202, comparing the coded data output by the high quantization level encoder with the original video frame to obtain a residual value of the high quantization level encoder;

[0114] S203, setting the number of stages of a multi-stage residual encoder by using the residual value of the encoder at the high quantization level;

[0115] The level of the multi-level coding is obtained by the following formula:

[0116] M=[1+sqrt[exp(min(C,C0) / max(C,C0))+ln[1+(C-C0) / C0]]]×M0

[0117] Wherein, M represents the level of multi-level coding, and is rounded up; M0 represents a preset level number reference value; C represents the residual value of the current encoder of the high quantization level; C0 represents a preset residual threshold;

[0118] S204: Arrange a multi-stage residual encoder according to the number of stages of the multi-stage encoding.

[0119] The working principle of the above technical solution is: extracting the coded data output by the high quantization level encoder (step S201): the system first extracts the coded data generated by the high quantization level encoder.

[0120] Calculate the residual value of the high quantization level encoder (step S202): Compare the encoded data generated by the high quantization level encoder with the original video frame to obtain a residual value. The residual value represents the distortion or error of the high quantization encoding relative to the original video.

[0121] Setting the number of levels of the multi-level residual encoder (step S203): Based on the calculated residual value, a specific formula is used to calculate the number of levels of the multi-level encoding. The calculation of the number of levels of the multi-level encoding takes into account the size of the residual relative to the preset residual threshold and some mathematical functions. This number of levels is used to determine the number of layers of the multi-level residual encoder.

[0122] Arrange multi-stage residual encoder (step S204): According to the calculated multi-stage encoding level, the system arranges the multi-stage residual encoder in the data transmission path. The task of each stage residual encoder is to further encode the data generated by the previous level encoder to reduce the distortion of the data.

[0123] The effects of the above technical solution are: Adaptive multi-level coding: the number of levels of multi-level coding is adaptively adjusted according to the residual value of the high quantization level encoder and the preset residual threshold, which helps to reduce the distortion level while maintaining transmission efficiency.

[0124] Improved video quality: The arrangement of multi-stage residual encoders can further reduce the distortion of the encoded data, thereby improving the quality of the transmitted video. This is very important to ensure that the receiving end obtains high-quality video.

[0125] Reduced bandwidth requirements: Through effective multi-level encoding, the required bandwidth can be reduced, thus facilitating the transmission of video under limited bandwidth conditions.

[0126] In summary, the goal of this technical solution is to achieve high-quality video transmission while minimizing distortion and bandwidth requirements. The number of levels of multi-level coding is adaptively adjusted according to the residual situation to provide the best performance in different situations.

[0127] An embodiment of the present invention uses the multi-stage encoder to transmit data and controls the data receiving end to perform video reconstruction, including:

[0128] S301, using the multi-stage encoder to encode the original video stream data step by step to obtain encoded video stream data;

[0129] S302, sending the encoded video stream data to a data receiving end, the specific steps of which include:

[0130] Step A1: Use formula (1) to obtain the transmission efficiency of the video stream data according to various information of the video stream data.

[0131]

[0132] Among them, E represents the amount of data successfully transmitted per unit time during the transmission process of video stream data; D represents the size of the successfully transmitted video stream data (bits); T represents the time required for transmission (seconds); P represents the packet loss rate (between 0 and 1); C represents the channel capacity (bits / second); β represents the network congestion coefficient, which reflects the degree of network congestion; γ represents the coding efficiency coefficient of the video stream, which reflects the quality and compression effect of video coding;

[0133] Step A2: Use formula (2) to predict the video stream delay duration based on the video stream data status

[0134]

[0135] Where L is the delay time of the video stream; D is the data size of the video stream (bits); C is the channel capacity (bits / second); P is the packet loss rate (between 0 and 1); α is the network delay gain coefficient (reflecting the stability of the network) E d Indicates the decoding time (seconds), which depends on the decoding capability of the receiving end; E crepresents the encoding time (seconds), which depends on the encoding capability of the sender; δ represents the additional processing delay (seconds), such as buffering and processing time;

[0136] Step A3: Use formula (3) to control the state of the encoding rate according to the video stream data transmission efficiency and the video stream delay duration to achieve the effect of adaptive stream control

[0137]

[0138] Where S represents the coding rate in the adaptive flow control strategy; R h ,R m ,R l Respectively represent high, medium and low coding rates; E target represents the desired transmission efficiency target; L min ,L max Represent the lowest and highest acceptable delays respectively; E threshold Indicates the threshold of energy or efficiency; L threshold represents the load threshold; and represents and;

[0139] First, the transmission efficiency of the video stream data is obtained according to various information of the video stream data using formula (1) of step A1. The formula takes into account the packet loss rate and network congestion, thereby improving the accuracy of the calculation result. Then, the delay duration of the video stream is predicted according to the state of the video stream data using formula (2) of step A2. The network delay gain is introduced into the formula, thereby enhancing the sensitivity to the network state. Finally, the state of the coding rate is controlled according to the video stream data transmission efficiency and the delay duration of the video stream using formula (3) of step A3, thereby achieving the effect of adaptive stream control. Based on the outputs of the first two formulas, more complex factors are used to adjust the coding rate to ensure that the best user experience can be provided under different network conditions.

[0140] S303, after receiving the encoded video stream data, the data receiving end decodes the encoded video stream data to obtain preliminary video frame data corresponding to the original video stream data;

[0141] S304, inputting the preliminary video frame data into a multi-level residual decoder having the same number of levels as the multi-level residual encoder to obtain multi-level residual data;

[0142] S305 , combining the preliminary video frame data with the multi-level residual data to perform video reconstruction to obtain restored video stream data.

[0143] The working principle of the above technical solution is as follows: Encoding at each level (step S301): the original video stream data is encoded at each level, and the encoder at each level further compresses and encodes the data. This will generate a series of encoded video stream data, and the encoding at each level is performed at different quality and compression rate.

[0144] Data transmission (step S302): The encoded video stream data is sent to a data receiving end and transmitted through a network.

[0145] Decoding (step S303): After receiving the encoded video stream data, the data receiving end performs a decoding operation to obtain preliminary video frame data. These preliminary video frame data are decoded but still contain lossy compressed information.

[0146] Multi-level residual decoding (step S304): The preliminary video frame data is input into a multi-level residual decoder that is consistent with the level of multi-level coding. Each level of residual decoder is responsible for decoding the residual data of the corresponding level. The residual decoder restores the residual information from the encoded data.

[0147] Video reconstruction (step S305): In this step, the preliminary video frame data is combined with the multi-level residual data to perform video reconstruction. By adding or merging the preliminary video frame data with the residual data, the quality and clarity of the original video are improved. Ultimately, this process produces restored video stream data that has higher quality than the preliminary decoded data.

[0148] The effects of the above technical solution are: Multi-level quality control: Multi-level encoding and decoding allows selection between different quality and compression levels. This enables the system to adjust the video quality according to network bandwidth or performance requirements.

[0149] Reconstructing high-quality video: Multi-level residual decoding allows improving the quality of initially decoded video by combining residual data. This helps reduce distortion and provide clearer images.

[0150] Adaptive network transmission: The system can adaptively adjust transmission parameters under different network conditions to optimize video transmission. This helps cope with changes in network bandwidth.

[0151] In general, the goal of this technical solution is to provide high-quality video reconstruction during data transmission, while being adaptable to meet the needs of different network conditions. The combination of progressive encoding and multi-level residual decoding enables a balance between video quality and network performance.

[0152] An embodiment of the present invention adaptively adjusts network bandwidth during data transmission, including:

[0153] S401, setting an initial network bandwidth according to the number of stages of the multi-stage residual encoder; wherein the initial network bandwidth is obtained by the following formula:

[0154] B=[1+(M-M0) / M]×B0

[0155] Wherein, B represents the initial network bandwidth; B0 represents the preset reference bandwidth value; M represents the level of multi-level coding, and is rounded up; M0 represents the preset level number reference value; C represents the residual value of the current high quantization level encoder; C0 represents the preset residual threshold;

[0156] S402, real-time monitoring of network packet loss rate and delay;

[0157] S403: Adaptively adjust the network bandwidth during the data transmission process according to the packet loss rate and the delay.

[0158] The working principle of the above technical solution is as follows: Setting the initial network bandwidth (step S401): According to the number of stages of the multi-stage residual encoder, the initial network bandwidth will be set. This bandwidth value is used as a starting point at the beginning of data transmission and is calculated based on the number of stages of multi-stage encoding and other parameters.

[0159] Real-time monitoring of network quality (step S402): During data transmission, the system will continuously monitor the packet loss rate and delay of the network. These parameters are key indicators for measuring network quality.

[0160] Adaptive bandwidth adjustment (step S403): Based on the real-time monitored packet loss rate and delay information, the system automatically adjusts the bandwidth of data transmission. The specific bandwidth adjustment strategy may vary depending on the specific situation, but the main goal is to ensure the stability and quality of data transmission.

[0161] The effects of the above technical solution are: Network quality optimization: By real-time monitoring of the network's packet loss rate and delay, the system can adaptively adjust the bandwidth according to the current network conditions, thereby maximizing the stability and quality of data transmission.

[0162] Reduce data loss: By adjusting the bandwidth, the system can reduce the loss of data packets, thereby improving data integrity. This is very important for applications such as video transmission that require high data integrity.

[0163] Provide better user experience: Adaptive adjustment of network bandwidth can ensure that users can still enjoy high-quality video streaming under different network conditions. This helps to provide a better user experience and meet user needs.

[0164] In general, this technical solution aims to adjust the bandwidth in real time according to the network conditions to ensure the quality and stability of data transmission, especially in unstable network environments. This helps to improve the efficiency and user satisfaction of multi-level encoded video transmission.

[0165] The embodiment of the present invention proposes a video stream transmission system based on multi-level coding, such as Figure 2 As shown, the video stream transmission system based on multi-level coding includes:

[0166] A coding data acquisition module is used to encode the original video stream using a high quantization level encoder to obtain coding data;

[0167] A multi-level residual encoder parameter module, used to set the number of levels of multi-level encoding using the residual value of the encoder at the high quantization level, and arrange the multi-level residual encoder according to the number of levels of the multi-level encoding;

[0168] A video reconstruction execution module, used to use the multi-stage encoder to perform data transmission and control the data receiving end to perform video reconstruction;

[0169] The adaptive adjustment module is used to adaptively adjust the network bandwidth during data transmission.

[0170] The working principle of the above technical solution is as follows: High quantization level encoding: First, the original video stream is encoded by a high quantization level encoder. At a high quantization level, the video encoder places more emphasis on data compression, usually losing some details to reduce the data size.

[0171] Multi-level coding level: The residual data of the high quantization level encoder is then used to set the number of multi-level coding levels. In multi-level coding, different encoders can use different quantization levels, allowing video to be transmitted at multiple levels of detail.

[0172] Multi-level residual encoder arrangement: For different encoding levels, the system arranges multi-level residual encoders. These residual encoders are used to process residual data at high quantization levels to provide more details at each level.

[0173] Data transmission and video reconstruction: The original coded data and different levels of residual data are transmitted through a multi-level encoder. The receiver receives and decodes this data and then uses the decoded data for video reconstruction. Due to the presence of multi-level residual coding, the video can be reconstructed at different quality levels.

[0174] Adaptive network bandwidth adjustment: During the entire data transmission process, the system monitors the network bandwidth in real time. If the network bandwidth decreases, the system can adaptively adjust the encoding level to ensure that video transmission can still be carried out effectively under low bandwidth conditions. This improves the stability and adaptability of video transmission.

[0175] The effects of the above technical solution are: Quality and bandwidth balance: This method allows balancing video quality and bandwidth consumption according to network conditions and needs. Under high bandwidth conditions, higher quality videos can be provided, while under low bandwidth conditions, videos with moderate quality can still be transmitted.

[0176] Gradual transmission of details: Multi-level encoding allows the transmission of video details in a gradual manner, which is helpful for gradually improving the user experience or gradually adapting to the network load.

[0177] Adaptability: The system's adaptability ensures that video transmission remains effective under different network conditions and reduces freezes and interruptions in video transmission.

[0178] In summary, this technical solution aims to provide more adaptive video streaming to meet the needs under different network conditions and provide a better user experience when bandwidth fluctuates.

[0179] In one embodiment of the present invention, the coded data acquisition module includes:

[0180] A data transmission requirement extraction module, used for extracting data transmission requirements of video stream transmission;

[0181] The encoder calling module is used to call an encoder with a high quantization level according to data transmission requirements;

[0182] The coding data acquisition execution module is used to encode the original video stream using a high quantization level encoder to obtain coding data.

[0183] The working principle of the above technical solution is as follows: Extracting data transmission requirements: First, the system extracts the data transmission requirements of video streaming transmission from relevant parameters. This may include information such as required transmission quality, bandwidth requirements, transmission rate, etc. These requirements can be determined based on network conditions and user experience.

[0184] Calling a high quantization level encoder: Based on data transmission requirements, the system will select or call a high quantization level encoder. A high quantization level encoder usually encodes the video at a higher compression rate, so the quality of the generated encoded data is lower.

[0185] Encode using high quantization level encoder: The selected high quantization level encoder is used to encode the original video stream. This will produce encoded data that has a smaller data size but may have a certain degree of loss in quality.

[0186] The effects of the above technical solution are: Data compression: Encoding the original video using an encoder with a high quantization level can significantly reduce the size of the encoded data. This is very helpful for transmitting video under limited bandwidth, because smaller data volumes can be more easily transmitted over the network.

[0187] Save bandwidth: High quantization level encoding results in smaller encoded data, thus occupying less bandwidth on the network. This helps achieve better video transmission when network bandwidth is limited.

[0188] Sacrifice video quality to ensure transmission: This method ensures transmission by sacrificing video quality, because high quantization level encoding usually reduces video details and clarity. This is a trade-off to adapt to the needs between network bandwidth and demand.

[0189] In short, the goal of this technical solution is to meet specific data transmission requirements through high quantization level encoding so as to effectively transmit video under limited bandwidth conditions. This is very useful when you need to save bandwidth or when the network load is heavy.

[0190] In one embodiment of the present invention, the multi-stage residual encoder parameter module includes:

[0191] A coding data extraction execution module, used for extracting the coding data output by the high quantization level encoder;

[0192] A comparison and residual value acquisition module, used for comparing the coded data output by the high quantization level encoder with the original video frame to obtain the residual value of the high quantization level encoder;

[0193] A multi-stage residual encoder level setting module, used to set the level of the multi-stage residual encoder using the residual value of the encoder at the high quantization level;

[0194] The level of the multi-level coding is obtained by the following formula:

[0195] M=[1+sqrt[exp(min(C,C0) / max(C,C0))+ln[1+(C-C0) / C0]]]×M0

[0196] Wherein, M represents the level of multi-level coding, and is rounded up; M0 represents a preset level number reference value; C represents the residual value of the current encoder of the high quantization level; C0 represents a preset residual threshold;

[0197] The multi-stage residual encoder arrangement module is used to arrange the multi-stage residual encoder according to the number of stages of the multi-stage encoding.

[0198] The working principle of the above technical solution is: extracting the coded data output by the high quantization level encoder: the system first extracts the coded data generated by the high quantization level encoder.

[0199] Calculating the residual value of the high quantization level encoder: Comparing the encoded data generated by the high quantization level encoder with the original video frame to obtain the residual value. The residual value represents the distortion or error of the high quantization encoding relative to the original video.

[0200] Set the number of levels for the multi-level residual encoder: Based on the calculated residual value, a specific formula is used to calculate the number of levels for the multi-level encoding. The calculation of the number of levels for the multi-level encoding takes into account the size of the residual relative to the preset residual threshold and some mathematical functions. This number of levels is used to determine the number of layers in the multi-level residual encoder.

[0201] Arrange multi-level residual encoders: According to the calculated number of multi-level encoding levels, the system arranges multi-level residual encoders in the data transmission path. The task of each level of residual encoder is to further encode the data generated by the previous level encoder to reduce the distortion of the data.

[0202] The effects of the above technical solution are: Adaptive multi-level coding: the number of levels of multi-level coding is adaptively adjusted according to the residual value of the high quantization level encoder and the preset residual threshold, which helps to reduce the distortion level while maintaining transmission efficiency.

[0203] Improved video quality: The arrangement of multi-stage residual encoders can further reduce the distortion of the encoded data, thereby improving the quality of the transmitted video. This is very important to ensure that the receiving end obtains high-quality video.

[0204] Reduced bandwidth requirements: Through effective multi-level encoding, the required bandwidth can be reduced, thus facilitating the transmission of video under limited bandwidth conditions.

[0205] In summary, the goal of this technical solution is to achieve high-quality video transmission while minimizing distortion and bandwidth requirements. The number of levels of multi-level coding is adaptively adjusted according to the residual situation to provide the best performance in different situations.

[0206] In one embodiment of the present invention, the adaptive adjustment module includes:

[0207] A step-by-step encoding module, used to use the multi-stage encoder to encode the original video stream data step-by-step to obtain encoded video stream data;

[0208] The video stream data sending module is used to send the encoded video stream data to the data receiving end; the specific steps include:

[0209] Step A1: Use formula (1) to obtain the transmission efficiency of the video stream data according to various information of the video stream data.

[0210]

[0211] Among them, E represents the amount of data successfully transmitted per unit time during the transmission process of video stream data; D represents the size of the successfully transmitted video stream data (bits); T represents the time required for transmission (seconds); P represents the packet loss rate (between 0 and 1); C represents the channel capacity (bits / second); β represents the network congestion coefficient, which reflects the degree of network congestion; γ represents the coding efficiency coefficient of the video stream, which reflects the quality and compression effect of video coding;

[0212] Step A2: Use formula (2) to predict the video stream delay duration based on the video stream data status

[0213]

[0214] Where L is the delay time of the video stream; D is the data size of the video stream (bits); C is the channel capacity (bits / second); P is the packet loss rate (between 0 and 1); α is the network delay gain coefficient (reflecting the stability of the network) E d Indicates the decoding time (seconds), which depends on the decoding capability of the receiving end; E c represents the encoding time (seconds), which depends on the encoding capability of the sender; δ represents the additional processing delay (seconds), such as buffering and processing time;

[0215] Step A3: Use formula (3) to control the state of the encoding rate according to the video stream data transmission efficiency and the video stream delay duration to achieve the effect of adaptive stream control

[0216]

[0217] Where S represents the coding rate in the adaptive flow control strategy; R H ,R m ,R l Respectively represent high, medium and low coding rates; E target represents the desired transmission efficiency target; L min ,L max Represent the lowest and highest acceptable delays respectively; E tHresHold Indicates the threshold of energy or efficiency; L threshold represents the load threshold; and represents and;

[0218] First, the transmission efficiency of the video stream data is obtained according to various information of the video stream data using formula (1) of step A1. The formula takes into account the packet loss rate and network congestion, thereby improving the accuracy of the calculation result. Then, the delay duration of the video stream is predicted according to the state of the video stream data using formula (2) of step A2. The network delay gain is introduced into the formula, thereby enhancing the sensitivity to the network state. Finally, the state of the coding rate is controlled according to the video stream data transmission efficiency and the delay duration of the video stream using formula (3) of step A3, thereby achieving the effect of adaptive stream control. Based on the outputs of the first two formulas, more complex factors are used to adjust the coding rate to ensure that the best user experience can be provided under different network conditions.

[0219] A preliminary video frame data acquisition module is used for the data receiving end to decode the encoded video stream data after receiving the encoded video stream data to obtain preliminary video frame data corresponding to the original video stream data;

[0220] A multi-level residual data acquisition module, used for inputting the preliminary video frame data into a multi-level residual decoder having the same number of levels as the multi-level residual encoder, to obtain multi-level residual data;

[0221] The video stream restoration module is used to combine the preliminary video frame data with the multi-level residual data to perform video reconstruction and obtain restored video stream data.

[0222] The working principle of the above technical solution is: level-by-level encoding: the original video stream data is encoded level by level, and the encoder at each level further compresses and encodes the data. This will generate a series of encoded video stream data, and the encoding at each level is performed at different quality and compression rate.

[0223] Data transmission: The encoded video stream data is sent to the data receiving end and transmitted over the network.

[0224] Decoding: After receiving the encoded video stream data, the data receiving end performs decoding operations to obtain preliminary video frame data. These preliminary video frame data are decoded but still contain lossy compressed information.

[0225] Multi-level residual decoding: The preliminary video frame data is input into a multi-level residual decoder that is consistent with the number of levels of multi-level encoding. Each level of residual decoder is responsible for decoding the residual data of the corresponding level. The residual decoder restores the residual information from the encoded data.

[0226] Video reconstruction: In this step, the preliminary video frame data is combined with the multi-level residual data for video reconstruction. By adding or merging the preliminary video frame data with the residual data, the quality and clarity of the original video are improved. Ultimately, this process produces restored video stream data that has higher quality than the preliminary decoded data.

[0227] The effects of the above technical solution are: Multi-level quality control: Multi-level encoding and decoding allows selection between different quality and compression levels. This enables the system to adjust the video quality according to network bandwidth or performance requirements.

[0228] Reconstructing high-quality video: Multi-level residual decoding allows improving the quality of initially decoded video by combining residual data. This helps reduce distortion and provide clearer images.

[0229] Adaptive network transmission: The system can adaptively adjust transmission parameters under different network conditions to optimize video transmission. This helps cope with changes in network bandwidth.

[0230] In general, the goal of this technical solution is to provide high-quality video reconstruction during data transmission, while being adaptable to meet the needs of different network conditions. The combination of progressive encoding and multi-level residual decoding enables a balance between video quality and network performance.

[0231] In one embodiment of the present invention, the adaptive adjustment module includes:

[0232] The initial network bandwidth setting module is used to set the initial network bandwidth according to the number of stages of the multi-stage residual encoder; wherein the initial network bandwidth is obtained by the following formula:

[0233] B=[1+(M-M0) / M]×B0

[0234] Wherein, B represents the initial network bandwidth; B0 represents the preset reference bandwidth value; M represents the level of multi-level coding, and is rounded up; M0 represents the preset level number reference value; C represents the residual value of the current high quantization level encoder; C0 represents the preset residual threshold;

[0235] Packet loss rate and delay real-time monitoring module, used to monitor the packet loss rate and delay of the network in real time;

[0236] The adaptive adjustment execution module is used to adaptively adjust the network bandwidth during the data transmission process according to the packet loss rate and delay.

[0237] The working principle of the above technical solution is as follows: Setting the initial network bandwidth: According to the number of levels of the multi-level residual encoder, the initial network bandwidth will be set. This bandwidth value is used as the starting point at the beginning of data transmission and is calculated based on the number of levels of multi-level encoding and other parameters.

[0238] Real-time monitoring of network quality: During data transmission, the system will continuously monitor the packet loss rate and latency of the network. These parameters are key indicators used to measure network quality.

[0239] Adaptive bandwidth adjustment: Based on the real-time monitored packet loss rate and delay information, the system automatically adjusts the bandwidth of data transmission. The specific bandwidth adjustment strategy may vary according to the specific situation, but the main goal is to ensure the stability and quality of data transmission.

[0240] The effects of the above technical solution are: Network quality optimization: By real-time monitoring of the network's packet loss rate and delay, the system can adaptively adjust the bandwidth according to the current network conditions, thereby maximizing the stability and quality of data transmission.

[0241] Reduce data loss: By adjusting the bandwidth, the system can reduce the loss of data packets, thereby improving data integrity. This is very important for applications such as video transmission that require high data integrity.

[0242] Provide better user experience: Adaptive adjustment of network bandwidth can ensure that users can still enjoy high-quality video streaming under different network conditions. This helps to provide a better user experience and meet user needs.

[0243] In general, this technical solution aims to adjust the bandwidth in real time according to the network conditions to ensure the quality and stability of data transmission, especially in unstable network environments. This helps to improve the efficiency and user satisfaction of multi-level encoded video transmission.

[0244] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A video stream transmission method based on multi-level coding, characterized in that: The video stream transmission method based on multi-level coding comprises: Encode the original video stream using a high quantization level encoder to obtain encoded data; Using the residual value of the encoder at the high quantization level to set the number of levels of multi-level coding, and arranging the multi-level residual encoder according to the number of levels of the multi-level coding; Using the multi-stage encoder to transmit data, and controlling the data receiving end to perform video reconstruction; Adaptively adjust network bandwidth during data transmission.

2. The video stream transmission method based on multi-level coding according to claim 1, characterized in that: Encode the raw video stream using a high quantization level encoder, including: Extract data transmission requirements for video streaming; Call a high quantization level encoder according to data transmission requirements; The original video stream is encoded using an encoder with a high quantization level to obtain encoded data.

3. The video stream transmission method based on multi-level coding according to claim 1, characterized in that: The method further comprises: setting the number of levels of multi-level coding by using the residual value of the high quantization level encoder, and arranging the multi-level residual encoder according to the number of levels of the multi-level coding, comprising: Extracting the encoded data output by the high quantization level encoder; Compare the coded data output by the high quantization level encoder with the original video frame to obtain a residual value of the high quantization level encoder; Using the residual value of the encoder at the high quantization level to set the number of levels of the multi-level residual encoder; The level of the multi-level coding is obtained by the following formula: M=[1+sqrt[exp(min(C,C0) / max(C,C0))+ln[1+(C-C0) / C0]]]×M0 Wherein, M represents the level of multi-level coding, and is rounded up; M0 represents a preset level number reference value; C represents the residual value of the current encoder of the high quantization level; C0 represents a preset residual threshold; The multi-stage residual encoders are arranged according to the number of stages of the multi-stage encoding.

4. The video stream transmission method based on multi-level coding according to claim 1, characterized in that: The multi-stage encoder is used to transmit data and control a data receiving end to reconstruct a video, including: Using the multi-stage encoder to encode the original video stream data stage by stage to obtain encoded video stream data; The encoded video stream data is sent to a data receiving end; the specific steps include: Step A1: Use formula (1) to obtain the transmission efficiency of the video stream data according to various information of the video stream data. Among them, E represents the amount of data successfully transmitted per unit time during the transmission process of video stream data; D represents the size of the successfully transmitted video stream data (bits); T represents the time required for transmission (seconds); P represents the packet loss rate (between 0 and 1); C represents the channel capacity (bits / second); β represents the network congestion coefficient, which reflects the degree of network congestion; γ represents the coding efficiency coefficient of the video stream, which reflects the quality and compression effect of video coding; Step A2: Use formula (2) to predict the video stream delay duration based on the video stream data status Where L is the delay time of the video stream; D is the data size of the video stream (bits); C is the channel capacity (bits / second); P is the packet loss rate (between 0 and 1); α is the network delay gain coefficient (reflecting the stability of the network) E d Indicates the decoding time (seconds), which depends on the decoding capability of the receiving end; E c represents the encoding time (seconds), which depends on the encoding capability of the sender; δ represents the additional processing delay (seconds), such as buffering and processing time; Step A3: Use formula (3) to control the state of the encoding rate according to the video stream data transmission efficiency and the video stream delay duration to achieve the effect of adaptive stream control Where S represents the coding rate in the adaptive flow control strategy; R h ,R m ,R l Respectively represent high, medium and low coding rates; E target represents the desired transmission efficiency target; L min ,L max Represent the lowest and highest acceptable delays respectively; E threshold Indicates the threshold of energy or efficiency; L threshold represents the load threshold; and represents and; After receiving the encoded video stream data, the data receiving end decodes the encoded video stream data to obtain preliminary video frame data corresponding to the original video stream data; Inputting the preliminary video frame data into a multi-level residual decoder having the same number of levels as the multi-level residual encoder to obtain multi-level residual data; The preliminary video frame data is combined with the multi-level residual data to perform video reconstruction to obtain restored video stream data.

5. The video stream transmission method based on multi-level coding according to claim 1, characterized in that: Adaptive adjustment of network bandwidth during data transmission, including: The initial network bandwidth is set according to the number of stages of the multi-stage residual encoder; wherein the initial network bandwidth is obtained by the following formula: B=[1+(M-M0) / M]×B0 Wherein, B represents the initial network bandwidth; B0 represents the preset reference bandwidth value; M represents the level of multi-level coding, and is rounded up; M0 represents the preset level number reference value; C represents the residual value of the current high quantization level encoder; C0 represents the preset residual threshold; Real-time monitoring of network packet loss rate and latency; The network bandwidth is adaptively adjusted during the data transmission process according to the packet loss rate and the delay.

6. A video stream transmission system based on multi-level coding, characterized in that: The video stream transmission system based on multi-level coding includes: A coding data acquisition module is used to encode the original video stream using a high quantization level encoder to obtain coding data; A multi-level residual encoder parameter module, used to set the number of levels of multi-level encoding using the residual value of the encoder at the high quantization level, and arrange the multi-level residual encoder according to the number of levels of the multi-level encoding; A video reconstruction execution module, used to use the multi-stage encoder to perform data transmission and control the data receiving end to perform video reconstruction; The adaptive adjustment module is used to adaptively adjust the network bandwidth during data transmission.

7. The video stream transmission system based on multi-level coding according to claim 6, characterized in that: The coded data acquisition module comprises: A data transmission requirement extraction module, used for extracting data transmission requirements of video stream transmission; The encoder calling module is used to call an encoder with a high quantization level according to data transmission requirements; The coding data acquisition execution module is used to encode the original video stream using a high quantization level encoder to obtain coding data.

8. The video stream transmission system based on multi-level coding according to claim 6, characterized in that: The multi-stage residual encoder parameter module comprises: A coding data extraction execution module, used for extracting the coding data output by the high quantization level encoder; A comparison and residual value acquisition module, used for comparing the coded data output by the high quantization level encoder with the original video frame to obtain the residual value of the high quantization level encoder; A multi-stage residual encoder level setting module, used to set the level of the multi-stage residual encoder using the residual value of the encoder at the high quantization level; The level of the multi-level coding is obtained by the following formula: M=[1+sqrt[exp(min(C,C0) / max(C,C0))+ln[1+(C-C0) / C0]]]×M0 Wherein, M represents the level of multi-level coding, and is rounded up; M0 represents a preset level number reference value; C represents the residual value of the current encoder of the high quantization level; C0 represents a preset residual threshold; The multi-stage residual encoder arrangement module is used to arrange the multi-stage residual encoder according to the number of stages of the multi-stage encoding.

9. The video stream transmission system based on multi-level coding according to claim 6, characterized in that: The adaptive adjustment module comprises: A step-by-step encoding module, used to use the multi-stage encoder to encode the original video stream data step-by-step to obtain encoded video stream data; The video stream data sending module is used to send the encoded video stream data to the data receiving end, and its specific steps include: Step A1: Use formula (1) to obtain the transmission efficiency of the video stream data according to various information of the video stream data. Among them, E represents the amount of data successfully transmitted per unit time during the transmission process of video stream data; D represents the size of the successfully transmitted video stream data (bits); T represents the time required for transmission (seconds); P represents the packet loss rate (between 0 and 1); C represents the channel capacity (bits / second); β represents the network congestion coefficient, which reflects the degree of network congestion; γ represents the coding efficiency coefficient of the video stream, which reflects the quality and compression effect of video coding; Step A2: Use formula (2) to predict the video stream delay duration based on the video stream data status Where L is the delay time of the video stream; D is the data size of the video stream (bits); C is the channel capacity (bits / second); P is the packet loss rate (between 0 and 1); α is the network delay gain coefficient (reflecting the stability of the network) E d Indicates the decoding time (seconds), which depends on the decoding capability of the receiving end; E c represents the encoding time (seconds), which depends on the encoding capability of the sender; δ represents the additional processing delay (seconds), such as buffering and processing time; Step A3: Use formula (3) to control the state of the encoding rate according to the video stream data transmission efficiency and the video stream delay duration to achieve the effect of adaptive stream control Where S represents the coding rate in the adaptive flow control strategy; R h ,R m ,R l Respectively represent high, medium and low coding rates; E target represents the desired transmission efficiency target; L min ,L max Represent the lowest and highest acceptable delays respectively; E threshold Indicates the threshold of energy or efficiency; L threshold represents the load threshold; and represents and; A preliminary video frame data acquisition module is used for the data receiving end to decode the encoded video stream data after receiving the encoded video stream data to obtain preliminary video frame data corresponding to the original video stream data; A multi-level residual data acquisition module, used for inputting the preliminary video frame data into a multi-level residual decoder having the same number of levels as the multi-level residual encoder, to obtain multi-level residual data; The video stream restoration module is used to combine the preliminary video frame data with the multi-level residual data to perform video reconstruction and obtain restored video stream data.

10. The video stream transmission system based on multi-level coding according to claim 6, characterized in that: The adaptive adjustment module comprises: The initial network bandwidth setting module is used to set the initial network bandwidth according to the number of stages of the multi-stage residual encoder; wherein the initial network bandwidth is obtained by the following formula: B=[1+(M-M0) / M]×B0 Wherein, B represents the initial network bandwidth; B0 represents the preset reference bandwidth value; M represents the level of multi-level coding, and is rounded up; M0 represents the preset level number reference value; C represents the residual value of the current high quantization level encoder; C0 represents the preset residual threshold; Packet loss rate and delay real-time monitoring module, used to monitor the packet loss rate and delay of the network in real time; The adaptive adjustment execution module is used to adaptively adjust the network bandwidth during the data transmission process according to the packet loss rate and delay.

Images