Video Transmission Method, Device, and Computer Storage Medium Based on Forward Error Correction

Abstract

The present invention discloses a video transmission method, device and computer storage medium based on forward error correction. The video transmission method based on forward error correction includes: performing level configuration on video frames of video data; respectively calculating the redundancy corresponding to video frames of each level; performing data encoding and redundancy encoding on video frames of each level to obtain data packets and redundancy packets for transmission. By the above method, the present invention can overcome the problem of video freezing in scenarios with large network fluctuations.

Description

Technical Field

[0001] The present invention relates to the field of communications, and in particular, to a video transmission method, device, and computer storage medium based on forward error correction. Background Art

[0002] In an IP network-based video communication system, network packet loss has a very serious impact on the quality of real-time video communication. For example, it causes problems such as video mosaics, lags, and frame skips, resulting in a very poor user experience. Especially in a poor network environment, packet loss is a frequent problem.

[0003] Automatic Repeat-reQuest (ARQ) is a commonly used method. In this method, after the receiving party detects packet loss, it then requests the sending party to retransmit. However, in an environment with large network latency, it is easy to cause lags in real-time video browsing. Summary of the Invention

[0004] The main technical problem to be solved by the present invention is to provide a video transmission method, device, and computer storage medium based on forward error correction, which can overcome the problem of video lags in scenarios with large network fluctuations.

[0005] To solve the above technical problem, a technical solution adopted by the present invention is: to provide a video transmission method based on forward error correction, which includes: performing level configuration on video frames of video data; respectively calculating the redundancy corresponding to video frames of each level; performing data encoding and redundancy encoding on video frames of each level to obtain data packets and redundancy packets for transmission.

[0006] Wherein, the video data includes one or more groups of pictures, and each group of pictures includes a key frame and multiple forward frames. Performing level configuration on video frames of video data includes: detecting whether a group of pictures contains a target event; if a group of pictures contains a target event, then configuring the key frame in the group of pictures as the first level, and configuring at least part of the forward frames in the group of pictures as the second level, where the first level is higher than / equal to the second level.

[0007] Wherein, detecting whether a group of pictures contains a target event further includes: if a group of pictures does not contain a target event, then configuring the key frame in the group of pictures as the first level, and configuring the forward frames in the group of pictures as the third level, where the third level is lower than the second level.

[0008] Wherein, after detecting that a group of pictures contains a target event and performing level configuration on the video frames of the group of pictures, it includes: determining whether the network bandwidth W is greater than the transmission volume D, where the transmission volume Let L be the network packet loss rate, Qn be the redundancy adjustment parameter for video frames of each level, and B be the video bitstream size. If the network bandwidth W is greater than or equal to the transmission volume D, the level of the video frames is not adjusted. If the network bandwidth W is less than the transmission volume D, the levels of some forward frames in the group of pictures are adjusted to the third level, and the third level is lower than the second level.

[0009] Among them, if the network bandwidth W is less than the transmission volume D, the key frames in the group of pictures are configured as the first level, the levels of the first N forward frames are configured as the second level, and the remaining forward frames are configured as the third level. Among them, N is the smallest integer that satisfies the formula ; where W is the network bandwidth, B is the video bitstream size, L is the network packet loss rate, Q1 is the redundancy adjustment factor for high-level videos, Q2 is the redundancy adjustment factor for low-level videos, Bm represents the high-level video bitstream size, F is the video frame rate size, K is the ratio of the size of I frames to P frames, the first level and the second level belong to high levels, and the third level belongs to low levels.

[0010] Among them, calculating the redundancy corresponding to the video frames of each level respectively includes: calculating the basic redundancy S, and S is the smallest integer that satisfies the formula ; the redundancy of the video frames of each level is Qn*S, and Qn is the redundancy adjustment parameter for the video frames of each level.

[0011] Among them, the higher the level of the video frame, the larger the redundancy adjustment parameter Qn of the video frame, and 1 < Qn < 2.

[0012] Among them, after data encoding and redundancy encoding are performed on the video frames of each level to obtain data packets and redundancy packets for transmission, it includes: receiving packet loss feedback information and obtaining the packet loss rate.

[0013] To solve the above technical problems, another technical solution adopted by the present invention is: to provide a video transmission device based on forward error correction, and the device includes a processor, and the processor is used to execute instructions to implement the forward error correction-based video transmission method as described above.

[0014] To solve the above technical problems, another technical solution adopted by the present invention is: to provide a computer-readable storage medium, and the computer-readable storage medium is used to store instructions / program data, and the instructions / program data can be executed to implement the forward error correction-based video transmission method as described above.

[0015] The beneficial effects of the present invention are as follows: Different from the prior art, before video transmission, the present invention first classifies the importance levels of video frames, performs differential redundancy on video data under different levels, provides more redundant data for video frames with higher levels, and uses a FEC encoder to encode and transmit the original data and redundant data, which can overcome the problem of undifferentiated redundancy of video data in the prior art during video transmission and solve the video stuttering problem in scenarios with large network fluctuations. Description of the Drawings

[0016] Figure 1 is a schematic diagram of the forward error correction method;

[0017] Figure 2 is a schematic flowchart of an embodiment of the video transmission method based on forward error correction in the present application;

[0018] Figure 3 is a schematic flowchart of another embodiment of the video transmission method based on forward error correction in the present application;

[0019] Figure 4 is a schematic structural diagram of the video transmission method based on forward error correction in the present application;

[0020] Figure 5 is a schematic flowchart of a specific embodiment of the video transmission method based on forward error correction in the embodiment of the present application;

[0021] Figure 6 is a schematic diagram of a video frame level configuration in the present application;

[0022] Figure 7 is a schematic diagram of another video frame level configuration in the present application;

[0023] Figure 8 is a schematic flowchart of the backend real-time video streaming device in the present application;

[0024] Figure 9 is a schematic structural diagram of the video transmission device based on forward error correction in the embodiment of the present application;

[0025] Figure 10 is a schematic structural diagram of the video transmission device based on forward error correction in the embodiment of the present application;

[0026] Figure 11 is a schematic structural diagram of the computer-readable storage medium in the embodiment of the present application. Detailed Embodiments

[0027] To make the objectives, technical solutions, and effects of the present invention clearer and more definite, the following further describes the present invention in detail with reference to the accompanying drawings and by way of examples.

[0028] Please refer toFigure 1 , Figure 1 is a schematic diagram of the forward error correction method. The forward error correction (FEC) method is that when the sender sends data, some redundant packets are calculated according to the sent data through the FEC algorithm; when the receiver receives the valid data packets and redundant packets, even if some data packets are lost, the receiver can still use the limited data packets and redundant packets received through the FEC algorithm to recover the complete valid data. This method can recover the complete data without retransmission after packet loss, ensuring the transmission effect of real-time video. However, the additional redundant packets increase the network burden. In a real-time video communication system, the FEC method is more suitable than the packet loss retransmission method. However, when the network bandwidth is fixed, if the video data is redundantly encoded without discrimination, the effective utilization rate of the network bandwidth is relatively low; as a result, the user's picture quality experience is poor. Therefore, the present application provides a video transmission method based on forward error correction. According to the network situation, before video transmission, the importance levels of video frames are classified first, and a differential redundancy method with appropriate redundancy is used for video data of each level, providing more redundant data for high-level video frames, and using the FEC encoder to encode and transmit the original data and redundant data, which can overcome the non-discriminatory redundancy of video data in the prior art video transmission process and solve the video freezing problem in scenarios with large network fluctuations.

[0029] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of an embodiment of the video transmission method based on forward error correction of the present application. It should be noted that if there are substantially the same results, this embodiment is not limited to Figure 2 the flowchart sequence shown. As Figure 2 shown, this embodiment includes:

[0030] S210: Configure the levels of video frames of video data.

[0031] Perform type detection on the video data to be transmitted, and set different level configurations for different types of video frames. Configure important data as a higher level frame by frame, and correspondingly configure other data as a lower level frame by frame.

[0032] S230: Calculate the redundancy corresponding to each level of video frames respectively.

[0033] Perform differential redundancy on the data of each video level in combination with the network situation. Different levels of video frames correspond to different redundancies. The higher the redundancy, the more redundant data is configured for the data.

[0034] S250: Perform data encoding and redundant encoding on video frames of each level to obtain data packets and redundant packets for transmission.

[0035] Combined with the calculated redundancy, the FEC encoder encodes the original data and redundant data of video frames of each level respectively to obtain data packets and redundant packets, and further performs data transmission.

[0036] In this embodiment, by first dividing the importance level of video frames before video transmission, using forward error correction suitable for the redundancy to perform differential redundancy methods on video data of each level, providing more redundant data for video frames with higher levels, and using the FEC encoder to encode and transmit the original data and redundant data, it can overcome the problem of non-differential redundancy of video data in the prior art video transmission process and solve the video freezing problem in scenarios with large network fluctuations.

[0037] Please refer to Figure 3 , Figure 3 which is a schematic flowchart of another embodiment of the video transmission method based on forward error correction in this application. It should be noted that if there are substantially the same results, this embodiment is not limited to Figure 3 the process sequence shown. As Figure 3 shown, this embodiment includes:

[0038] S310: Perform level configuration on video frames of video data.

[0039] Video data includes one or more groups of pictures, each group of pictures includes a key frame I and multiple forward frames P. The interval between two key frames I is GOP (Group Of Picture), and a GOP contains multiple forward frames P. Detect whether the group of pictures contains a target event, and set different level configurations for video frames of different types of groups of pictures. If the group of pictures contains a target event, configure the key frame in the group of pictures as the first level, and configure at least part of the forward frames in the group of pictures as the second level, where the first level is higher than / equal to the second level. If the group of pictures does not contain a target event, configure the key frame in the group of pictures as the first level, and configure the forward frames in the group of pictures as the third level, where the third level is lower than the second level. The higher the level configuration, the greater the transmission volume during video transmission.

[0040] S330: Adjust the level configuration in combination with network bandwidth and packet loss rate.

[0041] During the transmission of video frames from a front-end video device to a back-end device, data packet loss often occurs. At the same time, the current network conditions also affect video transmission. Therefore, the level configuration of the above video frames is adjusted according to the current network conditions and packet loss situation. According to the packet loss feedback information, the packet loss rate is calculated, and further the current data transmission volume is calculated. Among them, the transmission volume D = (1 + L * Q) * B, where L is the network packet loss rate, Q is the redundancy adjustment parameter for video frames of each level, and B is the video bitstream size. In the embodiments of the present application, different redundancy adjustment parameters are set for video frames of different levels. The redundancy adjustment parameter of the first level is greater than that of the second level, and greater than that of the third level. In one embodiment, multiple video frames in a group of pictures are divided into multiple levels. Among them, if the redundancy adjustment parameter of the video frame of the nth level is Qn, then the data transmission volume

[0042] Furthermore, the current network bandwidth is obtained, and it is judged whether the level configuration needs to be adjusted according to the current data transmission volume and the current network bandwidth. It is judged whether the network bandwidth W is greater than the transmission volume D. If the network bandwidth W is greater than or equal to the transmission volume D, the level of the video frame is not adjusted; if the network bandwidth W is less than the transmission volume D, the levels of some forward frames in the group of pictures are adjusted to the third level, and the third level is lower than the second level.

[0043] In a specific embodiment, if the network bandwidth W is less than the transmission volume D, the levels of the first N forward frames in the group of pictures are configured as the second level, and the remaining forward frames are configured as the third level; the first level and the second level belong to high levels, and the third level belongs to low levels. Among them, N is the smallest integer that satisfies the formula ; where W is the network bandwidth, B is the video bitstream size, S is the packet loss rate, Q1 is the redundancy adjustment factor for high-level videos, Q2 is the redundancy adjustment factor for low-level videos, Bm represents the video bitstream size of the first level, F is the video frame rate size, and K is the ratio of the size of I frames to P frames.

[0044] S350: Calculate the redundancy corresponding to the video frames of each level respectively.

[0045] The basic redundancy S is calculated using the number of originally transmitted data packets and the transmission packet loss rate. S is the smallest integer that satisfies the formula According to the video frame level, the number of redundant packets to be generated is adjusted. Among them, M is the number of originally transmitted data packets, and the redundancy of video frames of each level is Q * S, where Q is the redundancy adjustment parameter for video frames of each level. The higher the level of the video frame, the larger the redundancy adjustment parameter Q of the video frame, and 1 < Q < 2.

[0046] S370: Perform data encoding and redundancy encoding on the video frames of each level to obtain data packets and redundant packets for transmission.

[0047] Input N pieces of original video data and the number of redundant packets Q*S to be added into the FEC encoder for encoding. Transmit the encoded data to the backend device so that the backend device can decode and read it.

[0048] In this embodiment, by first dividing the importance of the video frame content into multiple levels before video transmission, and then further dividing the levels according to the current network condition, and adopting forward error correction with appropriate redundancy to perform differential redundancy on the video data of each level, providing more redundant data for the video frames with higher levels, and using the FEC encoder to encode and transmit the original data and redundant data, it can overcome the problem of undifferentiated redundancy of video data in the prior art video transmission process and solve the video freezing problem in scenarios with large network fluctuations.

[0049] Please refer to Figure 4 , Figure 4 which is a schematic structural diagram of the video transmission method based on forward error correction in this application. In one embodiment, taking the real-time video communication between the front-end video device and the back-end real-time streaming device as an example for illustration, the first level and the second level belong to the high levels, and the third level belongs to the low level. Please refer to Figure 5 , Figure 5 which is a schematic flowchart of a specific embodiment of the video transmission method based on forward error correction in the embodiment of this application. It should be noted that if there are substantially the same results, this embodiment is not limited to Figure 5 the process sequence shown. As shown in Figure 5 this embodiment includes:

[0050] S510: The front-end video device encodes the video according to the level configuration information and outputs video frame data with encoded levels.

[0051] The front-end video device first divides the video levels of the video frames to be transmitted. The video data includes one or more groups of pictures (GOPs), each GOP includes a key frame I and multiple forward frames P. The interval between two key frames I is GOP, and a GOP contains multiple forward frames P. Detect whether the GOP contains a target event, and set different level configurations for the video frames of different types of GOPs. In one embodiment, if the GOP contains a target event, configure the key frame in the GOP as a high level and configure the forward frames in the GOP as high levels. If the GOP does not contain a target event, configure the key frame in the GOP as a high level and configure the forward frames in the GOP as low levels. The higher the level configuration, the greater the transmission volume during video transmission. Taking a GOP with 25 frames as an example for illustration, within one cycle, please refer to Figure 6 , Figure 6It is a schematic diagram of video frame level configuration in this application. If there is a target event in a GOP, the levels of the forward P frames in this GOP are configured as high levels; if there is no target event in other GOPs, the levels of all forward P frames in the GOP are configured as low levels. In another embodiment, please refer to Figure 7 , Figure 7 It is another schematic diagram of video frame level configuration in this application. The levels of the forward P frames in a GOP are set according to the network conditions; when the network bandwidth is in a certain situation, the levels of the first n forward P frames close to the key frame I frame are set as high levels, and the others are set as low levels.

[0052] Furthermore, the configuration levels are adjusted in combination with the packet loss rate. Obtain the current network bandwidth W, the video bitstream size B, and the redundancy adjustment parameters Q for video frames of each level. According to the packet loss feedback information, calculate the packet loss rate, and further calculate the current data transmission volume, where the transmission volume D = (1 + L * Q1 + L * Q2) * B, L is the network packet loss rate, Q is the redundancy adjustment parameter for video frames of each level, Q1 is the redundancy adjustment parameter for high-level video frames, Q2 is the redundancy adjustment parameter for low-level video frames, and B is the video bitstream size. In the embodiment of this application, different redundancy adjustment parameters are set for video frames of different levels, and the redundancy adjustment parameter of the high level is greater than that of the low level.

[0053] Judge whether it is necessary to adjust the level configuration according to the current data transmission volume and the current network bandwidth. Judge whether the network bandwidth W is greater than the transmission volume D. If the network bandwidth W is greater than or equal to the transmission volume D, the levels of the video frames are not adjusted; if the network bandwidth W is less than the transmission volume D, further judge whether the picture group contains a target event. If the picture group does not contain a target event, the levels of the video frames are not adjusted; if the picture group contains a target event, the levels of some forward frames in the picture group are adjusted to low levels.

[0054] In a specific embodiment, if the network bandwidth W is less than the transmission volume D, the levels of the first N forward frames in the picture group are configured as the second level, and the remaining forward frames are configured as the third level;

[0055] where N is the smallest integer that satisfies the formula ; where W is the network bandwidth, B is the video bitstream size, S is the packet loss rate, Q1 is the high-level video redundancy adjustment factor, Q2 is the low-level video redundancy adjustment factor, Bm represents the high-level video bitstream size, F is the video frame rate size, and K is the ratio of the size of the I frame to the P frame.

[0056] S530: Combine the packet loss rate to obtain the redundancy corresponding to video frames of each level.

[0057] According to the packet loss feedback information, calculate the packet loss rate L. Based on the number of original video data packets M that need to be redundant and the network packet loss rate L calculated in the first step; according to the formula: Calculate the number of redundant packets S to be generated, and S takes the smallest integer. For example: if the number of original video data packets M is 50 and the packet loss rate L is 0.2, then S > 12.5; the smallest integer for S is 13.

[0058] Adjust the number of redundant packets to be generated according to the video frame level. For high-level video frames, according to K calculated in the second step, use Q1 * K redundant packets, and for low-level video frames, use Q2 * K redundant packets; where the value ranges of parameters Q1 and Q2 are: 1 < Q2 < Q1 < 2.

[0059] S550: The FEC encoding algorithm performs data redundancy encoding according to the level of video data and the corresponding redundancy.

[0060] The FEC encoding algorithm encodes N original video data and the number of redundant packets Q1 * K (or Q2 * K) to be added.

[0061] S570: Transmit the original video data and redundant data to the backend device through the communication module.

[0062] S590: The backend device restores all video data according to the redundant data, decodes and displays the data.

[0063] Please refer to Figure 8 , Figure 8 which is a schematic flow diagram of the backend real-time pulling device of this application. After receiving the video data, the backend real-time pulling device detects whether there is packet loss. When there is no packet loss, it directly performs video packet detection; when there is packet loss, it sends packet loss feedback information to the front-end video device, further performs video packet detection, and stores them in different cache queues according to the received packet type. The video packets are stored in the video cache queue, and the FEC redundant packets are stored in the redundant cache queue. Specifically, it detects whether the received data packet is a video packet. When it detects that the data packet is a video packet, it puts the data packet into the video packet cache queue. When it detects that the data packet is not a video packet, it means that the data packet is a redundant packet and puts it into the FEC packet cache queue. Further, it detects whether the video packets are continuous, that is, whether there are missing video packets. When there are missing video packets and there are FEC redundant packets, it uses the redundant data in the FEC packet cache queue for recovery, and performs decoding and display processing on the recovered video data.

[0064] In this embodiment, before video transmission, the front-end video device first divides the video frame content into multiple levels of importance, and then further divides the levels according to the current network condition and packet loss situation. A differential redundancy method for video data of each level is adopted with forward error correction suitable for the redundancy degree, providing more redundant data for video frames with a higher level. The FEC encoder is used to encode and transmit the original data and redundant data. After the back-end device receives the data, it feeds back the packet loss situation to enable the front-end video device to make further level adjustments. The back-end device performs FEC decoding on the received original video data and redundant data and conducts video display. It can overcome the problem of undifferentiated redundancy of video data in the prior art during video transmission and solve the video freezing problem in scenarios with large network fluctuations.

[0065] Please refer to Figure 9 , Figure 9 FIG. is a schematic structural diagram of a forward error correction-based video transmission device in an embodiment of the present application. In this embodiment, the forward error correction-based video transmission device includes a configuration module 91, a redundancy module 92, and an encoding module 93.

[0066] Among them, the configuration module 91 is used to configure the levels of video frames of video data; the redundancy module 92 is used to calculate the redundancy degrees corresponding to video frames of each level respectively; the encoding module 93 is used to perform data encoding and redundancy encoding on video frames of each level to obtain data packets and redundancy packets for transmission. The forward error correction-based video transmission device is used to first divide the levels of importance of video frames before video transmission, adopt a differential redundancy method for video data of each level with forward error correction suitable for the redundancy degree, provide more redundant data for video frames with a higher level, and use the FEC encoder to encode and transmit the original data and redundant data, which can overcome the problem of undifferentiated redundancy of video data in the prior art during video transmission and solve the video freezing problem in scenarios with large network fluctuations.

[0067] Please refer to Figure 10 , Figure 10 FIG. is a schematic structural diagram of a forward error correction-based video transmission device in an embodiment of the present application. In this embodiment, the forward error correction-based video transmission device 01 includes a processor 02.

[0068] The processor 02 can also be referred to as a CPU (Central Processing Unit). The processor 02 may be an integrated circuit chip with the ability to process signals. The processor 02 can also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor 02 can also be any conventional processor, etc.

[0069] The video transmission device 01 based on forward error correction can further include a memory (not shown in the figure) for storing the instructions and data required for the operation of the processor 02.

[0070] The processor 02 is used to execute instructions to implement the method provided by any embodiment and any non-conflicting combination of the above-mentioned forward error correction-based video transmission method of the present application.

[0071] Please refer to Figure 11 , Figure 11 FIG. is a schematic structural diagram of a computer-readable storage medium in an embodiment of the present application. The computer-readable storage medium 11 of the embodiment of the present application stores instruction / program data 12, and when the instruction / program data 12 is executed, it implements the method provided by any embodiment and any non-conflicting combination of the forward error correction-based video transmission method of the present application. Among them, the instruction / program data 12 can form a program file and be stored in the above storage medium 11 in the form of a software product, so that a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor can execute all or part of the steps of the methods of various embodiments of the present application. The foregoing storage medium 11 includes: various media such as a USB flash drive, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, RandomAccess Memory), a magnetic disk, or an optical disc that can store program codes, or a computer, a server, a mobile phone, a tablet, or other terminal devices.

[0072] In several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of units is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces, and the indirect coupling or communication connection of the device or unit can be in an electrical, mechanical, or other form.

[0073] In addition, each functional unit in various embodiments of the present application may be integrated into one processing unit, may exist physically alone for each unit, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of a software functional unit.

[0074] The above are only the embodiments of the present invention, and do not limit the patent scope of the present invention accordingly. Any equivalent structure or equivalent process transformation made by using the content of the specification and drawings of the present invention, or directly or indirectly applied in other related technical fields, shall be equally included in the patent protection scope of the present invention.

Claims

1. A video transmission method based on forward error correction, characterized in that, The method includes: Performing level configuration on video frames of video data; Calculating the redundancy corresponding to video frames of each level respectively; Performing data encoding and redundancy encoding on video frames of each level to obtain data packets and redundancy packets for transmission; The video data includes one or more groups of pictures, and each group of pictures includes a key frame and multiple forward frames. The performing level configuration on video frames of the video data includes: detecting whether the group of pictures contains a target event; if the group of pictures contains the target event, configuring the key frame in the group of pictures as the first level and configuring at least part of the forward frames in the group of pictures as the second level, where the first level is higher than / equal to the second level; After detecting that the image group contains the target event and performing level configuration on the video frames of the image group, it includes: determining whether the network bandwidth W is greater than the transmission volume D, where the transmission volume L is the network packet loss rate, Qn is the redundancy adjustment parameter of each level of video frame, and B is the video bitstream size; if the network bandwidth W is less than the transmission volume D, then adjust the level of some of the forward frames in the image group to the third level, and the third level is lower than the second level.

2. The video transmission method based on forward error correction according to claim 1, wherein, The detecting whether the group of pictures contains a target event further includes: If the group of pictures does not contain the target event, configuring the key frame in the group of pictures as the first level and configuring the forward frames in the group of pictures as the third level, where the third level is lower than the second level.

3. The video transmission method based on forward error correction according to claim 1, characterized in that After detecting that the group of pictures contains the target event and performing level configuration on video frames of the group of pictures, it includes: If the network bandwidth W is greater than or equal to the transmission amount D, no adjustment is made to the levels of the video frames.

4. The video transmission method based on forward error correction according to claim 1, wherein If the network bandwidth W is less than the transmission amount D, configuring the key frame in the group of pictures as the first level, configuring the levels of the first N forward frames as the second level, and configuring the remaining forward frames as the third level; Wherein, the first level and the second level belong to high levels, and the third level belongs to a low level.

5. The video transmission method based on forward error correction according to claim 1, wherein The calculating the redundancy corresponding to video frames of each level respectively includes: Calculate the basic redundancy S, where S is the smallest integer that satisfies the formula , where M is the number of originally transmitted data packets and L is the network packet loss rate; The redundancy of video frames of each level is Qn*S, where Qn is the redundancy adjustment parameter of video frames of each level.

6. The video transmission method based on forward error correction according to claim 5, wherein The higher the level of the video frame, the larger the redundancy adjustment parameter Qn of the video frame, and 1 < Qn < 2.

7. The video transmission method based on forward error correction according to claim 1, wherein After performing data encoding and redundancy encoding on video frames of each level to obtain data packets and redundancy packets for transmission, it includes: Receiving packet loss feedback information and obtaining the network packet loss rate.

8. A video transmission device based on forward error correction, characterized in that, It includes a processor, and the processor is used to execute instructions to implement the video transmission method based on forward error correction according to any one of claims 1-7.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store instructions / program data, and the instructions / program data can be executed by a computer device or a processor to implement the video transmission method based on forward error correction according to any one of claims 1-7.

Images