A video network transmission fault tolerance protection method, system, device and storage medium

Abstract

The present invention discloses a method, system, device and storage medium for fault-tolerant protection of video network transmission. The method for fault-tolerant protection of video network transmission includes: generating a first quantization parameter and a first reference list; encoding and generating network data according to the first quantization parameter and the first reference list; decoding the network data to generate a first video frame; confirming that there is erroneous data in the first video frame and generating feedback information; obtaining a second frame number according to the feedback information; generating a second quantization parameter and a second reference list according to the second frame number; encoding and generating a second video frame according to the second quantization parameter and the second reference list and caching the same. The present invention achieves timely detection and error correction by decoding and error detection of the received network data, and feeding back the first frame number corresponding to the erroneous data to the transmitter to adjust the reference list in real time. This suppresses the propagation of errors while meeting the real-time nature of video network transmission, thereby improving the visual experience of the video.

Description

Technical Field

[0001] The present application relates to the field of streaming media technology, and in particular to a method, system, device and storage medium for fault-tolerant protection of video network transmission. Background Art

[0002] In streaming media transmission systems, network fluctuations can cause video packet loss or transmission errors, impacting the viewing experience at the receiving end. With the widespread adoption of live streaming, the quality of online video viewing is becoming increasingly important. Current mainstream video coding standards still utilize a hybrid coding architecture, which still presents the problem of error propagation. If a bit in the current frame of video encoding is erroneous, the error will propagate to subsequent frames, causing decoding errors in subsequent frames as well, leading to error accumulation.

[0003] Currently, the mainstream solution for most Internet live broadcast systems is to enhance channel fault tolerance through forward error correction (FEC) or backward error correction (BEC). Common backward error correction technologies include automatic repeat request (ARQ), which recovers erroneous data packets by having the receiver request the sender to retransmit the erroneous data packets; common forward error correction technologies use channel error correction coding technology, where the sender uses error correction codes (ECC) to redundantly encode the information. The redundant part allows the receiver to detect and correct limited errors that may occur anywhere in the information without requesting the sender to retransmit.

[0004] However, backward error correction technology increases the communication delay of video network transmission, reduces the real-time performance of live video, and has poor applicability in scenarios with high real-time requirements. Forward error correction technology only targets the channel and does not consider the correlation between previous and subsequent data. Although it can ensure high real-time performance, it still cannot prevent the occurrence of errors or the spread of errors. Summary of the Invention

[0005] The purpose of the present invention is to solve one of the technical problems existing in the prior art to at least a certain extent.

[0006] To this end, an object of embodiments of the present invention is to provide a method, system, device and storage medium for fault-tolerant protection of video network transmission, so as to improve the fault-tolerant capability and error-resistance capability of video network transmission and prevent the spread of uncoded signals.

[0007] In order to achieve the above technical objectives, the technical solutions adopted by the embodiments of the present invention include:

[0008] In a first aspect, an embodiment of the present invention provides a method for fault-tolerant protection of video network transmission, comprising the following steps:

[0009] generating a first quantization parameter and a first reference list;

[0010] Perform encoding according to the first quantization parameter and the first reference list to generate network data;

[0011] Decoding the network data to generate a first video frame;

[0012] Confirming that erroneous data exists in the first video frame, and generating feedback information, wherein the feedback information includes a first frame number, where the first frame number is a frame number corresponding to the erroneous data;

[0013] Acquire a second frame number according to the feedback information;

[0014] generating a second quantization parameter and a second reference list according to the second frame number;

[0015] Encoding is performed according to the second quantization parameter and the second reference list to generate a second video frame and cache it.

[0016] A video network transmission fault tolerance protection method according to an embodiment of the present invention decodes and detects errors in received network data, and feeds back the first frame number corresponding to the erroneous data to the transmitter for real-time adjustment of the reference list. This method achieves timely detection and correction of erroneous data and reduces the continuation of erroneous data to subsequent frames. This method suppresses error propagation while meeting the real-time nature of video network transmission, thereby improving the visual experience of the video.

[0017] In addition, the video network transmission fault tolerance protection method according to the above embodiment of the present invention may also have the following additional technical features:

[0018] Furthermore, in a video network transmission fault tolerance protection method according to an embodiment of the present invention, encoding according to the first quantization parameter and the first reference list to generate network data includes:

[0019] performing a first encoding on the first quantization parameter and the first reference list to generate a third video frame, wherein the first encoding includes video data compression encoding;

[0020] The third video frame is subjected to a second encoding to generate the network data, where the second encoding includes forward error correction encoding.

[0021] Furthermore, in one embodiment of the present invention, decoding the network data to generate the first video frame includes:

[0022] Performing a first decoding on the network data to generate decoded data, wherein the first decoding includes forward error correction decoding;

[0023] The decoded data is subjected to a second decoding to generate the first video frame, where the second decoding includes video frame decoding.

[0024] Furthermore, in one embodiment of the present invention, generating a second quantization parameter and a second reference list according to the second frame number includes:

[0025] generating the second reference list according to the second frame number and the first reference list;

[0026] The second quantization parameter is generated according to the second frame number.

[0027] In a second aspect, an embodiment of the present invention provides a video network transmission fault tolerance protection system, comprising:

[0028] a rate control module, configured to generate a first quantization parameter, and to generate a second quantization parameter according to a second frame number;

[0029] a reference list generating module, configured to generate a first reference list, and to generate a second reference list according to a second frame number;

[0030] an encoding module, configured to encode according to the first quantization parameter and the first reference list to generate network data, and to encode according to the second quantization parameter and the second reference list to generate and cache a second video frame;

[0031] A decoding module, configured to decode the network data to generate a first video frame;

[0032] a feedback information generating module, configured to confirm that there is erroneous data in the first video frame and generate feedback information;

[0033] The second frame number obtaining module is configured to obtain the second frame number according to the feedback information.

[0034] Furthermore, in one embodiment of the present invention, the encoding module includes:

[0035] A first encoding module, configured to perform a first encoding on the first quantization parameter and the first reference list to generate a third video frame;

[0036] The second encoding module is used to perform a second encoding on the third video frame to generate the network data.

[0037] Furthermore, in one embodiment of the present invention, the decoding module includes:

[0038] A first decoding module, configured to perform a first decoding on the network data to generate decoded data;

[0039] The second decoding module is used to perform a second decoding on the decoded data to generate the first video frame.

[0040] Furthermore, in one embodiment of the present invention, the reference list generating module is configured to generate the second reference list according to the second frame number and the first reference list.

[0041] In a third aspect, an embodiment of the present invention provides a video network transmission fault tolerance protection device, comprising:

[0042] at least one processor;

[0043] at least one memory for storing at least one program;

[0044] When the at least one program is executed by the at least one processor, the at least one processor implements the video network transmission fault tolerance protection method.

[0045] In a fourth aspect, an embodiment of the present invention provides a storage medium storing a program executable by a processor, wherein the program executable by the processor is used to implement the method for fault-tolerant protection of video network transmission when executed by the processor.

[0046] The advantages and benefits of the present invention will be described in part in the following description and will become apparent from the following description or learned through practice of the present application:

[0047] The embodiment of the present invention decodes and detects errors in the received network data, and feeds back the first frame number corresponding to the erroneous data to the transmitter for real-time adjustment of the reference list, thereby achieving timely detection and correction of erroneous data and reducing the continuation of erroneous data to subsequent frames. This suppresses the propagation of errors while meeting the real-time nature of video network transmission, thereby improving the visual experience of the video. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following introduction is made to the drawings of the embodiments of the present application or the related technical solutions in the prior art. It should be understood that the drawings introduced below are only for the convenience of clearly describing some embodiments of the technical solutions of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without any creative work.

[0049] Figure 1 A flowchart of a specific embodiment of a video network transmission fault tolerance protection method according to the present invention;

[0050] Figure 2 A schematic diagram of feedback information of a specific embodiment of a video network transmission fault tolerance protection method according to the present invention;

[0051] Figure 3 A schematic structural diagram of a specific embodiment of a video network transmission fault-tolerant protection system according to the present invention;

[0052] Figure 4 The figure is a structural diagram of a specific embodiment of a video network transmission fault-tolerant protection device of the present invention. DETAILED DESCRIPTION

[0053] The embodiments of the present invention are described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application and are not to be construed as limiting the present application. The step numbers in the following embodiments are provided only for the convenience of explanation and do not limit the order of the steps. The order of execution of the steps in the embodiments can be adaptively adjusted according to the understanding of those skilled in the art.

[0054] The terms "first," "second," "third," and "fourth," etc., in the specification, claims, and accompanying drawings of the present invention are used to distinguish between different items, not to describe a specific order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

[0055] References to "embodiments" in this disclosure mean that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the disclosure. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0056] In streaming media transmission systems, network fluctuations can cause video packet loss or transmission errors, impacting the viewing experience at the receiving end. With the widespread adoption of live streaming, the quality of online video viewing is becoming increasingly important. Current mainstream video coding standards still utilize a hybrid coding architecture, which still presents the problem of error propagation. If a bit in the current frame of video encoding is erroneous, the error will propagate to subsequent frames, causing decoding errors in subsequent frames as well, leading to error accumulation.

[0057] Currently, the mainstream solution for most Internet live broadcast systems is to enhance channel fault tolerance through forward error correction (FEC) or backward error correction (BEC). Common backward error correction technologies include automatic repeat request (ARQ), which recovers erroneous data packets by having the receiver request the sender to retransmit the erroneous data packets; common forward error correction technologies use channel error correction coding technology, where the sender uses error correction codes (ECC) to redundantly encode the information. The redundant part allows the receiver to detect and correct limited errors that may occur anywhere in the information without requesting the sender to retransmit.

[0058] However, backward error correction technology increases the communication delay of video network transmission, reduces the real-time performance of live video, and has poor applicability in scenarios with high real-time requirements. Forward error correction technology only targets the channel and does not consider the correlation between previous and subsequent data. Although it can ensure high real-time performance, it still cannot prevent the occurrence of errors or the spread of errors.

[0059] To this end, the present invention proposes a video network transmission fault-tolerant protection method and system. By decoding and detecting errors in the received network data, and feeding back the first frame number corresponding to the erroneous data to the sender for real-time adjustment of the reference list, timely detection and correction of erroneous data are achieved, and the continuation of erroneous data to subsequent frames is reduced. While meeting the real-time nature of video network transmission, the propagation of errors is suppressed, thereby improving the visual experience of the video.

[0060] A video network transmission fault tolerance protection method and system according to an embodiment of the present invention will be described in detail below with reference to the accompanying drawings. First, a video network transmission fault tolerance protection method according to an embodiment of the present invention will be described with reference to the accompanying drawings.

[0061] Reference Figure 1 In an embodiment of the present invention, a method for fault-tolerant protection of video network transmission is provided. The method for fault-tolerant protection of video network transmission in an embodiment of the present invention can be applied to a terminal, a server, or software running in a terminal or a server. The terminal can be a tablet computer, a laptop computer, a desktop computer, etc., but is not limited thereto. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks (CDNs), and big data and artificial intelligence platforms. The method for fault-tolerant protection of video network transmission in an embodiment of the present invention mainly includes the following steps:

[0062] S101, generating a first quantization parameter and a first reference list;

[0063] Among them, the first quantization parameter (QP) reflects the compression of spatial details of the video. When the QP is small, most details will be retained; as the QP increases, some details of the video are lost and the bit rate is reduced; the first reference list is used to manage reference images.

[0064] Specifically, in the embodiment of the present invention, the first quantization parameter and the first reference list of the current coding frame are output according to the set initial working mode.

[0065] S102. Encode according to the first quantization parameter and the first reference list to generate network data;

[0066] S102 can be further divided into the following steps S1021-S1022:

[0067] Step S1021: Perform a first encoding on the first quantization parameter and the first reference list to generate a third video frame;

[0068] The first encoding includes video data compression encoding.

[0069] Specifically, in an embodiment of the present invention, H264 encoding is used to compress video data according to the first quantization parameter and the first reference list to generate a video frame, namely the third video frame. In one embodiment of the present invention, the VCC standard can be used for video data compression encoding to improve compression efficiency and source fault tolerance.

[0070] In the embodiment of the present invention, the Scalable Video Coding (SVC) technology in H264 coding is combined to output a multi-layer code stream including a base layer and an enhancement layer.

[0071] Step S1022: Perform a second encoding on the third video frame to generate the network data.

[0072] The second coding includes forward error correction coding (FEC coding).

[0073] S103, decoding the network data to generate a first video frame;

[0074] Specifically, after network data is generated through steps S101-S102, the network data is sent to a decoding module via network transmission. The decoding module decodes the network data to generate a decoded video frame, namely the first video frame.

[0075] S103 can be further divided into the following steps S1031-S1032:

[0076] Step S1031: performing a first decoding on the network data to generate decoded data;

[0077] The first decoding includes forward error correction decoding.

[0078] Specifically, according to step S1022, the third video frame is FEC-encoded to generate network data. Therefore, after receiving the network data, the network data first needs to be FEC-decoded.

[0079] Step S1032: Perform a second decoding on the decoded data to generate the first video frame.

[0080] The second decoding includes video frame decoding.

[0081] Specifically, in an embodiment of the present invention, H264 decoding is used to decode the FEC decoded data to generate the first video frame. According to step S1021, when the VCC standard is used for video data compression encoding, the VCC standard is correspondingly used for decoding when decoding the video frame.

[0082] S104: confirming that there is erroneous data in the first video frame, and generating feedback information;

[0083] The feedback information includes a first frame number, which is a frame number corresponding to the erroneous data.

[0084] Specifically, error detection is performed on the first video frame to determine whether erroneous data exists, and if so, the feedback information is generated. As can be seen from step S1021, the first encoding of the embodiment of the present invention incorporates SVC technology. Therefore, when error detection is performed on the first video frame, if the frame with the first frame number corresponding to the erroneous data is in the base layer, the frame with the first frame number is replaced with a frame from the corresponding enhancement layer for display, and the feedback information is generated. If the frame with the first frame number is in the enhancement layer, the frame with the first frame number is replaced with a frame from the corresponding base layer for display, and the feedback information does not need to be generated.

[0085] S105. Obtain a second frame number according to the feedback information;

[0086] The second frame number is obtained according to the first frame number in the feedback information, and then the video stream output by the subsequent coded frame encoding is optimized according to the second frame number to prevent the error from spreading to the subsequent video stream.

[0087] Specifically, refer to Figure 2In one embodiment of the present invention, steps S101-S102 (the transmitting end) generate and transmit the first eight frames of data with a normal reference relationship. After decoding and error detection on the first eight frames of data in steps S103-S104 (the receiving end), it is discovered that an error has occurred in video frame num=5 (the first frame number). At this point, the transmitting end changes the reference relationship of video frame num=9 by referring to the reference relationship of video frame num=3 (the second frame number), ignoring video frame num=8, thereby ensuring that video frame num=9 can be decoded normally.

[0088] S106, generating a second quantization parameter and a second reference list according to the second frame number;

[0089] Specifically, according to the specific embodiment of step S105, the second reference list is generated according to the second frame number and the first reference list, and the second quantization parameter is generated according to the second frame number.

[0090] S107: Encode according to the second quantization parameter and the second reference list to generate a second video frame and cache it.

[0091] Specifically, encoding is performed according to the second quantization parameter adjusted in real time and the second reference list to generate a second video frame and cache it in a cache queue.

[0092] A video network transmission fault tolerance protection method according to an embodiment of the present invention decodes and detects errors in received network data, and feeds back the first frame number corresponding to the erroneous data to the transmitter for real-time adjustment of the reference list. This method achieves timely detection and correction of erroneous data and reduces the continuation of erroneous data to subsequent frames. This method suppresses error propagation while meeting the real-time nature of video network transmission, thereby improving the visual experience of the video.

[0093] Next, a video network transmission fault-tolerant protection system proposed according to an embodiment of the present application is described with reference to the accompanying drawings.

[0094] Figure 3 This is a structural diagram of a video network transmission fault-tolerant protection system according to an embodiment of the present application.

[0095] The system specifically includes:

[0096] The rate control module 301 is configured to generate a first quantization parameter and to generate a second quantization parameter according to a second frame number;

[0097] a reference list generating module 302, configured to generate a first reference list, and to generate a second reference list according to a second frame number;

[0098] an encoding module 303, configured to perform encoding according to the first quantization parameter and the first reference list to generate network data, and to perform encoding according to the second quantization parameter and the second reference list to generate and cache a second video frame;

[0099] A decoding module 304 is configured to decode the network data to generate a first video frame;

[0100] A feedback information generating module 305 is configured to confirm that there is erroneous data in the first video frame and generate feedback information;

[0101] The second frame number obtaining module 306 is configured to obtain a second frame number according to the feedback information.

[0102] In an embodiment of the present invention, the encoding module includes:

[0103] A first encoding module, configured to perform a first encoding on the first quantization parameter and the first reference list to generate a third video frame;

[0104] The second encoding module is used to perform a second encoding on the third video frame to generate the network data.

[0105] In an embodiment of the present invention, the decoding module includes:

[0106] A first decoding module, configured to perform a first decoding on the network data to generate decoded data;

[0107] The second decoding module is used to perform a second decoding on the decoded data to generate the first video frame.

[0108] In an embodiment of the present invention, the reference list generating module is configured to generate the second reference list according to the second frame number and the first reference list.

[0109] It can be seen that the contents of the above method embodiments are all applicable to the present system embodiments. The functions specifically implemented by the present system embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0110] Reference Figure 4 , an embodiment of the present application provides a video network transmission fault tolerance protection device, comprising:

[0111] at least one processor 401;

[0112] at least one memory 402, configured to store at least one program;

[0113] When the at least one program is executed by the at least one processor 401, the at least one processor 401 implements the video network transmission fault tolerance protection method.

[0114] Similarly, the contents of the above method embodiments are applicable to the present device embodiments. The functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0115] In some optional embodiments, the function / operation mentioned in the block diagram may not occur in the order mentioned in the operation diagram. For example, depending on the function / operation involved, the two boxes shown in succession can actually be executed substantially simultaneously or the boxes can sometimes be executed in reverse order. In addition, the embodiments presented and described in the flow chart of the present application are provided in an exemplary manner for the purpose of providing a more comprehensive understanding of the technology. The disclosed method is not limited to the operations and logical flows presented herein. Optional embodiments are contemplated in which the order of the various operations is changed and the sub-operations described as a part of a larger operation are performed independently.

[0116] In addition, although the present application is described in the context of functional modules, it should be understood that, unless otherwise stated, one or more of the functions and / or features may be integrated into a single physical device and / or software module, or one or more functions and / or features may be implemented in separate physical devices or software modules. It is also understood that a detailed discussion of the actual implementation of each module is not necessary for understanding the present application. More specifically, given the properties, functions, and internal relationships of the various functional modules in the devices disclosed herein, the actual implementation of the module will be understood within the routine skills of an engineer. Therefore, a person skilled in the art can implement the present application as set forth in the claims using ordinary techniques without undue experimentation. It is also understood that the specific concepts disclosed are merely illustrative and are not intended to limit the scope of the present application, which is determined by the full scope of the appended claims and their equivalents.

[0117] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several programs for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0118] The logic and / or steps represented in a flowchart or otherwise described herein, for example, may be considered as an ordered list of executable programs for implementing the logical functions, and may be embodied in any computer-readable medium for use by, or in conjunction with, a program execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can retrieve and execute a program from a program execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" may be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, a program execution system, apparatus, or device.

[0119] More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic devices), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disc read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering, or processing in another suitable manner as necessary, and then stored in a computer memory.

[0120] It should be understood that various parts of the present application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable program execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0121] In the above description of this specification, reference to the terms "one embodiment / example," "another embodiment / example," or "certain embodiments / examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in any appropriate manner in any one or more embodiments or examples.

[0122] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions, and variations may be made to the embodiments without departing from the principles and intent of the present application, and that the scope of the present application is defined by the claims and their equivalents.

[0123] The above is a specific description of the preferred implementation of the present application, but the present application is not limited to the embodiments. Those skilled in the art may make various equivalent modifications or substitutions without violating the spirit of the present application. These equivalent modifications or substitutions are all included in the scope defined by the claims of the present application.

Claims

1. A video network transmission fault tolerance protection method, characterized in that: The following steps are involved: generating a first quantization parameter and a first reference list; Perform encoding according to the first quantization parameter and the first reference list to generate network data; Decoding the network data to generate a first video frame; Confirming that erroneous data exists in the first video frame, and generating feedback information, wherein the feedback information includes a first frame number, where the first frame number is a frame number corresponding to the erroneous data; Acquire a second frame number according to the feedback information; generating a second quantization parameter and a second reference list according to the second frame number; Encoding according to the second quantization parameter and the second reference list to generate a second video frame and cache the second video frame; The encoding according to the first quantization parameter and the first reference list to generate network data includes: performing a first encoding on the first quantization parameter and the first reference list to generate a third video frame, wherein the first encoding includes video data compression encoding; performing a second encoding on the third video frame to generate the network data, wherein the second encoding includes forward error correction encoding; The decoding of the network data to generate a first video frame includes: Performing a first decoding on the network data to generate decoded data, wherein the first decoding includes forward error correction decoding; The decoded data is subjected to a second decoding to generate the first video frame, where the second decoding includes video frame decoding.

2. A video network transmission fault tolerance protection method according to claim 1, characterized in that: Generating a second quantization parameter and a second reference list according to the second frame number includes: generating the second reference list according to the second frame number and the first reference list; The second quantization parameter is generated according to the second frame number.

3. A video network transmission fault tolerance protection system, characterized in that: include: a rate control module, configured to generate a first quantization parameter, and to generate a second quantization parameter according to a second frame number; a reference list generating module, configured to generate a first reference list, and to generate a second reference list according to a second frame number; an encoding module, configured to encode according to the first quantization parameter and the first reference list to generate network data, and to encode according to the second quantization parameter and the second reference list to generate and cache a second video frame; A decoding module, configured to decode the network data to generate a first video frame; a feedback information generating module, configured to confirm that there is erroneous data in the first video frame and generate feedback information; A second frame number acquisition module, configured to acquire a second frame number according to the feedback information; The encoding module includes: A first encoding module, configured to perform a first encoding on the first quantization parameter and the first reference list to generate a third video frame; A second encoding module, configured to perform a second encoding on the third video frame to generate the network data; The decoding module includes: A first decoding module, configured to perform a first decoding on the network data to generate decoded data; The second decoding module is used to perform a second decoding on the decoded data to generate the first video frame.

4. A video network transmission fault tolerance protection system according to claim 3, characterized in that: The reference list generating module is configured to generate the second reference list according to the second frame number and the first reference list.

5. A video network transmission fault-tolerant protection device, characterized in that: include: at least one processor; at least one memory for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements a video network transmission fault tolerance protection method according to any one of claims 1 to 2.

6. A storage medium storing a program executable by a processor, characterized in that: The processor-executable program is used to implement a video network transmission fault tolerance protection method according to any one of claims 1 to 2 when executed by the processor.

Images