Video coding fault tolerance method

Abstract

The invention discloses a video coding fault-tolerant method, which comprises the following steps of S1, judging whether a strict fault-tolerant mode is used in a current use scene or not, if so, entering S2, and if not, judging that the current use scene is a common fault-tolerant mode, and directly entering S6; s2, analyzing the SPS transmitted by the IPC, and obtaining each syntax element of the SPS specified by a standard specification; s3, analyzing the PPS transmitted by the IPC, and obtaining each syntax element of the PPS specified by the standard specification; and S4, judging whether the SPS and the PPS conform to standard specifications or not, if so, entering S9, and if not, entering S5. The method supports two fault-tolerant modes, namely a strict fault-tolerant mode and a common fault-tolerant mode, and can respectively provide fault-tolerant schemes for different performance requirement scenes so as to be compatible with different use scenes, so that the compatibility of different third-party devices can be greatly improved, and the customer experience is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of video coding, and in particular to a method for video coding error tolerance. Background Art

[0002] Traditional intercom systems mostly use private protocols (such as TCP / UDP custom protocols, analog signal transmission), and only support the interconnection of indoor machines, door machines, and management machines of the same brand. Users cannot freely access third-party devices (such as cameras and smart locks of other brands). Moreover, traditional intercom systems mainly focus on audio intercom, and the video function relies on analog signals (such as CVBS), with low resolution (such as CIF 352×288), which cannot meet the high-definition visualization requirements. For this reason, an intelligent intercom system has emerged on the market. By introducing ONVIF and RTSP standard protocols, it can seamlessly access third-party devices and achieve device interconnection between different manufacturers. On this basis, by introducing H264 and H265 digital encoding and video coding technologies, it can provide users with high-resolution video services under limited bandwidth conditions. In video coding, SPS (Sequence Parameter Set) and PPS (Picture Parameter Set) are crucial header information, which carry global parameters required for decoding and ensure that the decoder can correctly parse the video stream;

[0003] However, there are compatibility problems in the video coding technology in the prior art. Due to the variety of device types and uneven quality of third-party manufacturers, and there are various versions of firmware, it is inevitable that the SPS and PPS parameters used by some manufacturers do not meet the standards. If the SPS and PPS are directly parsed according to the standards, the cameras of some manufacturers will not display the picture. Therefore, it is necessary to perform standard compatibility checks on these SPSs and correct them to display the camera picture as much as possible. For this reason, the present application proposes a method for video coding error tolerance. Summary of the Invention

[0004] Based on the technical problems existing in the background art, the present invention proposes a method for video coding error tolerance.

[0005] A method for video coding error tolerance proposed by the present invention includes the following steps:

[0006] S1: Determine whether the current usage scenario uses the strict error tolerance mode. If so, enter S2; if not, it is determined as the normal error tolerance mode and directly enter S6;

[0007] S2: Parse the SPS transmitted by the IPC and obtain each syntax element of the SPS specified by the standard specification;

[0008] S3: Analyze the PPS transmitted by IPC and obtain each syntax element of the PPS specified by the standard specification;

[0009] S4: Determine whether the SPS and PPS comply with the standard specification. If they comply, proceed to S9; if not, proceed to S5;

[0010] S5: Using the SPS as a standard, adjust the non - compliant parts of the PPS to make the PPS compliant with the standard;

[0011] S6: Determine whether the current PPS is the first PPS. If it is, proceed to S7; if not, proceed to S9;

[0012] S7: Determine whether the PPS conforms to the characteristics of an abnormal PPS. If it conforms, proceed to S8; if not, proceed to S9;

[0013] S8: Repair the PPS according to the characteristics and attempt to make the PPS compliant with the standard;

[0014] S9: Send the PPS to the decoder for normal decoding and end the process.

[0015] Preferably, in S1, the strict error - tolerance mode requires parsing the SPS and PPS parameter sets, while the normal error - tolerance mode does not require parsing the SPS and PPS.

[0016] Preferably, in S5, when adjusting the non - compliant parts of the PPS, the syntax elements that should not appear need to be deleted from the PPS.

[0017] Preferably, in S8, when repairing the PPS according to the characteristics, only the first - frame PPS is repaired for error tolerance. Only when the interval between the first - frame PPS and the second - frame PPS cannot be decoded, and the interval is one GOP. Generally, the GOP is set to 2 seconds, that is, generally, it takes 2 more seconds to be able to decode normally. When the first - frame PPS is abnormal, after deleting the illegal fields in it, the originally undecodable stream can now be decoded normally.

[0018] Compared with the existing technology, the beneficial effects of the present invention are:

[0019] The method of the present invention supports two error - tolerance modes, namely, the strict error - tolerance mode and the normal error - tolerance mode, and can propose error - tolerance solutions respectively for different performance - requirement scenarios to be compatible with different usage scenarios, thereby greatly improving the compatibility with different third - party devices and enhancing the customer experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a flowchart of a video coding error - tolerance method proposed by the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0021] The present invention will be further described below in conjunction with specific embodiments.

[0022] Embodiment

[0023] Referring to Figure 1 , this embodiment proposes a method for video coding error tolerance, including the following steps:

[0024] S1: Determine whether the current usage scenario uses the strict error tolerance mode. If so, enter S2; if not, it is determined as the normal error tolerance mode and directly enter S6;

[0025] Among them, the strict error tolerance mode requires parsing the SPS and PPS parameter sets, while the normal error tolerance mode does not require parsing the SPS and PPS. The strict error tolerance mode is used for scenarios with high performance and high standards, and the normal error tolerance mode is used for scenarios with low performance and low requirements;

[0026] S2: Parse the SPS transmitted by IPC and obtain each syntax element of the SPS specified by the standard specification;

[0027] S3: Parse the PPS transmitted by IPC and obtain each syntax element of the PPS specified by the standard specification;

[0028] S4: Determine whether the SPS and PPS conform to the standard specification. If they conform, enter S9; if not, enter S5;

[0029] S5: Taking the SPS as the standard, adjust the part of the PPS that does not conform to the standard to make the PPS conform to the standard;

[0030] Among them, when adjusting the part of the PPS that does not conform to the standard, the syntax elements that should not appear need to be deleted from the PPS. For example: when the profile_idc value in the SPS is 66 (baseline), and the transform_8x8_mode_flag or pic_scaling_matrix_present_flag or second_chroma_qp_index_offset syntax element appears in the PPS, the syntax elements that should not appear need to be deleted from the PPS at this time;

[0031] S6: Determine whether it is the first PPS currently. If so, enter S7; if not, enter S9;

[0032] S7: Determine whether the PPS conforms to the characteristics of the abnormal PPS. If it conforms, enter S8; if not, enter S9;

[0033] S8: Repair the PPS according to the characteristics and try to make the PPS conform to the standard;

[0034] When performing PPS repair by feature, only the first-frame PPS is repaired for fault tolerance. Only when the interval between the first-frame PPS and the second-frame PPS cannot be decoded, and the interval period is a GOP. Generally, the GOP is set to 2 seconds, that is, generally, an additional 2 seconds need to be waited for normal decoding. When the first-frame PPS is abnormal and the illegal fields in it are deleted, the originally undecodable stream can now be decoded normally. For example: if the last character is 0, we delete this 0, and only the first-frame PPS is deleted. Assuming this 0 meets the standard, when the second-frame PPS is sent to the decoder, it can be decoded normally. And if this 0 is an abnormal 0, then after deleting this 0, the originally undecodable stream can now be decoded normally;

[0035] S9: Send the PPS to the decoder for normal decoding and end the process;

[0036] This embodiment supports two fault-tolerant modes, namely, the strict fault-tolerant mode and the normal fault-tolerant mode, and can propose fault-tolerant solutions respectively for different performance requirement scenarios to be compatible with different usage scenarios, thereby greatly improving the compatibility with different third-party devices and enhancing the customer experience.

[0037] The above is only a preferred specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present invention, according to the technical solution and inventive concept of the present invention, makes equivalent substitutions or changes, and all should be covered within the protection scope of the present invention.

Claims

1. A method for video coding error tolerance, characterized in that, It includes the following steps: S1: Determine whether the strict fault tolerance mode is used in the current usage scenario. If so, go to S2; if not, it is determined as the normal fault tolerance mode and directly go to S6; S2: Parse the SPS transmitted by the IPC to obtain each syntax element of the SPS specified by the standard specification; S3: Parse the PPS transmitted by the IPC to obtain each syntax element of the PPS specified by the standard specification; S4: Determine whether the SPS and PPS conform to the standard specification. If they conform, go to S9; if not, go to S5; S5: Take the SPS as the standard and adjust the non - conforming part of the PPS to make the PPS conform to the standard; S6: Determine whether it is the first PPS currently. If so, go to S7; if not, go to S9; S7: Determine whether the PPS conforms to the abnormal PPS characteristics. If it conforms, go to S8; if not, go to S9; S8: Repair the PPS according to the characteristics and try to make the PPS conform to the standard; S9: Send the PPS to the decoder for normal decoding and end the process.

2. The method for video coding error tolerance according to claim 1, characterized in that In S1, the strict fault tolerance mode requires parsing the SPS and PPS parameter sets, while the normal fault tolerance mode does not need to parse the SPS and PPS.

3. A method for video coding error tolerance according to claim 1, characterized in that, In S5, when adjusting the non - conforming part of the PPS, the syntax elements that should not appear need to be deleted from the PPS.

4. A method for video coding error tolerance according to claim 1, characterized in that, In S8, when repairing the PPS according to the characteristics, only the first - frame PPS is repaired for fault tolerance. Only during the interval between the first - frame PPS and the second - frame PPS cannot be decoded. The interval is one GOP. Generally, the GOP is set to 2 seconds, that is, generally, you need to wait 2 more seconds to decode normally. When the first - frame PPS is abnormal, after deleting the illegal fields in it, the originally undecodable stream can now be decoded normally.

Images