Image data false detection methods, video conferencing equipment and storage media

Abstract

This invention provides an image data false detection method, a video conferencing device, and a storage medium, belonging to the field of image processing technology. The method includes: acquiring encoded data and supplementary enhancement information output from an encoding end, wherein the supplementary enhancement information includes at least a first checksum; decoding the encoded data to obtain video frame image data corresponding to the encoded data; determining a second checksum corresponding to the video frame image data; and determining whether the video frame image data is abnormal based on the first checksum and the second checksum. The technical solution of this invention solves the problem of excessive detection overhead caused by the need for regularization judgment on each syntax element in the image data false detection process of existing encoding / decoding systems by verifying the decoded video frame image data according to the supplementary enhancement information, thereby improving the efficiency and accuracy of image data false detection in the encoding / decoding system.

Description

Technical Field

[0001] This invention relates to the field of image processing technology, and in particular to a method for detecting false image data, a video conferencing device, and a storage medium. Background Technology

[0002] In video conferencing systems, H.264 or H.265 codec protocols, known for their high compression efficiency, are typically used for encoding and decoding video streams. To improve efficiency and reduce power consumption, multi-core parallel DSP chips are generally employed. However, in existing multi-core systems, data tampering often occurs during image data transmission due to issues such as cache write-back anomalies and direct memory access (DMA) errors. Current image data false detection methods in codec systems primarily rely on the decoder's assessment of the regularity of syntax elements in the bitstream. This method cannot detect screen artifacts caused by tampering with residual data during transmission, nor can it detect screen artifacts caused by tampering with reference frame sequence data in the decoder. This results in both low detection efficiency and low accuracy.

[0003] Therefore, improving the efficiency and accuracy of false detection of image data in encoding and decoding systems has become an urgent problem to be solved. Summary of the Invention

[0004] The main objective of this invention is to provide an image data false detection method, a video conferencing device, and a storage medium. By verifying the decoded video frame image data based on supplementary enhancement information, this invention solves the problem of excessive detection overhead caused by the need to perform regularization judgment on each syntax element in the image data false detection process of existing codec systems, thereby improving the efficiency and accuracy of image data false detection in codec systems.

[0005] In a first aspect, embodiments of the present invention provide an image data false detection method, applied at a decoding end, comprising:

[0006] The encoding data and supplementary enhancement information output by the encoding end are obtained, wherein the supplementary enhancement information includes at least a first check value; the encoding data is decoded to obtain video frame image data corresponding to the encoding data; a second check value corresponding to the video frame image data is determined, and whether the video frame image data is abnormal is determined based on the first check value and the second check value.

[0007] Secondly, embodiments of the present invention provide an image data false detection method, applied at the encoding end, comprising:

[0008] Acquire encoded data and supplementary enhancement information; output the encoded data and supplementary enhancement information to the decoding end, so that the decoding end can decode the encoded data to obtain video frame image data, and determine whether the video frame image data is abnormal based on the supplementary enhancement information.

[0009] Thirdly, embodiments of the present invention also provide a video conferencing device, the video conferencing device including an encoding end and / or a decoding end, the encoding end including a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for realizing connection communication between the processor and the memory, wherein the computer program, when executed by the processor, implements the image data false detection method corresponding to the above-described encoding end;

[0010] The decoding end includes a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for connecting and communicating between the processor and the memory. When the computer program is executed by the processor, it implements the image data false detection method corresponding to the decoding end described above.

[0011] Fourthly, embodiments of the present invention also provide a storage medium for computer-readable storage, characterized in that the storage medium stores one or more programs, which can be executed by one or more processors to implement the steps of any of the image data false detection methods provided in this specification.

[0012] This invention provides an image data false detection method, a video conferencing device, and a storage medium. By acquiring the encoded data and supplementary enhancement information output from the encoding end, a first checksum corresponding to the encoded data can be obtained through the supplementary enhancement information. By decoding the encoded data, video frame image data corresponding to the encoded data can be obtained. By determining the second checksum corresponding to the video frame image data, it can be determined whether the video frame image data is abnormal based on the first checksum and the second checksum. This solves the problem that existing encoding and decoding systems require regularization judgment for each syntax element during image data false detection, resulting in excessive detection overhead, and improves the efficiency and accuracy of image data false detection in the encoding and decoding system.

[0013] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit the invention. Attached Figure Description

[0014] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1 This is a schematic diagram of the structure of an encoding / decoding system provided in an embodiment of the present invention;

[0016] Figure 2 This is a schematic diagram of another encoding / decoding system provided in an embodiment of the present invention;

[0017] Figure 3 This is a schematic block diagram of a decoding end provided in an embodiment of the present invention;

[0018] Figure 4 This is a schematic block diagram of an encoding end structure provided in an embodiment of the present invention;

[0019] Figure 5 A schematic flowchart illustrating an image data false detection method provided in an embodiment of the present invention;

[0020] Figure 6 This is a schematic block diagram illustrating the decoding of encoded data according to an embodiment of the present invention;

[0021] Figure 7 This is a schematic diagram of video frame image data provided in an embodiment of the present invention;

[0022] Figure 8 This is a schematic flowchart of another image data false detection method provided in an embodiment of the present invention;

[0023] Figure 9 This is a schematic flowchart illustrating a sub-step for acquiring encoded data and supplementary enhancement information provided in an embodiment of the present invention;

[0024] Figure 10 This is a schematic block diagram illustrating the encoding of raw video frame image data according to an embodiment of the present invention. Detailed Implementation

[0025] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0026] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0027] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0028] This invention provides an image data false detection method, a video conferencing device, and a storage medium. The image data false detection method can be applied to the decoding end. By verifying the decoded video frame image data based on supplementary enhancement information, it solves the problem that existing codec systems require regularization judgment for each syntax element during image data false detection, resulting in excessive detection overhead. This improves the efficiency and accuracy of image data false detection in the codec system.

[0029] For example, video conferencing equipment may include a server or a terminal. The server may be a standalone server or a server cluster; the terminal may be an electronic device such as a video conferencing terminal, smartphone, tablet, laptop, or desktop computer.

[0030] Video conferencing equipment may include both an encoding and decoding end, or it may include only one of them. It is understood that the encoding and decoding ends can be located within the same video conferencing equipment or in different video conferencing equipment.

[0031] Please see Figure 1 , Figure 1 This is a schematic diagram of the structure of an encoding / decoding system provided in an embodiment of the present invention. Figure 1 As shown, the encoding and decoding system includes a shooting device, an encoding end, and a decoding end; wherein, the decoding end is connected to the display screen, and the encoding end and the decoding end are in the same video conferencing equipment.

[0032] For example, the capturing device can send or copy the acquired raw video frame image data to the encoding end, where the encoding end encodes the raw video frame image data. After encoding the raw video frame image data, the encoding end obtains encoded data and reconstructed image data. Then, the encoding end verifies the reconstructed image data according to a preset check row number to obtain a first check value; and based on the first check value and the check row number, generates supplementary enhancement information, and outputs the encoded data and supplementary enhancement information to the decoding end. The decoding end decodes the encoded data to obtain the corresponding video frame image data; then, it verifies the video frame image data according to the supplementary enhancement information to determine whether the video frame image data is abnormal. When it is determined that the video frame image data is normal, the video frame image data is displayed on the screen; when it is determined that the video frame image data is abnormal, it requests the encoding end to refresh the image immediately.

[0033] It should be noted that by placing the encoding and decoding ends in the same video conferencing device, the problems often encountered in existing encoding and decoding systems, which, in order to improve efficiency and reduce performance, typically use multi-core parallel DSP chips for encoding and decoding and run the application layer on ARM chips. These problems frequently lead to data tampering due to cache write-back anomalies and direct memory storage anomalies. Furthermore, since the encoding and decoding ends are located in the same video conferencing device, interaction between them does not require network communication. This solves the problem of data tampering at the transport layer, where many intermediate switching elements in existing encoding and decoding systems, in order to reduce performance consumption, do not perform CRC (Cyclic Redundancy Check) on the bitstream packets.

[0034] Please see Figure 2 , Figure 2 This is a schematic diagram of another encoding / decoding system provided in an embodiment of the present invention. For example... Figure 2 As shown, the encoding and decoding system includes a shooting device, an encoding end, and a decoding end; wherein, the decoding end is connected to the display screen, and the encoding end and the decoding end are in different video conferencing devices.

[0035] It should be noted that when the encoding and decoding ends are on different video conferencing devices, verifying the decoded video frame image data based on supplementary enhancement information can solve the problem of data tampering at the transport layer caused by many intermediate switching network elements not performing CRC checks on the bitstream packets during network transmission in order to reduce performance consumption. Furthermore, verifying the decoded video frame image data based on supplementary enhancement information can also reduce computational load and improve detection efficiency, solving the problem of excessive detection overhead caused by the need for regularization checks on each syntax element in existing codec systems during false detection of image data.

[0036] In some embodiments, the decoding end obtains the encoded data and supplementary enhancement information output by the encoding end, wherein the supplementary enhancement information includes at least a first check value; the encoded data is decoded to obtain the video frame image data corresponding to the encoded data; a second check value corresponding to the video frame image data is determined, and whether the video frame image data is abnormal is determined based on the first check value and the second check value.

[0037] In some embodiments, the encoding end acquires encoded data and supplementary enhancement information; outputs the encoded data and supplementary enhancement information to the decoding end, so that the decoding end decodes the encoded data to obtain video frame image data, and determines whether the video frame image data is abnormal based on the supplementary enhancement information.

[0038] Please see Figure 3 , Figure 3 This is a schematic block diagram of a decoding end provided in an embodiment of the present invention. For example... Figure 3 As shown, the decoding end 1000 may include a processor 1001 and a memory 1002, wherein the processor 1001 and the memory 1002 can be connected by a bus, such as an I2C (Inter-integrated Circuit) bus or any applicable bus.

[0039] The memory 1002 may include a non-volatile storage medium and internal memory. The non-volatile storage medium may store an operating system and a computer program. The computer program includes program instructions that, when executed, cause the processor to perform the image data false detection method corresponding to the decoding end 1000.

[0040] The processor 1001 provides computing and control capabilities to support the operation of the entire decoding end 1000.

[0041] In one embodiment, the processor 1001 is configured to run a computer program stored in the memory 1002, and to perform the following steps when executing the computer program:

[0042] The encoding data and supplementary enhancement information output by the encoding end are obtained, wherein the supplementary enhancement information includes at least a first check value; the encoding data is decoded to obtain video frame image data corresponding to the encoding data; a second check value corresponding to the video frame image data is determined, and whether the video frame image data is abnormal is determined based on the first check value and the second check value.

[0043] In one embodiment, the supplementary enhancement information further includes a check row number, wherein the first check value is obtained by the encoding end verifying the reconstructed image data according to the check row number, and the reconstructed image data is generated by the encoding end when encoding the original video frame image data to obtain the encoded data; the processor 1001, when determining the second check value corresponding to the video frame image data, is configured to:

[0044] The video frame image data is verified according to the verification row number to obtain the second verification value corresponding to the video frame image data.

[0045] In one embodiment, when the processor 1001 verifies the video frame image data according to the verification row number to obtain the second verification value corresponding to the video frame image data, it is configured to:

[0046] Based on a preset pixel acquisition strategy, at least one target pixel corresponding to the video frame image data is obtained according to the verification row number; the second verification value is determined according to the sum of the pixel values ​​of the at least one target pixel.

[0047] In one embodiment, the processor 1001 implements a preset pixel acquisition strategy to acquire at least one target pixel corresponding to the video frame image data according to the verification row number, for the purpose of:

[0048] Number all pixels in the target row corresponding to the verification row number, and determine the number of the last pixel in the target row; determine the first target pixel in the target row, and determine the next target pixel in sequence based on a preset pixel interval value and the number of the last pixel.

[0049] In one embodiment, the processor 1001 is also configured to implement:

[0050] When the video frame image data is determined to be normal, the video frame image data is displayed; when the video frame image data is determined to be abnormal, a request is sent to the encoding end to immediately refresh the image frame.

[0051] The processor 1001 can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0052] Please see Figure 4 , Figure 4 This is a schematic block diagram of an encoding end structure provided in an embodiment of the present invention. For example... Figure 4 As shown, the encoding end 2000 may include a processor 2001 and a memory 2002, wherein the processor 2001 and the memory 2002 can be connected by a bus, such as an I2C (Inter-integrated Circuit) bus or any applicable bus.

[0053] The memory 2002 may include a non-volatile storage medium and internal memory. The non-volatile storage medium may store an operating system and a computer program. The computer program includes program instructions that, when executed, cause the processor to perform the image data false detection method corresponding to the encoding end 2000.

[0054] The processor 2001 provides computing and control capabilities to support the operation of the entire encoding end 2000.

[0055] In one embodiment, the processor 2001 is configured to run a computer program stored in the memory 2002, and to perform the following steps when executing the computer program:

[0056] Acquire encoded data and supplementary enhancement information; output the encoded data and supplementary enhancement information to the decoding end, so that the decoding end can decode the encoded data to obtain video frame image data, and determine whether the video frame image data is abnormal based on the supplementary enhancement information.

[0057] In one embodiment, the processor 2001, when acquiring encoded data and supplementary enhancement information, is used to:

[0058] The original video frame image data captured by the shooting device is acquired; the original video frame image data is encoded to obtain the encoded data and the reconstructed image data corresponding to the encoded data; the reconstructed image data is verified to obtain the supplementary enhancement information.

[0059] In one embodiment, when the processor 2001 verifies the reconstructed image data to obtain the supplementary enhancement information, it is configured to:

[0060] Based on the frame number and height value corresponding to the reconstructed image data, the verification row number corresponding to the reconstructed image data is determined; the reconstructed image data is verified based on the verification row number to obtain the first verification value corresponding to the reconstructed image data; the supplementary enhancement information is determined based on the first verification value and the verification row number.

[0061] The processor 2001 can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0062] The following detailed description of some embodiments of the present invention is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0063] Please see Figure 5 , Figure 5 This is a schematic flowchart illustrating an image data false detection method provided by an embodiment of the present invention. This image data false detection method can be applied to the decoding end. By verifying the decoded video frame image data based on supplementary enhancement information, it solves the problem of excessive detection overhead caused by the need for regularization judgment on each syntax element in existing encoding and decoding systems during image data false detection, thus improving the efficiency and accuracy of image data false detection in the encoding and decoding system. The image data false detection method includes steps S101 to S103.

[0064] Step S101: Obtain the encoded data and supplementary enhancement information output by the encoding end, wherein the supplementary enhancement information includes at least a first check value.

[0065] It should be noted that Supplemental Enhancement Information (SEI) is a concept within the context of the bitstream. SEI provides a way to add information to the video bitstream and is a feature of the H.264 / H.265 video codec protocol.

[0066] In this embodiment of the invention, the supplementary enhancement information is generated by the encoding end based on the reconstructed image data, and the supplementary enhancement information also includes a check row number. The first check value is obtained by the encoding end verifying the reconstructed image data based on the check row number. The reconstructed image data is generated by the encoding end when encoding the original video frame image data to obtain encoded data. It can be understood that the original video frame image data refers to the image data captured by the shooting device that has not been encoded.

[0067] For example, the shooting device can be a camera built into a video conferencing terminal, or it can include electronic devices with shooting functions such as laptops, mobile phones, and surveillance cameras.

[0068] For example, the encoding end can verify the reconstructed image data according to the preset verification row number to obtain the first verification value; then, based on the first verification value and the verification row number, supplementary enhancement information is generated.

[0069] It should be noted that the preset verification row number refers to the row number corresponding to the pixel in the reconstructed image data. For example, the first row of pixels, the third row of pixels, the seventh row of pixels, etc. in the reconstructed image data.

[0070] For example, the check row number is used by the encoding end to determine the position of the target pixel when calculating the first check value corresponding to the reconstructed image data, and also by the decoding end to determine the position of the target pixel when calculating the second check value corresponding to the decoded video frame image data.

[0071] In this embodiment of the invention, the decoding end can acquire the encoded data and supplementary enhancement information output by the encoding end through wired / wireless transmission, or by copying it to an external storage device. The specific method for acquiring the encoded data and supplementary enhancement information output by the encoding end is not limited here.

[0072] By acquiring the encoded data and supplementary enhancement information output from the encoding end, the verification line number and the first verification value can be obtained through the supplementary enhancement information. Subsequently, the decoded video frame image data can be verified using the verification line number and the first verification value.

[0073] Step S102: Decode the encoded data to obtain the video frame image data corresponding to the encoded data.

[0074] Please see Figure 6 , Figure 6 This is a schematic block diagram illustrating the decoding of encoded data according to an embodiment of the present invention. Figure 6 As shown, the decoding end can be based on the H.264 / H.265 encoding / decoding protocol. The decoding end inputs the encoded data into the decoder for decoding and outputs the corresponding video frame image data. It should be noted that the decoder is a single-input, single-output channel; after decoding the encoded data, the decoder does not output reconstructed image data separately.

[0075] By decoding the encoded data, the corresponding video frame image data can be obtained.

[0076] Step S103: Determine the second verification value corresponding to the video frame image data, and determine whether the video frame image data is abnormal based on the first verification value and the second verification value.

[0077] In this embodiment of the invention, the supplementary enhancement information may further include the verification line number corresponding to the reconstructed image data.

[0078] In some embodiments, determining the second check value corresponding to the video frame image data may include: verifying the video frame image data according to the check row number to obtain the second check value corresponding to the video frame image data.

[0079] By validating video frame image data based on the verification line number, it is not necessary to perform regularity checks on each syntax element, thereby improving the efficiency of false detection of image data.

[0080] For example, when verifying a video frame image, at least one target pixel corresponding to the video frame image data can be obtained based on a preset pixel acquisition strategy and the verification row number; and a second verification value can be determined based on the sum of the pixel values ​​of the at least one target pixel.

[0081] It should be noted that the preset pixel acquisition strategy refers to extracting at least one target pixel from the row containing the verification row number within the width value of the video frame image data.

[0082] In some implementations, based on a preset pixel acquisition strategy, at least one target pixel corresponding to the video frame image data is acquired according to the verification row number, including: numbering all pixels of the target row corresponding to the verification row number and determining the number of the last pixel of the target row; determining the first target pixel of the target row, and determining the next target pixel sequentially based on a preset pixel interval value and the number of the last pixel.

[0083] Please see Figure 7 , Figure 7 This is a schematic diagram of video frame image data provided in an embodiment of the present invention. For example... Figure 7As shown, if the verification row number is 1, then the first row of the video frame image data is taken as the target row; then all pixels in the first row are numbered, for example, pixel 0, pixel 1, pixel 2, ..., pixel n. Here, pixel n refers to the number of the last pixel in the first row. If the verification row number also includes 3, then all pixels in the third row can also be numbered.

[0084] For example, the preset pixel interval value can be set according to the actual situation, and the specific value is not limited here. In this embodiment of the invention, the preset pixel interval value can be 128.

[0085] like Figure 7 As shown, when the first target pixel of the target row is determined to be pixel 0, the next target pixel is determined to be pixel 256 based on the preset pixel interval value of 128; wherein, the code of the target pixel is not greater than the number n of the last pixel.

[0086] After determining at least one target pixel corresponding to the video frame image data, a second check value can be determined based on the sum of the pixel values ​​of at least one target pixel.

[0087] In this embodiment of the invention, the process of determining the second verification value can be implemented using a loop conditional expression, as shown below:

[0088]

[0089] Where j represents the pixel number; i represents the check row number; checkSum represents the second check value; Y i [j] represents the pixel value of the j-th pixel in the i-th row.

[0090] For example, for the first row, if the number n of the last pixel is 500, then the second check value checkSum is equal to Y1[0]+Y1

[128] +Y1

[256] +Y1

[384] .

[0091] By using a preset pixel acquisition strategy, at least one target pixel corresponding to the video frame image data is obtained according to the verification row number. Thus, the second verification value can be conveniently and accurately determined by calculating the sum of the pixel values ​​of at least one target pixel.

[0092] In this embodiment of the invention, after determining the second check value corresponding to the video frame image data, it can be determined whether the video frame image data is abnormal based on the first check value and the second check value.

[0093] In some embodiments, determining whether video frame image data is abnormal based on a first check value and a second check value may include: determining that the video frame image data is normal when the first check value is equal to the second check value.

[0094] It is understandable that since the first check value is obtained by the encoding end through checking the reconstructed image data based on the check row number, and the reconstructed image data is the same as the video frame image data before encoding, it is possible to determine whether the decoded video frame image data is consistent with the video frame image data before encoding based on the first check value and the second check value.

[0095] It should be noted that when the first checksum equals the second checksum, it indicates that the decoded video frame image data is consistent with the encoded data. The encoded data was not tampered with during transmission, and it was also not tampered with or subject to decoding errors during the decoding process. Therefore, it can be confirmed that the decoded video frame image data is normal.

[0096] In this embodiment of the invention, when it is determined that the video frame image data is normal, the video frame image data is displayed.

[0097] For example, video frame image data can be displayed on a screen. This screen is the display screen in the video conferencing equipment corresponding to the decoding end.

[0098] In other embodiments, determining whether the video frame image data is abnormal based on the first check value and the second check value may include: determining that the video frame image data is abnormal when the first check value is not equal to the second check value.

[0099] It should be noted that when the first checksum is not equal to the second checksum, it indicates that the decoded video frame image data is inconsistent with the encoded data. Therefore, it can be determined that the decoded video frame image data is abnormal. The abnormality may be caused by the encoded data being tampered with during network transmission, or by the encoded data being tampered with or a decoding error occurring during the decoding process.

[0100] By comparing the first check value and the second check value, it is possible to conveniently and accurately determine whether the video frame image data is abnormal, thereby improving the efficiency and accuracy of false detection of image data.

[0101] In some embodiments, when it is determined that the video frame image data is abnormal, a request is sent to the encoding end to immediately refresh the image frame.

[0102] It should be noted that the purpose of an IDR (Instantaneous Decoding Refresh) frame is to refresh the image immediately, preventing errors from propagating. Starting from an IDR frame, a new sequence is determined to begin decoding.

[0103] For example, the decoding end can send an IDR frame request message to the encoding end via wired or wireless communication, so that the encoding end can return an IDR frame based on the received IDR frame request message.

[0104] In this embodiment of the invention, the decoding end can establish a communication connection with the encoding end based on protocols such as SIP (Session Initiation Protocol), H.323 (audio and video transmission protocol), or RTCP (Real-time Control Protocol), and send IDR frame request messages to the encoding end.

[0105] For example, when the decoding end receives an IDR frame and encodes its image data, it can immediately clear the reference frame queue, output or discard all decoded video frame image data, search for a new parameter set, and start a new sequence. This way, if an error occurs in the previous video frame image data, an opportunity for resynchronization can be obtained.

[0106] By requesting an immediate refresh of the image frame from the encoding end when an anomaly is detected in the video frame image data, automatic image refresh can be achieved, thereby improving the user experience.

[0107] The image data false detection method, video conferencing equipment, and storage medium provided in the above embodiments, by acquiring the encoded data and supplementary enhancement information output by the encoding end, can obtain the verification line number and the first verification value through the supplementary enhancement information. Subsequently, the decoded video frame image data can be verified using the verification line number and the first verification value. By decoding the encoded data, the corresponding video frame image data can be obtained. By verifying the video frame image data according to the verification line number, there is no need to perform regularization judgment on each syntax element, thereby improving the efficiency of image data false detection. By obtaining at least one target pixel corresponding to the video frame image data according to the verification line number based on a preset pixel acquisition strategy, the second verification value can be conveniently and accurately determined by calculating the sum of the pixel values ​​of at least one target pixel. By comparing the first verification value and the second verification value, it is convenient and accurate to determine whether the video frame image data is abnormal, thereby improving the efficiency and accuracy of image data false detection. By requesting the encoding end to immediately refresh the image frame when it is determined that the video frame image data is abnormal, automatic image refresh can be achieved, thereby improving the user experience.

[0108] Please see Figure 8 , Figure 8This is a schematic flowchart illustrating another image data false detection method provided in this embodiment of the invention. This image data false detection method can be applied to the encoding end. By outputting the encoded data and supplementary enhancement information together to the decoding end, the decoding end can verify the decoded video frame image data based on the supplementary enhancement information. This solves the problem of excessive detection overhead caused by the need for regularization judgment on each syntax element in the image data false detection process of existing encoding and decoding systems, thus improving the efficiency and accuracy of image data false detection in the encoding and decoding system. This image data false detection method includes steps S201 and S202.

[0109] Step S201: Obtain encoded data and supplementary enhancement information.

[0110] Please see Figure 9 , Figure 9 This is an illustrative flowchart of a sub-step for obtaining encoded data and supplementary enhancement information provided in an embodiment of the present invention, which may specifically include steps S2011 to S2013.

[0111] Step S2011: Obtain the original video frame image data captured by the shooting device.

[0112] For example, during a video conference, the encoding end can acquire raw video frame image data captured in real time by the shooting device.

[0113] It is understandable that raw video frame image data refers to image data captured by the shooting device that has not been encoded.

[0114] For example, the shooting device may include electronic devices with shooting capabilities such as laptops, mobile phones, and surveillance cameras. The shooting device can be an electronic device built into the video conferencing equipment where the encoding end is located, or it can be an external electronic device with shooting capabilities.

[0115] For example, when acquiring the raw video frame image data captured by the shooting device, the raw video frame image data can be numbered. For example, the first video frame image data, the second video frame image data, the third video frame image data, etc. Thus, when encoding the raw video frame image data, reconstructed image data corresponding to each video frame image data is obtained.

[0116] Step S2012: Encode the original video frame image data to obtain the encoded data and the reconstructed image data corresponding to the encoded data.

[0117] In this embodiment of the invention, the encoding end can encode the original video frame image data to obtain encoded data and reconstructed image data.

[0118] Please see Figure 10 , Figure 10 This is a schematic block diagram illustrating the encoding of raw video frame image data according to an embodiment of the present invention. Figure 10 As shown, based on the H.264 / H.265 encoding and decoding protocol, the encoding end inputs the original video frame image data into the encoder for encoding, and outputs encoded data and reconstructed image data.

[0119] It should be noted that the encoder is a single-input dual-output channel; therefore, during the encoding process, the encoder encodes each frame of image data, outputs the encoded data, and simultaneously generates reconstructed image data in the reconstruction area.

[0120] For example, after encoding the first frame video frame image data, the first frame encoded data and the first frame reconstructed image data corresponding to the first frame video frame image data can be obtained.

[0121] By encoding the original video frame image data, we can obtain the encoded data and the corresponding reconstructed image. Subsequently, we can verify the reconstructed image data to obtain supplementary enhancement information.

[0122] Step S2013: Verify the reconstructed image data to obtain the supplementary enhancement information.

[0123] In some embodiments, verifying the reconstructed image data to obtain supplementary enhancement information may include: determining the verification row number corresponding to the reconstructed image data based on the frame number and height value corresponding to the reconstructed image data; verifying the reconstructed image data based on the verification row number to obtain a first verification value corresponding to the reconstructed image data; and determining supplementary enhancement information based on the first verification value and the verification row number.

[0124] It is understandable that the height value of the reconstructed image data can be the total number of rows of pixels in the reconstructed image data. Therefore, the height value can be determined based on the actual total number of rows of pixels in the reconstructed image data.

[0125] For example, when determining the verification row number corresponding to the reconstructed image data based on the frame number and height value, the verification row number can be determined based on the remainder of the ratio of the frame number to the height value.

[0126] For example, for the first frame of reconstructed image data, its frame number is 1; if the height value of the first frame of reconstructed image data is 10, then the remainder of the ratio of frame number 1 to height value 10 is 1, that is, the check row number is 1.

[0127] For example, for the reconstructed image data of the second frame, its frame number is 2; if the height value of the reconstructed image data of the second frame is 10, then the remainder of the ratio of frame number 2 to height value 10 is 2, that is, the check row number is 2.

[0128] For example, for the reconstructed image data of frame 11, its frame number is 11; if the height value of the reconstructed image data of frame 11 is 10, then the remainder of the ratio of frame number 11 to height value 10 is 1, that is, the check row number is 1.

[0129] In some embodiments, verifying the reconstructed image data according to the verification row number to obtain a first verification value corresponding to the reconstructed image data may include: obtaining at least one target pixel corresponding to the reconstructed image data according to the verification row number based on a preset pixel acquisition strategy; and determining the first verification value according to the sum of the pixel values ​​of the at least one target pixel.

[0130] In this embodiment of the invention, the process of determining the second verification value can be implemented using a loop conditional expression, as shown below:

[0131]

[0132] Here, checkSum represents the first check value.

[0133] The specific process for determining the first check value can be found in the detailed explanation of determining the second check value in the above embodiment, and the specific process will not be repeated here.

[0134] In some embodiments, after determining the first check value corresponding to the reconstructed image data, supplementary enhancement information can be determined based on the first check value and the check row number.

[0135] For example, if the first check value is A and the check row number is B, then the supplementary enhancement information includes the first check value A and the check row number B.

[0136] By determining the frame number and height value corresponding to the reconstructed image data, the verification row number of the reconstructed image data can be identified. By verifying the reconstructed image data based on the verification row number, the first verification value corresponding to the reconstructed image data can be obtained conveniently and accurately. Then, supplementary enhancement information can be obtained based on the first verification value and the verification row number.

[0137] Step S202: Output the encoded data and the supplementary enhancement information to the decoding end, so that the decoding end can decode the encoded data to obtain video frame image data, and determine whether the video frame image data is abnormal based on the supplementary enhancement information.

[0138] In this embodiment of the invention, the encoding end can output the encoded data and supplementary enhancement information to the decoding end via wired / wireless transmission, or via copying from an external storage device. The specific output method is not limited here.

[0139] For example, after receiving the encoded data and supplementary enhancement information output by the encoding end, the decoding end can decode the encoded data to obtain video frame image data, and determine whether the video frame image data is abnormal based on the supplementary enhancement information. For instance, the decoding end can determine whether the video frame image data is abnormal based on the first checksum in the supplementary enhancement information.

[0140] For details on determining whether the video frame image data is abnormal, please refer to the detailed description of the above embodiments; the specific process will not be repeated here.

[0141] By outputting the encoded data and supplementary enhancement information together to the decoder, the decoder can verify the decoded video frame image data based on the supplementary enhancement information. This solves the problem that existing codec systems require regularization judgment for each syntax element during image data false detection, resulting in excessive detection overhead. This improves the efficiency and accuracy of image data false detection in the codec system.

[0142] In some embodiments, after outputting the encoded data and supplementary enhancement information to the decoding end, the method may further include: if an IDR frame request information is received from the decoding end, then an IDR frame is returned to the decoding end according to the IDR frame request information.

[0143] By returning IDR frames to the decoder, the decoder can redetermine a new sequence based on the IDR frames and start decoding, thus automatically refreshing the image and improving the user experience.

[0144] The image data false detection method, video conferencing equipment, and storage medium provided in the above embodiments, by encoding the original video frame image data, can obtain encoded data and corresponding reconstructed image data. The reconstructed image data can then be verified to obtain supplementary enhancement information. By determining the verification line number corresponding to the reconstructed image data based on the frame number and height value, the first verification value corresponding to the reconstructed image data can be conveniently and accurately obtained by verifying the reconstructed image data based on the verification line number. Then, supplementary enhancement information can be obtained based on the first verification value and the verification line number. By outputting the encoded data and supplementary enhancement information together to the decoding end, the decoding end can verify the decoded video frame image data based on the supplementary enhancement information. This solves the problem of excessive detection overhead caused by performing regularization judgments on each syntax element during the image data false detection process in existing encoding and decoding systems, improving the efficiency and accuracy of image data false detection in the encoding and decoding system. By returning an IDR frame to the decoding end, the decoding end can redetermine a new sequence based on the IDR frame and start decoding, achieving automatic image refresh and thus improving the user experience.

[0145] This invention also provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs that can be executed by one or more processors to implement the steps of any of the image data false detection methods provided in the specification of this invention.

[0146] For example, when the program is loaded by the processor, it can perform the following steps:

[0147] The encoding data and supplementary enhancement information output by the encoding end are obtained, wherein the supplementary enhancement information includes at least a first check value; the encoding data is decoded to obtain video frame image data corresponding to the encoding data; a second check value corresponding to the video frame image data is determined, and whether the video frame image data is abnormal is determined based on the first check value and the second check value.

[0148] For example, once the program is loaded by the processor, it can perform the following steps:

[0149] Acquire encoded data and supplementary enhancement information; output the encoded data and supplementary enhancement information to the decoding end, so that the decoding end can decode the encoded data to obtain video frame image data, and determine whether the video frame image data is abnormal based on the supplementary enhancement information.

[0150] The storage medium can be the internal storage unit of the video conferencing device described in the foregoing embodiments, such as the hard drive or memory of the video conferencing device. Alternatively, the storage medium can be an external storage device of the video conferencing device, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the video conferencing device.

[0151] It will be understood by those skilled in the art that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware embodiments, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0152] It should be understood that the term "and / or" as used in this specification and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes such combinations. It should be noted that, herein, the terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0153] The sequence numbers of the above embodiments of the present invention are merely for descriptive purposes and do not represent the superiority or inferiority of the embodiments. The above descriptions are only specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for detecting false positives in image data, applied at a decoding end, the method comprising: The encoding end outputs encoded data and supplementary enhancement information, wherein the supplementary enhancement information includes at least a first check value and a check row number corresponding to the reconstructed image data. The first check value is obtained by the encoding end verifying the reconstructed image data according to the check row number. The reconstructed image data is generated by the encoding end in the reconstruction area when the encoding end encodes the original video frame image data to obtain the encoded data. The encoded data is decoded to obtain the video frame image data corresponding to the encoded data; The video frame image data is verified according to the verification row number to obtain the second verification value corresponding to the video frame image data. The video frame image data is then used to determine whether it is abnormal based on the first verification value and the second verification value.

2. The image data false detection method according to claim 1, characterized in that, The step of verifying the video frame image data according to the verification row number to obtain the second verification value corresponding to the video frame image data includes: Based on a preset pixel acquisition strategy, at least one target pixel corresponding to the video frame image data is obtained according to the verification row number; The second verification value is determined based on the sum of the pixel values ​​of the at least one target pixel.

3. The image data false detection method according to claim 2, characterized in that, The method based on a preset pixel acquisition strategy, which acquires at least one target pixel corresponding to the video frame image data according to the verification row number, includes: Number all pixels in the target row corresponding to the verification row number, and determine the number of the last pixel in the target row; The first target pixel in the target row is determined, and the next target pixel is determined sequentially based on a preset pixel interval value and the number of the last pixel.

4. The image data false detection method according to any one of claims 1-3, characterized in that, The method further includes: When it is determined that the video frame image data is normal, the video frame image data is displayed; When it is determined that the video frame image data is abnormal, a request is sent to the encoding end to immediately refresh the image frame.

5. A method for detecting false positives in image data, applied at the encoding end, the method comprising: Acquire encoded data and supplementary enhancement information, wherein the supplementary enhancement information includes at least a first check value and a check row number corresponding to the reconstructed image data, the first check value is obtained by the encoding end verifying the reconstructed image data according to the check row number, and the reconstructed image data is generated by the encoding end in the reconstruction area when the encoding end encodes the original video frame image data to obtain the encoded data; The encoded data and the supplementary enhancement information are output to the decoding end, so that the decoding end decodes the encoded data to obtain video frame image data, verifies the video frame image data according to the verification line number to obtain the second verification value corresponding to the video frame image data, and determines whether the video frame image data is abnormal based on the first verification value and the second verification value.

6. The image data false detection method according to claim 5, characterized in that, The acquisition of encoded data and supplementary enhancement information includes: Acquire raw video frame image data captured by the shooting device; The original video frame image data is encoded to obtain the encoded data and the reconstructed image data corresponding to the encoded data; The reconstructed image data is verified to obtain the supplementary enhancement information.

7. The image data false detection method according to claim 6, characterized in that, The step of verifying the reconstructed image data to obtain the supplementary enhancement information includes: Based on the frame number and height value corresponding to the reconstructed image data, determine the verification row number corresponding to the reconstructed image data; The reconstructed image data is verified according to the verification row number to obtain the first verification value corresponding to the reconstructed image data; The supplementary enhancement information is determined based on the first verification value and the verification row number.

8. A video conferencing device, characterized in that, The video conferencing equipment includes an encoding end and / or a decoding end, wherein, The encoding end includes a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for implementing communication between the processor and the memory, wherein the computer program, when executed by the processor, implements the image data false detection method as described in any one of claims 1 to 4; The decoding end includes a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for implementing communication between the processor and the memory, wherein the computer program, when executed by the processor, implements the image data false detection method as described in any one of claims 5 to 7.

9. A storage medium for readable storage, characterized in that, The storage medium stores one or more programs, which can be executed by one or more processors to achieve: The image data false detection method as described in any one of claims 1 to 4, or The image data false detection method as described in any one of claims 5 to 7.

Images