Protective device and method for image data processing modules, electronic equipment and storage medium

Abstract

An embodiment of the present disclosure discloses an apparatus and method, an electronic device, and a medium for protecting an image data processing module, in which the apparatus includes an input monitoring module connected to an input end of the image data processing module and used to monitor the input of the image data processing module to obtain an input monitoring result, an output monitoring module connected to an output end of the image data processing module and used to monitor the output of the image data processing module to obtain an output monitoring result, and a monitoring result processing module connected to the input monitoring module and the output monitoring module, respectively, and used to determine the operating state of the image data processing module based on the input monitoring result and the output monitoring result. The embodiment of the present disclosure can realize effective monitoring of the operating state of the image data processing module, does not require redundant hardware settings for the image data processing module, and realizes effectively reducing hardware overhead and power consumption overhead in ensuring the functional safety of the image data processing module.

Description

【Technical Field】 【0001】 This disclosure claims priority to a Chinese patent application filed on February 25, 2022, with application number 202210183590.0 and invention title "Protection Device and Method for Image Data Processing Module, Electronic Device, and Medium", and all of its content is incorporated herein by reference. 【0002】 This disclosure relates to image processing technology, and particularly to a protection device and method for an image data processing module, an electronic device, and a medium. 【Background Art】 【0003】 In fields where high functional safety of an image data processing module is highly required, such as an autopilot, in order to ensure the safety of the hardware function of the image data processing module, usually, the hardware logics of two sets of image data processing modules are set by means of hardware redundancy to check each other. However, due to hardware redundancy, the hardware overhead and power consumption increase significantly. 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0004】 In order to solve the technical problem that the hardware overhead and power consumption overhead caused by the above-mentioned hardware redundancy are relatively large, this disclosure is provided. Embodiments of this disclosure provide a protection device and method for an image data processing module, an electronic device, and a medium. 【Means for Solving the Problems】 【0005】 According to one embodiment of the present disclosure, a protection device for an image data processing module is provided, comprising: an input monitoring module connected to the input terminal of the image data processing module and used to monitor the input of the image data processing module and obtain input monitoring results; an output monitoring module connected to the output terminal of the image data processing module and used to monitor the output of the image data processing module and obtain output monitoring results; and a monitoring result processing module connected to the input monitoring module and the output monitoring module, respectively, and used to determine the operating state of the image data processing module based on the input monitoring results and the output monitoring results. 【0006】 According to another embodiment of the present disclosure, a method for protecting an image data processing module is provided, which includes the steps of: monitoring the input of the image data processing module and obtaining an input monitoring result; monitoring the output of the image data processing module and obtaining an output monitoring result; and determining the operating state of the image data processing module based on the input monitoring result and the output monitoring result. 【0007】 In yet another embodiment of the embodiments of the present disclosure, a computer-readable storage medium is provided, the storage medium is used to store a computer program, the computer program is used to perform the protection method for an image data processing module as described in any of the embodiments of the present disclosure, or the storage medium is used to store data that is necessary to be stored in at least one hardware logic circuit of the protection device for an image data processing module as described in any of the embodiments of the present disclosure, so that the hardware logic can realize a corresponding function when it is operating. 【0008】 In yet another embodiment of the embodiments of the present disclosure, an electronic device is provided, the electronic device comprising a processor and a memory used to store executable commands for the processor, the processor being used to read the executable commands from the memory and execute the executable commands to implement the method for protecting an image data processing module as described in any of the embodiments of the present disclosure, or the electronic device comprising a device for protecting an image data processing module as described in any of the embodiments, wherein at least one module in the device for protecting an image data processing module is implemented by hardware logic circuitry, or at least one unit in at least one module is implemented by hardware logic circuitry, or at least one subunit in at least one unit is implemented by hardware logic circuitry. [Effects of the Invention] 【0009】 Based on the protection device and method, electronic equipment, and medium for the image data processing module according to the above embodiment of this disclosure, the inputs and outputs of the image data processing module are monitored, and the operating state of the image data processing module is determined based on the monitoring results. This enables effective monitoring of the operating state of the image data processing module, and if an error occurs in the operating state, a corresponding error alarm signal can be output. This eliminates the need for redundant hardware settings for the image data processing module, and effectively reduces hardware overhead and power consumption overhead while ensuring the functional safety of the image data processing module. 【0010】 The technical solutions of this disclosure will be described in more detail below with reference to the drawings and embodiments. [Brief explanation of the drawing] 【0011】 The above and other purposes, features and advantages of this disclosure will become clearer by describing the embodiments of this disclosure in more detail with reference to the drawings. The drawings are used to provide a further understanding of the embodiments of this disclosure, constitute part of this specification, and are used to describe this disclosure together with the embodiments of this disclosure, and do not limit this disclosure. In the drawings, the same reference numerals generally indicate the same members or steps. 【0012】 [Figure 1] This is one exemplary application scenario of the protective device for the image data processing module related to this disclosure. [Figure 2] This is a schematic diagram of the structure of a protective device for an image data processing module according to one exemplary embodiment of the present disclosure. [Figure 3] This is a schematic diagram of the structure of an input monitoring module 21 according to one exemplary embodiment of the present disclosure. [Figure 4] This is a schematic diagram of the structure of an output monitoring module 22 according to one exemplary embodiment of the present disclosure. [Figure 5] This is a schematic diagram of the structure of a monitoring result processing module 23 according to one exemplary embodiment of the present disclosure. [Figure 6] This is a schematic diagram of the structure of a protective device for an image data processing module according to another exemplary embodiment of the present disclosure. [Figure 7] This is a schematic diagram of the structure of an input signal component monitoring unit 211 according to one exemplary embodiment of the present disclosure. [Figure 8] This is a schematic diagram of the structure of an output signal component monitoring unit 221 according to one exemplary embodiment of the present disclosure. [Figure 9] This is a schematic diagram of the structure of an input control signal monitoring unit 212 according to one exemplary embodiment of the present disclosure. [Figure 10] This is a schematic diagram of the structure of an output control signal monitoring unit 222 according to one exemplary embodiment of the present disclosure. [Figure 11] This is a schematic diagram of the structure of a protective device for an image data processing module according to yet another exemplary embodiment of the present disclosure. [Figure 12]It is a flowchart of a method for protecting an image data processing module according to one exemplary embodiment of the present disclosure. [Figure 13] It is a flowchart of a method for protecting an image data processing module according to another exemplary embodiment of the present disclosure. [Figure 14] It is a flowchart of step 401 according to one exemplary embodiment of the present disclosure. [Figure 15] It is a flowchart of step 501 according to one exemplary embodiment of the present disclosure. [Figure 16] It is a schematic structural diagram of one application embodiment of an electronic device according to the present disclosure. [Figure 17] It is a schematic structural diagram of another application embodiment of an electronic device according to the present disclosure. 【Embodiments for Carrying Out the Invention】 【0013】 Hereinafter, exemplary embodiments according to the present disclosure will be described in detail while referring to the drawings. It should be clearly understood that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments of the present disclosure, and the present disclosure is not limited by the exemplary embodiments described herein. 【0014】 It should be noted that unless there is a specific description, the relative arrangements, mathematical formulas and numerical values of the members and steps described in these embodiments do not limit the scope of the present disclosure. 【0015】 As those skilled in the art will understand, terms such as "first", "second", etc. in the embodiments of the present disclosure are used to distinguish different steps, devices or modules, etc., and do not represent any specific technical meaning, nor do they represent an inevitable logical order between them. 【0016】 Furthermore, in the embodiments of the present disclosure, it should be understood that "a plurality" may mean two or more, and "at least one" may mean one, two or more. 【0017】 The following description of at least one exemplary embodiment is purely illustrative and does not in any way limit the disclosure or its application or use. Note that in the following drawings, similar reference numerals and letters represent similar items, so that once an item is defined in one drawing, it does not need to be further examined in subsequent drawings. 【0018】 The embodiments of this disclosure are applicable to electronic devices such as terminal devices, computer systems, and servers, and can operate with many other general-purpose or dedicated computing system environments or configurations. Examples of well-known terminal devices, computing systems, environments and / or configurations suitable for use with electronic devices such as terminal devices, computer systems, and servers include, but are not limited to, personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, small computer systems, large computer systems, and distributed cloud computing technology environments including any of the above systems. 【0019】 Electronic devices such as terminal equipment, computer systems, and servers can be described in the general context of computer system executable commands (such as program modules) executed by computer systems. Generally, program modules may include routines, programs, object programs, components, logic, data structures, etc., that perform a specific task or implement a specific abstract data type. Computer systems / servers can be implemented in a distributed cloud computing environment, where tasks are executed by remote processing devices linked by a communication network. In a distributed cloud computing environment, program modules may reside on local or remote computing system storage media, including storage devices. 【0020】 Summary of this disclosure 【0021】 In the process of realizing this disclosure, the inventors found that in fields where high functional safety of image data processing modules is required, such as autopilots, the safety of the hardware functions of the image data processing module is usually ensured by setting up two sets of hardware logic for image data processing modules using hardware redundancy and having them check each other. However, hardware redundancy increases hardware overhead and power consumption. 【0022】 Example Overview 【0023】 Figure 1 shows one exemplary application scene of the image data processing module protection device according to the present disclosure. Here, the image data processing module protection device is abbreviated as the protection device, and the image data processing module to be protected is a hardware logic circuit or chip for realizing certain image data processing functions. For example, in the field of autopilot, it is a hardware logic circuit or chip that performs image data processing in an in-vehicle computing platform. In this example, the image data processing module is an image scaling module, which is used to perform scaling on an image. Scaling is the process of reducing or enlarging an image. The protection device of the present disclosure monitors the input and output of the image data processing module, determines the operating state of the image data processing module based on the monitoring results, and enables effective monitoring of the operating state of the image data processing module. If an error occurs in the operating state, it can output a corresponding error alarm signal. There is no need to configure redundant hardware for the image data processing module, and the hardware overhead and power consumption overhead of the protection device of the present disclosure are far smaller than those of a redundant image data processing module. Therefore, it effectively reduces hardware overhead and power consumption overhead in order to ensure the functional safety of the image data processing module. 【0024】 Naturally, the protection device of this disclosure is not only applicable to image scaling modules, but also to any image data processing module in which feature value invariance exists in the output image relative to the input image, such as modules used for image data processing such as image rotation transformation (where the image pixel values ​​remain unchanged, but the pixel positions are rotated), translation transformation (where the image pixel values ​​remain unchanged, but the pixel positions are translated), mirror transformation, and offset transformation (irregular movement). Here, feature value invariance is the property that, relative to the input image, the ratio of pixels with different luminances and the ratio of pixels with different chromaticities do not change in the entire or partial area of ​​the output image. For example, image scaling transforms the input image by enlarging or reducing its scale, but the ratio of pixels belonging to different luminances within it does not change. Based on feature value invariance, the device monitors the input and output to provide protection to the image data processing module and ensure the accuracy of image data processing. Based on this, the protection device of this disclosure is applicable to the protection of image data processing modules in any scene having such feature value invariance in any field, and this disclosure is not limited to specific fields or scenes. 【0025】 Exemplary device 【0026】 Figure 2 is a schematic diagram of the structure of a protection device for an image data processing module according to one exemplary embodiment of the present disclosure. This embodiment can be applied to electronic devices, specifically, for example, an in-vehicle computing platform, and as shown in Figure 2, the device includes an input monitoring module 21, an output monitoring module 22, and a monitoring result processing module 23. 【0027】 The input monitoring module 21 is connected to the input terminal of the image data processing module and is used to monitor the input of the image data processing module and obtain the input monitoring results. 【0028】 The output monitoring module 22 is connected to the output terminal of the image data processing module and is used to monitor the output of the image data processing module and obtain output monitoring results. 【0029】 The monitoring result processing module 23 is connected to the input monitoring module 21 and the output monitoring module 22, respectively, and is used to determine the operating state of the image data processing module based on the input monitoring results and the output monitoring results. 【0030】 Here, the image data processing module is any image processing module that has feature value invariance. The region in which its feature values ​​do not change is predetermined, and monitoring rules for the protective device are set accordingly to monitor the input and output. The operating state of the image data processing module may include two states: normal and error. If the operating state is normal, it indicates that the image data processing module is operating normally; otherwise, it indicates that an error has occurred in the image data processing module and that corresponding measures need to be taken. An error alarm signal can be output and reported to the CPU in a certain manner for processing, which can be specifically set according to the actual needs. 【0031】 In one possible example, the input of the image data processing module may include input image data, and accordingly, the output may include output image data. Accordingly, the input monitoring module 21 can monitor the input image data and obtain input monitoring results, the output monitoring module 22 can monitor the output image data and obtain corresponding output monitoring results, and the monitoring result processing module 23 determines the operating state of the image data processing module based on the input monitoring results and output monitoring results. 【0032】 In one selectable example, the input of the image data processing module may include an input control signal, and the corresponding output may include an output control signal. The input monitoring module 21 and the output monitoring module 22 monitor the input control signal and the output control signal, respectively, and obtain the input monitoring results and the output monitoring results. 【0033】 In one selectable example, the input of the image data processing module includes input image data and input control signals, the corresponding output includes output image data and output control signals, the input monitoring module 21 monitors the input image data and input control signals and obtains input monitoring results, and the output monitoring module 22 monitors the output image data and output control signals and obtains output monitoring results. 【0034】 The input control signal is a signal that controls the input of the input image data and may include, for example, related information such as a frame start signal, a frame end signal, and a row enable signal for the input image data. The output control signal is a signal that controls the output of the output image data and may include, for example, related information such as a frame start signal, a frame end signal, and a row enable signal for the output image data. 【0035】 The protection device for the image data processing module according to this embodiment monitors the input and output of the image data processing module and determines the operating state of the image data processing module based on the monitoring results, thereby achieving effective monitoring of the operating state of the image data processing module. If an error occurs in the operating state, it can output a corresponding error alarm signal. This eliminates the need to configure redundant hardware for the image data processing module and effectively reduces hardware overhead and power consumption overhead while ensuring the functional safety of the image data processing module. 【0036】 Figure 3 is a schematic diagram of the structure of an input monitoring module 21 according to one exemplary embodiment of the present disclosure. 【0037】 In one selectable example, the input monitoring module 21 includes an input signal component monitoring unit 211 used to sample component signals of the input image data of the image data processing module based on the input control signals of the image data processing module, obtain a first pixel value in each component, and obtain the number of first pixel values ​​included in each pixel range in each component as an input monitoring result, based on the pixel range to which the first pixel value in each component belongs. 【0038】 Here, the input control signal is a signal that controls the input of the input image data, and may include relevant information such as a frame start signal, a frame end signal, and a row enable signal for the input image data. Based on the input control signal, the start and end of one frame of the input image can be determined, thereby enabling sampling of the component signal of the input image for each frame. A component means a channel of an image; for example, if the input image data is in YUV data format, it includes three components: the Y channel, the U channel, and the V channel; or, for example, if the input image data is in RGB data format, it includes three components: the R channel, the G channel, and the B channel. The specific image data format can be set according to the actual needs, and this disclosure does not limit the specific image data format. A pixel value means a pixel feature element value, which is a value assigned when the image is digitized, and represents the brightness and chromaticity information of a pixel in the image; for example, with an 8-bit bit width, the pixel value is in the range of 0 to 255, and different levels represent different brightness and chromaticity. This disclosure divides a pixel value range (e.g., 0 to 255) into multiple pixel ranges, and the specific number of divisions can be set according to the actual needs. For example, the range 0 to 255 can be divided into 16 stages (i.e., 16 pixel ranges), 32 stages, etc., and this disclosure does not limit the specific number of divisions. After collecting the first pixel values ​​in each component of the input image data, each first pixel value can be classified into a corresponding pixel range. For example, if a first pixel value is 28 and it is divided into a total of 16 pixel ranges including 0 to 15 (first stage range), 16 to 31 (second stage range), 32 to 47, ..., 239 to 255 (sixteenth stage range), then the first pixel value belongs to the second stage range, 16 to 31. This allows the pixel range of each first pixel value in each component to be determined. Furthermore, by counting the number of first pixel values ​​included in each pixel range in each component, the number of first pixel values ​​included in each pixel range in each component can be obtained. 【0039】 The input signal component monitoring unit 211 of this disclosure can be implemented using any implementable logic circuit or software, and this embodiment is not limited to the input signal component monitoring unit 211. To ensure real-time data processing, it can be implemented using hardware logic circuitry. 【0040】 This disclosure allows for the calculation of the proportion of the number of first pixel values ​​in different pixel ranges by dividing the input image data into multiple pixel ranges, sampling the input image data, classifying the first pixel values ​​in each component into each pixel range, and counting them. By performing a similar calculation on the output image data, and based on the invariance of feature values ​​in image transformation, the proportion of pixels in the same pixel range in the same component of the output image data and the input image data must be the same or approximately the same. Therefore, it is possible to determine whether the processing process of the input image by the image data processing module is correct. If the proportion of the output image data differs significantly from that of the input image, it indicates to the image data processing module that an error has occurred and an error alarm signal can be issued. 【0041】 Figure 4 is a schematic diagram of the structure of an output monitoring module 22 according to one exemplary embodiment of the present disclosure. 【0042】 In one selectable example, the output monitoring module 22 includes an output signal component monitoring unit 221 used to sample the component signals of the output image data of the image data processing module based on the output control signal of the image data processing module, obtain a second pixel value in each component, and obtain the number of second pixel values ​​included in each pixel range in each component as an output monitoring result, based on the pixel range to which the second pixel value in each component belongs. 【0043】 Here, the output control signal is a signal that controls the output of the output image data, and may include, for example, related information such as a frame start signal, a frame end signal, and a row enable signal for the output image data. 【0044】 The operating principle of the output signal component monitoring unit 221 is the same as that of the input signal component monitoring unit 211, so we will omit the explanation here. 【0045】 The output signal component monitoring unit 221 of this disclosure can be implemented using any implementable logic circuit or software, and this embodiment is not limited to the output signal component monitoring unit 221. To ensure real-time data processing, it can be implemented using hardware logic circuitry. 【0046】 Furthermore, monitoring of input and output image data is performed on regions where the feature values ​​do not change after processing the image data. Specifically, if the feature values ​​of the entire image region do not change, the first pixel value sampled is the pixel value in the entire input image region, and the second pixel value sampled is the pixel value in the entire output image region. In cases where the feature values ​​of some regions of the image may change, such as with translational transformations or offset transformations, for example, a translational transformation moves some regions of the input image out of the current space and moves a new portion into the current space. This results in some regions of the output image having no corresponding pixels in the input image, and some regions of the input image having no corresponding pixels in the output image. In this case, it is necessary to set the sampling region according to the specific function of the image data processing, and the first and second pixel values ​​sampled are regions where the feature values ​​in the input and output images do not change, that is, regions where only the pixel position changes and the pixel value does not change. For example, in a translational transformation, region A on the left side of the input image becomes region B on the right side of the output image through the translational transformation. The first pixel value sampled is the pixel value in region A on the left side of the input image, and the second pixel value sampled is the pixel value in region B on the right side of the output image. The specific sampling region can be set according to actual needs, and this disclosure is not limited to a specific sampling region. 【0047】 Figure 5 is a schematic diagram of the structure of a monitoring result processing module 23 according to one exemplary embodiment of the present disclosure. 【0048】 In one selectable example, the input monitoring result includes the number of first pixel values ​​contained in each pixel range in each component corresponding to the input image data, the output monitoring result includes the number of second pixel values ​​contained in each pixel range in each component corresponding to the output image data, and the monitoring result processing module 23 includes a first processing unit 231, a first comparison unit 232, and a second processing unit 233. 【0049】 The first processing unit 231 is used to normalize the number of second pixel values ​​contained in each pixel range in each component based on the scaling ratio of the output image data to the input image data, and to obtain the normalized number of second pixel values ​​contained in each pixel range in each component. The first comparison unit 232 is used to compare the number of normalized second pixel values ​​contained in each pixel range in each component with the corresponding number of first pixel values ​​and to obtain a comparison result. The second processing unit 233 is used to determine whether an error has occurred in the image data processing module based on the comparison result, and if an error has occurred, to output an error alarm signal. 【0050】 Here, since the output image data is obtained by performing a certain transformation on the input image data, it is necessary to normalize the total number of second pixel values ​​to the same number as the total number of first pixel values ​​in each pixel range of each component in order to determine whether or not it is abnormal by comparing the number of first pixel values ​​with the number of second pixel values ​​in each pixel range of each component. For example, if the input image is 100*100 (10,000 pixels) and the image data processing module reduces the input image to 50*50 (2,500 pixels), then the number of second pixel values ​​in each pixel range of each component must all be multiplied by 4 to complete the normalization. Then, the normalized number of second pixel values ​​is compared with the corresponding number of first pixel values ​​to obtain the comparison result. 【0051】 Naturally, it is possible to compare the ratio of the number of first pixel values ​​to the number of second pixel values ​​in each pixel range for each component, and in this case, normalization is not necessary. The specific method can be set according to the actual needs. 【0052】 The decision rule for determining whether an error has occurred in the image data processing module based on the comparison results can be set according to the actual needs. For example, a quantity difference threshold may be set, and if the difference between the number of normalized second pixel values ​​and the number of corresponding first pixel values ​​for a certain pixel range in a certain component exceeds the quantity difference threshold, it is determined that an error has occurred. 【0053】 While the first processing unit 231, the first comparison unit 232, and the second processing unit 233 in this example can all be implemented using hardware logic circuits or software, this disclosure uses hardware logic circuits to ensure real-time performance. 【0054】 In one selectable example, Figure 6 is a schematic diagram of the structure of a protection device for an image data processing module according to another exemplary embodiment of the present disclosure. In this embodiment, the device of the present disclosure further includes a data storage module 24. The data storage module 24 is connected to an input monitoring module 21 and a first comparison unit 232, respectively, and is used to store input monitoring results acquired by the input monitoring module 21. The first comparison unit 232 is used to respond to a read trigger signal of a first processing unit 231, read the number of each first pixel value from the data storage module 24, and obtain a comparison result by comparing it with the number of each normalized second pixel value transmitted from the first processing unit 231. 【0055】 Here, the data storage module 24 can be implemented in any feasible form, for example, using a FIFO (First-In, First-Out) memory. The FIFO memory stores the number of first pixel values ​​for each pixel range in each component, and the values ​​are stored sequentially and cyclically according to the first-in, first-out rule. Subsequent modules need to issue read request signals to sequentially read the stored statistical information. A detailed explanation of the specific principles is omitted. 【0056】 Optionally, statistics for the first number of pixel values ​​may be implemented using a histogram statistics chip, and can be specifically configured according to actual needs. 【0057】 This disclosure facilitates the implementation of hardware logic by normalizing the number of second pixel values ​​in each pixel range within each component, thereby allowing for the determination of whether an error has occurred by comparing the number of first pixel values ​​in the same pixel range within the same component with the normalized number of second pixel values. 【0058】 In one selectable example, Figure 7 is a schematic diagram of the structure of an input signal component monitoring unit 211 according to one exemplary embodiment of the present disclosure. In this example, the input signal component monitoring unit 211 includes a first sampling subunit 2111, a first decision logic subunit 2112, a first count subunit 2113, and a first write subunit 2114. 【0059】 The first sampling subunit 2111 is used to sample the first pixel value in each component of the input image data; the first decision logic subunit 2112 is connected to the first sampling subunit 2111 and is used to determine the pixel range to which the first pixel value in each component belongs; the first count subunit 2113 is connected to the first decision logic subunit 2112 and is used to count the first pixel values ​​contained in each pixel range in each component and to obtain the number of first pixel values ​​contained in each pixel range in each component; and the first write subunit 2114 is connected to the first count subunit 2113 and is used to write the number of first pixel values ​​contained in each pixel range in each component to the data storage module 24. 【0060】 The first sampling subunit 2111 samples each first pixel value in each component from the input image data based on a preset sampling rule. The sampling rule can be set based on the data format of the input image data to be processed, and a detailed explanation is omitted. Each first pixel value is sent to the first decision logic subunit 2112, which determines the pixel range to which the first pixel value belongs. The first count subunit 2113 counts the number of first pixel values ​​in different pixel ranges in different components, and the count result is written to the data storage module 24 by the first write subunit 2114. 【0061】 In this example, any of the subunits among the first sampling subunit 2111, the first decision logic subunit 2112, the first count subunit 2113, and the first write subunit 2114 can be implemented in hardware or software, but in order to guarantee real-time performance, this disclosure is implemented by hardware logic circuitry. For example, the first decision logic subunit 2112 can determine the pixel range to which a first pixel value belongs by a combination of multiple comparators, and the first count subunit 2113 may be implemented using a counter, and can be specifically configured according to the actual needs. 【0062】 In one selectable example, Figure 8 is a schematic diagram of the structure of an output signal component monitoring unit 221 according to one exemplary embodiment of the present disclosure. In this example, the output signal component monitoring unit 221 includes a second sampling subunit 2211, a second decision logic subunit 2212, a second count subunit 2213, and a first output subunit 2214. 【0063】 The second sampling subunit 2211 is used to sample the second pixel value in each component of the output image data; the second decision logic subunit 2212 is connected to the second sampling subunit 2211 and is used to determine the pixel range to which the second pixel value in each component belongs; the second count subunit 2213 is connected to the second decision logic subunit 2212 and is used to count the second pixel values ​​contained in each pixel range in each component and to obtain the number of second pixel values ​​contained in each pixel range in each component; the first output subunit 2214 is connected to the second count subunit 2213 and the monitoring result processing module 23 and is used to output the number of second pixel values ​​contained in each pixel range in each component to the monitoring result processing module 23; and the monitoring result processing module 23 is used to determine the operating state of the image data processing module based on the input monitoring results and the number of second pixel values ​​contained in each pixel range in each component. 【0064】 The operating principles of each subunit of the output signal component monitoring unit 221 in this example are the same as those of each subunit of the input signal component monitoring unit 211, and therefore will not be explained here. 【0065】 Similarly, any of the subunits in this example may be implemented in hardware or in software, but may also be implemented using hardware logic circuits to ensure real-time performance. 【0066】 In one selectable example, the input monitoring module 21 further includes an input control signal monitoring unit 212 used to monitor whether the input control signals of the image data processing module are correct, and if they are incorrect, to output a corresponding error alarm signal. 【0067】 The input control signal includes relevant information such as the frame start signal, frame end signal, and row valid signal of the input image data. By monitoring the input control signal, the data frame interval time of the input image, the number of rows and columns of the input image per frame can be detected. This allows for the determination of whether or not an error has occurred in the frame interval time, number of rows, and number of columns, and if an error occurs, an error alarm signal can be output. 【0068】 This disclosure further improves monitoring effectiveness and ensures the operational accuracy of the image data processing module by monitoring input control signals. 【0069】 In one selectable example, Figure 9 is a schematic diagram of the structure of an input control signal monitoring unit 212 according to one exemplary embodiment of the present disclosure. In this embodiment, the input control signal includes a first frame start signal, a first frame end signal, and a first row enable signal of the input image data, and the input control signal monitoring unit 212 includes a first frame count subunit 2121, a first row count subunit 2122, a first column count subunit 2123, a first comparison logic subunit 2124, a second comparison logic subunit 2125, and a third comparison logic subunit 2126. 【0070】 The first frame count subunit 2121 is used to record the first frame interval time of the input image data based on the first frame start signal and the first frame end signal of the input control signal; the first row count subunit 2122 is used to record the number of pixels in each row in each frame of the input image data based on the first frame start signal, the first frame end signal and the first row valid signal of the input control signal; the first column count subunit 2123 is used to record the number of rows in each frame of the input image data based on the first frame start signal, the first frame end signal and the first row valid signal of the input control signal; and the first comparison logic subunit 2124 is used in conjunction with the first frame count subunit 212 The second comparison logic subunit 2125 is connected to the first row count subunit 2122 and is used to output a corresponding error alarm signal based on the relationship between the length of time between the first frame interval time and the first preset interval time. The second comparison logic subunit 2125 is connected to the first row count subunit 2122 and is used to output a corresponding error alarm signal based on the relationship between the number of pixels in each row in each frame of the input image data and the first preset number threshold. The third comparison logic subunit 2126 is connected to the first column count subunit 2123 and is used to output a corresponding error alarm signal based on the relationship between the number of rows in each frame of the input image data and the first preset row number threshold. 【0071】 Here, the first frame start signal represents the start of one frame of the input image, the first frame end signal represents the end of one frame of the input image, the first row enable signal is used to identify one row of data in the input image of that frame, and the pull-down of the first row enable signal represents the end of one row. Based on this, the frame interval time of the input image data (called the first frame interval time) can be measured, and based on the first frame start signal, the first frame end signal, and the first row enable signal, the number of pixel rows and columns (i.e., the number of pixels per row) in one frame image can be counted. Specifically, the content of one row is identified by the first row enable signal, the number of pixels in each row is determined by counting the pixel values ​​in that row, the start of one row is identified by the pull-up (rising edge) of the first row enable signal, and the end of one row is identified by the pull-down (falling edge), and based on the pull-up and pull-down of the first row enable signal, the number of rows in the frame image can be counted. The specific principle of triggering the count with different signals is omitted from this explanation. If any of the first frame interval times is greater than a first preset interval time, it is determined that a frame loss error has occurred. If the number of pixels in any row in any frame is not equal to a first preset threshold, it is determined that an image row error has occurred. If the number of rows in any frame is not equal to a first preset threshold for the number of rows, it is determined that an image row error has occurred. The occurrence of any error generates a corresponding error alarm signal, allowing relevant parties to take timely corrective action. 【0072】 The first frame count subunit 2121's count of frame interval time is reset at the start of each frame, the first row count subunit 2122's count of pixels per row is reset at the end of each row, and the first column count subunit 2123's count of rows in the input image per frame is reset at the end of each input image per frame. 【0073】 In this example, any of the subunits—the first frame count subunit 2121, the first row count subunit 2122, the first column count subunit 2123, the first comparison logic subunit 2124, the second comparison logic subunit 2125, and the third comparison logic subunit 2126—can be implemented in hardware or software, but may be implemented using hardware logic circuits to ensure real-time performance. 【0074】 This disclosure determines whether an error has occurred by counting and comparing the frame interval time, the number of rows and columns per frame of the input image data, thereby more effectively monitoring the operational accuracy of the image data processing module and enabling timely detection of errors and timely countermeasures. 【0075】 In one selectable example, the output monitoring module 22 further includes an output control signal monitoring unit 222 used to monitor whether the output control signals of the image data processing module are correct, and if they are incorrect, to output a corresponding error alarm signal. 【0076】 The specific operating principle of the output control signal monitoring unit 222 is the same as that of the input control signal monitoring unit 212, and therefore will not be explained here. 【0077】 In one selectable example, Figure 10 is a schematic diagram of the structure of an output control signal monitoring unit 222 according to one exemplary embodiment of the present disclosure. In this example, the output control signal includes a second frame start signal, a second frame end signal, and a second row enable signal of the output image data, and the output control signal monitoring unit 222 includes a second frame count subunit 2221, a second row count subunit 2222, a second column count subunit 2223, a fourth comparison logic subunit 2224, a fifth comparison logic subunit 2225, and a sixth comparison logic subunit 2226. 【0078】 The second frame count subunit 2221 is used to record the second frame interval time of the output image data based on the second frame start signal and the second frame end signal of the output control signal; the second row count subunit 2222 is used to record the number of pixels in each row in each frame of the output image data based on the second frame start signal, the second frame end signal and the second row valid signal of the output control signal; the second column count subunit 2223 is used to record the number of rows in each frame of the output image data based on the second frame start signal, the second frame end signal and the second row valid signal of the output control signal; and the fourth comparison logic subunit 2224 is used to record the second frame count subunit 222 The fifth comparison logic subunit 2225 is connected to the second row count subunit 2222 and is used to output a corresponding error alarm signal based on the relationship between the length of time between the second frame interval time and the second preset interval time. The fifth comparison logic subunit 2225 is connected to the second row count subunit 2222 and is used to output a corresponding error alarm signal based on the relationship between the number of pixels in each row in each frame of the output image data and the second preset number threshold. The sixth comparison logic subunit 2226 is connected to the second column count subunit 2223 and is used to output a corresponding error alarm signal based on the relationship between the number of rows in each frame of the output image data and the second preset row number threshold. 【0079】 The specific operation of each subunit of the output control signal monitoring unit 222 in this example is the same as the specific operation of each subunit of the input control signal monitoring unit 212 described above, and therefore will not be explained here. 【0080】 Any of the subunits in this example can be implemented using hardware or software, but to ensure real-time performance, they may also be implemented using hardware logic circuits. 【0081】 This disclosure determines whether an error has occurred by counting and comparing the frame interval time, the number of rows and columns per frame of the output image data, thereby more effectively monitoring the operational accuracy of the image data processing module and enabling timely detection of errors and timely countermeasures. 【0082】 In one selectable example, Figure 11 is a schematic diagram of the structure of a protection device for an image data processing module according to yet another exemplary embodiment of the present disclosure. In this embodiment, the input signal component monitoring unit 211 samples the component signals of the input image data of the image data processing module based on the input control signal of the image data processing module, obtains a first pixel value in each component, and obtains the number of first pixel values ​​included in each pixel range in each component as an input monitoring result based on the pixel range to which the first pixel value in each component belongs, and stores it in the data storage module 24. The output signal component monitoring unit 221 samples the component signals of the output image data of the image data processing module based on the output control signal of the image data processing module, obtains the second pixel value in each component, obtains the number of second pixel values ​​included in each pixel range in each component as an output monitoring result based on the pixel range to which the second pixel value in each component belongs, and outputs it to the first processing unit 231. The first processing unit 231 normalizes the number of second pixel values ​​included in each pixel range in each component based on the scaling ratio of the output image data to the input image data, obtains the normalized number of second pixel values ​​included in each pixel range in each component, outputs it to the first comparison unit 232, and issues a read trigger signal to the first comparison unit 232. The first comparison unit 232 responds to the read trigger signal from the first processing unit 231, reads the number of each first pixel value from the data storage module 24, compares it with the normalized number of each second pixel value transmitted from the first processing unit 231 to obtain a comparison result, and outputs it to the second processing unit 233. The second processing unit 233 determines whether an error has occurred in the image data processing module based on the comparison result, and outputs an error alarm signal if an error has occurred. The input control signal monitoring unit 212 monitors whether the input control signal of the image data processing module is correct, and outputs a corresponding error alarm signal if it is incorrect. The output control signal monitoring unit 222 monitors whether the output control signal of the image data processing module is correct, and outputs a corresponding error alarm signal if it is incorrect. 【0083】 In one possible example, to ensure the real-time nature of the protective device, each module, unit within each module, and subunit within each unit of the protective device of this disclosure is implemented using hardware logic circuits, thereby effectively reducing hardware overhead and power consumption overhead in ensuring the functional safety of the image data processing module, and guaranteeing the real-time nature of error alarms. This avoids serious consequences due to insufficient timely error alarms during use. For example, in the field of autopilot, it is possible to effectively monitor the image data processing module of the in-vehicle computing platform in real time, detect errors in a timely manner, avoid the occurrence of hazards, and thereby effectively improve safety. When implemented using pure hardware, hardware initialization is required, i.e., the pixel range, input image sampling area, output image sampling area, various thresholds, and other related information must be initialized. After initialization, it can operate automatically and does not need to be combined with software. 【0084】 Exemplary Method 【0085】 Figure 12 is a flowchart of a method for protecting an image data processing module according to one exemplary embodiment of the present disclosure, which can be implemented by any of the devices of the above embodiment. As shown in Figure 12, the method of the present disclosure is Step 301 involves monitoring the input of an image data processing module and obtaining the input monitoring result, Step 302 involves monitoring the output of the image data processing module and obtaining the output monitoring result, The process includes step 303, which determines the operating state of the image data processing module based on the input monitoring results and output monitoring results. 【0086】 The specific operations of each step of the method disclosed herein will be described in detail in the embodiments of the apparatus described above, and will not be described here. 【0087】 Figure 13 is a flowchart of a method for protecting an image data processing module according to another exemplary embodiment of the present disclosure. 【0088】 In one selectable example, step 301 involves monitoring the input of an image data processing module and obtaining the input monitoring result. Step 3011 involves sampling the component signals of the input image data of the image data processing module based on the input control signal of the image data processing module and obtaining a first pixel value for each component, The method includes step 3012, which obtains the number of first pixel values ​​included in each pixel range in each component as an input monitoring result, based on the pixel range to which the first pixel value in each component belongs. 【0089】 In one selectable example, step 302 involves monitoring the output of the image data processing module and obtaining the output monitoring result. Step 3021 involves sampling the component signals of the output image data of the image data processing module based on the output control signal of the image data processing module and obtaining a second pixel value for each component, The method includes step 3022, which obtains the number of second pixel values ​​included in each pixel range in each component as an output monitoring result, based on the pixel range to which the second pixel value in each component belongs. 【0090】 In one selectable example, the input monitoring result includes the number of first pixel values ​​in each pixel range in each component corresponding to the input image data, and the output monitoring result includes the number of second pixel values ​​in each pixel range in each component corresponding to the output image data. Accordingly, step 303 determines the operating state of the image data processing module based on the input monitoring result and the output monitoring result. Step 3031: Based on the scaling ratio of the output image data to the input image data, normalize the number of second pixel values ​​contained in each pixel range in each component, and obtain the normalized number of second pixel values ​​contained in each pixel range in each component. Step 3032 involves comparing the number of normalized second pixel values ​​contained in each pixel range in each component with the corresponding number of first pixel values ​​to obtain a comparison result. The procedure includes step 3033, which determines whether an error has occurred in the image data processing module based on the comparison results, and outputs an error alarm signal if an error has occurred. 【0091】 In one selectable example, after step 301, the method of the present disclosure further includes the step of storing the input monitoring results in a data storage module. 【0092】 Accordingly, step 3032 includes reading the number of each first pixel value from the data storage module and comparing it with the normalized number of each second pixel value to obtain a comparison result. 【0093】 In one selectable example, step 3012, which obtains the number of first pixel values ​​included in each pixel range in each component as an input monitoring result based on the pixel range to which the first pixel value in each component belongs, includes the steps of determining the pixel range to which the first pixel value in each component belongs, and counting the first pixel values ​​included in each pixel range in each component, and obtaining the number of first pixel values ​​included in each pixel range in each component as an input monitoring result. 【0094】 In one selectable example, step 3022, which obtains the number of second pixel values ​​contained in each pixel range in each component based on the pixel range to which the second pixel value in each component belongs, includes the steps of determining the pixel range to which the second pixel value in each component belongs, and counting the second pixel values ​​contained in each pixel range in each component to obtain the number of second pixel values ​​contained in each pixel range in each component, and step 303 is specifically used to determine the operating state of the image data processing module based on the input monitoring results and the number of second pixel values ​​contained in each pixel range in each component. 【0095】 In one possible example, the method of this disclosure further: Step 401 includes monitoring whether the input control signal of the image data processing module is correct, and if it is incorrect, outputting a corresponding error alarm signal. Steps 401 and 301 can be performed in any order. 【0096】 In one selectable example, Figure 14 is a flowchart of step 401 according to one exemplary embodiment of the present disclosure, in which the input control signals include a first frame start signal, a first frame end signal, and a first row enable signal of the input image data, and step 401 is, Step 4011: Record a first frame interval time of input image data based on a first frame start signal and a first frame end signal of the input control signal. Step 4012 records the number of pixels in each row in each frame of the input image data based on the first frame start signal, the first frame end signal, and the first row enable signal of the input control signals. Step 4013 records the number of rows in each frame of the input image data based on the first frame start signal, the first frame end signal, and the first row enable signal of the input control signals. Step 4014 involves comparing a first frame interval time with a first preset interval time and outputting a corresponding error alarm signal based on the relationship between the length of the first frame interval time and the first preset interval time. Step 4015 outputs a corresponding error alarm signal based on the relationship between the number of pixels in each row of each frame of the input image data and a first preset threshold number. Step 4016 includes outputting a corresponding error alarm signal based on the relationship between the number of rows in each frame of the input image data and a first preset row threshold, Steps 4011-4013 can be performed in any order, and steps 4014-4016 can be performed in any order. 【0097】 In one possible example, the method of this disclosure further: The process further includes step 501, which monitors whether the output control signal of the image data processing module is correct, and if it is incorrect, outputs a corresponding error alarm signal. Steps 501 and 302 can be performed in any order. 【0098】 In one selectable example, Figure 15 is a flowchart of step 501 according to one exemplary embodiment of the present disclosure, in which the output control signal includes a second frame start signal, a second frame end signal and a second row enable signal of the output image data, and step 501 is, Step 5011 records the second frame interval time of the output image data based on the second frame start signal and the second frame end signal of the output control signal, Step 5012 records the number of pixels in each row in each frame of the output image data based on the second frame start signal, the second frame end signal, and the second row enable signal of the output control signal. Step 5013 records the number of rows in each frame of the output image data based on the second frame start signal, second frame end signal, and second row enable signal of the output control signal. Step 5014 involves comparing a second frame interval time with a second preset interval time and outputting a corresponding error alarm signal based on the relative lengths of the second frame interval time and the second preset interval time. Step 5015 outputs a corresponding error alarm signal based on the relationship between the number of pixels in each row of each frame of the output image data and a second preset threshold number. The process includes step 5016, which outputs a corresponding error alarm signal based on the relationship between the number of rows in each frame of the output image data and a second preset row threshold. 【0099】 Any method for protecting an image data processing module according to the embodiments of this disclosure can be executed by any suitable device having data processing capabilities, including but not limited to terminal devices and servers. Alternatively, any method for protecting an image data processing module according to the embodiments of this disclosure can be executed by a processor, for example, by calling a corresponding command stored in memory. Alternatively, any method for protecting an image data processing module according to the embodiments of this disclosure can be executed by a hardware logic circuit device. Further explanation is omitted below. 【0100】 Exemplary electronic device 【0101】 Embodiments of this disclosure include memory used to store computer programs, Further providing is an electronic device including a processor used to execute a computer program stored in the memory, which, when the computer program is executed, implements a method for protecting an image data processing module as described in any of the embodiments of this disclosure. 【0102】 Alternatively, the electronic device may include a protection device for the image data processing module according to any of the above embodiments to implement the method for protecting the image data processing module described in any of the above embodiments of this disclosure. 【0103】 Here, at least one module in the protection device of the image data processing module is implemented by hardware logic circuitry, or at least one unit in at least one module is implemented by hardware logic circuitry, or at least one subunit in at least one unit is implemented by hardware logic circuitry. 【0104】 To improve real-time performance, each module in the device, each unit within each module, and each subunit within each unit are all implemented using hardware logic circuits; in other words, the entire device is a hardware logic circuit. 【0105】 Figure 16 is a schematic diagram of the structure of one application embodiment of the electronic device of the present disclosure. In this embodiment, the electronic device 10 includes one or more processors 11 and memory 12. 【0106】 The processor 11 can be a central processing unit (CPU) or another form of processing unit having data processing capability and / or command execution capability, and can control other components in the electronic device 10 to perform desired functions. 【0107】 The memory 12 may include one or more computer program products, which may include various forms of computer-readable storage media such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program commands can be stored in the computer-readable storage media, and the processor 11 can implement the methods of each embodiment of the present disclosure and / or other desired functions by executing the program commands. Various contents such as input signals, signal components, and noise components can also be stored in the computer-readable storage media. 【0108】 In one example, the electronic device 10 may further include input devices 13 and output devices 14 that are interconnected via a bus system and / or other forms of connection mechanisms (not shown). 【0109】 For example, the input device 13 may be the microphone or microphone array described above, and is used to capture the input signal of a sound source. The input device 13 may also be an image acquisition sensor such as a camera, and is used to collect image data. 【0110】 Furthermore, the input device 13 may include, for example, a keyboard or a mouse. 【0111】 The output device 14 can output various types of information, including determined distance information and direction information, to an external source. The output device 14 may include, for example, a display, a speaker, a printer, a communication network, and remote output devices connected thereto. 【0112】 Naturally, for the sake of simplification, Figure 16 shows only some of the components within the electronic device 10 that are relevant to this disclosure, omitting components such as buses and input / output interfaces. Furthermore, depending on the specific application, the electronic device 10 may include any other appropriate components. 【0113】 Figure 17 is a schematic diagram of the structure of another application embodiment of the electronic device of the present disclosure. In this embodiment, the electronic device includes a protection device for an image data processing module according to any of the above embodiments or examples, and may further include other related devices, which are not described herein. At least one module in the protection device for an image data processing module is implemented by hardware logic circuitry, or at least one unit in at least one module is implemented by hardware logic circuitry, or at least one subunit in at least one unit is implemented by hardware logic circuitry. 【0114】 For example, to improve real-time performance, all modules in the protection device for the image data processing module are implemented using hardware logic circuits. 【0115】 Exemplary computer program products and computer-readable storage media 【0116】 The embodiments of this disclosure may also include, in addition to the above-described methods and apparatus, computer program products that, when executed by a processor, cause the processor to perform the steps in the various embodiments of the disclosure described in the “Exemplary Methods” section of this specification. 【0117】 The computer program product can be made in any combination of one or more programming languages ​​to produce program code for performing the operations of the embodiments of the Disclosure, and such programming languages ​​include object-oriented programming languages ​​such as Java and C++, and also include conventional procedural programming languages ​​such as C or similar programming languages. The program code may run entirely on a user computing device, partially on a user computing device, run as a standalone software package, run partly on a user's device and partly on a remote computing device, or run entirely on a remote computing device or server. 【0118】 Furthermore, embodiments of the present disclosure may be computer-readable storage media that, when executed by a processor, store computer program commands causing the processor to perform the steps in the various embodiments of the present disclosure described in the “Exemplary Methods” section of this specification. 【0119】 The storage medium of this disclosure can also store data that needs to be stored by at least one hardware logic circuit of the protection device of the image data processing module described in the "Exemplary Devices" section of this disclosure, so that the hardware logic circuit can implement the corresponding function during operation. For example, the storage medium is a register of the hardware logic circuit, which stores initial setting data or data that needs to be stored during operation, and is not specifically limited. Here, at least one hardware logic circuit may be a hardware logic circuit of a module in the device, a hardware logic circuit of a unit in a module, or a hardware logic circuit of a subunit in a unit, and is not specifically limited. 【0120】 The computer-readable storage medium may employ any combination of one or more readable media. The readable media may be a readable signal medium or a readable storage medium. The readable storage medium may include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any combination thereof. More specific examples (non-exclusive list) of readable storage media include electrical connections with one or more wires, mobile hard drives, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. 【0121】 While the basic principles of this disclosure have been explained above in conjunction with specific examples, the advantages, advantages, and effects mentioned in this disclosure are not limiting but merely illustrative, and it should not be assumed that various examples of this disclosure will necessarily possess those advantages, advantages, and effects. Furthermore, the specific details disclosed above are merely illustrative and serve to facilitate understanding, and are not limiting, and the details do not necessarily limit the implementation of this disclosure in the specific details described above. 【0122】 Each example in this specification is described progressively, with each example focusing on its differences from other examples, and any identical or similar parts between examples should be referred to from one another. System examples are described briefly, as they essentially correspond to method examples, and relevant sections should be referred to the description of the method examples. 【0123】 The block diagrams of the devices, apparatus, equipment, and systems relating to this disclosure are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will see, these devices, apparatus, equipment, and systems may be connected, arranged, or configured in any manner. Words such as “include,” “contain,” and “have” are open vocabulary and mean “including, but not limited to,” and can be used interchangeably. The words “or” and “and” as used herein mean “and / or,” and can be used interchangeably unless the context clearly indicates otherwise. The word “for example” as used herein means “for example, but not limited to,” and can be used interchangeably. 【0124】 Furthermore, in the apparatus, equipment, and methods of this disclosure, each component or step can be disassembled and / or reassembled. Such disassembly and / or reassembly should be considered equivalent solutions of this disclosure.

Claims

[Claim 1] An input monitoring module connected to the input terminal of an image data processing module and used to monitor the input of the image data processing module and obtain input monitoring results, An output monitoring module connected to the output terminal of the image data processing module and used to monitor the output of the image data processing module and obtain output monitoring results, Includes a monitoring result processing module connected to the input monitoring module and the output monitoring module, respectively, which determines the operating state of the image data processing module based on the input monitoring result and the output monitoring result, The input monitoring result includes the number of first pixel values ​​included in each pixel range in each component corresponding to the input image data, and the output monitoring result includes the number of second pixel values ​​included in each pixel range in each component corresponding to the output image data. Each pixel range is obtained by dividing the pixel value range; this is a protective device for an image data processing module. [Claim 2] The aforementioned input monitoring module is The apparatus according to claim 1, further comprising an input signal component monitoring unit used to sample component signals of input image data of the image data processing module based on an input control signal of the image data processing module, obtain a first pixel value in each component, and obtain the number of first pixel values ​​included in each pixel range of each component as the input monitoring result, based on the pixel range to which the first pixel value in each component belongs. [Claim 3] The aforementioned input signal component monitoring unit is: A first sampling subunit used to sample a first pixel value in each component of the input image data, A first decision logic subunit connected to the first sampling subunit and used to determine the pixel range to which the first pixel value in each component belongs, A first count subunit connected to the first decision logic subunit is used to count the first pixel values ​​included in each pixel range in each component and to obtain the number of first pixel values ​​included in each pixel range in each component, The apparatus according to claim 2, further comprising: a first write subunit connected to the first count subunit and used to write the number of first pixel values ​​included in each of the pixel ranges in each of the components to a data storage module. [Claim 4] The aforementioned input monitoring module is The apparatus according to claim 2, further comprising an input control signal monitoring unit used to monitor whether the input control signal of the image data processing module is correct or not, and to output a corresponding error alarm signal if it is incorrect. [Claim 5] The input control signal includes a first frame start signal, a first frame end signal, and a first row enable signal of the input image data, and the input control signal monitoring unit is A first frame count subunit used to record a first frame interval time of the input image data based on the first frame start signal and the first frame end signal of the input control signal, A first row count subunit used to record the number of pixels in each row of each frame of the input image data, based on the first frame start signal, the first frame end signal, and the first row enable signal of the input control signal, A first column count subunit used to record the number of rows in each frame of the input image data based on the first frame start signal, the first frame end signal, and the first row enable signal of the input control signal, A first comparison logic subunit is connected to the first frame count subunit and is used to compare the first frame interval time with a first preset interval time and to output a corresponding error alarm signal based on the relationship between the length of the first frame interval time and the first preset interval time. A second comparison logic subunit is connected to the first row count subunit and is used to output a corresponding error alarm signal based on the relationship between the number of pixels in each row in each frame of the input image data and a first preset threshold number. The apparatus according to claim 4, further comprising: a third comparison logic subunit connected to the first column count subunit and used to output a corresponding error alarm signal based on the relationship between the number of rows in each frame of the input image data and a first preset row threshold. [Claim 6] The output monitoring module described above is: The apparatus according to claim 1, further comprising an output signal component monitoring unit used to sample component signals of output image data of the image data processing module based on the output control signal of the image data processing module, obtain a second pixel value in each component, and obtain the number of second pixel values ​​included in each pixel range of each component as the output monitoring result, based on the pixel range to which the second pixel value in each component belongs. [Claim 7] The output signal component monitoring unit is: A second sampling subunit used to sample a second pixel value in each component of the output image data, A second decision logic subunit connected to the second sampling subunit and used to determine the pixel range to which the second pixel value in each component belongs, A second count subunit connected to the second decision logic subunit is used to count the second pixel values ​​included in each pixel range in each component and to obtain the number of second pixel values ​​included in each pixel range in each component, The system includes the second count subunit and the first output subunit connected to the monitoring result processing module, which is used to output to the monitoring result processing module the number of second pixel values ​​included in each of the pixel ranges in each of the components, The apparatus according to claim 6, wherein the monitoring result processing module is used to determine the operating state of the image data processing module based on the input monitoring result and the number of second pixel values ​​included in each of the pixel ranges in each of the components. [Claim 8] The output monitoring module described above is: The apparatus according to claim 6, further comprising an output control signal monitoring unit used to monitor whether the output control signal of the image data processing module is correct, and to output a corresponding error alarm signal if it is incorrect. [Claim 9] The aforementioned monitoring result processing module is: A first processing unit used to normalize the number of second pixel values ​​included in each pixel range in each component based on the scaling ratio of the output image data with respect to the input image data, and to obtain the normalized number of second pixel values ​​included in each pixel range in each component, A first comparison unit used to obtain a comparison result by comparing the number of normalized second pixel values ​​included in each pixel range in each component with the corresponding number of first pixel values, The apparatus according to claim 1, further comprising: a second processing unit used to determine whether an error has occurred in the image data processing module based on the comparison result, and to output an error warning signal if an error has occurred. [Claim 10] The steps include monitoring the input of an image data processing module and obtaining the input monitoring result, The steps include: monitoring the output of the image data processing module and obtaining the output monitoring result; The step includes determining the operating state of the image data processing module based on the input monitoring results and the output monitoring results, The input monitoring result includes the number of first pixel values ​​included in each pixel range in each component corresponding to the input image data, and the output monitoring result includes the number of second pixel values ​​included in each pixel range in each component corresponding to the output image data. A method for protecting an image data processing module, wherein each pixel range is obtained by dividing the pixel value range. [Claim 11] A computer-readable storage medium storing a computer program used to perform the protection method for the image data processing module described in claim 10 when executed by a processor. [Claim 12] Processor and The processor includes memory used to store executable commands, The processor is used to read the executable command from the memory and to execute the executable command in order to implement the protection method for the image data processing module described in claim 10, in an electronic device.

Images