A method, apparatus, electronic device, and storage medium for determining screen freezing

Abstract

The present invention discloses a method, apparatus, electronic device and storage medium for judging picture freezing. The method includes: controlling a fill light to perform fill light according to a preset fill light change rule; determining image processing parameters when a fill light change zeroing condition is satisfied, and controlling a shooting device to perform image processing according to the image processing parameters; wherein the shooting device is a fixed-point shooting device or a moving-point shooting device; determining an image to be analyzed output after the shooting device performs image processing during the fill light process of the fill light, and judging whether the shooting device has picture freezing according to the image to be analyzed. The present invention can accurately judge whether the picture of the shooting device is frozen.

Description

Technical Field

[0001] The present invention relates to the technical field of image processing, and in particular, to a method, apparatus, electronic device, and storage medium for judging picture freeze. Background Art

[0002] Picture freeze means that the image output by the shooting device pauses on a certain frame and no longer updates the display content in real time. The main reasons for picture freeze are the overload or crash of the main control of the shooting device. However, in some specific scenarios, even when the shooting device is working normally, there may be situations where the scene of the image does not change, or only the display time in the image changes. For example, in the scenario of monitoring an instrument with a card camera, if the instrument does not change for a long time, the image output by the card camera will also remain unchanged for a long time. Another example is in the scenario of forest night fire prevention with a pan-tilt camera. When there is no ignition point and the pan-tilt camera stays at a preset position, the captured image may also show no change.

[0003] Currently, in the existing technology, there is a lack of a technical solution to determine whether the picture freeze is caused by the overload or crash of the main control of the shooting device or by the unchanged shooting scene of the shooting device when the image does not change for a long time. Summary of the Invention

[0004] The present invention provides a method, apparatus, electronic device, and storage medium for judging picture freeze to accurately judge whether the picture of the shooting device is frozen.

[0005] In a first aspect, an embodiment of the present invention provides a method for judging picture freeze, the method including:

[0006] Controlling a fill light to perform fill light according to a preset fill light change rule;

[0007] Determining image processing parameters when the fill light change zeroing condition is satisfied, and controlling the shooting device to perform image processing according to the image processing parameters;

[0008] Wherein, the shooting device is a fixed-point shooting device or a moving-point shooting device;

[0009] Determining an image to be analyzed output by the shooting device after image processing during the fill light of the fill light, and judging whether the shooting device is picture frozen according to the image to be analyzed.

[0010] In a second aspect, an embodiment of the present invention further provides another method for judging picture freeze, the method including:

[0011] Controlling a moving-point shooting device to rotate in the horizontal direction and / or the vertical direction;

[0012] Determine the image to be analyzed output by the moving-point shooting device, and determine whether the moving-point shooting device has a frozen picture according to the image to be analyzed.

[0013] In a third aspect, an embodiment of the present invention further provides a device for judging a frozen picture, and the device includes:

[0014] A fill light control module, configured to control a fill light to perform fill light according to a preset fill light change rule;

[0015] An image processing parameter control module, configured to determine image processing parameters when a fill light change zeroing condition is satisfied, and control a shooting device to perform image processing according to the image processing parameters;

[0016] Wherein, the shooting device is a fixed-point shooting device or a moving-point shooting device;

[0017] A first frozen picture judgment module, configured to determine an image to be analyzed output after the shooting device performs image processing during the fill light of the fill light, and determine whether the shooting device has a frozen picture according to the image to be analyzed.

[0018] In a fourth aspect, an embodiment of the present invention further provides another device for judging a frozen picture, and the device includes:

[0019] A pan-tilt control module, configured to control a moving-point shooting device to rotate in a horizontal direction and / or a vertical direction;

[0020] A second frozen picture judgment module, configured to determine the image to be analyzed output by the moving-point shooting device, and determine whether the moving-point shooting device has a frozen picture according to the image to be analyzed.

[0021] In a fifth aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the program, it implements the method for judging a frozen picture as described in any one of the embodiments of the present invention.

[0022] In a sixth aspect, an embodiment of the present invention further provides a storage medium storing computer-executable instructions, and when the computer-executable instructions are executed by a computer processor, they are used to execute the method for judging a frozen picture as described in any one of the embodiments of the present invention.

[0023] In the technical solution of the embodiment of the present invention, by controlling the fill light to perform fill light according to the fill light change rule, during the fill light process, controlling the imaging device to perform image processing according to the image processing parameters when the fill light change returns to zero, and judging whether the imaging device has a frozen screen according to the image to be analyzed output by the imaging device. This solves the problem in the prior art that when the image screen remains unchanged for a long time, it is impossible to accurately determine whether it is caused by the frozen screen of the imaging device or due to the unchanged shooting scene, and realizes the accurate judgment of whether the screen of the imaging device is frozen.

[0024] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present invention, nor is it used to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0026] Figure 1 is a flowchart of a method for judging a frozen screen provided in Embodiment 1 of the present invention;

[0027] Figure 2 is a flowchart of a method for judging a frozen screen provided in Embodiment 2 of the present invention;

[0028] Figure 3 is a flowchart of another method for judging a frozen screen provided in Embodiment 3 of the present invention;

[0029] Figure 4 is a schematic structural diagram of a device for judging a frozen screen provided in Embodiment 4 of the present invention;

[0030] Figure 5 is a schematic structural diagram of another device for judging a frozen screen provided in Embodiment 5 of the present invention;

[0031] Figure 6 is a schematic structural diagram of an electronic device provided in Embodiment 6 of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0032] To enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of protection of the present invention.

[0033] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices. In the embodiments of the present application, certain industry-existing solutions such as certain software, components, models, etc. may be mentioned. They should be regarded as exemplary, and their purpose is only to illustrate the feasibility in the implementation of the technical solutions of the present application, but it does not mean that the applicant has already or necessarily used this solution.

[0034] In the technical solution of the present application, the acquisition, transmission, storage, use, processing, etc. of data all comply with the relevant regulations of national laws and regulations.

[0035] Embodiment 1

[0036] Figure 1 FIG. 13 is a flowchart of a method for judging picture freezing provided in Embodiment 1 of the present invention. This embodiment is applicable to the situation of judging whether the shooting device freezes the picture. This method can be executed by a judging device for picture freezing. The judging device for picture freezing can be implemented in the form of hardware and / or software. The judging device for picture freezing can be configured in a server or an image management device and used in cooperation with a fixed-point shooting device or a moving-point shooting device.

[0037] As Figure 1 shown, the method includes:

[0038] S110. Control the fill light to perform fill light according to a preset fill light change rule.

[0039] Among them, the fill light can be deployed in the shooting device or set independently of the shooting device. Through the fill light control module, the fill light is controlled to ensure that the fill light can perform fill light according to the preset fill light change rule. Specifically, the server can send a fill light instruction to the fill light control module, and the fill light control module controls the fill light to perform fill light.

[0040] The light of the fill light needs to be able to shine into the field of view of the shooting device so that the shooting device can perceive it during normal operation. However, in this embodiment, there is no limitation on the specific position of the light irradiation in the field of view of the shooting device during fill light and the proportion of the light irradiation range in the field of view of the shooting device.

[0041] The fill light change rule refers to the change of the color, brightness, etc. of the light within a fill light change cycle, and the light of the fill light changes according to the fill light change rule.

[0042] Furthermore, the fill light change rule includes a light color change rule and / or a light brightness change rule.

[0043] The light color change rule refers to the change of the RGB (Red Green Blue) color mode of the light within a fill light change cycle, where it can be the change of a certain color channel or the change of multiple color channels.

[0044] In a specific example, the fill light change rule can be one fill light change cycle per 1 minute. Within one fill light change cycle, the brightness of the fill light remains unchanged, the G value and the B value remain fixed, for example, both remain 0. In the first 30 seconds, the R value of the fill light increases from 128 to 255, and in the last 30 seconds, the R value of the fill light decreases from 255 to 128. It is reflected that the light of the fill light changes from dark red to bright red in the first 30 seconds and returns from bright red to dark red in the last 30 seconds within one fill light change cycle.

[0045] In another specific example, the fill light change rule can be one fill light change cycle per 1 minute. Within one fill light change cycle, the brightness of the fill light remains unchanged. In the first 20 seconds, the G value and the B value are 0, and the R value increases from 128 to 255. In the middle 20 seconds, the R value and the B value are 0, and the G value increases from 128 to 255. In the last 20 seconds, the R value and the G value are 0, and the B value increases from 128 to 255. It is reflected that the light of the fill light changes from dark red to bright red in the first 20 seconds, from dark green to bright green in the middle 20 seconds, and from dark blue to bright blue in the last 20 seconds within one fill light change cycle.

[0046] The law of light brightness change refers to the change of light brightness within a supplementary light change cycle. In a specific example, the supplementary light change cycle can be 1 minute. Within a supplementary light change cycle, the brightness of the supplementary light gradually increases from 0 to 100 lm (lumen) in the first 30 seconds, and then decreases from 100 lm to 0 in the next 30 seconds. Further, the brightness can be controlled to change according to the sine wave law to achieve smooth brightness change.

[0047] Further, when the supplementary light is provided according to the law of supplementary light change, it is necessary to ensure that the normal shooting of the shooting device is not affected. For example, in the scenario of monitoring the instrument through a digital camera, the brightness and color changes of the supplementary light during supplementary light provision should not affect the monitoring effect of the camera on the instrument. That is, after introducing the supplementary light change, the instrument area in the monitoring image should be clear and easy to identify.

[0048] It can be understood that in this embodiment, by introducing a regular change of light into the field of view of the shooting device and then determining whether the regular change of light is reflected in the image output by the shooting device, it is determined whether the shooting device has a frozen frame. Therefore, in this embodiment, it is first necessary to ensure that the supplementary light is in a normal working state. Specifically, the server can judge whether the supplementary light control module is working properly through a heartbeat mechanism. Or, a current transformer with communication function can also be connected to the negative pole of the supplementary light. When there is current in the current transformer, the supplementary light can be normally controlled, and the server judges whether the supplementary light is in a normal working state by communicating with the current transformer.

[0049] Further, in this embodiment, a trigger condition for the supplementary light setting can be set to control the supplementary light to be provided according to the preset law of supplementary light change: determine the similarity between two consecutive images output by the shooting device. For example, the similarity can be calculated by using picture blocks and calculating the motion vectors of the corresponding divided blocks. The calculation method of similarity in this embodiment is not limited. If it is determined that a continuous preset number of similarities are all greater than or equal to the similarity threshold, then control the supplementary light to be provided according to the preset law of supplementary light change. Judging the frozen frame after detecting that the image does not change can reduce the consumption of computing resources.

[0050] In this embodiment, by introducing regularly changing supplementary light and making the supplementary light shine into the field of view of the shooting device, when the shooting device is working normally, the output image can reflect the light change situation, so that it can be distinguished whether the frozen frame of the image is caused by the abnormal shooting device or the actual shooting scene has not changed.

[0051] S120. Determine the image processing parameters when the supplementary light change return-to-zero condition is satisfied, and control the shooting device to perform image processing according to the image processing parameters.

[0052] Among them, the image processing parameters refer to the parameters adjusted when an Image Signal Processor (ISP) processes the raw image collected by the image sensor of the shooting device. Exemplarily, the image processing parameters may include AE (Auto Exposure), AWB (Auto White Balance), or Gain, etc. This embodiment does not limit the type and quantity of the image processing parameters.

[0053] In an optional embodiment, determining the image processing parameters when the fill light change return-to-zero condition is met may include: before controlling the fill light to perform fill light according to the preset fill light change rule, saving the latest image processing parameters in the image signal processor, and using this image processing parameter as the image processing parameter when the fill light change return-to-zero condition is met.

[0054] In another optional embodiment, meeting the fill light change return-to-zero condition may further include: if it is determined according to the fill light change rule that the color of the fill light is within the color change range, and / or the brightness of the fill light is within the brightness change range, then it is determined that the fill light change return-to-zero condition is met.

[0055] Among them, the color change range may refer to the color change range corresponding to white light. For example, it may refer to the case where the R value, G value, and B value are all 255; or the R value is 255, the G value is 210 - 230, and the B value is 180 - 200; or the R value, G value, and B value are all 250 - 255. This embodiment does not limit this.

[0056] The brightness change range may be that the brightness of the fill light is 0, or the brightness of the fill light is 0 - 10 lm. This embodiment does not limit this.

[0057] The color change range and the brightness change range match the fill light change rule. Specifically, since the fill light change rule is the change process of the fill light within a fill light change cycle, therefore, if the fill light change rule is the light color change rule, the color change range is the RGB value range when the color of the fill light is relatively stable and "normal" during the change process. Taking the fill light change rule as an example of sequentially performing red light, green light, and blue light conversion within a fill light change cycle, since the change of the light color is a gradual change process, that is, within a fill light change cycle, it is actually a process of white light - red light - white light - green light - white light - blue light. Therefore, at this time, the RGB value range corresponding to white light is used as the color change range. If the fill light change rule is the light brightness change rule, the brightness change range is the range where the fill light brightness is 0 or relatively small during the change process.

[0058] The shooting device is a fixed-point shooting device or a moving-point shooting device. A fixed-point shooting device refers to a shooting device with a relatively fixed position, which is installed at a specific position and usually does not move. A moving-point shooting device refers to a shooting device that can change its position or angle, usually equipped with a pan-tilt head (used to control the rotation of the shooting device in the horizontal and vertical directions) or a moving device (such as a track, a drone, etc.), and can flexibly adjust the shooting position and angle as needed. It can be understood that since the present embodiment affects the image effect by introducing fill light changes, there is no limitation on whether the shooting device is a moving point or a fixed point.

[0059] Control the shooting device to perform image processing according to the image processing parameters. Specifically, it means controlling the image signal processor to use fixed image processing parameters for image processing when processing the original image collected by the image sensor of the shooting device.

[0060] It can be understood that when the image signal processor processes the original image collected by the image sensor of the shooting device, it will perform automatic exposure adjustment, automatic white balance adjustment, color correction, noise reduction processing, etc., in order to obtain a clearer, more balanced and natural image. When the fill light is on, the image signal processor will continuously adjust various image processing parameters in the above processing process as the fill light color or brightness changes. For example, if the fill light is red light, the image signal processor will reduce the gain of the red channel, while appropriately increasing the gain of the blue and green channels, and may also adjust the parameters of the color correction matrix, or adjust the noise reduction parameters of the red channel, etc., so that the adjusted image is more balanced and natural. The adjusted image effect will weaken the effect presented by the fill light color and / or fill light brightness change in the original image, which may cause the change of the fill light color and / or fill light brightness to be not obvious in the image output by the shooting device, resulting in a misjudgment of the picture freeze.

[0061] Therefore, in this embodiment, obtaining the image processing parameters when the fill light change returns to zero and fixing these image processing parameters for processing the original image can avoid the adjustment of the image processing parameters from weakening the influence of the fill light color and / or fill light brightness change on the image effect, thereby improving the accuracy of subsequent picture freeze judgment.

[0062] S130. Determine the image to be analyzed output after the shooting device performs image processing during the fill light process of the fill light, and judge whether the shooting device has a picture freeze according to the image to be analyzed.

[0063] In this embodiment, the fill light performs fill light according to a preset fill light rule, the image processor of the shooting device collects the original image, the image signal processor determines the image processing parameters when the fill light change returns to zero, and fixes these image processing parameters to process the collected original image, and finally outputs the image as the image to be analyzed.

[0064] Further, during the supplementary light process of the fill light, the to-be-analyzed images output after the image processing by the shooting device are determined, including: determining each to-be-analyzed image output after the image processing by the shooting device during the supplementary light process of the fill light within the screen freeze analysis period; wherein, the screen freeze analysis period is greater than or equal to the supplementary light change period of the fill light.

[0065] Wherein, the screen freeze analysis period is the shortest time period for continuously acquiring the to-be-analyzed images and performing screen freeze judgment based on each to-be-analyzed image acquired during this period. The screen freeze analysis period needs to be greater than or equal to the supplementary light change period of the fill light.

[0066] It can be understood that since in this embodiment, by introducing regular supplementary light, it is judged whether a corresponding image effect is generated in the image output by the shooting device. Therefore, the duration of continuously monitoring the to-be-analyzed images output needs to be at least greater than or equal to a supplementary light change period to avoid misjudgment of screen freeze caused when the to-be-analyzed images monitored happen to be the images acquired during the period when the supplementary light change in the supplementary light change period returns to zero, thereby improving the accuracy of screen freeze judgment.

[0067] In an optional embodiment, to judge whether the shooting device has a frozen screen according to the to-be-analyzed images, taking the light brightness change rule as the supplementary light change rule as an example, for each continuously acquired to-be-analyzed image, its brightness mean value is determined, and the maximum value and the minimum value among the brightness mean values of each to-be-analyzed image are determined. If it is determined that the difference between the maximum value and the minimum value of the brightness mean value is greater than or equal to a preset brightness mean value difference threshold, and / or the time interval between the to-be-analyzed images corresponding to the maximum value and the minimum value of the brightness mean value matches the supplementary light change period (for example, the difference between the time interval and the supplementary light change period is less than the time difference threshold, or the supplementary light change period is an integer multiple of the time interval), it is determined that the shooting device has not frozen the screen.

[0068] Correspondingly, taking the light color change rule as the supplementary light change rule as an example, for each continuously acquired to-be-analyzed image, its color mean value is determined, and the maximum value and the minimum value among the color mean values of each to-be-analyzed image are determined. If it is determined that the difference between the maximum value and the minimum value of the color mean value is greater than or equal to a preset color mean value difference threshold, and / or the time interval between the to-be-analyzed images corresponding to the maximum value and the minimum value of the color mean value matches the supplementary light change period (for example, the difference between the time interval and the supplementary light change period is less than the time difference threshold, or the supplementary light change period is an integer multiple of the time interval), it is determined that the shooting device has not frozen the screen.

[0069] It should be noted that the brightness mean difference threshold and the color mean difference threshold can be set accordingly according to the change range of brightness or color in the fill light change rule, and this embodiment does not limit this.

[0070] It can be understood that if the imaging device does not freeze the screen and can work normally, for each image to be analyzed continuously obtained within the screen freeze analysis period, compared with before the fill light, the change in the fill light brightness during the fill light change period will affect the brightness of the image to be analyzed output by the imaging device, and the change in the fill light color will affect the color of the image to be analyzed output by the imaging device. Also, since the screen freeze analysis period is greater than or equal to the fill light change period, each image to be analyzed can at least cover the influence of the fill light change on the image effect within one fill light change period. Therefore, in this embodiment, by judging whether the difference between the maximum value and the minimum value of the brightness mean or color mean within the screen freeze analysis period is greater than or equal to a preset threshold, the judgment of whether the imaging device works normally is carried out. Such a setting can avoid misjudgment of screen freeze caused by the change in the brightness mean of the image to be analyzed due to the change in the ambient light brightness, and improve the accuracy of screen freeze judgment.

[0071] When the imaging device works normally, the image effect will be affected by the change in the fill light brightness and / or color. At the same time, this influence situation is consistent with the fill light change rule. Since the form of the fill light change rule is diverse, not limited to linear form or sine wave form, etc., and at the same time, the influence relationship of the fill light change rule on the image effect does not necessarily show a linear relationship, this embodiment does not limit the specific form of the change of the image effect with the fill light change rule. However, the change rule of the image effect should be consistent with the fill light change rule. Therefore, in this embodiment, by determining the time interval between the images to be analyzed corresponding to the maximum value and the minimum value of the brightness mean or color mean, and judging whether this time interval is consistent with the fill light change period, or the fill light change period is an integer multiple of the time interval, the judgment of whether the change period of the image effect is the same as the fill light change period is carried out.

[0072] In another optional embodiment, to judge whether the imaging device freezes the screen according to the image to be analyzed, it can also be realized according to the brightness variance and / or color variance of each image to be analyzed. The specific process is similar to the above embodiment, and this embodiment will not be elaborated here.

[0073] It is understandable that the average brightness can represent the overall light and dark degree of an image, and the average brightness of the image will increase to varying degrees during fill light. The brightness variance is used to measure the degree of dispersion of the pixel brightness values in the image relative to the average brightness, and can represent the distribution of the image brightness. Since the fill light range of the fill light is usually only a partial area in the field of view of the shooting device, the brightness variance of the image will increase during fill light. Similarly, the average color can represent the overall color tendency of the image. When filling light, for example, when filling red light, the increase in the pixel color values in the red channel leads to an increase in the average color. The color variance measures the degree of dispersion of the pixel color values in each color channel relative to the average color of that channel, and can reflect the uniformity of the image color distribution. Therefore, the color variance of the image will increase during fill light.

[0074] In yet another optional embodiment, it is also possible to determine the fill light area in the image to be analyzed based on whether the shooting device has a frozen frame in the image to be analyzed. Among them, the position and size of the fill light area can be determined by pre-calibration. Taking the fill light change rule as the light brightness change rule as an example, it is determined whether the shooting device has a frozen frame according to the average brightness and / or brightness variance of the fill light area in each image to be analyzed. Correspondingly, when the fill light change rule is the light color change rule, it is determined whether the shooting device has a frozen frame according to the average color and / or color variance of the fill light area in each image to be analyzed. The specific process is similar to the above embodiment, and will not be elaborated here.

[0075] In this embodiment, by parameters such as the average brightness, brightness variance, average color, and color variance of the image to be analyzed, it is determined whether the brightness of each image to be analyzed changes with the change of the fill light brightness and / or whether the color of each image to be analyzed changes with the change of the fill light color during the frozen frame analysis period; at the same time, it is determined whether the change rule of the image effect is consistent with the fill light change rule. Thus, it is determined whether the image frame remains unchanged for a long time due to the frozen frame of the shooting device or due to the fact that the actual scene has not actually changed.

[0076] It should be noted that in this embodiment, the fill light is controlled by the fill light, and it is determined whether the shooting device is frozen by judging whether the brightness and / or color and other effects of the output image of the shooting device change with the fill light change. It is also possible to control the pan-tilt to rotate, zoom the picture size, etc., and determine whether the image frame has changed, so as to determine whether the shooting device is frozen. It is also possible to control the image signal processor. When processing the original image collected by the image sensor, by adjusting parameters such as white balance and gain, regular changes are added to the original image, such as adjusting the brightness and / or color in a specific area of the original image. Then, it is determined whether the shooting device is frozen by judging whether the specific area of the image to be analyzed output by the shooting device conforms to the brightness and / or color change rule.

[0077] In the technical solution of the embodiment of the present invention, by controlling the fill light to perform fill light according to the fill light change rule, during the fill light process, the imaging device is controlled to perform image processing according to the image processing parameters when the fill light change returns to zero, and whether the imaging device freezes the picture is judged according to the image to be analyzed output by the imaging device. This solves the problem in the prior art that when the image does not change for a long time, it is impossible to accurately determine whether it is caused by the imaging device freezing the picture or due to the unchanging shooting scene, and realizes the accurate judgment of whether the picture of the imaging device freezes.

[0078] Embodiment 2

[0079] Figure 2 It is a flowchart of a method for judging picture freezing provided by the second embodiment of the present invention. On the basis of the above embodiment, the present embodiment further specifies the specific process of judging whether the imaging device freezes the picture according to the image to be analyzed.

[0080] As Figure 2 shown, the method includes:

[0081] S210. Control the fill light to perform fill light according to a preset fill light change rule.

[0082] The fill light process has been described in the above embodiment, and will not be elaborated here in this embodiment.

[0083] S220. Determine the image processing parameters when the fill light change returns to zero, and control the imaging device to perform image processing according to the image processing parameters.

[0084] S230. Determine the image to be analyzed output by the imaging device after image processing during the fill light process of the fill light.

[0085] The process of determining the image processing parameters when the fill light change returns to zero, fixing the image processing parameters for image processing, and determining the image to be analyzed output by the imaging device has been described in the above embodiment, and will not be elaborated here in this embodiment.

[0086] S240. Determine the image entropy of the image to be analyzed, and determine the image entropy change rule according to the continuous images to be analyzed.

[0087] In this embodiment, taking the image entropy as an example, it is analyzed whether the image effect of the image to be analyzed changes with the fill light change rule.

[0088] Among them, the image entropy represents the amount of information contained in the image. The more information the image contains, the higher the image entropy. When the image entropy is relatively high, the gray value (or color value) distribution of the pixels in the image is relatively complex and diverse, and the details are relatively rich.

[0089] In this embodiment, the image entropy of the image to be analyzed is determined. In a specific example, the image to be analyzed can be grayscaled to obtain a grayscale image, and then the image entropy can be calculated using the following formula: , where H represents the image entropy, L is the maximum possible number of image pixel values in the image to be analyzed (for example, for an 8-bit grayscale image, L = 256), is the probability that a pixel with pixel value k appears in the image to be analyzed.

[0090] In another specific example, the above method can also be separately applied to the three RGB color channels to calculate the entropy values corresponding to each color channel 、 and . Then, the average value of 、 and is calculated as the image entropy of the final image to be analyzed.

[0091] According to the continuous images to be analyzed, the variation law of the image entropy is determined. Specifically, the variation curve of the image entropy can be plotted with the images to be analyzed as the abscissa and the corresponding image entropy of each image to be analyzed as the ordinate. The variation law of the image entropy within the analysis period of the frozen frame is represented by the variation curve of the image entropy.

[0092] S250. Determine whether the shooting device has a frozen frame according to the variation law of the image entropy and the variation law of the supplementary light.

[0093] Correspondingly, the variation law of the supplementary light can also be represented by a curve. With the time within a supplementary light variation period as the horizontal axis and the light brightness and / or light color corresponding to different times as the vertical axis, the variation curve of the supplementary light is determined.

[0094] Furthermore, S250 can further include: if it is determined that the variation law of the image entropy and the variation law of the supplementary light match, it is determined that the shooting device does not have a frozen frame.

[0095] Specifically, to determine whether the variation law of the image entropy and the variation law of the supplementary light match, the key feature points of the variation curve of the image entropy and the variation curve of the supplementary light can be determined respectively, such as the starting point, ending point, turning point, maximum value point, minimum value point, etc. By comparing whether the order, relative position, distance, etc. of these feature points in the variation curve of the image entropy and the variation curve of the supplementary light are the same, it is determined whether the variation law of the image entropy and the variation law of the supplementary light match.

[0096] Exemplarily, taking the light compensation change rule that the light compensation brightness gradually increases from 0 and then decreases until it becomes 0 within 20s as an example, correspondingly, the images to be analyzed obtained within these 20s show that the image entropy gradually increases from an initial value and then gradually decreases to near the initial value. At this time, the change rule of the image entropy matches the change rule of the light compensation, and the shooting device does not freeze the screen.

[0097] In this embodiment, when the change rule of the image entropy matches the change rule of the light compensation, the scene of the screen does not change, which may be due to the fact that the actual scene has not changed. It is possible to judge whether the screen freezes at preset time intervals to continuously monitor whether the screen of the shooting device freezes.

[0098] Furthermore, S250 may further include: if it is determined that the change rule of the image entropy does not match the change rule of the light compensation, and / or the proportion of the image entropy within the image entropy change range in all the image entropy is greater than or equal to a preset proportion threshold, then it is determined that the screen of the shooting device freezes.

[0099] In an optional embodiment, the image entropy change range can be determined by pre-calibration. Specifically, when it is determined that the shooting device is in a normal working state, the images output by the shooting device within a preset time period can be collected, the image entropy of each image can be calculated, and the image entropy change range can be determined. Furthermore, multiple image entropy change ranges can be respectively calibrated for different time periods or different scenarios, and the corresponding image entropy change range can be determined according to the time period or scenario where the current screen freeze analysis period is located.

[0100] In another optional embodiment, the image entropy change range can be determined when it is determined that the trigger condition for the screen freeze judgment is satisfied, that is, when it is determined that for a continuous preset number of images output by the shooting device, the similarity between adjacent two images is greater than or equal to the similarity threshold, calculate the image entropy for the continuous preset number of images output by the shooting device, and determine the image entropy change range.

[0101] In this embodiment, a change range is set for the image entropy. If for each image to be analyzed within the screen freeze analysis period, the ratio of the image entropy within the image entropy change range to all the image entropy is greater than or equal to the preset proportion threshold, that is, most of the image entropy remains within this change range, it indicates that the image entropy of the image to be analyzed remains relatively unchanged for a long time. At this time, it is determined that the shooting device malfunctions and causes the screen to freeze.

[0102] Alternatively, the image entropy change pattern does not match the fill light change pattern. Still taking the above fill light change pattern as an example, where the fill light brightness gradually increases from 0 within 20s first, and then decreases until it becomes 0. If the image entropy first decreases and then increases, or continuously decreases or continuously increases, or the change period of the image entropy is 10s, and it first increases and then decreases within the change period, etc., at this time, it is considered that the image entropy change pattern does not match the fill light change pattern, the shooting device malfunctions, and the screen freezes.

[0103] Furthermore, this embodiment illustrates by taking the calculation of the overall image entropy of the image to be analyzed as an example. It is also possible to determine the fill light area in each image to be analyzed, calculate the image entropy for the fill light area, and then determine the image entropy change pattern based on the image entropy of the fill light areas of consecutive images to be analyzed. According to the image entropy change pattern and the fill light change pattern, it is judged whether the shooting device has a frozen screen. The specific processes of calculating the image entropy, determining the image entropy change pattern, and judging whether the image entropy change pattern and the fill light change pattern match are similar to those in the above embodiments, and will not be elaborated here.

[0104] The technical solution of this embodiment, on the one hand, controls the fill light to change in brightness or color according to the fill light change pattern, and fills light for the field of view of the shooting device. By introducing regularly changing fill light, the change of fill light brightness and / or color is introduced into the image effect of the image output by the shooting device. On the other hand, it controls the image signal sensor of the shooting device to fix the image processing parameters when the fill light change returns to zero, and performs subsequent image processing during the fill light process, so that the finally output image can better present the influence of the change of fill light brightness and / or color on the image effect, thereby improving the accuracy of subsequent frozen screen judgment. For each image to be analyzed within the frozen screen analysis period, the parameter of image entropy is used to reflect the situation of the continuously acquired images to be analyzed changing with the fill light change. It is judged whether the image entropy change pattern of each image to be analyzed is consistent with the fill light change pattern, so as to judge whether the shooting device is in a normal working state, which can effectively distinguish whether the image screen remains unchanged for a long time due to the frozen screen of the shooting device or due to the unchanged shooting scene, and realizes the accurate judgment of whether the screen of the shooting device is frozen.

[0105] Embodiment III

[0106] Figure 3 FIG. 13 is a flowchart of another method for judging a frozen screen provided by Embodiment III of the present invention. This embodiment is applicable to the situation of judging whether the shooting device has a frozen screen. This method can be executed by a device for judging a frozen screen, and the device for judging a frozen screen can be implemented in the form of hardware and / or software. The device for judging a frozen screen can be configured in a server or an image management device and used in cooperation with a moving-point shooting device.

[0107] AsFigure 3 As shown, the method includes:

[0108] S310. Control the moving-point shooting device to rotate in the horizontal direction and / or the vertical direction.

[0109] This embodiment is applicable to the judgment of the picture freezing of the moving-point shooting device. It can be understood that since the shooting device needs to be controlled to rotate in this embodiment, it can only be realized by the moving-point shooting device.

[0110] Specifically, a rotation control instruction can be sent to the pan-tilt or the mobile device through the server to control the rotation of the moving-point shooting device. This embodiment does not limit this. At the same time, the rotation control method based on the pan-tilt or the mobile device can be implemented in a conventional manner, and this embodiment will not elaborate on this.

[0111] In this embodiment, it is necessary to ensure that the pan-tilt or the mobile device that executes the rotation control is in a normal working state. Similarly, the heartbeat mechanism or the like can be used to judge whether the pan-tilt or the mobile device is working normally.

[0112] In this embodiment, by controlling the moving-point shooting device to rotate in the horizontal direction and / or the vertical direction, the field of view of the moving-point shooting device is changed, so as to judge whether the shooting device is picture frozen.

[0113] S320. Determine the image to be analyzed output by the moving-point shooting device, and judge whether the moving-point shooting device is picture frozen according to the image to be analyzed.

[0114] Specifically, the similarity between two consecutive images to be analyzed output by the shooting device can be determined, and the similarity calculation process will not be elaborated. If the similarity is less than the preset similarity threshold, it means that the moving-point shooting device is not picture frozen. If for a preset number of consecutive images to be analyzed, the ratio of the number of similarities greater than or equal to the similarity threshold to the preset number is greater than or equal to the preset ratio threshold, it is determined that the moving-point shooting device is picture frozen.

[0115] Further, after determining that the moving-point shooting device is not picture frozen, it is also necessary to control the moving-point shooting device to reset to restore the original position and angle of the moving-point shooting device.

[0116] The technical solution of this embodiment controls the moving-point shooting device to rotate in the horizontal direction and / or the vertical direction, changes the field of view of the moving-point shooting device, so that it can be judged whether the moving-point shooting device is picture frozen according to the similarity between the images to be analyzed output by the shooting device. It solves the problem in the prior art that when the image picture does not change for a long time, it is impossible to accurately judge whether it is caused by the picture freezing of the shooting device or the non-changing shooting scene, and realizes the accurate judgment of whether the picture of the shooting device is frozen.

[0117] Embodiment 4

[0118] Figure 4 The following is a schematic structural diagram of a device for judging picture freezing provided in Embodiment 4 of the present invention. As Figure 4 shown, the device includes:

[0119] A fill light control module 410, configured to control a fill light to perform fill light according to a preset fill light change rule;

[0120] An image processing parameter control module 420, configured to determine image processing parameters when a fill light change zeroing condition is satisfied, and control a photographing device to perform image processing according to the image processing parameters;

[0121] A first picture freezing judgment module 430, configured to determine a to-be-analyzed image output after the photographing device performs image processing during the fill light process of the fill light, and judge whether the photographing device freezes the picture according to the to-be-analyzed image.

[0122] The technical solution of the embodiment of the present invention controls the fill light to perform fill light according to the fill light change rule. During the fill light process, the photographing device is controlled to perform image processing according to the image processing parameters when the fill light change returns to zero, and it is judged whether the photographing device freezes the picture according to the to-be-analyzed image output by the photographing device. It solves the problem in the prior art that when the image picture does not change for a long time, it is impossible to accurately judge whether it is caused by the picture freezing of the photographing device or due to the unchanged shooting scene, and realizes the accurate judgment of whether the picture of the photographing device freezes.

[0123] On the basis of the above embodiment, optionally, the fill light change rule includes a light color change rule and / or a light brightness change rule.

[0124] On the basis of the above embodiment, optionally, the image processing parameter control module 420 includes:

[0125] A fill light change zeroing condition judgment unit, configured to determine that the fill light change zeroing condition is satisfied if it is determined according to the fill light change rule that the color of the fill light is within the color change range and / or the brightness of the fill light is within the brightness change range.

[0126] On the basis of the above embodiment, optionally, the first picture freezing judgment module 430 includes:

[0127] A to-be-analyzed image acquisition unit, configured to determine each to-be-analyzed image output after the photographing device performs image processing during the fill light process of the fill light within a picture freezing analysis period;

[0128] Wherein, the picture freezing analysis period is greater than or equal to the fill light change period of the fill light.

[0129] Based on the above embodiments, optionally, the first screen freeze determination module 430 includes:

[0130] An image entropy change rule determination unit, configured to determine the image entropy of the image to be analyzed, and determine the image entropy change rule according to consecutive images to be analyzed;

[0131] A screen freeze determination unit, configured to determine whether the shooting device has a frozen screen according to the image entropy change rule and the fill light change rule.

[0132] Based on the above embodiments, optionally, the screen freeze determination unit is specifically configured to:

[0133] If it is determined that the image entropy change rule and the fill light change rule match, it is determined that the shooting device does not have a frozen screen.

[0134] Based on the above embodiments, optionally, the screen freeze determination unit is specifically configured to:

[0135] If it is determined that the image entropy change rule and the fill light change rule do not match, and / or the proportion of the image entropy within the image entropy change range to the total image entropy is greater than or equal to a preset proportion threshold, it is determined that the screen of the shooting device is frozen.

[0136] The screen freeze determination device provided by the embodiments of the present invention can execute the screen freeze determination method provided by any embodiment of the present invention, and has corresponding functional modules and beneficial effects for executing the method.

[0137] Embodiment Five

[0138] Figure 5 FIG. provides a schematic structural diagram of another screen freeze determination device according to Embodiment Five of the present invention. As Figure 5 shown, the device includes:

[0139] A rotation control module 510, configured to control the moving point shooting device to rotate in the horizontal direction and / or the vertical direction;

[0140] A second screen freeze determination module 520, configured to determine the image to be analyzed output by the moving point shooting device, and determine whether the moving point shooting device has a frozen screen according to the image to be analyzed.

[0141] The technical solution of this embodiment controls the moving-point shooting device to rotate in the horizontal direction and / or the vertical direction, changing the field of view of the moving-point shooting device. Thus, it can determine whether the moving-point shooting device has a frozen screen according to the similarity between the to-be-analyzed images output by the shooting device. This solves the problem in the prior art that when the image screen remains unchanged for a long time, it is impossible to accurately determine whether it is caused by the freezing of the shooting device's screen or by the lack of change in the shooting scene, and realizes an accurate determination of whether the shooting device's screen is frozen.

[0142] The device for judging screen freezing provided by the embodiment of the present invention can execute the method for judging screen freezing provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects for executing the method.

[0143] Embodiment Six

[0144] Figure 6 The structural schematic diagram of the electronic device 10 that can be used to implement the embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described herein and / or claimed.

[0145] As Figure 6 shown, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc. Among them, the memory stores a computer program executable by the at least one processor. The processor 11 can execute various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. The input / output (I / O) interface 15 is also connected to the bus 14.

[0146] Multiple components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disc, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0147] The processor 11 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the method for judging screen freeze.

[0148] In some embodiments, the method for judging screen freeze can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the method for judging screen freeze described above can be executed. Alternatively, in other embodiments, the processor 11 can be configured to execute the method for judging screen freeze by any other suitable means (e.g., by means of firmware).

[0149] The various embodiments of the systems and technologies described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs, which can be executed and / or interpreted on a programmable system including at least one programmable processor, and the programmable processor can be a special or general-purpose programmable processor, and can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.

[0150] A computer program for implementing the method of the present invention can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, a special purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowchart and / or block diagram to be implemented. The computer programs can be executed entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine, or entirely on the remote machine or server.

[0151] In the context of the present invention, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, the computer-readable storage medium can be a machine-readable signal medium. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0152] In order to provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0153] The systems and techniques described herein can be implemented in a computing system including backend components (e.g., as a data server), or a computing system including middleware components (e.g., an application server), or a computing system including frontend components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described herein), or a computing system including any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected to each other by digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), blockchain network, and the Internet.

[0154] A computing system can include a client and a server. The client and the server are generally remote from each other and typically interact through a communication network. The client-server relationship is created by computer programs running on respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system, solving the defects of difficult management and weak business scalability existing in traditional physical hosts and VPS services.

[0155] It should be understood that various forms of the processes shown above can be used, with steps reordered, added, or deleted. For example, the steps recited in the present invention can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved, and no limitation is made herein.

[0156] The above specific embodiments do not constitute a limitation on the protection scope of the present invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principle of the present invention shall be included within the protection scope of the present invention.

Claims

1. A method for determining whether a picture is frozen, characterized in that: include: Determine the similarity between two consecutive images output by the shooting device, and if it is determined that the similarities between a preset number of consecutive images are greater than or equal to a similarity threshold, control the fill light to perform fill light according to a preset fill light change rule; the fill light change rule includes a light color change rule and / or a light brightness change rule; Determine image processing parameters when the fill light change zeroing condition is met, and control the shooting device to perform image processing according to the image processing parameters; The fill light change zeroing conditions are met, including: If it is determined according to the fill light variation rule that the color of the fill light is within the color variation range, and / or the brightness of the fill light is within the brightness variation range, then it is determined that the fill light variation zeroing condition is met; Determining the image processing parameters when the fill light change returns to zero condition is met, including: determining the image processing parameters in the image signal processor before controlling the fill light to perform fill light according to a preset fill light change rule, and using the image processing parameters as the image processing parameters when the fill light change returns to zero condition is met; The image processing parameters are parameters for adjusting the effect of changes in fill light color and / or fill light brightness in the original image; Wherein, the shooting device is a fixed-point shooting device or a dynamic-point shooting device; An image to be analyzed output by the shooting device after image processing during the fill light filling process is determined, and whether the shooting device is frozen is determined according to the image to be analyzed.

2. The method according to claim 1, characterized in that: Determine the image to be analyzed output by the camera after image processing during the fill light filling process, including: Determine each image to be analyzed that is output after the camera performs image processing during the fill light filling process within the image freezing analysis period; The image freezing analysis period is greater than or equal to the fill light change period of the fill light.

3. The method according to claim 1, characterized in that Determining whether the image of the shooting device is frozen according to the image to be analyzed includes: Determine the image entropy of the image to be analyzed, and determine the image entropy change law based on the continuous images to be analyzed; Determine whether the image of the shooting device is frozen based on the change rules of image entropy and fill light.

4. The method according to claim 3, characterized in that According to the change rules of image entropy and fill light, determine whether the image of the shooting device is frozen, including: If it is determined that the image entropy change rule matches the fill light change rule, it is determined that the image capturing device is not frozen.

5. The method according to claim 3, characterized in that: According to the change law of image entropy and fill light, it is judged whether the image of the shooting device is frozen, and it also includes: If it is determined that the image entropy change law and the fill light change law do not match, and / or the proportion of the image entropy within the image entropy change range to the total image entropy is greater than or equal to a preset proportion threshold, it is determined that the picture of the shooting device is frozen.

6. A device for determining whether a picture is frozen, characterized in that: include: A fill light control module is used to determine the similarity between two consecutive images output by the camera device. If it is determined that the similarities between a preset number of consecutive images are greater than or equal to a similarity threshold, the fill light is controlled to perform fill light according to a preset fill light variation rule; the fill light variation rule includes a light color variation rule and / or a light brightness variation rule; An image processing parameter control module, used to determine the image processing parameters when the fill light change zeroing condition is met, and control the shooting device to perform image processing according to the image processing parameters; Image processing parameter control module, including: A fill light change zeroing condition judgment unit, used to determine that the fill light change zeroing condition is met if it is determined according to the fill light change rule that the color of the fill light is within the color change range and / or the brightness of the fill light is within the brightness change range; An image processing parameter control module is used to determine the image processing parameters in the image signal processor before controlling the fill light to perform fill light according to a preset fill light change rule, and use the image processing parameters as the image processing parameters when the fill light change zeroing condition is met; The image processing parameters are parameters for adjusting the effect of changes in fill light color and / or fill light brightness in the original image; Wherein, the shooting device is a fixed-point shooting device or a dynamic-point shooting device; The first screen freeze judgment module is used to determine the image to be analyzed output by the shooting device after image processing during the fill light filling process, and judge whether the shooting device has a screen freeze according to the image to be analyzed.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method for determining whether the screen is frozen as described in any one of claims 1 to 5 is implemented.

8. A storage medium storing computer executable instructions, characterized in that: When the computer executable instructions are executed by a computer processor, they are used to execute the method for determining whether the screen is frozen as described in any one of claims 1 to 5.

Images