Image collector shielding detection method and device, electronic equipment and medium

By acquiring the parameters of the image acquisition device and the image difference values, and comparing them with standard parameters, the problem of poor anti-interference capability of occlusion detection in monitoring equipment is solved, and more accurate occlusion detection is achieved.

CN114663824BActive Publication Date: 2026-02-06ZHEJIANG UNIVIEW TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011525759.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-22
Publication Date
2026-02-06
Estimated Expiration
2040-12-22

AI Technical Summary

Technical Problem

Existing surveillance equipment occlusion detection solutions have poor anti-interference capabilities and are easily affected by normal environmental changes, leading to inaccurate detection results.

Method used

By acquiring the parameters of the image acquisition device and the image difference values, and comparing them with standard parameters, the influence of changes in ambient brightness and shooting darker objects can be eliminated, and the obstruction of the image acquisition device can be accurately determined.

Benefits of technology

It improves the accuracy and reliability of occlusion detection, eliminates interference from environmental changes, and ensures the precision of detection results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114663824B_ABST
    Figure CN114663824B_ABST
Patent Text Reader

Abstract

Embodiments of the present application disclose a kind of image collector shielding detection method, device, electronic equipment and medium.The method comprises: obtaining the first parameter of image collector at current time and the current image collected, historical image collected before current time and the second parameter of image collector when image collection history image is collected;If the difference value of current image and historical image is greater than preset image difference value, and the difference value of first parameter and second parameter is greater than preset parameter difference value, first parameter is compared with standard parameter;Standard parameter is the same image as current image when image collector is not shielded in current environment and is collected corresponding parameter;If the difference value of first parameter and standard parameter is greater than preset standard difference value, determine that image collector is in shielded state.The above scheme introduces the parameter of image collector to determine whether there is shielding, avoids the problem that only according to image analysis anti-interference is poor, improves the accuracy and reliability of shielding detection.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The embodiment of the present application relates to the technical field of intelligent detection, in particular to an image collector shielding detection method and device, electronic equipment and medium. BACKGROUND

[0002] With the rapid development of technologies in the monitoring field, people pursue high-quality visual experience effect, which promotes comprehensive improvement of image definition, and the effect of day and night is greatly improved, and the security guarantee for people is more and more comprehensive. However, when the monitoring device is shielded, it cannot provide a clear image and cannot realize safe monitoring.

[0003] At present, the detection scheme for shielding of the monitoring device generally analyzes the image collected by the monitoring device to determine whether the monitoring device is shielded. However, the analysis result is poor in anti-interference and is easily affected by normal changes in the environment. SUMMARY

[0004] The embodiment of the present application provides an image collector shielding detection method, device, electronic equipment and medium to improve the accuracy and reliability of image collector shielding detection.

[0005] In one embodiment, the embodiment of the present application provides an image collector shielding detection method, which comprises:

[0006] obtaining a first parameter of an image collector at a current time and a current image collected by the image collector, and a historical image collected before the current time and a second parameter of the image collector when the historical image is collected;

[0007] If the difference value of the current image and the historical image is greater than a preset image difference value, and the difference value of the first parameter and the second parameter is greater than a preset parameter difference value, the first parameter is compared with a standard parameter;

[0008] The standard parameter is a parameter corresponding to the same image as the current image collected by the image collector in an unshielded state in the current environment.

[0009] If the difference value of the first parameter and the standard parameter is greater than a preset standard difference value, it is determined that the image collector is in a shielded state.

[0010] In another embodiment, the embodiment of the present application further provides an image collector shielding detection device, which comprises:

[0011] a data acquisition module, configured to acquire a first parameter of an image collector at a current time and a current image collected by the image collector, and a historical image collected before the current time and a second parameter of the image collector when the historical image is collected;

[0012] a comparison module, configured to compare the first parameter with a standard parameter if a difference value of the current image and the historical image is greater than a preset image difference value, and a difference value of the first parameter and the second parameter is greater than a preset parameter difference value;

[0013] wherein the standard parameter is a parameter corresponding to the current image collected by the image collector in a non-occluded state in a current environment;

[0014] a state determination module, configured to determine that the image collector is in an occluded state if a difference value of the first parameter and the standard parameter is greater than a preset standard difference value.

[0015] In yet another embodiment, the embodiments of the present application further provide an electronic device, comprising: one or more processors;

[0016] a memory, configured to store one or more programs;

[0017] When the one or more programs are executed by the one or more processors, the one or more processors implement the image collector occlusion detection method according to any of the embodiments of the present application.

[0018] In still another embodiment, the embodiments of the present application further provide a computer readable storage medium, having stored thereon a computer program, which is executed by a processor to implement the image collector occlusion detection method according to any of the embodiments of the present application.

[0019] In the embodiment of the present application, the first parameter of the image collector at the current time and the current image collected are acquired, and the historical image collected before the current time and the second parameter of the image collector when the historical image is collected are acquired; if the difference value of the current image and the historical image is greater than a preset image difference value, and the difference value of the first parameter and the second parameter is greater than a preset parameter difference value, the first parameter is compared with a standard parameter; wherein the standard parameter is a parameter corresponding to the same image as the current image collected by the image collector in the current environment without being blocked; if the difference value of the first parameter and the standard parameter is greater than a preset standard difference value, it is determined that the image collector is in a blocked state. The parameter when the image collector collects the image is introduced, the standard parameter under the condition that the parameter of the image collector is normally adjusted is combined with the image collected by the image collector, and whether the image collector is blocked is comprehensively and comprehensively determined, so as to exclude the case that the image changes due to normal light and dark changes of the environment or shooting of dark objects, and the accuracy and reliability of the blocking detection are improved. BRIEF DESCRIPTION OF DRAWINGS

[0020] Figure 1 A flowchart of an image collector blocking detection method provided by an embodiment of the present application is shown in the figure.

[0021] Figure 2 A flowchart of an image collector blocking detection method provided by another embodiment of the present application is shown in the figure.

[0022] Figure 3 A flowchart of an image collector blocking detection method provided by another embodiment of the present application is shown in the figure.

[0023] Figure 4 A specific implementation flowchart of an image collector blocking detection method provided by another embodiment of the present application is shown in the figure.

[0024] Figure 5 A structure schematic diagram of an image collector blocking detection device provided by an embodiment of the present application is shown in the figure.

[0025] Figure 6 A structure schematic diagram of an electronic device provided by an embodiment of the present application is shown in the figure. DETAILED DESCRIPTION

[0026] The present application will be further described in detail below in combination with the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, in order to facilitate the description, only the parts related to the present application are shown in the drawings, but not all the structures.

[0027] Figure 1A flowchart of an image collector shielding detection method provided by an embodiment of the present application is shown. The image collector shielding detection method provided by the embodiment of the present application can be applied to the case of detecting whether the image collector is shielded. The method can be specifically executed by an image collector shielding detection device, which can be implemented in software and / or hardware, and can be integrated in an electronic device capable of implementing the image collector shielding detection method. Referring to Figure 1 The method of the embodiment of the present application specifically includes the following steps.

[0028] S110, acquiring a first parameter of the image collector at a current time and a current image collected by the image collector, and a historical image collected before the current time and a second parameter of the image collector when the historical image is collected.

[0029] The image collector can be an image collector in a monitoring device, such as a camera or a video camera. The current image is an image collected by the image collector at the current time, and the first parameter is a parameter of the image collector when the current image is collected at the current time. The historical image can be an image collected by the image collector at any time before the current time, or images collected by the image collector at at least two times before the current time. The second parameter is a parameter of the image collector when the historical image is collected.

[0030] At present, when the shielding condition of the image collector is detected, a plurality of images collected by the image collector are compared and analyzed to determine whether the image collector is shielded. However, only the images are analyzed, and it is not possible to distinguish between the case where the image collector is shielded, the case where the environment normally changes in brightness, and the case where a dark object is photographed. In the embodiment of the present application, the parameter of the image collector when the image is collected is introduced, so that the shielding condition of the image collector can be accurately analyzed according to the change of the parameter in the subsequent process, and it is determined whether the change of the image is caused by the shielding of the image collector or the normal change in brightness of the environment.

[0031] S120, if the difference value of the current image and the historical image is greater than a preset image difference value, and the difference value of the first parameter and the second parameter is greater than a preset parameter difference value, the first parameter is compared with a standard parameter.

[0032] The standard parameter is a parameter corresponding to the case where the same image as the current image is collected by the image collector in an unshielded state in the current environment. The preset image difference value and the preset parameter difference value can be set according to actual conditions.

[0033] For example, the image collector is tested in the current environment in advance to determine the parameters of the image collector when collecting images in different brightness environments when the image collector is not blocked. If the brightness of the environment changes normally, there will be a difference between the current image and the historical image, and there will be a difference between the first parameter and the second parameter. If the image collector captures a darker object, such as a blackboard, the current image will be darker than the historical image, but since the brightness of the environment does not change, the image collector will not adjust the parameters, and there will be no difference between the first parameter and the second parameter. In the embodiment of the present application, the image and the parameter are comprehensively analyzed to distinguish whether the difference between the current image and the historical image is caused by the change of the environment or the capture of a darker object. If the difference value between the current image and the historical image is greater than a preset image difference value, and the difference value between the first parameter and the second parameter is greater than a preset parameter difference value, it is indicated that there is a difference between the current image and the historical image, which is caused by the change of the brightness of the environment, and is not caused by the capture of a darker object.

[0034] For example, if the difference value between the current image and the historical image is greater than a preset image difference value, and the difference value between the first parameter and the second parameter is greater than a preset parameter difference value, it is indicated that there is a difference between the current image and the historical image, and the image collection environment changes, and then the same image as the current image is searched from the images obtained by the pre-test, and the same includes the same brightness and the same texture. The standard parameter corresponding to the same image recorded in advance is determined, and the standard parameter is compared with the first parameter. If the standard parameter is consistent with the first parameter, it is indicated that the change of the current image relative to the historical image and the change of the first parameter relative to the second parameter are caused by the normal change of the brightness of the environment.

[0035] In S130, if the difference value between the first parameter and the standard parameter is greater than a preset standard difference value, it is determined that the image collector is in a blocked state.

[0036] For example, if the brightness of the environment changes normally, the image collector adaptively adjusts the parameters, which can improve the quality of the current image, and if the image collector is blocked, the image collector will greatly adjust the parameters, and the quality of the current image will not be improved. Therefore, in the embodiment of the present application, it is judged whether the difference value between the first parameter and the standard parameter is greater than a preset standard difference value. If the difference value between the first parameter and the standard parameter is greater than a preset standard difference value, it is indicated that the image collector adjusts the parameters with a large amplitude, which is greater than the amplitude of the adjustment of the parameters of the image collector when the brightness of the environment changes normally, and therefore it can be determined that the image collector is in a blocked state.

[0037] Specifically, the standard parameter can be determined by testing in the current environment in advance. For example, the brightness of the ambient light is gradually adjusted, and the parameter reached by the image collector when the un-occluded image collector collects images under different ambient light brightness to adapt to the change of the ambient light and adjust its own parameters is taken as the standard parameter. When the image collector is not occluded, the adjustment of its own parameters to adapt to the change of the ambient light is normal adjustment, which can change the quality of the collected images. When the image collector is occluded, the brightness of the ambient light becomes dim, and the image collector cannot improve the quality of the collected images when adjusting its own parameters, so the image collector continues to adjust, forming abnormal adjustment with a large adjustment range. According to this principle, whether the adjustment range of the first parameter compared with the standard parameter is large is determined, and then whether the image collector is occluded is accurately determined.

[0038] In the embodiment of the application, the first parameter of the image collector at the current time and the current image collected, and the historical image collected before the current time and the second parameter of the image collector when the historical image is collected are obtained. If the difference value of the current image and the historical image is greater than a preset image difference value, and the difference value of the first parameter and the second parameter is greater than a preset parameter difference value, the first parameter is compared with a standard parameter. The standard parameter is a parameter corresponding to the same image as the current image collected by the image collector in the current environment when the image collector is not occluded. If the difference value of the first parameter and the standard parameter is greater than a preset standard difference value, it is determined that the image collector is in an occluded state. The parameter of the image collector when collecting images is introduced, and the standard parameter under the normal adjustment of the image collector is combined with the image collected by the image collector, so that whether the image collector is occluded is comprehensively and comprehensively determined, thereby excluding the case that the image changes due to the normal bright-dark change of the environment or the shooting of dark objects, and improving the accuracy and reliability of the occlusion detection.

[0039] In the embodiment of the application, the first parameter and the second parameter include a shutter value and / or a gain value.

[0040] In the embodiments of the present application, the process of determining whether the difference value of the current image and the historical image is greater than the preset image difference value includes: if the brightness value of the current image is less than the brightness value of the historical image, and the difference value of the brightness values is greater than the preset brightness difference value, it is determined that the difference value of the current image and the historical image is greater than the preset image difference value; and / or, the texture data of the current image is less than the texture data of the historical image, and the difference value of the texture data is greater than the preset texture difference value, it is determined that the difference value of the current image and the historical image is greater than the preset image difference value. The process of determining whether the difference value of the first parameter and the second parameter is greater than the preset parameter difference value includes: if the first shutter value contained in the first parameter is greater than the second shutter value contained in the second parameter, and the difference value of the first shutter value and the second shutter value is greater than the preset shutter value difference value, it is determined that the difference value of the first parameter and the second parameter is greater than the preset parameter difference value; and / or, if the first gain value contained in the first parameter is greater than the second gain value contained in the second parameter, and the difference value of the first gain value and the second gain value is greater than the preset gain value difference value, it is determined that the difference value of the first parameter and the second parameter is greater than the preset parameter difference value. If the difference value of the first parameter and the standard parameter is greater than the preset standard difference value, it is determined that the image collector is in the state of being blocked, including: if the first shutter value contained in the first parameter is greater than the standard shutter value contained in the standard parameter, and the difference value of the first shutter value and the standard shutter value is greater than the first preset difference threshold value, it is determined that the image collector is in the state of being blocked; and / or, if the first gain value contained in the first parameter is greater than the standard gain value contained in the standard parameter, and the difference value of the first gain value and the standard gain value is greater than the second preset difference threshold value, it is determined that the image collector is in the state of being blocked.

[0041] In the embodiment of the present application, the scheme is specifically refined as follows: comparing the brightness value of the current image with the brightness value of the historical image, and / or comparing the texture data of the current image with the texture data of the historical image. If the brightness value of the current image is less than the brightness value of the historical image, that is, the current image is darkened relative to the historical image, and the difference between the brightness values is greater than a preset brightness difference, and / or if the texture data of the current image is less than the texture data of the historical image, that is, the texture data of the current image is less than the texture data of the historical image, it can be determined that the difference between the current image and the historical image is greater than a preset image difference. In the case where the difference between the current image and the historical image is greater than the preset image difference, it is still not determined that the image collector is blocked, and it is still necessary to further compare the first parameter and the second parameter of the image collector. In the embodiment of the present application, the parameters of the image collector obtained can be shutter values and / or gain values. If the first shutter value contained in the first parameter is greater than the second shutter value contained in the second parameter, that is, the shutter value of the image collector is increased, and the difference between the first shutter value and the second shutter value is greater than a preset shutter value difference, that is, the first shutter value is adjusted more relative to the second shutter value of the image collector when the historical image is collected, and / or if the first gain value contained in the first parameter is greater than the second gain value contained in the second parameter, that is, the gain value of the image collector is increased, and the difference between the first gain value and the second gain value is greater than a preset gain value difference, that is, the first gain value is adjusted more relative to the second gain value of the image collector when the historical image is collected, it can be determined that the difference between the first parameter and the second parameter is greater than a preset parameter difference. In this case, since the parameter value of the image collector changes, the case that the image is darkened and / or the texture is less due to the shooting of a dark object is excluded, and further, according to the comparison between the first parameter and the standard parameter, it is determined whether the image is darkened and / or the texture is less due to normal darkening of the environment or the image collector is blocked. If the first shutter value contained in the first parameter is greater than the standard shutter value contained in the standard parameter, and the difference between the first shutter value and the standard shutter value is greater than a first preset difference threshold, it indicates that the shutter value of the image collector is increased when the current image is collected at the current time, and the amplitude of the increase is greater than the amplitude of the adjustment of the shutter value of the image collector when the environment normally brightens and darkens, and thus it can be determined that the current image collector is blocked. And / or, if the first gain value contained in the first parameter is greater than the standard gain value contained in the standard parameter, and the difference between the first gain value and the standard gain value is greater than a second preset difference threshold, it indicates that the gain value of the image collector is increased when the current image is collected at the current time, and the amplitude of the increase is greater than the amplitude of the adjustment of the shutter of the image collector when the environment normally brightens and darkens, and thus it can be determined that the current image collector is blocked.

[0042] The beneficial effect of the above scheme is that when the brightness value of the current image is significantly darkened and / or the texture is significantly reduced, the shutter value and / or the gain value of the image collector are combined to determine whether the shutter value and / or the gain value are adjusted. If the shutter value and / or the gain value are not adjusted, it indicates that the image collector captures a dark object, resulting in the brightness value of the current image being significantly darkened and / or the texture being significantly reduced. If the shutter value and / or the gain value are adjusted, it indicates that the ambient brightness is adjusted. Further, according to the comparison between the first shutter value and the standard shutter value, and / or the comparison between the first gain value and the standard gain value, it is determined whether the brightness value of the current image is significantly darkened and / or the texture is significantly reduced, and whether the adjustment of the shutter value and / or the gain value is due to the normal dimming of the environment or the blocking of the image collector, so as to more accurately detect and determine the blocking state of the image collector.

[0043] In the embodiment of the present application, if the difference value between the current image and the historical image is greater than the preset image difference value, and the difference value between the first parameter and the second parameter is greater than the preset parameter difference value, the method further comprises: controlling the light compensation lamp to be turned on, and acquiring a reference image collected by the image collector in the light compensation lamp turned-on state; and if the brightness value of the reference image is consistent with the brightness value of the current image, it is determined that the image collector is in a blocked state.

[0044] For example, if the difference value between the current image and the historical image is greater than the preset image difference value, and the difference value between the first parameter and the second parameter is greater than the preset parameter difference value, it can only be determined that the brightness of the ambient light around the image collector changes, resulting in the change of the collected image, and it is difficult to determine whether the change of the ambient light around the image collector is the normal change of the ambient light or the blocking of the image collector, so further verification is needed. The scheme adopted in the embodiment of the present application is to control the light compensation lamp to be turned on, and at this time, the image collector collects a reference image. If the image collector is not blocked, after the light compensation lamp is turned on, the brightness value of the reference image should be greater than that of the current image, that is, the reference image is brighter. If the image collector is blocked, even if the light compensation lamp is turned on, the brightness of the collected reference image will not be brighter, and will be consistent with that of the current image. Therefore, when it is determined that the brightness value of the reference image is consistent with that of the current image, it is determined that the image collector is in a blocked state.

[0045] The beneficial effect of the above scheme is that the interference of the image brightness change caused by the normal change of the ambient light is excluded, so that the reference image collected in the light compensation lamp turned-on state is used to more accurately determine whether the image collector is blocked.

[0046] Figure 2A flowchart of an image collector shielding detection method provided by another embodiment of the present application is shown. The embodiment of the present application is a further optimization of the above-mentioned embodiment, and the details not described in the embodiment of the present application are described in the above-mentioned embodiment. See Figure 2 The image collector shielding detection method provided by the embodiment of the present application can include the following steps.

[0047] S210, acquiring a first parameter of the image collector at a current time and a current image collected by the image collector, and a historical image collected before the current time and a second parameter of the image collector when the historical image is collected.

[0048] S220, if the difference value of the current image and the historical image is greater than a preset image difference value, and the difference value of the first parameter and the second parameter is greater than a preset parameter difference value, comparing the first parameter with a standard parameter.

[0049] The standard parameter is a parameter corresponding to the same image as the current image collected by the image collector in a current environment without being shielded.

[0050] S230, if the difference value of the first parameter and the standard parameter is greater than a preset standard difference value, acquiring a current environmental audio collected by a microphone at the current time and a historical environmental audio collected before the current time.

[0051] In the embodiment of the present application, after it is determined that the difference value of the first parameter and the standard parameter is greater than the preset standard difference value, in order to further improve the accuracy of shielding detection, a second verification is performed according to the audio collected by the microphone. For a barrel camera and other image collectors, the microphone is close to the sensor, and when the sensor is shielded, the microphone will also be shielded accordingly. When the microphone is shielded, the audio acquired is different from the audio acquired when it is not shielded. Therefore, according to the audio collected by the microphone, whether the image collector is shielded can be further verified. Specifically, the microphone collects a current environmental audio at the current time and a historical environmental audio collected before the current time. By comparing the current environmental audio and the historical environmental audio, whether the image collector is shielded is determined.

[0052] S240, if the volume value of the current environmental audio is less than the volume value of the historical environmental audio, and the frequency variation of the current environmental audio is less than the frequency variation of the historical environmental audio, it is determined that the image collector is in a shielded state.

[0053] For example, the audio acquired by the microphone when being shielded has a smaller volume and a smaller frequency change range than the audio when not being shielded. Therefore, if it is determined that the volume value of the current environmental audio is smaller than the volume value of the historical environmental audio, and the frequency change range of the current environmental audio is smaller than the frequency change range of the historical environmental audio, it is determined that the current image collector is shielded.

[0054] The scheme in the embodiment of the application performs secondary verification on whether the image collector is shielded by using the current environmental audio and the historical environmental audio acquired by the microphone, thereby further improving the accuracy and reliability of the image collector shielding detection, increasing the perception of the environment by the shielding detection, and improving the shielding detection accuracy.

[0055] Figure 3 A flowchart of the image collector shielding detection method provided by another embodiment of the application is shown in FIG. 4. The embodiment of the application optimizes the above-described embodiments, and the details not described in the embodiment of the application are described in the above-described embodiments. Referring to FIG. 4, the image collector shielding detection method provided by the embodiment of the application can include the following steps. Figure 3

[0056] S310, acquiring a first parameter of an image collector at a current time and a current image collected by the image collector, and a historical image collected before the current time and a second parameter of the image collector when the historical image is collected.

[0057] S320, if a difference value of the current image and the historical image is greater than a preset image difference value, and a difference value of the first parameter and the second parameter is greater than a preset parameter difference value, comparing the first parameter with a standard parameter.

[0058] The standard parameter is a parameter corresponding to the same image as the current image when the image collector is not shielded in the current environment.

[0059] S330, if a difference value of the first parameter and the standard parameter is greater than a preset standard difference value, playing a preset frequency audio by the audio generating device.

[0060] In the embodiment of the application, after it is determined that the difference value of the first parameter and the standard parameter is greater than the preset standard difference value, in order to further improve the accuracy of the shielding detection, the audio generating device is caused to play the preset frequency audio, and the audio acquired by the microphone is used to further verify whether the image collector is shielded.

[0061] S340, acquiring a current playing audio collected by a microphone at a current time, and a historical playing audio collected before the current time.

[0062] ​Exemplarily, since the audio collected when the microphone is shielded is different from the audio collected when the microphone is not shielded, whether the image collector is shielded can be determined by comparing the current playing audio collected at the current time and the historical playing audio collected before the current time.

[0063] In S350, if the audio feature of the current playing audio and the change feature of the historical playing audio are consistent with the preset change feature, it is determined that the image collector is in a shielded state.

[0064] The preset change feature is a change feature of the audio collected when the microphone is not shielded and the audio collected when the microphone is shielded, which is obtained in advance.

[0065] Exemplarily, a test is performed in advance. The audio generating device plays audio of a preset frequency in the current environment. When the image collector is not shielded, the audio is collected by the microphone. When the image collector is shielded, the audio is collected by the microphone. The change feature of the audio is analyzed, which is the preset change feature collected when the image collector is from not shielded to shielded. In the actual detection process, the change feature of the current playing audio and the historical playing audio is analyzed. If the change feature is consistent with the preset change feature, it is determined that the image collector is in a shielded state at the current time.

[0066] The above scheme has the beneficial effect that if the ambient audio collected by the microphone is used, when the environment is always quiet, the ambient audio collected when the image collector is not shielded and the ambient audio collected when the image collector is shielded do not change significantly, and it is difficult to determine whether the image collector is shielded. In the embodiment of the present application, the audio generating device plays audio of a preset frequency, which can adaptively control the volume and frequency of the audio, so that the audio collected when the image collector is not shielded and the audio collected when the image collector is shielded change significantly, so as to accurately analyze whether the image collector is shielded.

[0067] In the embodiment of the present application, a test can also be performed in advance. The audio generating device plays audio of a preset frequency in the current environment. When the image collector is not shielded, the audio is collected by the microphone to determine the audio feature. When the image collector is shielded, the audio is collected by the microphone to determine the audio feature. In the actual detection process, the audio feature of the current playing audio obtained at the current time is compared with the audio feature determined in the test process, to determine whether the audio feature of the current playing audio is consistent with the audio feature of the audio collected when the image collector is not shielded or consistent with the audio feature of the audio collected when the image collector is shielded, and then whether the current image collector is shielded is determined.

[0068] It should be noted that the preset frequency audio played by the audio generating device in S330 and the subsequent steps in the embodiments of the present application can be executed after it is judged that the difference value between the first parameter and the standard parameter is greater than the preset standard difference value, or can be executed after it is judged whether the volume value of the current environmental audio is less than the volume value of the historical environmental audio and whether the frequency variation of the current environmental audio is less than the frequency variation of the historical environmental audio, so as to further verify after the microphone performs the shielding detection judgment according to the current environmental audio and the historical environmental audio. In addition, the preset frequency audio played by the audio generating device in S330 and the subsequent steps in the embodiments of the present application can be executed after it is judged that the volume value of the current environmental audio is less than the volume value of the historical environmental audio and the frequency variation of the current environmental audio is less than the frequency variation of the historical environmental audio. As shown in the following, the preset frequency audio played by the audio generating device in S330 and the subsequent steps can be executed after it is not judged that the volume value of the current environmental audio is less than the volume value of the historical environmental audio and it is not judged that the frequency variation of the current environmental audio is less than the frequency variation of the historical environmental audio, so as to realize multiple verifications and improve the accuracy of the shielding detection. Figure 4

[0069] Figure 5 The structure diagram of the image collector shielding detection device provided by an embodiment of the present application is shown. The device can be applied to the case of detecting whether the image collector is shielded. The device can be realized by software and / or hardware, and can be integrated in an electronic device. Referring to Figure 5 , the device specifically includes:

[0070] The data acquisition module 410 is configured to acquire a first parameter of the image collector at a current time and a current image collected by the image collector, and a historical image collected before the current time and a second parameter of the image collector when the historical image is collected.

[0071] The comparison module 420 is configured to compare the first parameter with a standard parameter if the difference value between the current image and the historical image is greater than a preset image difference value and the difference value between the first parameter and the second parameter is greater than a preset parameter difference value.

[0072] The standard parameter is a parameter corresponding to the same image as the current image collected by the image collector in a current environment without being shielded.

[0073] The state determination module 430 is configured to determine that the image collector is in a shielded state if the difference value between the first parameter and the standard parameter is greater than a preset standard difference value.

[0074] In the embodiments of the present application, the first parameter and the second parameter include a shutter value and / or a gain value.​

[0075] In the embodiments of the present application, the device further comprises:

[0076] The reference image acquisition module is configured to control the light supplement lamp to be turned on, and acquire a reference image collected by the image collector in a state where the light supplement lamp is turned on.

[0077] The brightness value comparison module is configured to determine that the image collector is in the state of being blocked if the brightness value of the reference image is consistent with the brightness value of the current image.

[0078] In the embodiments of the present application, the device further comprises:

[0079] The shutter value comparison module is configured to determine that the difference value between the first parameter and the second parameter is greater than the preset parameter difference value if the first shutter value contained in the first parameter is greater than the second shutter value contained in the second parameter, and the difference between the first shutter value and the second shutter value is greater than a preset shutter value difference; and / or,

[0080] The gain value comparison module is configured to determine that the difference value between the first parameter and the second parameter is greater than the preset parameter difference value if the first gain value contained in the first parameter is greater than the second gain value contained in the second parameter, and the difference between the first gain value and the second gain value is greater than a preset gain value difference.

[0081] In the embodiments of the present application, the state determination module 430 comprises:

[0082] The standard shutter value comparison unit is configured to determine that the image collector is in the state of being blocked if the first shutter value contained in the first parameter is greater than the standard shutter value contained in the standard parameter, and the difference between the first shutter value and the standard shutter value is greater than a first preset difference threshold; and / or,

[0083] The standard gain value comparison unit is configured to determine that the image collector is in the state of being blocked if the first gain value contained in the first parameter is greater than the standard gain value contained in the standard parameter, and the difference between the first gain value and the standard gain value is greater than a second preset difference threshold.

[0084] In the embodiments of the present application, the device further comprises:

[0085] The environmental audio acquisition module is configured to acquire a current environmental audio collected by the microphone at a current time, and a historical environmental audio collected before the current time.

[0086] The environmental audio comparison module is configured to determine that the image collector is in the blocked state if a volume value of the current environmental audio is less than a volume value of the historical environmental audio and a frequency variation of the current environmental audio is less than a frequency variation of the historical environmental audio.

[0087] In the embodiments of the present application, the device further comprises:

[0088] The audio playing module is configured to play preset frequency audio through the audio generating device.

[0089] The playing audio acquisition module is configured to acquire current playing audio collected by the microphone at a current time and historical playing audio collected before the current time.

[0090] The playing audio comparison module is configured to determine that the image collector is in the blocked state if audio features of the current playing audio and variation features of the historical playing audio are consistent with preset variation features.

[0091] The preset variation features are variation features of audio collected by the microphone when the microphone is not blocked and when the microphone is blocked, which are acquired in advance.

[0092] The image collector blocking detection device provided in the embodiments of the present application can execute the image collector blocking detection method provided in any of the embodiments of the present application, and has the corresponding function modules and beneficial effects of the execution method.

[0093] Figure 6 A structural schematic diagram of an electronic device provided in an embodiment of the present application is shown. Figure 6 A block diagram of an exemplary electronic device 512 suitable to implement embodiments of the present application is shown. Figure 6 The electronic device 512 shown is merely an example, and should not impose any limitation on the functions and use range of the embodiments of the present application.

[0094] As shown in Figure 6 The electronic device 512 can include one or more processors 516, and a memory 528 for storing one or more programs, when the one or more programs are executed by the one or more processors 516, the one or more processors 516 implement the image collector blocking detection method provided in the embodiments of the present application, including:

[0095] Acquire a first parameter of the image collector at a current time and a current image collected by the image collector, and a historical image collected before the current time and a second parameter of the image collector when the historical image is collected.

[0096] If the difference value of the current image and the historical image is greater than a preset image difference value, and the difference value of the first parameter and the second parameter is greater than a preset parameter difference value, the first parameter is compared with a standard parameter;

[0097] The standard parameter is a parameter corresponding to the current image collected by the image collector in a non-occluded state in the current environment.

[0098] If the difference value of the first parameter and the standard parameter is greater than a preset standard difference value, it is determined that the image collector is in an occluded state.

[0099] The components of electronic device 512 can include, but are not limited to, one or more processors or processor(s) 516, memory 528, and bus 518 that connects the various device components, including the memory 528 and the processor(s) 516.

[0100] Bus 518 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics accelerator bus, a processor or local bus using any of a variety of bus architectures. By way of example, these architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

[0101] Electronic device 512 typically includes a variety of computer device readable media. Such media can be any available media that is located either internally or externally to electronic device 512, including both volatile and nonvolatile media, removable and non-removable media.

[0102] Memory 528 can include computer device readable media in the form of volatile memory, such as random access memory (RAM) 530 and / or cache memory 532. Electronic device 512 can further include other removable / non-removable, volatile / non-volatile computer device storage media. By way of example only, storage system 534 can be used for reading from and writing to non-removable, non-volatile magnetic media (e.g., a "hard drive"). Figure 6 Not shown, is an example of removable / non-removable, volatile / non-volatile computer device storage media, such as a magnetic disk drive and corresponding disk drive controller, which typically reads from and writes to non-removable, non-volatile magnetic media (e.g., a "hard drive"). Figure 6A disk drive, a floppy disk drive, a CD-ROM drive, a DVD-ROM drive, or other removable media drive, or any combination thereof, can be provided in the computing device 500 for reading from and writing to a removable nonvolatile media (e.g., a floppy disk, a CD-ROM, a DVD-ROM, a Blu-ray Disc®, or another optical disc, a flash memory, a magnetic tape, or another magnetic medium, a solid-state memory device, or any combination thereof). Such drives can be connected to the bus 518 by one or more data media interfaces. The memory 528 can include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the application.

[0103] The program / utility 540 having a set (at least one) of program modules 542 can be stored in memory 528 by way of example, and not limitation, as well as an operating system, one or more application programs, other program modules, and program data, each or any combination thereof, can include implementation of a network environment. The program modules 542 generally carry out the functions and / or methodologies of embodiments of the application as described herein.

[0104] The electronic device 512 can also communicate with one or more external devices 514 (such as a keyboard or a pointing device, a display 524, etc.) by way of an input / output (I / O) interface 522. Further, the electronic device 512 can communicate with one or more devices that enable a user to interact with the electronic device 512 by way of an I / O interface 522. Communication can be enabled by way of, for example, an I / O interface 522. Figure 6 As indicated, the network adapter 520 is in communication with the other ​ Other hardware and / or software modules that can be used in conjunction with the electronic device 512 can also be provided, such as a microcode, device drivers, redundant processing units, external disk drive arrays, RAID devices, tape drives, and data archival storage devices, etc.

[0105] The processor 516 performs a variety of functions as described above by executing instructions of one or more programs stored in the memory 528. For example, the processor 516 can implement a method for occlusion detection of an image collector.

[0106] An embodiment of the present application provides a storage medium containing computer executable instructions, which when executed by a computer processor, are used to perform an occlusion detection method of an image collector, comprising:

[0107] acquire a first parameter of the image collector at a current time and a current image collected at the current time, and a historical image collected before the current time and a second parameter of the image collector when the historical image is collected;

[0108] If the difference value of the current image and the historical image is greater than a preset image difference value, and the difference value of the first parameter and the second parameter is greater than a preset parameter difference value, the first parameter is compared with a standard parameter;

[0109] The standard parameter is a parameter corresponding to the current image collected by the image collector in a non-occluded state in the current environment.

[0110] If the difference value of the first parameter and the standard parameter is greater than a preset standard difference value, it is determined that the image collector is in an occluded state.

[0111] The computer storage medium of the embodiments of the present application can adopt any combination of one or more computer readable storage media. The computer readable storage medium can be a computer readable signal storage medium or a computer readable storage medium. The computer readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor device, device or device, or any combination of the above. More specific examples (non-exhaustive list) of computer readable storage media include: electrical connections with one or more conductors, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In the embodiments of the present application, the computer readable storage medium can be any tangible storage medium containing or storing a program that can be used by or in conjunction with an instruction execution device, device or device.

[0112] The computer readable signal storage medium can include a data signal propagating in a baseband or as a carrier wave part of a data signal, in which a computer readable program code is carried. Such a propagating data signal can take various forms, including but not limited to electromagnetic signals, optical signals or any suitable combination of the above. The computer readable signal storage medium can also be any computer readable storage medium other than the computer readable storage medium, which can send, propagate or transmit programs for use by or in conjunction with an instruction execution device, device or device.

[0113] The program code contained on the computer readable storage medium can be transmitted in any suitable storage medium, including but not limited to wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0114] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0115] Note that, as previously discussed, the above merely describes a few exemplary embodiments of the present application and the principles of technology used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, modifications and substitutions can be made by those skilled in the art without departing from the scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the claims.

Claims

1. An occlusion detection method for an image acquisition device, characterized in that, The method includes: Obtain the first parameter of the image acquisition device at the current moment and the currently acquired image, as well as the historical images acquired before the current moment and the second parameter of the image acquisition device when the historical images were acquired; If the difference between the current image and the historical image is greater than a preset image difference value, and the difference between the first parameter and the second parameter is greater than a preset parameter difference value, then the first parameter is compared with the standard parameter. The standard parameters are those corresponding to the acquisition of the same image as the current image when the image acquisition device is not obstructed in the current environment. If the difference between the first parameter and the standard parameter is greater than a preset standard difference value, then the method further includes: Play a preset frequency audio through an audio generator; Get the currently playing audio captured by the microphone at the current moment, as well as the historical playing audio captured before the current moment; If the audio characteristics of the currently playing audio and the change characteristics of the historically played audio are consistent with the preset change characteristics, then it is determined that the image acquisition device is in an occluded state. The preset change feature is the change feature of the audio collected when the microphone is not blocked and the audio collected when the microphone is blocked.

2. The method according to claim 1, characterized in that, The first parameter and the second parameter include shutter value and / or gain value.

3. The method according to claim 1, characterized in that, If the difference between the current image and the historical image is greater than a preset image difference value, and the difference between the first parameter and the second parameter is greater than a preset parameter difference value, then the method further includes: Control the fill light to turn on, and acquire the reference image captured by the image acquisition device when the fill light is on; If the brightness value of the reference image is the same as the brightness value of the current image, then the image acquisition device is determined to be in an occluded state.

4. The method according to claim 1, characterized in that, The process for determining whether the difference between the first parameter and the second parameter is greater than the preset parameter difference value includes: If the first shutter speed value included in the first parameter is greater than the second shutter speed value included in the second parameter, and the difference between the first shutter speed value and the second shutter speed value is greater than a preset shutter speed difference, then it is determined that the difference between the first parameter and the second parameter is greater than the preset parameter difference value; and / or, If the first gain value contained in the first parameter is greater than the second gain value contained in the second parameter, and the difference between the first gain value and the second gain value is greater than the preset gain value difference, then it is determined that the difference between the first parameter and the second parameter is greater than the preset parameter difference value.

5. The method according to claim 4, characterized in that, If the difference between the first parameter and the standard parameter is greater than a preset standard difference value, then the image acquisition device is determined to be in an occluded state, including: If the first shutter speed value included in the first parameter is greater than the standard shutter speed value included in the standard parameter, and the difference between the first shutter speed value and the standard shutter speed value is greater than a first preset difference threshold, then it is determined that the image acquisition device is in an occluded state; and / or, If the first gain value contained in the first parameter is greater than the standard gain value contained in the standard parameter, and the difference between the first gain value and the standard gain value is greater than a second preset difference threshold, then it is determined that the image acquisition device is in an occluded state.

6. The method according to claim 1, characterized in that, If the difference between the first parameter and the standard parameter is greater than a preset difference threshold, the method further includes: Acquire the current environmental audio captured by the microphone at the current moment, as well as the historical environmental audio captured before the current moment; If the volume of the current ambient audio is less than the volume of the historical ambient audio, and the frequency change of the current ambient audio is less than the frequency change of the historical ambient audio, then the image acquisition device is determined to be in an occluded state.

7. An image acquisition device for occlusion detection, characterized in that, The device includes: The data acquisition module is used to acquire the first parameters of the image acquisition device at the current moment and the currently acquired image, as well as the historical images acquired before the current moment and the second parameters of the image acquisition device when acquiring the historical images; The comparison module is used to compare the first parameter with a standard parameter if the difference between the current image and the historical image is greater than a preset image difference value, and the difference between the first parameter and the second parameter is greater than a preset parameter difference value. The standard parameters are those corresponding to the acquisition of the same image as the current image when the image acquisition device is not obstructed in the current environment. The status determination module is used to play an audio at a preset frequency through an audio generator if the difference between the first parameter and the standard parameter is greater than a preset standard difference value. Get the currently playing audio captured by the microphone at the current moment, as well as the historical playing audio captured before the current moment; If the audio characteristics of the currently playing audio and the change characteristics of the historically played audio are consistent with the preset change characteristics, then it is determined that the image acquisition device is in an occluded state. The preset change feature is the change feature of the audio collected when the microphone is not blocked and the audio collected when the microphone is blocked.

8. An electronic device, characterized in that, The electronic device includes: One or more processors; Memory, used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the image acquisition occlusion detection method as described in any one of claims 1-6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the image acquisition occlusion detection method as described in any one of claims 1-6.

Citation Information

Patent Citations

  • Camera shielding detection method and device, storage medium and electronic equipment

    CN111970405A

  • Camera blockage detection for autonomous driving systems

    US20200380269A1