Light detection method and device of image monitoring equipment

Abstract

The invention discloses a light detection method for image monitoring equipment, and the method comprises the steps: obtaining a configuration file matched with the type of an image sensor at a microprocessor MCU side in the image monitoring equipment when the image monitoring equipment is in a dormant state, the type of the image sensor is divided at least according to the self-adaptive capability of exposure parameters of the image sensor along with environment change, the configuration file at least comprises set exposure parameters, and the image sensor is configured to enter a low-power-consumption online mode based on the configuration file, so that the image sensor collects image data according to the set exposure parameters in the mode, image brightness information is obtained according to the type of an image sensor and collected image data so as to carry out light detection, the image sensor is connected with the MCU and a system-on-chip (SOC) in the image monitoring equipment, and the image monitoring equipment does not comprise a photosensitive assembly used for light detection. The problem that real-time snapshot cannot be realized under the condition that the image monitoring equipment is not provided with a photosensitive component is solved.

Description

Technical Field

[0001] The present invention relates to the field of image monitoring, and in particular to a light detection method of an image monitoring device. Background Art

[0002] With the development of technology, more and more image monitoring devices are widely used. Low-power image monitoring devices are one of the image monitoring devices that are powered by wireless batteries and can provide users with environmental images for a long time.

[0003] See also Figure 1 As shown, Figure 1 The figure is a schematic diagram of the internal hardware circuit of an existing low-power image monitoring device. The low-power image monitoring device includes a single-chip microcomputer (MCU), a non-image component connected to the single-chip microcomputer, a chip on a chip (SOC), and an image sensor connected to the SOC.

[0004] Among them, non-image components include:

[0005] Environmental sensing components for environmental detection, such as passive infrared detectors (PIR), radar sensors, etc.

[0006] Photosensitive components for light detection,

[0007] Infrared switching components for infrared switching, such as infrared switch (IRCUT),

[0008] A fill light component for fill light.

[0009] When the low-power image monitoring device is in sleep mode, the SOC and image sensor are powered off, and the MCU is in low-power standby mode. When someone is detected walking by, the environmental perception component triggers an MCU interrupt. The MCU first determines the day or night state based on the light detection result of the photosensitive component, and then modifies the state of the infrared switching component and the fill light component, and triggers the SOC and image sensor to power on. The SOC quickly outputs the image to the user end.

[0010] In order to make the images clearly displayed in front of the user, existing image monitoring equipment usually has a day and night mode switching function. When the daytime is bright, the device outputs color images; when the night environment is dark or the full-color night vision mode is on, the infrared switching component receives visible light, and the visible light fill light component is turned on to output color images; when the night environment is dark or the infrared night vision mode is on, the infrared fill light component is turned on, and the infrared switching component receives infrared light to output black and white images. Therefore, it is necessary to switch between day mode and night mode according to the environmental conditions.

[0011] For low-power image monitoring devices with photosensitive components, the day and night mode judgment when the SOC is just powered on and the automatic exposure parameters (AE, Auto Exposure) of the SOC output image are currently determined by the MCU based on light detection performed by the photosensitive component circuit.

[0012] For low-power image monitoring devices that do not have photosensors, the SOC can only determine the day and night mode after it is powered on to collect image data. This not only causes a delay in the output of image data, but also makes it impossible to capture images in real time. Summary of the invention

[0013] The invention provides a light detection method for an image monitoring device, so as to solve the problem that the image monitoring device cannot capture images in real time when it has no light-sensitive components.

[0014] The first aspect of the present application provides a light detection method for an image monitoring device, the method comprising: on a microprocessor MCU side in the image monitoring device,

[0015] When the image monitoring device is in a dormant state, a microprocessor MCU in the image monitoring device obtains a configuration file that matches the type of the image sensor, wherein the type of the image sensor is classified at least according to the adaptive capability of the exposure parameter of the image sensor as the environment changes, and the configuration file at least includes the set exposure parameter.

[0016] Based on the configuration file, the image sensor is configured to enter the low-power online mode, so that the image sensor collects image data according to the set exposure parameters in this mode.

[0017] According to the image sensor type and the collected image data, the image brightness information is obtained for light detection.

[0018] in,

[0019] The image sensor is connected to the MCU and the system on chip SOC in the image monitoring device respectively.

[0020] The image monitoring device does not include a photosensitive component for light detection.

[0021] Preferably, the image sensor types are further divided according to whether the image sensor outputs image brightness information;

[0022] The configuration file also includes: a set first resolution and a first frame rate, which are used to enable the image sensor to output the collected image data according to the set first resolution and the set first frame rate in the low power online mode;

[0023] The method further comprises:

[0024] When the image monitoring device switches from the sleep state to the awake state, the MCU obtains the image brightness information according to the image sensor type and the collected image data to perform light detection, and determines the exposure parameters of the first frame image in the awake state according to the image sensor type.

[0025] After the SOC is powered on, the SOC configures the image sensor to output the collected image data at the set second resolution and second frame rate.

[0026] The first resolution is smaller than the second resolution, and the first frame rate is smaller than the second frame rate.

[0027] Preferably, the light detection comprises:

[0028] According to the image brightness information, identify whether the current environment is a daytime environment or a nighttime environment;

[0029] The image sensor types include:

[0030] The first type of image acquisition is performed according to the exposure parameters configured externally by the image sensor,

[0031] A second type of performing image acquisition according to exposure parameters configured externally by the image sensor and outputting image brightness information, and or

[0032] The third type is an image sensor that configures automatic exposure parameters according to the environment and outputs the automatic exposure parameters and image brightness information;

[0033] For the first type image sensor and the second type image sensor, the exposure parameters include: a set fixed exposure parameter,

[0034] For the third type of image sensor, the exposure parameters include: set initial automatic exposure parameters.

[0035] Preferably, configuring the image sensor to enter a low power consumption online mode based on the configuration file includes:

[0036] For the first type image sensor and / or the second type image sensor, the image sensor is configured according to the fixed exposure parameters set in the configuration file, so that the image sensor collects image data according to the fixed exposure parameters, or

[0037] For the third type of image sensor, the image sensor is configured according to the initial exposure parameters set in the configuration file, so that the image sensor collects image data based on the automatic exposure parameters configured based on the initial automatic exposure parameters.

[0038] Preferably, the identifying whether the current environment is a daytime environment or a nighttime environment according to the image brightness information includes:

[0039] For the first type of image sensor, the MCU receives image data from the image sensor, calculates the average brightness of each pixel, and determines that the current environment is a night environment when the average brightness is less than a set first brightness threshold; otherwise, the current environment is determined to be a day environment.

[0040] For the second type of image sensor, the MCU receives brightness information from the image sensor, and when the brightness value is less than a set second brightness threshold, determines that the current environment is a night environment; otherwise, determines that the current environment is a day environment, or

[0041] For the third type of image sensor, the MCU receives brightness information and exposure parameters from the image sensor, where the exposure parameters include exposure rows and exposure gains, and calculates the ratio of the product of the exposure row and the exposure gain to the brightness value. If the ratio is greater than a set threshold, the current environment is determined to be a night environment; otherwise, the current environment is determined to be a day environment.

[0042] Preferably, the MCU determines the exposure parameters of the first frame image in the awake state according to the type of the image sensor, including:

[0043] For the first type image sensor and / or the second type image sensor, the MCU determines the exposure parameter of the first frame image in the awakened state according to the current image brightness information based on the correspondence between the pre-stored brightness information and the exposure parameter.

[0044] For the third type of image sensor, the MCU converts the exposure parameters before SOC startup into exposure parameters after SOC startup based on the principle that the total exposure amount before and after SOC startup is consistent, and determines the converted exposure parameters as the exposure parameters of the first frame image in the awakened state.

[0045] Preferably, converting the exposure parameter before SOC startup into the exposure parameter after SOC startup includes:

[0046] Calculate the product of the exposure row before SOC starts, the exposure gain, and the absolute exposure time corresponding to one exposure row.

[0047] The values ​​of the exposure row, exposure gain, and absolute exposure time corresponding to one exposure row after SOC is started are set so that the product of the exposure row, exposure gain, and one exposure row after SOC is started is equal to the product of the exposure row, exposure gain, and absolute exposure time corresponding to one exposure row before SOC is started.

[0048] Preferably, the corresponding relationship between the brightness information and the exposure parameter is included in a configuration file.

[0049] The step of obtaining a configuration file matching the image sensor type includes:

[0050] The MCU searches for a configuration file that matches the image sensor type from the configuration file set according to the set image sensor type, wherein the configuration file set includes: configuration files corresponding to different image sensor types,

[0051] or,

[0052] The MCU reads the pre-stored configuration file of the image sensor type from the memory.

[0053] A second aspect of the present application provides an image monitoring device, the device comprising a microprocessor, an image sensor, a system on chip connected to the microprocessor, an image sensor connected to the system on chip, and a non-image component connected to the MCU, wherein the image sensor is also connected to the MCU.

[0054] When the device is in a dormant state, the image sensor is configured by the MCU to work in a low-power online mode according to a configuration file, so that the image sensor collects image data in this mode according to set exposure parameters, wherein the configuration file matches the type of the image sensor and at least includes the set exposure parameters, and the type of the image sensor is divided at least according to the adaptive capability of the exposure parameters of the image sensor to changes in the environment,

[0055] The non-imaging components do not include photosensitive components for light detection.

[0056] A third aspect of the present application provides a light detection device for an image monitoring device, the device comprising: a microprocessor and a memory, the memory storing a computer program, the microprocessor being configured to execute the computer program to implement any step of the light detection method for the image monitoring device.

[0057] The light detection method for an image monitoring device provided in an embodiment of the present application enables the image sensor connected to the MCU to operate in a low-power online mode when the device is in a sleep state, so that the image sensor can capture images in real time, thereby utilizing the real-time captured image data for light detection, thereby avoiding delayed output of image data due to SOC power-on. The present application is beneficial for removing photosensitive components from the image monitoring device, thereby simplifying the structure of the image monitoring device and facilitating the miniaturization of the image monitoring device. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1 The present invention is a schematic diagram of the internal hardware circuit of an existing low-power image monitoring device.

[0059] Figure 2 A schematic flow chart of a light detection method for an image monitoring device according to an embodiment of the present application.

[0060] Figure 3A schematic diagram of the internal hardware circuit of the low-power image monitoring device according to an embodiment of the present application.

[0061] Figure 4 A schematic flow chart of a light detection method for an image monitoring device without a photosensitive component according to an embodiment of the present application.

[0062] Figure 5 A schematic diagram of a light detection device for an image monitoring device. DETAILED DESCRIPTION

[0063] In order to make the objectives, technical means and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings.

[0064] The light detection method for an image monitoring device provided in an embodiment of the present application, in the case where the image monitoring device does not have a photosensitive component for light detection, when the image monitoring device is in a sleep state, by configuring an image sensor connected to the MCU to be in a low-power online mode, the image sensor collects image data according to set exposure parameters, and obtains image brightness information based on the type of image sensor and the collected image data for light detection.

[0065] See also Figure 2 As shown, Figure 2 This is a flow chart of a light detection method for an image monitoring device according to an embodiment of the present application. The method comprises: on the microprocessor MCU side in the image monitoring device,

[0066] Step 21, when the image monitoring device is in a dormant state, obtain a configuration file that matches the image sensor type, wherein the image sensor type is distinguished at least according to the adaptive capability of the exposure parameter of the image sensor with environmental changes, and the configuration file at least includes the set exposure parameter, so that different image sensor types correspond to different configuration files.

[0067] The sleep state refers to the MCU in the image monitoring device being in low power mode and the SOC being in power-off state.

[0068] As an example, the image sensor type can also be divided according to whether the image sensor outputs image brightness information.

[0069] As an example, the adaptability of exposure parameters to changes in the environment refers to whether the image sensor has an automatic exposure function. For example, image sensors with the automatic exposure function are of one type, and image sensors without the automatic exposure function are of another type.

[0070] It should be understood that the configuration file is pre-generated, and the configuration file can be stored locally in the image monitoring device or in a server.

[0071] Step 22: Based on the configuration file, configure the image sensor to enter a low-power online mode, so that the image sensor collects image data according to the set exposure parameters in this mode.

[0072] Compared with the background art mode of not working when the power is cut off and no power consumption, the low power consumption online mode means that the image sensor operates in real time in a low power consumption mode without power supply.

[0073] As an example, the configuration file further includes: a set first resolution and a first frame rate, which are used to enable the image sensor to output the collected image data according to the set first resolution and the first frame rate in the low power online mode;

[0074] It should be understood that the configuration file may be a readable file for the MCU to read and parse, or may be an executable code.

[0075] Step 23, according to the image sensor type and the collected image data, obtain image brightness information to perform light detection,

[0076] As an example, light detection includes: identifying whether the current environment is a daytime environment or a nighttime environment based on image brightness information, so that the MCU determines whether the non-image component and the image sensor are operating in a daytime mode or a nighttime mode;

[0077] in,

[0078] The image sensor is connected to the MCU and the system on chip SOC in the image monitoring device respectively.

[0079] The image monitoring device does not include a photosensitive component for light detection.

[0080] As an example, the method further includes:

[0081] When the image monitoring device switches from a sleep state to an awake state, the MCU determines the exposure parameters of the first frame image in the awake state according to the image sensor type, so as to optimize the brightness of the first frame image and improve the quality of the first frame image.

[0082] After the SOC is powered on, the SOC configures the image sensor to output the collected image data at the set second resolution and second frame rate.

[0083] The first resolution is smaller than the second resolution, and the first frame rate is smaller than the second frame rate.

[0084] The embodiment of the present application removes the photosensitive component of the image monitoring device, so that the hardware structure of the image monitoring device can be simplified, which is conducive to the miniaturization of the image monitoring device. In addition, since the image sensor works continuously, the real-time light detection is not affected by the removal of the photosensitive component, and the determination of the day and night mode is not affected by the removal of the photosensitive component. This avoids the delay caused by the traditional image monitoring device without a photosensitive component that needs to wait for the SOC to be powered on before identifying the day and night mode based on the image data, and the situation where it is impossible to capture in real time. With the reduction of power consumption of image sensors and the popularization of automatic exposure functions, the present application is conducive to reducing the overall power consumption of image monitoring devices and provides a soft photosensitivity detection solution for image monitoring devices.

[0085] To facilitate understanding of the embodiments of the present application, the following description is provided in conjunction with the working process of an image monitoring device.

[0086] See also Figure 3 As shown, Figure 3 This is a schematic diagram of the internal hardware circuit of the low-power image monitoring device of the embodiment of the present application. The low-power image monitoring device includes: a single-chip microcomputer (MCU), a non-image component connected to the single-chip microcomputer, an image sensor, and a chip on a chip (SOC).

[0087] Among them, non-image components include:

[0088] Environmental sensing components for environmental detection, such as passive infrared detectors (PIR), radar sensors, etc.

[0089] Infrared switching components for infrared switching, such as infrared switch (IRCUT),

[0090] A fill light component for fill light.

[0091] The non-image components do not include photosensitive components for light detection;

[0092] The image sensor is connected to the single-chip microcomputer and the on-chip chip respectively. As an example, the image sensor is connected to the single-chip microcomputer and the on-chip chip respectively through a two-wire serial bus.

[0093] The single-chip microcomputer is connected to the on-chip chip. As an example, the single-chip microcomputer is connected to the on-chip chip via a two-wire serial bus, SPI, etc.

[0094] In the sleep state, only the SOC is powered off, while the image sensor, MCU, and non-image components are in a low-power continuous working state.

[0095] In the awake state, the SOC is powered on, and the image sensor, MCU, and non-image components are in a normal working state without low power consumption.

[0096] See also Figure 4 As shown, Figure 4 This is a flow chart of a light detection method for an image monitoring device without a photosensitive component according to an embodiment of the present application. The method includes:

[0097] Step 41 : The image monitoring device is turned on, the image sensor, MCU, and SOC are all powered on, and the image monitoring device outputs image data.

[0098] Step 42, determine whether there is no external trigger source in the environment, such as no one passing by, no one ringing the doorbell, and no animal passing by.

[0099] If yes, the image monitoring device enters a dormant state, at which point the SOC is powered off and the MCU switches to a low power mode. After executing steps 43 to 44, the process returns to step 42 until the image monitoring device is powered off.

[0100] Otherwise, the image monitoring device enters the awake state, at which time the SOC is powered on, the MCU switches to the normal working mode, and after executing steps 45-46, the process returns to step 42 until the image monitoring device is shut down.

[0101] Step 43, the MCU obtains a configuration file that matches the image sensor type, and configures the image sensor according to the configuration file so that the image sensor enters a low-power online mode.

[0102] As an example, in the low power online mode, the image sensor outputs image data at a first resolution and a first frame rate, wherein the first resolution and the first frame rate are small resolution and low frame rate, for example, the image array is 100×100 and the frame rate is 5fps. The first resolution and the first frame rate may or may not be included in the configuration file.

[0103] As an example, image sensors are classified into the following types according to the adaptability of the exposure parameters of the image sensors to changes in the environment and whether the image sensors output image brightness information:

[0104] The first type of image acquisition is performed according to the exposure parameters configured externally by the image sensor, for example, the image sensor only has the function of acquiring images, and this type of image sensor can only output the acquired images;

[0105] The second type is to collect images according to the exposure parameters configured externally by the image sensor and output the image brightness information. For example, the image sensor has the function of counting the brightness of the picture. This type of image sensor can not only output the collected picture, but also count the brightness of the picture according to the configured exposure parameters and output the picture brightness information externally.

[0106] The third type of image sensor configures automatic exposure parameters according to the environment and outputs automatic exposure parameters and image brightness information. For example, it has an automatic exposure function. This type of image sensor can not only output the collected picture, but also perform automatic exposure internally, automatically configure different exposure parameters as the environment changes, and output exposure parameters and current picture brightness information to the outside.

[0107] Different image sensor types have different configuration parameters, which can be included in the configuration file.

[0108] For the first type, the image data is collected by setting fixed exposure parameters, and the image data is output at a low resolution and low frame rate, for example, the image array is 100×100 and the frame rate is 5fps, so as to maintain the image sensor in a low power online mode. In this way, the MCU maintains a low power mode, receives image data from the image sensor and calculates the received image information: statistics the screen brightness information, obtains the average screen brightness, and judges the current environment based on the average brightness.

[0109] For the second type, the image data is collected by setting fixed exposure parameters, and the image data is output at a low resolution and low frame rate, for example, the image array is 100×100 and the frame rate is 5fps, so as to maintain the image sensor in a low-power online mode. In this way, the MCU maintains a low-power mode, communicates with the image sensor, obtains the current screen brightness information output by the image sensor, and determines the current environment based on the screen brightness.

[0110] For the third type, the image data is collected based on the automatic exposure parameters configured based on the initial automatic exposure parameters, and the image data is output at a low resolution and low frame rate, for example, the image array is 100×100 and the frame rate is 5fps, so as to maintain the image sensor in a low power online mode. In this way, the MCU maintains the low power mode, communicates with the image sensor, obtains the current screen brightness information and automatic exposure parameters output by the image sensor, and determines the current environment according to the screen brightness and automatic exposure parameters.

[0111] As an example, the configuration file is pre-generated and stored in the memory according to the image sensor type. As another example, the configuration file is a configuration file set including multiple image sensor types pre-generated and stored in the memory, and the MCU searches for the configuration file of the image sensor type in the configuration file set according to the set image sensor type.

[0112] As an example, the exposure parameters include exposure row, and exposure gain.

[0113] Step 44 , the MCU, in the low power consumption mode, identifies whether the current environment is a daytime environment or a nighttime environment based on the image brightness information obtained according to the image sensor type.

[0114] As an example,

[0115] For the first type, the MCU receives image data from the image sensor and counts the brightness information of the picture to obtain the average brightness of the picture, for example, counting the brightness value of each pixel and calculating the average value of the counted brightness values; judging whether the average value is less than a set first brightness threshold, if so, it is determined to be a night environment, otherwise, it is determined to be a day environment;

[0116] For the second type, the MCU communicates with the image sensor to obtain the brightness information of the current image data, and determines whether the brightness value is less than a set second brightness threshold. If so, it is determined to be a night environment, otherwise, it is determined to be a day environment;

[0117] For the third type, the MCU communicates with the image sensor to obtain the brightness information of the current image data and the automatic exposure parameters, calculates the ratio of the product of the exposure row and the exposure gain to the brightness value, and determines whether the ratio is greater than a set threshold. If so, it is determined to be a night environment, otherwise, it is determined to be a day environment;

[0118] The calculation of the ratio can be expressed by a mathematical formula: AEexp*AEgain / Bright, where AEexp is the exposure value, AEgain is the exposure gain, and Bright is the brightness value.

[0119] Step 45, when the image monitoring device detects the existence of an external trigger source in the environment, the MCU identifies whether the current environment is a daytime environment or a nighttime environment according to the type of image sensor and based on the obtained picture brightness information. When the identified environment is a daytime environment, the MCU enters the daytime mode; when the identified environment is a nighttime environment, the MCU enters the nighttime mode. In this way, the need to wait for the SOC to be powered on to output image data is avoided, and real-time capture can be achieved.

[0120] Step 46: The MCU configures the exposure parameters of the first frame image according to the image sensor type.

[0121] As an example,

[0122] For the first type and the second type, the automatic exposure parameters are configured according to the brightness information. For example, Table 1 shows different first frame exposure rows and first frame exposure gains corresponding to different brightness, and the corresponding relationship can be stored in the form of a configuration file.

[0123] Table 1

[0124] Brightness information First frame exposure row First frame gain B1 AE_EXP1 AE_GAIN1 B2 AE_EXP2 AE_GAIN2 … … … … … … Bn AE_EXPn AE_GAINn

[0125] For the third type, the automatic exposure parameters of the first frame are calculated according to the principle of consistent total exposure. That is, under the same environment, the principle of consistent total exposure is followed. For example, when there is no external trigger source, the image output by the image sensor is an image array of 100×100 and a frame rate of 5fps. After the SOC is started, it is generally 1080P and the frame rate is 15fps. There are differences in the corresponding exposure rows and exposure gains before and after the SOC is started. Therefore, the principle of consistent total exposure is followed to convert the AE parameters before startup into the AE parameters after startup. That is:

[0126] AE_EXP1×AE_GAIN1×Line_Time1=AE_EXP2×AE_GAIN2×Line_Time2

[0127] Among them, Line_Time1 and Line_Time2 are the absolute exposure time corresponding to 1 exposure line in the current state, AE_EXP1, AE_GAIN1, and Line_Time1 are the AE parameters before startup, and AE_EXP2, AE_GAIN2, and Line_Time2 are the AE parameters after startup.

[0128] Step 47: After the SOC is started, the image sensor is controlled to capture the current image according to the configured automatic exposure parameters, and output the image at the second resolution and the second frame rate.

[0129] The second resolution is greater than the first resolution, and the second frame rate is greater than the first frame rate.

[0130] This embodiment removes the hardware photosensitive components of the image monitoring device, which is helpful to simplify the hardware structure of the image monitoring device, and classifies the image sensors, and pre-generates configuration files corresponding to different types of image sensors. When the image monitoring device is in a sleep state, the image sensor is configured to be in a low-power online mode using the configuration file, and brightness information is obtained with the help of image data collected in the low-power online mode to perform light detection, which not only makes a day and night judgment, but also optimizes the exposure parameter configuration of the first frame after the image monitoring device is awakened.

[0131] See also Figure 5 As shown, Figure 5 A schematic diagram of a light detection device of an image monitoring device, the device comprises: a microprocessor and a memory, the memory stores a computer program, and the microprocessor is configured to execute the computer program to implement the steps of the light detection method of the image monitoring device.

[0132] The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0133] The above-mentioned microprocessor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0134] An embodiment of the present invention further provides a computer-readable storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a microprocessor, the steps of a light detection method of an image monitoring device are implemented.

[0135] As for the apparatus / network-side device / storage medium embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0136] In this article, relational terms such as first and second, etc. are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0137] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A light detection method for an image monitoring device, characterized in that: The method includes: When the image monitoring device is in a dormant state, a microprocessor MCU in the image monitoring device obtains a configuration file that matches the type of the image sensor, wherein the type of the image sensor is classified at least according to the adaptive capability of the exposure parameter of the image sensor as the environment changes, and the configuration file at least includes the set exposure parameter. Based on the configuration file, the image sensor is configured to enter the low-power online mode, so that the image sensor collects image data according to the set exposure parameters in this mode. According to the image sensor type and the collected image data, the image brightness information is obtained for light detection. in, The image sensor is connected to the MCU and the system on chip SOC in the image monitoring device respectively. The image monitoring device does not include a photosensitive component for light detection.

2. The light detection method according to claim 1, characterized in that: The image sensor types are also divided according to whether the image sensor outputs image brightness information; The configuration file also includes: a set first resolution and a first frame rate, which are used to enable the image sensor to output the collected image data according to the set first resolution and the set first frame rate in the low power consumption online mode; The method further comprises: When the image monitoring device switches from the sleep state to the awake state, the MCU obtains the image brightness information according to the image sensor type and the collected image data to perform light detection, and determines the exposure parameters of the first frame image in the awake state according to the image sensor type. After the SOC is powered on, the SOC configures the image sensor to output the collected image data at the set second resolution and second frame rate. The first resolution is smaller than the second resolution, and the first frame rate is smaller than the second frame rate.

3. The light detection method according to claim 2, characterized in that: The light detection comprises: According to the image brightness information, identify whether the current environment is a daytime environment or a nighttime environment; The image sensor types include: The first type of image acquisition is performed according to the exposure parameters configured externally by the image sensor, The second type of image acquisition is performed according to the exposure parameters configured externally by the image sensor, and the image brightness information is output, or The third type is an image sensor that configures automatic exposure parameters according to the environment and outputs the automatic exposure parameters and image brightness information; For the first type image sensor and the second type image sensor, the exposure parameters include: a set fixed exposure parameter, For the third type of image sensor, the exposure parameters include: set initial automatic exposure parameters.

4. The light detection method according to claim 3, characterized in that: The step of configuring the image sensor to enter a low power consumption online mode based on the configuration file includes: For the first type of image sensor or the second type of image sensor, configuring the image sensor according to the fixed exposure parameters set in the configuration file so that the image sensor collects image data according to the fixed exposure parameters, or For the third type of image sensor, the image sensor is configured according to the initial exposure parameters set in the configuration file, so that the image sensor collects image data based on the automatic exposure parameters configured based on the initial automatic exposure parameters.

5. The light detection method according to claim 3, characterized in that: The step of identifying whether the current environment is a daytime environment or a nighttime environment according to the image brightness information includes: For the first type of image sensor, the MCU receives image data from the image sensor, calculates the average brightness of each pixel, and determines that the current environment is a night environment when the average brightness is less than a set first brightness threshold; otherwise, the current environment is determined to be a day environment. For the second type of image sensor, the MCU receives brightness information from the image sensor, and when the brightness value is less than a set second brightness threshold, determines that the current environment is a night environment; otherwise, determines that the current environment is a day environment, or For the third type of image sensor, the MCU receives brightness information and exposure parameters from the image sensor, where the exposure parameters include exposure rows and exposure gains, and calculates the ratio of the product of the exposure row and the exposure gain to the brightness value. If the ratio is greater than a set threshold, the current environment is determined to be a night environment; otherwise, the current environment is determined to be a day environment.

6. The light detection method according to claim 3, characterized in that: The MCU determines the exposure parameters of the first frame image in the awakened state according to the type of the image sensor, including: For the first type image sensor or the second type image sensor, the MCU determines the exposure parameter of the first frame image in the awakened state according to the current image brightness information based on the correspondence between the pre-stored brightness information and the exposure parameter. For the third type of image sensor, the MCU converts the exposure parameters before SOC startup into exposure parameters after SOC startup based on the principle that the total exposure amount before and after SOC startup is consistent, and determines the converted exposure parameters as the exposure parameters of the first frame image in the awakened state.

7. The light detection method according to claim 6, characterized in that: The converting the exposure parameter before the SOC is started into the exposure parameter after the SOC is started includes: Calculate the product of the exposure row before SOC starts, the exposure gain, and the absolute exposure time corresponding to one exposure row. The values ​​of the exposure row, exposure gain, and absolute exposure time corresponding to one exposure row after SOC is started are set so that the product of the exposure row, exposure gain, and one exposure row after SOC is started is equal to the product of the exposure row, exposure gain, and absolute exposure time corresponding to one exposure row before SOC is started.

8. The light detection method according to claim 6, characterized in that: The corresponding relationship between the brightness information and the exposure parameters is included in the configuration file. The step of obtaining a configuration file matching the image sensor type includes: The MCU searches for a configuration file that matches the image sensor type from the configuration file set according to the set image sensor type, wherein the configuration file set includes: configuration files corresponding to different image sensor types, or, The MCU reads the pre-stored configuration file of the image sensor type from the memory.

9. An image monitoring device, comprising a microprocessor, an image sensor, a system on chip connected to the microprocessor, an image sensor connected to the system on chip, and a non-image component connected to the MCU, characterized in that: The image sensor is also connected to the MCU. When the device is in a dormant state, the image sensor is configured by the MCU to work in a low-power online mode according to a configuration file, so that the image sensor collects image data in this mode according to set exposure parameters, wherein the configuration file matches the type of the image sensor and at least includes the set exposure parameters, and the type of the image sensor is divided at least according to the adaptive capability of the exposure parameters of the image sensor to changes in the environment, The non-imaging components do not include photosensitive components for light detection.

10. A light detection device for an image monitoring device, characterized in that: The device comprises: a microprocessor and a memory, wherein the memory stores a computer program, and the microprocessor is configured to execute the computer program to implement the steps of the light detection method of the image monitoring device according to any one of claims 1 to 8.

Images