Multi-region multi-spectral detection device, detection method thereof, and electronic device

Abstract

The present application discloses a multi-region multi-spectral detection device, a multi-region multi-spectral detection method thereof, and an electronic device. The multi-region multi-spectral detection device has a plurality of detection regions, and a plurality of spectral channels with different bands are arranged in the detection regions. The multi-region multi-spectral detection method includes: setting the number of single-frame openings of the target spectral channel corresponding to the target band in each detection frame according to the response rate requirement of the target band. The multi-region multi-spectral detection method can reduce power consumption.

Description

Technical Field

[0001] This application relates to the technical field of multi-region and multi-spectral detection, and specifically relates to a multi-region and multi-spectral detection device, its detection method, and an electronic device Background Art

[0002] The essence of photography is to record the light information at that time. Currently, mainly through CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) devices, based on photodiodes, the optical signal is converted into an electrical signal for detection and recording and preservation. However, limited by the working principle of photodiodes, these methods can only record the brightness information at different positions according to the light intensity, and cannot capture the color information

[0003] The color distinction of light is determined by the wavelength of light. Different colors of light correspond to different bands respectively. For example, the wavelength of red light is about 620nm - 780nm, the wavelength of green light is about 490nm - 560nm, and the wavelength of near-infrared light is about 780nm - 1500nm. Photodiodes can only detect the intensity of light energy and cannot distinguish different wavelengths. Different from the human eye, the sensitivity of the human eye to the light energy of different wavelengths is different. For example, if the ambient light contains light of the above three bands at the same time and the light intensity of each band is the same, the green light energy perceived by our human eyes will be significantly higher than the red light energy, and the infrared light energy cannot be perceived by the human eyes. The purpose of photography is to restore the light and shadow information that the human eyes can perceive at that time. However, due to the undifferentiated recording of photodiodes for light of different wavelengths, there will be a phenomenon that the photo is inconsistent with the actual light and shadow effect seen, that is, the so-called color cast

[0004] In the context of the increasing requirements for photography in current smart mobile phones and other intelligent terminal devices, the demand of mobile phone manufacturers for multi-spectral detection of ambient light is becoming more and more urgent. The so-called multi-spectral detection is to detect the optical signals of different wavelengths in the ambient light respectively and record the magnitude of the light energy of each band, which is equivalent to recording all the component information of each band in the ambient light at that time. Subsequently, intelligent terminal devices can use this information to perform algorithm correction on the captured pictures and effectively restore the light conditions that the human eyes can perceive at the moment when the image was recorded

[0005] Multi-region and multi-spectral imaging can perform multi-spectral detection on different regions respectively, and the imaging effect is better. However, due to the need for more spectral channels in multi-region and multi-spectral imaging, the power consumption during the working process is relatively large

[0006] How to reduce the power consumption of multi-region and multi-spectral detection is an urgent problem to be solved at present Summary of the Invention

[0007] In view of this, the present application provides a multi-region multi-spectral detection device, its detection method, and an electronic device to solve the problem of high power consumption of existing multi-region multi-spectral detection devices.

[0008] The present application discloses a multi-region multi-spectral detection method for a multi-region multi-spectral detection device. The multi-region multi-spectral detection device has a plurality of detection regions, and a plurality of spectral channels with different bands are provided in the detection regions. The multi-region multi-spectral detection method includes: setting the number of single-frame openings of the target spectral channel corresponding to the target band in each detection frame according to the response rate requirement of the target band.

[0009] Optionally, the higher the response rate requirement, the more the number of single-frame openings of the target spectral channel.

[0010] Optionally, the detection data obtained during the previous detection is used as the detection data for the current detection frame of the unopened target spectral channel.

[0011] Optionally, the number of single-frame openings is M / p, where M is the total number of target spectral channels, p is a response rate parameter, and p≥1; when p>1, the target spectral channels opened in adjacent detection frames do not repeat, so as to complete the detection of all target spectral channels within p detection frames.

[0012] Optionally, different numbers of single-frame openings are respectively configured for the detection regions at different positions; and / or, different numbers of single-frame openings are respectively configured for the spectral channels with different bands; and / or, according to the change amount of the detection data of each band in the detection result, the number of single-frame openings of the spectral channel corresponding to the band with a change amount of the detection data less than the threshold is reduced.

[0013] Optionally, a plurality of different scene modes are preset, and corresponding numbers of single-frame openings are respectively configured for the spectral channels corresponding to different bands in each scene mode.

[0014] Optionally, the plurality of different scene modes include a night scene mode. In the night scene mode, the number of single-frame openings of the sensitive band is M, and the number of single-frame openings of other bands is M / p. The average value of the detection data of p detections is used as the effective detection data of the sensitive band.

[0015] Optionally, a plurality of spectral channels with different bands are provided in the detection region, and the duration of the single-frame detection window of each spectral channel is a preset duration; the multi-region multi-spectral detection method further includes: adjusting the actual detection duration within the single-frame detection window of the spectral channel according to the detected light intensity.

[0016] Optionally, the method for adjusting the actual detection duration includes: detecting the detection signal output by the spectral channel, and stopping the detection when the amplitude of the detection signal increases to a preset amplitude; the preset amplitude corresponds to a first threshold value of the spectral channel; when the amplitude of the detection signal is less than or equal to the preset amplitude, continue the detection until the end of a single-frame detection window; or, pre-detecting the light intensity passing through the spectral channel, and determining the actual detection duration according to the detected light intensity magnitude.

[0017] The present application further provides a multi-region multi-spectral detection device, including: a plurality of detection regions, where the detection regions are provided with a plurality of spectral channels of different bands; a detection control module, connected to the plurality of detection regions, and configured to set the number of single-frame openings of the target spectral channel corresponding to the target band in each detection frame according to the response rate requirement of the target band.

[0018] The present application further provides a multi-region multi-spectral detection device, including: a plurality of detection regions, where the detection regions are provided with a plurality of spectral channels of different bands; a memory, configured to store a computer program; a processor, connected to the plurality of detection regions and the memory, and when the computer program is executed by the processor, it can implement the multi-region multi-spectral detection method as described in any one of the above.

[0019] The present application further provides an electronic device, including the multi-region multi-spectral detection device as described in any one of the above; or capable of implementing the multi-region multi-spectral detection method as described in any one of the above.

[0020] The above multi-region multi-spectral detection method of the present application proposes an energy-saving mode for multi-region multi-spectral detection that adapts to the scene. By using the different requirements of different scenes for the spectral detection response rates of different colors (bands) and different regional positions, flexibly select the number of single-frame openings of the detection channels within a single-frame detection window, so that while meeting the detection response speed, it effectively reduces the power consumption required for detection. Description of the Drawings

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those skilled in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0022] Figure 1 It is a distribution schematic diagram of the detection regions of the multi-region multi-spectral detection method according to an embodiment of the present application;

[0023] Figure 2 It is a distribution schematic diagram of the spectral channels within the detection regions of the multi-region multi-spectral detection method according to an embodiment of the present application;

[0024] Figures 3a to 3c It is a schematic diagram of the detection process of the target spectral channel in the multi-region multi-spectral detection method according to an embodiment of the present application;

[0025] Figure 4 It is a schematic diagram of a single-frame detection window and the actual detection duration according to an embodiment of the present application;

[0026] Figure 5a It is a schematic diagram of the relationship between light intensity and the actual detection duration according to an embodiment of the present application;

[0027] Figure 5b It is a schematic diagram of the relationship between light intensity and the actual detection duration according to another embodiment of the present application;

[0028] Figure 5c It is a schematic diagram of the relationship between light intensity and the actual detection duration according to another embodiment of the present application. Detailed implementation manners

[0029] As described in the background art, the power consumption of the existing multi-region multi-spectral detection is relatively large.

[0030] Please refer to Figure 1 , which is a schematic diagram of the detection area distribution of the multi-region multi-spectral detection according to an embodiment of the present invention.

[0031] To achieve multi-region multi-spectral detection, it is necessary to increase the multi-spectral detection area. For example, the imaging area is divided into Figure 1 7*5 detection areas in the example. And multiple spectral channels corresponding to different bands are respectively set in each area to detect the light signal energy of multiple different wavelengths (colors) (in Figure 1 the example, each area detects 9 signals of different bands). The spectral channel includes both a device for performing photoelectric conversion in a specific band (such as a photodiode), and a processing circuit connected to the device for processing the charge generated by the photoelectric conversion of the device to generate a detection signal. Each area and each band in the area require a corresponding spectral channel for light intensity. For example Figure 1 , 7*5*9 = 341 spectral channels are required, and each spectral channel outputs a detection signal. It can be seen that the number of detection channels that need to be simultaneously turned on for multi-region multi-spectral detection is also correspondingly large. In addition, the change range of the light energy of each band in different environments is very large, so it is required that each detection channel has a very large dynamic measurement range.

[0032] Therefore, the number of spectral channels that need to work simultaneously for multi-region multi-spectral detection is very large, and each channel has a high detection accuracy requirement. All spectral channels need to be turned on simultaneously and continuously detect the light intensity energy of the surrounding ambient light in each band in real time. This requires a large amount of power consumption.

[0033] To solve the above problems, the present application proposes a new multi-region multi-spectral detection device and detection method. By taking advantage of the different requirements for the spectral detection response rates of different colors (bands) and different regional positions in different scenarios, the number of enabled detection channels within a single-frame detection window is flexibly selected, which effectively reduces the power consumption required for detection while meeting the detection response speed.

[0034] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of the present application. Without conflict, the following various embodiments and their technical features can be combined with each other.

[0035] The multi-spectral detection device adopted by the multi-spectral detection method is as Figure 2 shown. The imaging region 100 is divided into several detection regions, and several spectral channels of different bands are provided in the detection regions; the multi-spectral detection method includes: setting the number of single-frame openings of the target spectral channel corresponding to the target band in each detection frame according to the response rate requirement of the target band.

[0036] As for multi-spectral detection, usually more than 4 spectral channels are provided in each detection region. The more spectral channels there are, the shorter the wavelength range recorded by each spectral channel, and the richer the spectral information obtained by each detection region.

[0037] In Figure 2 the shown embodiment, the same spectral channels are provided in each detection region. Specifically, the sizes of each detection region are the same (i.e., the area sizes of the regions for photoelectric conversion are the same), and each has corresponding spectral channels with the same number and the same band distribution. Taking four detection regions 101, 102, 103, and 104 as an example, 9 spectral channels are respectively formed in each detection region. Among them, spectral channels A1, B1, C1, and D1 are the same spectral channels, corresponding to the same band (color); spectral channels A2, B2, C2, and D2 are the same spectral channels, corresponding to the same band (color); the spectral channels in other detection regions are not specifically marked and will not be elaborated one by one here.

[0038] In other embodiments, if the accuracy or band requirements for multi-spectral detection at different positions within each imaging region are different, different numbers and / or different bands of spectral channels can be respectively provided in the detection regions at different positions.

[0039] In some embodiments, the imaging area 100 may be divided into m*n (m rows, n columns) detection areas, each detection area having k spectral channels corresponding to different bands. The spectral channels within each detection area are set the same, that is, each band has m*n spectral channels. Therefore, there are a total of n*m*k spectral channels.

[0040] There is a corresponding relationship between the corresponding positions of each spectral channel and the pixel positions of the imaging. In the most ideal case, each detection area corresponds to each pixel. However, limited by the existing coating (filter film) technology, it is impossible to make each pixel correspond to each spectral channel, that is, the resolution of the spectral channels is not as high as the imaging resolution. Usually, a fixed set of pixels at a fixed position corresponds to a fixed spectral channel. The smaller the size of a single detection area, the fewer the corresponding imaging pixel numbers, the higher the resolution of the multispectral detection, and the higher the resolution of the spectral change analysis.

[0041] Each spectral channel converts the received optical signal into charge through photoelectric conversion, accumulates it within a certain time, and then processes the accumulated charge amount to form a detection signal. During the detection process, the charge generated by each spectral channel is obtained by opening the detection window, so as to obtain the detection data of each spectral channel. Each detection window corresponds to one frame of data.

[0042] In some embodiments, for the requirement of the response rate of the target band, the method of setting the number of single-frame openings of the target spectral channels corresponding to the target band in each detection frame includes: reducing the number of single-frame openings of the spectral channels corresponding to the bands with a change amount less than the threshold according to the change amount of the detection data of each band in the detection result. Specifically, it can be detected for several frames in the state of full channel opening; according to the change of the detection data of each frame, calculate the change amount of the detection data of the spectral channels at each position. The change amount can be the change amount of the detection data between adjacent 2 frames, multiple frames apart, or at a certain time interval. The larger the change amount of the detection data, the greater the change rate of the optical energy received by the spectral channel, and it is necessary to have a sufficient update rate to reflect the change of the optical energy in time; in the case of smaller optical energy, the energy change between each frame is smaller, and the data update time can be appropriately extended without affecting the imaging effect. Those skilled in the art can set the threshold of the change amount of the detection data according to actual needs. When the change amount of the detection data is less than the threshold, the number of single-frame openings of the spectral channels corresponding to the corresponding band can be reduced; when the change amount of the detection data is greater than the threshold, the spectral channels of this band are all kept open in each frame of detection.

[0043] In some embodiments, it is assumed that the duration of the single-frame detection window for each channel is a preset duration t0. For a whole frame of data, that is, n*m*k spectral channels are opened simultaneously, within the time t0, the light intensity energy of each band (color) in all detection regions can be detected completely, that is, the single-frame output rate (frame rate) is (n*m*k detection data) / t0.

[0044] Set the number of single-frame openings as M / p, where M is the total number of target spectral channels, that is, M = m*n, and p is an adjustment parameter, p≥1.

[0045] When P = 1, it means that within the single-frame detection window, all m*n target spectral channels of the target band are opened. This corresponds to the case where the response rate requirement for the target band is relatively high.

[0046] When p>1, then within the single-frame detection window, only M / p target spectral channels of the target band are opened. At this time, the number of opened target spectral channels decreases, and the power consumption within the single-frame detection window is reduced. And when p>1, the target spectral channels opened in adjacent detection frames do not repeat, so as to complete the detection of all target spectral channels within p detection frames. Preferably, p is an integer greater than 1. At this time, it is necessary to perform continuous p-frame detections to complete the detection of all target spectral channels of the target band.

[0047] In some embodiments, the detection data obtained during the previous detection can be used as the detection data for the current detection frame of the unopened target spectral channels until the spectral channels are opened and the detection data is updated. Therefore, it takes t0*p time to complete the update of the detection data of all spectral channels of the target band, that is, the effective frame update duration changes from t0 to t0*p. The higher the response rate requirement, the more the number of single-frame openings of the target spectral channels, and the larger the value of p set.

[0048] Please refer to Figures 3a to 3b , which is a schematic diagram of the detection process of the target spectral channels in an embodiment of the present invention.

[0049] In this embodiment, only 24 target spectral channels A1 to X1 corresponding to the same band are taken as an example. According to the corresponding rate requirement of the target band, p = 3 is set, and the number of single-frame openings is M / p = 24 / 3 = 8. Eight target spectral channels are opened in each frame. Figure 3a As the first frame, spectral channels A1 to H1 are opened; Figure 3b As the second frame, spectral channels I1 to P1 are opened; Figure 3c As the third frame, spectral channels Q1 to X1 are opened; through three-frame detections, the detection of all spectral channels A1 to X1 is completed.

[0050] Since the number of spectral channels opened in each frame is reduced, the response rate is reduced, which can effectively reduce power consumption, reduce the peak power consumption of a single frame, and reduce the transient pressure of the circuit.

[0051] In other embodiments, different single-frame opening numbers can be configured for detection areas at different positions. Since the detection results of multiple regions and multiple spectra are used to perform algorithm correction on photos taken under the current ambient light conditions, the influence of color deviation is avoided. In different imaging areas, the requirements for color deviation compensation accuracy are different. For example, at the edges and corners of the photo, due to the existence of factors such as lens distortion, the original accuracy requirements are relatively low. In some cases, the user's attention to different imaging areas is also different. For example, the attention to the center of the imaging area is greater than the attention to the edge of the imaging area. This requires that the detection accuracy of each spectral channel in the detection area at the center position is greater than the detection accuracy of each spectral channel in the detection area at the edge position. Therefore, the response rate requirements of the spectral channels in these areas with lower accuracy requirements are lower, and a higher p value can be set to reduce the number of single-frame openings while still meeting the accuracy requirements of the area, thereby effectively reducing power consumption.

[0052] In other embodiments, different single-frame opening numbers can be configured for spectral channels of different bands. Since the sensitivity of the human eye to light intensities of different bands varies greatly, although each detection area needs to detect multiple different bands, that is, multiple light intensity energies received by spectral channels of different colors, the response rate requirements for each color are actually different. For example, for green light, to which the human eye is most sensitive, the response rate requirement of the corresponding spectral channel is also the highest. At this time, the single-frame opening number of the filter is required to be the largest, and p=1 is usually set; while for blue light with a lower wavelength and red light with a higher wavelength, the perception sensitivity of the human eye is lower, even if the response rate of the corresponding spectral channel is slower, the impact on the perception of the human eye is not great. Therefore, different single-frame opening numbers can be set for spectral channels of different bands. For spectral channels of colors with lower response rate requirements, the single-frame opening number can be set lower to minimize the number of spectral channels opened in a single frame; and for spectral channels of colors with higher response rate requirements, the single-frame opening number can be set higher to maximize the response rate and improve sensitivity.

[0053] In some embodiments, multiple different scene modes may be preset, and for each scene mode, the corresponding number of single-frame openings is configured for the spectral channels corresponding to different wavelength bands respectively. By setting the corresponding response mode for each scene mode, the optimal performance and power consumption ratio can be achieved. For example, in the indoor mode or the night scene mode, the energy of some wavelength bands is relatively stable and does not require a particularly fast response, so a larger p value can be selected; while for some bands affected by the lighting source and requiring a faster response rate, a smaller p value can be selected. The larger the p value, the fewer the number of spectral channels opened per unit time, and thus the lower the power consumption.

[0054] The switching of each scene mode can be manually switched by the user according to actual needs. Within each scene mode, the number of single-frame openings of the spectral channels at different positions and the spectral channels of different wavelength bands can also be manually configured according to the user's needs. In other embodiments, the switching of each scene mode can also be automatically switched according to the detection of the ambient light intensity or the scene being photographed, and the switching setting rules can be pre-configured. For example, when the ambient light intensity is less than a certain threshold, it is automatically switched to the night scene mode; when photographing an outdoor scene, it is automatically switched to the outdoor mode, etc.

[0055] In some embodiments, the multiple different scene modes include a night scene mode. In the night scene mode, the number of single-frame openings of the sensitive wavelength band is the total number M of spectral channels corresponding to the sensitive wavelength band, and the number of single-frame openings of other wavelength bands is M / p. The average value of the detection data of p detections is used as the effective detection data of the sensitive wavelength band. The night scene mode can be started in the night state or in a scene where the ambient light is detected to be very dim adaptively. In this mode, the light energy signals of most wavelength bands are very weak, and the amount of energy change over time is also very small. In this case, the response rate can be very slow, that is, the p value can be very large. The effective frame update time changes from t0 to t0*p. However, for the spectral channels of the wavelength bands that are particularly sensitive to the human eye, a relatively high number of single-frame openings can still be set, for example, p = 1, and the data of the sensitive spectral channels detected within the t0 time of each single-frame detection can be saved. The final output data is the average value of the p data. When the actual detection values of the p sensitive spectral channels are accumulated, the total signal amplitude increases by nearly p times the original. However, due to the non-correlation principle of noise, the total noise amplitude contributed by each spectral channel after accumulation increases to p 1 / 2 times the original, and the signal-to-noise ratio of the output data of the spectral channels of the sensitive wavelength band increases by p 1 / 2 times; the detection signal-to-noise ratio of other wavelength bands remains unchanged, but the power consumption per single channel is reduced by p times. By using this method, the detection of key information and the reduction of power consumption can be taken into account simultaneously.

[0056] In addition to optimizing power consumption by adjusting the number of spectral channels enabled within a single frame, in some embodiments, power consumption can be further optimized by adjusting the actual detection time of each enabled spectral channel within a single frame.

[0057] In some embodiments, the multi-region multi-spectral detection method further includes: adjusting the actual detection duration within the single-frame detection window of the spectral channel according to the detected light intensity. In practical application scenarios, ambient light detection often covers a very large light intensity range. Since each spectral channel has a background noise, when the light intensity is weak, the actual detected signal is small, resulting in a low signal-to-noise ratio; while when the light intensity is strong, the signal energy collected by a very short detection time can meet the signal-to-noise ratio requirements. Therefore, the actual detection duration of each enabled spectral channel can be set according to the light intensity situation. When the light intensity is weak, the actual detection duration is extended; when the light intensity is strong, the actual detection duration can be shortened, thereby saving power consumption.

[0058] In some embodiments, the preset duration of the single-frame detection window is the maximum time of the actual detection duration, set as t0; when the light intensity is greater than the first threshold Th1, a shorter actual detection duration t1 is selected, and the actual detection duration t1 is less than the preset duration t0. For example, it can be set that t1 = t0 / q, where q ≥ 1. Since the light intensity is large, even if the actual detection duration is shortened, sufficient signal energy can still be collected to achieve a sufficient signal-to-noise ratio. Since the single-frame output time, that is, the single-frame detection window, is still t0, and the actual working time of the spectral channel is t0 / q, the spectral channel does not need to work during the extra time, so power consumption can be saved. Please refer to Figure 4 , which is a schematic diagram of the single-frame detection window and the actual detection duration of a spectral channel of the present application. The first threshold Th1 and the actual detection duration t1 can be set according to the background noise situation of the spectral channel, and at least satisfy that when the light intensity is the first threshold Th1, the actual detection time is t1, which can meet the signal-to-noise ratio requirements.

[0059] Please refer to Figure 5a , in some embodiments, when the light intensity is less than or equal to the first threshold Th1, the actual detection duration is the duration t0 of the single-frame detection window; when the light intensity is greater than the first threshold Th1, the actual detection duration is t1, which is less than the duration t0 of the single-frame detection window. When the light intensity is greater than the first threshold, regardless of the actual light intensity size, the actual detection duration is fixed at t1.

[0060] In some embodiments, the actual detection duration can also be a variable value. When the light intensity is greater than the first threshold, as the light intensity increases, the actual detection duration can be further reduced.

[0061] In some embodiments, when the light intensity is less than or equal to the first threshold, the actual detection duration is the duration of a single-frame detection window; when the light intensity is greater than the first threshold, the actual detection duration is less than the duration of a single-frame detection window, and as the light intensity increases, the actual detection duration decreases stepwise. For example, the light intensity range greater than the first threshold is divided into multiple sub-intervals, and each interval corresponds to the same actual detection time. Please refer to Figure 5b , in this embodiment, the light intensity range greater than the first threshold Th11 is divided into multiple intervals. When the light intensity is in the Th11-Th12 interval, the actual detection duration is t11; when the light intensity is in the Th12-Th13 interval, the actual detection duration is t12; when the light intensity is greater than Th13, the actual detection duration is t13.

[0062] In some embodiments, when the light intensity is greater than the first threshold, the actual detection duration is less than the duration of a single-frame detection window, and as the light intensity increases, the actual detection duration decreases curvilinearly. The curve can be set according to the actual situation, for example, it can be a linear, quadratic, or multi-order curve. Please refer to Figure 5c , in this embodiment, within the light intensity range greater than the first threshold Th1, the actual detection time decreases linearly with the increase of the light intensity until the minimum detection time t10.

[0063] Since within the detection field of view, the light intensity distribution ranges are different in different regions, this may result in different actual detection times corresponding to the spectral channels at different positions.

[0064] In some embodiments, the method for adjusting the effective duration includes: detecting the detection signal output by the spectral channel, and stopping the detection when the amplitude of the detection signal increases to a preset amplitude; the preset amplitude corresponds to the first threshold value of the spectral channel; when the amplitude of the detection signal is less than or equal to the preset amplitude, continue the detection until the end of the single-frame detection window. Since the light energy is converted into electric charge during photoelectric conversion, the longer the light receiving time, the more electric charge is generated, and the amplitude of the detection signal will gradually increase. Moreover, the greater the light intensity, the shorter the time required to reach the preset amplitude. Corresponding to the setting method of the first threshold value, the preset amplitude can also be set according to the background noise of the spectral channel. When the detection signal reaches the preset amplitude and can meet the signal-to-noise ratio requirement for detection, the detection can be stopped. In the case of relatively high light intensity, when the actual detection duration does not reach the preset duration of the single-frame detection window, the amplitude of the detection signal can reach the preset amplitude, which can shorten the actual detection time for each frame of data output and reduce the power consumption. In the case of relatively low light intensity, continuous detection is required until the end of the single-frame detection window to obtain a relatively high amplitude of the detection signal as much as possible to improve the signal-to-noise ratio. This method can independently determine when to end the detection for the spectral channels enabled within a single frame according to their actual situations. The longest actual detection time does not exceed the preset duration t0 of the window. This method is relatively simple to implement, but has a relatively high peak power consumption.

[0065] In some other embodiments, the method for adjusting the actual detection duration includes: pre-detecting the light intensity passing through the spectral channel, and determining the actual detection duration according to the detected light intensity. It can be to first perform a short-time and low-precision pre-detection, calculate the light intensity based on the pre-detection time and the obtained amplitude of the detection signal. Compare the light intensity with the threshold value to set the corresponding actual detection duration. The pre-detection can be performed after each single-frame detection window is opened. First, perform the pre-detection, set the actual detection duration according to the pre-detection result, and then continue the subsequent actual detection. Among them, the pre-detection is part of the actual detection, and the detection signal during the pre-detection process is part of the detection signal obtained during the actual detection process; in other embodiments, it can also be a pre-detection for an additional period of time before the single-frame detection window is opened, and the pre-detection signal obtained is not used as the signal for actual detection. After determining the actual detection time through the pre-detection, each spectral channel can be turned on in a time-sharing manner, that is, the number of spectral channels turned on at the same time is relatively small, and the peak power consumption is relatively low.

[0066] The average power consumption of the above various methods has little difference. According to the actual circuit implementation conditions, the most suitable method can be selected to shorten the detection time of each channel and reduce the average power consumption.

[0067] For different spectral channels, different first threshold values can also be set respectively.

[0068] In some embodiments, different first thresholds are configured for spectral channels of different bands that need to be turned on in a single frame. For spectral channels of colors with lower sensitivity requirements for human eyes, the first threshold can be set lower to minimize the actual detection time of the corresponding spectral channels; and for spectral channels of colors with higher sensitivity requirements, the first threshold can be set higher to maximize the signal-to-noise ratio and improve sensitivity. The higher the sensitivity requirement, the larger the corresponding first threshold.

[0069] In some embodiments, different first thresholds may be configured for detection areas at different locations. A relatively low first threshold may be set for a spectral channel in an area with low accuracy requirements, thereby reducing detection time and effectively reducing power consumption while still meeting the accuracy requirements of the area.

[0070] In other embodiments, spectral channels of different wavelengths opened in the same detection area may correspond to different first thresholds respectively; spectral channels of the same wavelength opened in different detection areas may also correspond to different first thresholds; both may be set according to different requirements. Preferably, the setting may be made in combination with the sensitivity requirements of the human eye for different wavelengths, the sensitivity requirements at different positions, and other comprehensive requirements.

[0071] In some embodiments, when the light intensity received by the spectral channel is less than the second threshold, the light intensity is too low. Even if the actual detection time of a single frame of the spectral channel is equal to the single frame detection window time, the amplitude of the detection signal obtained is still very small, and the signal-to-noise ratio is low, which cannot meet the sensitivity requirement. In this case, the induced charges generated by the spectral channels of the same band whose light intensities in different detection areas are all less than the second threshold can be collected into one of the spectral channels, and the detection is performed by the one spectral channel. At this time, for the detection circuit of the spectral channel, the amplitude of the input signal increases, but the noise of the spectral channel does not increase as a result, thereby achieving the effect of improving the signal-to-noise ratio. In addition, the number of spectral channels (i.e., the detection circuit of the spectral channel) that needs to be turned on is also reduced, and accordingly, the total power consumption required for detection is reduced. Preferably, the charges of the same band of adjacent detection areas are collected, which is conducive to circuit implementation.

[0072] Since the spectral energy and light intensity distribution will continue to change during the detection process, the number of single-frame open spectral channels in each band and the actual detection time of the open spectral channels can be adjusted in real time or periodically according to the current ambient light.

[0073] The above multi-light-zone multi-spectral detection method proposes an energy-saving mode for multi-zone multi-spectral detection that adapts to the scene. By utilizing the different requirements of different scenes for the spectral detection response rates of different colors (bands) and different regional positions, the number of enabled detection channels within a single-frame detection window is flexibly selected, effectively reducing the power consumption required for detection while meeting the detection response speed.

[0074] Furthermore, the characteristics that the application scenario has a wide coverage of light intensity range and different requirements for the spectral detection accuracy of different colors and positions can also be utilized to flexibly select the opening time and the number of enabled detection channels, so that the accuracy requirements can be met under both strong and weak light conditions, while effectively reducing the power consumption required for detection.

[0075] An embodiment of the present application further provides a multi-zone multi-spectral detection device, including: a plurality of detection regions, where the detection regions are provided with a plurality of spectral channels of different bands; a detection control module, connected to the plurality of detection regions, for setting the number of single-frame openings of the target spectral channels corresponding to the target band in each detection frame according to the response rate requirements of the target band. The specific working principle and method of the detection control module can refer to the specific description in the foregoing embodiments and will not be elaborated herein.

[0076] The present application further provides a multi-zone multi-spectral detection device, including: a plurality of detection regions, where the detection regions are provided with a plurality of spectral channels of different bands; a memory, for storing a computer program; a processor, connected to the plurality of detection regions and the memory, and when the computer program is executed by the processor, it can implement the multi-zone multi-spectral detection method described in any one of the foregoing embodiments.

[0077] An embodiment of the present application further provides an electronic device, including the multi-zone multi-spectral detection device described in the foregoing embodiment; or capable of implementing the multi-zone multi-spectral detection method described in the foregoing embodiment. The electronic device can be a terminal device with a shooting function such as a smart phone, a tablet computer, a smart watch, etc. Through the multi-zone multi-spectral detection device of the present application, multi-spectral spectral information can be obtained to improve the shooting effect. The electronic device can also be a multi-zone multi-spectral detection device for spectral detection, achieving the effect of spectral imaging through multi-zone multi-spectral detection.

[0078] The above are only the embodiments of the present application, and do not limit the patent scope of the present application. Any equivalent structural or equivalent process transformation made using the content of the specification and drawings of the present application, such as the mutual combination of technical features between the embodiments, or direct or indirect application in other related technical fields, are equally included in the patent protection scope of the present application.

Claims

1. A multi-region multi-spectral detection method for a multi-region multi-spectral detection device, characterized in that, The multi-region multi-spectral detection device has a number of detection regions, and a number of spectral channels with different wavelength bands are provided in the detection regions; the multi-region multi-spectral detection method includes: According to the response rate requirement of the target wavelength band, set the number of single-frame openings of the target spectral channel corresponding to the target wavelength band in each detection frame, where the response rate of the target wavelength band is the change amount of the detection data obtained based on the charge generated by the target spectral channel, representing the light energy change rate received by the target spectral channel; set the number of single-frame openings through the relationship M / p, where M / p is the number of single-frame openings, M is the total number of target spectral channels, p is the response rate parameter, and p≥1; when p>1, the target spectral channels opened in adjacent detection frames do not repeat, so as to complete the detection of all target spectral channels within p detection frames.

2. The multi-region multi-spectral detection method according to claim 1, wherein The higher the response rate requirement, the more the number of single-frame openings of the target spectral channel.

3. The multi-region multi-spectral detection method according to claim 1, wherein Use the detection data obtained during the previous detection as the detection data of the current detection frame of the unopened target spectral channel.

4. The multi-region multi-spectral detection method according to claim 1, wherein For the detection regions at different positions, configure different numbers of single-frame openings respectively; and / or, for the spectral channels with different wavelength bands, configure different numbers of single-frame openings respectively; and / or, according to the change amount of the detection data of each wavelength band in the detection result, reduce the number of single-frame openings of the spectral channels corresponding to the wavelength bands with the change amount of the detection data less than the threshold.

5. The multi-region multi-spectral detection method according to claim 1, characterized in that Preset a plurality of different scene modes, and configure the corresponding number of single-frame openings for the spectral channels corresponding to different wavelength bands under each scene mode respectively.

6. The multi-region multi-spectral detection method according to claim 5, characterized in that The plurality of different scene modes include a night scene mode. In the night scene mode, the number of single-frame openings of the sensitive wavelength band is M, and the number of single-frame openings of other wavelength bands is M / p. The average value of the detection data of p detections is used as the effective detection data of the sensitive wavelength band.

7. The multi-region multi-spectral detection method according to claim 1, wherein The detection regions are provided with a number of spectral channels with different wavelength bands, and the duration of the single-frame detection window of each spectral channel is a preset duration; The multi-region multi-spectral detection method further includes: adjusting the actual detection duration within the single-frame detection window of the spectral channel according to the detected light intensity.

8. The multi-region multi-spectral detection method according to claim 7, wherein The method for adjusting the actual detection duration includes: detecting the detection signal output by the spectral channel, and stopping the detection when the amplitude of the detection signal increases to a preset amplitude; the preset amplitude corresponds to the first threshold corresponding to the spectral channel; when the amplitude of the detection signal is less than or equal to the preset amplitude, continue the detection until the end of the single-frame detection window; or, pre-detect the light intensity passing through the spectral channel, and determine the actual detection duration according to the detected light intensity.

9. A multi-region multi-spectral detection device, characterized in that, Including: A number of detection regions, and a number of spectral channels with different wavelength bands are provided in the detection regions; A detection control module, connected to the plurality of detection regions, is configured to set the number of single-frame openings of the target spectral channels corresponding to the target band in each detection frame according to the response rate requirement of the target band, wherein the response rate of the target band is the change amount of the detection data obtained based on the charges generated by the target spectral channels, representing the light energy change rate received by the target spectral channels; the number of single-frame openings is set by the relation M / p, where M / p is the number of single-frame openings, M is the total number of target spectral channels, p is a response rate parameter, and p≥1; when p>1, the target spectral channels opened in adjacent detection frames do not repeat, so as to complete the detection of all target spectral channels within p detection frames.

10. A multi-region multi-spectral detection device, characterized in that, Comprising: A plurality of detection regions, wherein the detection regions are provided with a plurality of spectral channels of different bands; A memory, configured to store a computer program; A processor, connected to the plurality of detection regions and the memory, and when the computer program is executed by the processor, it can implement the multi-region multi-spectral detection method according to any one of claims 1 to 8.

11. An electronic device, characterized in that, Comprising the multi-region multi-spectral detection device according to claim 9 or 10 above; or being capable of implementing the multi-region multi-spectral detection method according to any one of claims 1 to 8.

Images