Imaging module, electronic device, imaging method and storage medium

Abstract

The present application discloses an imaging module, an electronic device, an imaging method and a storage medium. The imaging module includes a lens, a filter and an image sensor. The filter is used to filter the light entering the lens according to an input preset electrical signal, and adjust the band of the filtered light according to the input preset electrical signal; the image sensor includes dynamic pixels, and the dynamic pixels are used to receive and respond to the brightness change of the filtered light to output a brightness change value. The filter can filter the light entering the lens according to the preset electrical signal to adjust the band of the filtered light, so that the dynamic pixel can quickly respond to the brightness change when the wavelength changes to output the brightness change value, and can realize continuous adjustment of multiple bands and determination of brightness values, and the efficiency of multi-spectral imaging is relatively high. In addition, the present application realizes multi-spectral imaging through the same lens, and there is no problem of poor overlapping accuracy of multiple lenses and the need to identify the overlapping parts of different lenses, and the imaging quality and output efficiency are both high.

Description

Technical Field

[0001] The present application relates to the field of imaging technology, and more specifically, to an imaging module, an electronic device, an imaging method and a storage medium. Background Art

[0002] At present, multispectral imaging has been widely used, such as food safety detection, anti-counterfeiting detection, etc. When realizing multispectral imaging, a multi-lens camera is generally used. The filter of each lens passes a different wavelength band, thereby obtaining image data corresponding to multiple light bands. However, it is difficult for the multiple lenses of the camera to accurately aim at the same place, the overlapping accuracy is poor, and when acquiring the image, it is necessary to identify the overlapping parts of different lenses, which affects the efficiency of image output. Summary of the invention

[0003] Embodiments of the present application provide an imaging module, an electronic device, an imaging method, and a storage medium.

[0004] The imaging module of the embodiment of the present application includes a lens, a filter and an image sensor, wherein the filter is used to filter the light entering the lens according to an input preset electrical signal and adjust the wavelength band of the filtered light according to the input preset electrical signal; the image sensor includes dynamic pixels, and the dynamic pixels are used to receive and respond to the brightness changes of the filtered light to output brightness change values.

[0005] The electronic device of the embodiment of the present application includes a housing and an imaging module, and the imaging module is arranged in the housing. The imaging module includes a lens, a filter and an image sensor, the filter is used to filter the light entering the lens according to the input preset electrical signal, and adjust the wavelength of the filtered light according to the input preset electrical signal. The image sensor includes dynamic pixels, and the dynamic pixels are used to receive and respond to the brightness change of the filtered light to output the brightness change value.

[0006] The imaging method of the embodiment of the present application is applied to an imaging module, characterized in that the imaging module includes a lens, a filter and an image sensor, the filter is used to filter the light entering the lens, the image sensor includes dynamic pixels, and the dynamic pixels are used to receive and respond to the brightness changes of the filtered light to output brightness change values; the imaging method includes controlling the filter to filter the light according to a preset electrical signal to adjust the wavelength band of the filtered light; and generating a target image according to the brightness change value.

[0007] The non-volatile computer-readable storage medium containing a computer program in the embodiment of the present application, when the computer program is executed by one or more processors, enables the processor to execute an imaging method. The imaging method is applied to an imaging module, characterized in that the imaging module includes a lens, a filter and an image sensor, the filter is used to filter the light entering the lens, the image sensor includes dynamic pixels, and the dynamic pixels are used to receive and respond to the brightness change of the filtered light to output a brightness change value; the imaging method includes controlling the filter to filter the light according to a preset electrical signal to adjust the wavelength band of the filtered light; and generating a target image according to the brightness change value.

[0008] In the imaging module, electronic device, imaging method and storage medium of the implementation mode of the present application, the filter can filter the light entering the lens according to the preset electrical signal to adjust the wavelength of the filtered light. After the wavelength changes, the brightness of the light will generally change, so that the dynamic pixel can quickly respond to the brightness change when the wavelength changes to output the brightness change value, which can achieve continuous adjustment of multiple bands and determination of brightness values, and the efficiency of multi-spectral imaging is relatively high. In addition, the present application realizes multi-spectral imaging through the same lens, and there is no problem of poor overlapping accuracy of multiple lenses and the need to identify the overlapping parts of different lenses, and the imaging quality and output efficiency are both high.

[0009] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0011] Figure 1 is a schematic diagram of the structure of an imaging module according to some embodiments of the present application;

[0012] Figure 2 is a schematic diagram of the principle of the filter in the embodiment of the present application;

[0013] Figure 3 is a schematic diagram of the structure of an imaging module according to some embodiments of the present application;

[0014] Figure 4 It is a schematic diagram of the principle of the preset electrical signal of certain embodiments of the present application;

[0015] Figure 5 is a schematic diagram of the structure of an imaging module according to some embodiments of the present application;

[0016] Figure 6is a schematic diagram of pixel arrangement of an image sensor in certain embodiments of the present application;

[0017] Figure 7 is a schematic diagram of the connection between dynamic pixels and visible light pixels in certain embodiments of the present application;

[0018] Figure 8 is a schematic flow chart of an imaging method according to certain embodiments of the present application;

[0019] Fig. 9 is a schematic plan view of an electronic device according to some embodiments of the present application;

[0020] Fig.10 is a schematic flow chart of an imaging method according to certain embodiments of the present application;

[0021] Fig.11 is a schematic diagram of the principle of the imaging method of certain embodiments of the present application;

[0022] Fig.12 is a schematic diagram of the principle of the imaging method of certain embodiments of the present application;

[0023] Fig.13 is a schematic flow chart of an imaging method according to certain embodiments of the present application; and

[0024] Fig.14 It is a connection diagram of a computer-readable storage medium and a processor according to an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following further describes the embodiments of the present application in conjunction with the accompanying drawings. The same or similar reference numerals in the accompanying drawings represent the same or similar elements or elements with the same or similar functions.

[0026] In addition, the embodiments of the present application described below in conjunction with the drawings are exemplary and are only used to explain the embodiments of the present application and should not be construed as limiting the present application.

[0027] See also Figure 1 The imaging module 10 of the embodiment of the present application includes a lens 11, a filter 12 and an image sensor 13. The filter 12 is used to filter the light entering the lens 11 and adjust the wavelength band of the filtered light according to the input preset electrical signal; the image sensor 13 includes a dynamic pixel 131, and the dynamic pixel 131 is used to receive and respond to the brightness change of the filtered light to output the brightness change value.

[0028] In the imaging module 10 of the embodiment of the present application, the filter 12 can filter the light entering the lens according to the preset electrical signal to adjust the wavelength of the filtered light. After the wavelength changes, the general light brightness will also change, so that the dynamic pixel 131 can quickly respond to the brightness change when the wavelength changes to output the brightness change value, which can achieve continuous adjustment of multiple bands and determination of brightness values, and the efficiency of multi-spectral imaging is relatively high. In addition, the present application realizes multi-spectral imaging through the same lens 11, and there is no problem of poor overlapping accuracy of multiple lenses 10 and the need to identify the overlapping parts of different lenses, and the imaging quality and output efficiency are both relatively high.

[0029] The imaging module 10 is described in detail below:

[0030] The imaging module 10 includes a lens 11, a filter 12, and an image sensor 13. The lens 11, the filter 12, and the image sensor 13 are arranged in sequence along the light incident direction, or the filter 12, the lens 11, and the image sensor 13 are arranged in sequence along the light incident direction, that is, the light entering the lens 11 can be filtered before entering the lens 11, or filtered after being processed by the lens 11, which can be set according to actual needs. This embodiment is described by taking the lens 11, the filter 12, and the image sensor 13 arranged in sequence along the light incident direction as an example.

[0031] Please continue reading Figure 1 The lens 11 includes a lens base 111, a lens barrel 112 and a lens 113. The lens barrel 112 is installed on the lens base 111, and the lens 113 is installed in the lens barrel 112. The lens 113 includes one or more lenses.

[0032] The filter 12 is arranged on the lens barrel 112 or the lens holder 111, and a plurality of lenses 113 and the filter 12 are arranged in sequence along the light incident direction. The filter 12 is used to filter the light emitted from the lens 113 so that light of a specific wavelength band can pass through the filter 12. Figure 2 , taking the visible light filter 12 as an example to explain the filtering principle of the filter 12 on light, the transmittance of the filter 12 for light of visible light wavelength (such as 350 nanometers to 750 nanometers) is relatively high, while the transmittance of light of other wavelengths is relatively low, and is almost 0 after 1000 nanometers. For the boundary position of the visible light wavelength, the transmittance of the filter 12 shows a gradually decreasing trend. As a result, the filter 12 can only pass the light of the visible light band, while other light will be reflected or absorbed, so as to achieve the filtering of light of a specific band (that is, the light after filtering is basically all light of a specific band). It can be understood that a band can be a wavelength range, or a band only includes one wavelength.

[0033] See also Figure 3The optical filter 12 is a plurality of optical filters, and the plurality of optical filters cooperate to filter light according to a preset electrical signal to adjust the wavelength band of the filtered light. Optionally, the optical filter 12 may be a Fabry-Perot interferometer.

[0034] Specifically, the filter 12 includes a first filter 121 and a second filter 122, and a Fabry-Perot cavity is formed between the first filter 121 and the second filter 122. After light of multiple wavelengths is injected into the Fabry-Perot cavity, light whose wavelength meets the resonance condition will have a very high peak in the transmission spectrum, corresponding to a high transmittance. Therefore, this light will be reflected multiple times in the Fabry-Perot cavity to form an interference beam, and finally pass through the filter 12 to be completely transmitted, while light that does not meet the resonance condition cannot pass through the filter 12. The transmittance of light in the Fabry-Perot cavity is related to the width of the gap formed between the two first filters 121 and the second filter 122. Generally, the resonance condition refers to the width of the gap (d) being half of the wavelength (λ) of the light, that is, d=λ / 2. At this time, the light has a higher transmittance. It can be seen that the larger the width d of the gap, the larger the wavelength that meets the resonance condition. By adjusting the width of the gap, filtering of light of a specific wavelength can be achieved.

[0035] Among them, the adjustment of the gap between the first filter 121 and the second filter 122 can be achieved by driving a motor (not shown in the figure, if the motor is a micro-electro-mechanical system (MEMS)), by inputting a preset electrical signal to the motor, and the motor adjusts the width of the gap according to the preset electrical signal, thereby achieving filtering of light of a specific wavelength. The preset electrical signal may include a plurality of different electrical signal values, such as a plurality of different voltage values ​​or a plurality of different current values, and different electrical signal values ​​correspond to at least two different bands. In this embodiment, different voltage values ​​correspond to the width of the gap one by one, and the width of the gap can be adjusted by adjusting the voltage input to the motor, thereby achieving filtering of light of a specific wavelength. In other words, the electrical signal value, the width of the gap and the wavelength correspond one by one.

[0036] In this way, by inputting a preset electrical signal including a plurality of different electrical signal values, the filter 12 can continuously pass light of a plurality of different wavelengths, thereby achieving the acquisition of multi-spectral light information.

[0037] See also Figure 4 In one example, the preset electrical signal is an electrical signal curve, such as Figure 4 In the coordinate system shown, the horizontal axis is time, the vertical axis is voltage value, and the electrical signal curve represents the voltage value input to the motor at different times. The corresponding voltage is input to the motor through the electrical signal curve, thereby continuously adjusting the wavelength of the light filtered by the filter 12. Figure 4When the electrical signal curve shown is input into the motor, the greater the input voltage, the greater the width of the gap, so that the wavelength of the light filtered by the filter 12 gradually increases. The maximum electrical signal value and the minimum electrical signal value of the electrical signal curve can be determined according to the preset band required for imaging by the imaging module 10.

[0038] See also Figure 5 Optionally, the multiple filters 12 can also be composed of a plurality of electrochromic films.

[0039] Specifically, there are multiple filters 12, and different filters 12 (i.e., different electrochromic filters) can pass at least partially different wavelengths of light when power is supplied. For example, the filters 12 include a red filter 12, a green filter 12, a blue filter 12, an infrared filter 12, etc., which are used to pass red light, green light, blue light, infrared light, etc. respectively when power is supplied.

[0040] Multiple filters 12 are arranged in an overlapping manner, such as multiple filters 12 are arranged in sequence along the incident light direction, and the orthographic projections of the multiple filters 12 on the imaging surface of the image sensor 13 at least partially overlap, and the overlapping part covers the outgoing light of the lens 11, thereby ensuring that all outgoing light can be filtered.

[0041] When filtering light of a specific wavelength band, multiple filters 12 can be selectively energized according to a preset electrical signal to adjust the wavelength band of the filtered light. For example, when the image sensor 13 needs to receive red light, an electrical signal can be input only to the red filter, so that the filter 12 only passes red light. The preset electrical signal may include multiple electrical signal values ​​and the object of each electrical signal value input (such as a red filter, a blue filter, etc.), and the electrical signal is sequentially input to the corresponding filter 12 according to the preset electrical signal, so that the filter 12 sequentially passes light of different wavelength bands to achieve the acquisition of multi-spectral light. For example, the filter 12 includes a red filter, a green filter, a blue filter and an infrared filter. According to the preset electrical signal, the electrical signal is sequentially input to the red filter, the green filter, the blue filter and the infrared filter, and four different wavelength bands of red light, filter light, blue light and infrared light can be sequentially acquired.

[0042] The image sensor 13 includes dynamic pixels 131, which can realize the function of a dynamic vision sensor (Dynamic Vision Sensor, DVS, sometimes also called event camera), which is an imaging sensor that can respond to local brightness changes. Event cameras do not use a shutter to capture images like conventional cameras. Instead, each pixel in an event camera operates independently and asynchronously and outputs these changes when brightness changes occur, otherwise it remains silent.

[0043] The advantages of event cameras are: low latency (up to 1 microsecond), no motion blur, high dynamic range, and ultra-low power consumption (average power consumption can be as low as 1 milliwatt). Event cameras are similar to frog eyes and can only see moving objects. If the brightness change of a dynamic pixel 131 exceeds a preset threshold, the dynamic pixel 131 will output the pixel address, brightness change direction, and polarity. The pixel address is the position of the dynamic pixel 131 on the image sensor, the brightness change direction is brightening or darkening, and the polarity includes 1 or 0. A polarity of 1 indicates that the brightness change of the dynamic pixel 131 is greater than the preset threshold, and a polarity of 0 indicates that the brightness change of the dynamic pixel 131 is less than the preset threshold. Event cameras do not have the concept of frames, only the real-time output of dynamic pixels 131, and react quickly to rapidly changing objects.

[0044] When the light filtered by the filter 12 enters the image sensor 13, if it is always the light of the same wavelength and the subject in the environment is not in motion, the dynamic pixel 131 will not output. When the wavelength band of the light filtered by the filter 12 changes, the brightness of the light filtered by the filter 12 caused by the wavelength change also changes accordingly, so that the dynamic pixel 131 outputs the pixel address, brightness change direction and brightness change value.

[0045] Each time the dynamic pixel 131 outputs, the brightness change value at the time of output is recorded as the preset brightness value, so that the next time the brightness change exceeds the threshold, the current brightness value and the recorded preset brightness value are compared, and the brightness difference between the two is compared with the preset threshold to determine whether the brightness change value needs to be output.

[0046] The preset threshold value can be set according to actual needs. The smaller the preset threshold value is, the higher the output frequency of the dynamic pixel 131 is. Conversely, the lower the output frequency of the dynamic pixel 131 is. For example, when it is necessary to respond to multiple light rays with small band changes in time, the brightness change is also small due to the small band change. Therefore, the preset threshold value needs to be set small, so as to respond in time when the band changes and accurately output the brightness information.

[0047] See also Figure 6 In addition to the dynamic pixels 131 (such as Figure 6 In addition to A), it may also include visible light pixels 132, infrared pixels, etc. (such as Figure 6 B) in the figure, so as to integrate multi-spectral imaging, conventional visible light imaging, infrared imaging and other functions in one image sensor 13. This embodiment is described by taking the image sensor 13 including the visible light pixel 132 and the dynamic pixel 131 as an example.

[0048] See also Figure 6, the dynamic pixels 131 and the visible light pixels 132 are arranged crosswise, such as the arrangement of the dynamic pixels 131 and the visible light pixels 132 can be such that the dynamic pixels 131 are surrounded by visible light pixels 132, and the visible light pixels 132 are surrounded by dynamic pixels 131, so that the two are closely combined and the parallax between the two is small. Alternatively, the dynamic pixels 131 and the visible light pixels 132 occupy two adjacent areas of the image sensor 13 respectively, etc. There are many ways of crosswise arrangement, which are not listed here one by one.

[0049] When performing multispectral imaging, according to the application scenario of multispectral imaging, such as fruit maturity detection, the fruit can be imaged by visible light first, so as to identify the fruit in the scene in the imaging area of ​​the image sensor 13, and then multispectral imaging is performed. The filter 12 is adjusted by a preset electrical signal to pass light of different bands in turn, and then multispectral imaging is performed according to the brightness change value of the dynamic pixel 131 in the imaging area, so as to be used for fruit maturity detection, realizing the structural and functional combination of visible light imaging and multispectral imaging.

[0050] Optionally, in order to further reduce the parallax between the dynamic pixel 131 and the visible light pixel 132, the dynamic pixel 131 and the visible light pixel 132 may share a photosensitive unit, and then different logic circuits are used to process the electrical signal generated by the photosensitive unit receiving the light, so as to realize the functions of the dynamic pixel 131 and the visible light pixel 132 respectively. Figure 7 For example, the visible light pixel 132 includes a first photosensitive unit 1321 and a first logic circuit 1322, and the dynamic pixel 131 includes a second photosensitive unit 1311 and a second logic circuit 1312. The first photosensitive unit 1321 and the second photosensitive unit 1311 are the same photosensitive unit. The first logic circuit 1322 obtains the pixel value of the visible light pixel 132 by obtaining the amount of charge accumulated in the photosensitive unit during the exposure time, and the second logic circuit 1312 determines whether the brightness change value corresponding to the accumulated charge amount is greater than a preset threshold value. If so, the brightness change value is output, otherwise, no output is performed.

[0051] See also Figure 1 and Figure 8 The imaging method of the embodiment of the present application is applied to the imaging module 10 of any of the aforementioned embodiments, and the imaging method includes:

[0052] 011: Control the filter 12 to filter the light according to a preset electrical signal to adjust the wavelength band of the filtered light;

[0053] 012: Generate target image according to brightness change value.

[0054] See also Fig. 9The electronic device of the embodiment of the present application includes a housing 20, an imaging module 10 and a processor 30, and the imaging module 10 and the processor 30 are both arranged in the housing 20. The processor 30 can be an application processor of the electronic device, or a processing chip arranged in the imaging module 10, and the processor 30 is used to control the filter 12 to filter the light according to a preset electrical signal to adjust the wavelength band of the filtered light; and generate a target image according to the brightness change value. That is to say, step 011 and step 012 can be executed by the processor 30.

[0055] Specifically, the electronic device 100 may be a mobile phone, a tablet computer, a display device, a laptop computer, a teller machine, a gate machine, a smart watch, a head-mounted display device, a game console, etc. Fig. 9 As shown, the embodiment of the present application is described by taking the electronic device 100 as a mobile phone as an example. It can be understood that the specific form of the electronic device 100 is not limited to a mobile phone. The housing 20 can also be used to install functional modules such as a display device, an imaging device, a power supply device, and a communication device of the electronic device 100, so that the housing 20 provides dustproof, drop-proof, waterproof and other protections for the functional modules.

[0056] When performing multi-spectral imaging, the processor 30 first inputs an electrical signal into the filter 12 according to a preset electrical signal, so as to continuously adjust the wavelength band of the filtered light according to the electrical signal.

[0057] As the wavelength band of the filtered light changes, the brightness of the filtered light changes accordingly. Each time the filtered light changes its wavelength, the brightness of the filtered light changes due to the different proportions of light of different wavelength bands in the incident light and the differences in the brightness of light of different wavelength bands. The dynamic pixels 131 in the image sensor 13 receive and respond to the brightness changes of the filtered light to output brightness change values, thereby generating a target image based on the brightness change values.

[0058] For example, the processor 30 can determine the brightness value corresponding to each band by adjusting the brightness change value of the band of the filtered light each time, and the preset brightness value of the dynamic pixel 131. The target image can be an image generated by the light of the preset band. The processor 30 determines the brightness value corresponding to the preset band, and can determine the pixel value of each dynamic pixel 131 corresponding to the preset band, so as to generate the target image according to the pixel value of each dynamic pixel 131 corresponding to the preset band, and realize the acquisition of the target image of any band.

[0059] See also Fig. 9 and Fig.10 In some embodiments, step 012 includes:

[0060] 0121: establishing a first mapping curve between brightness value and time according to the time when the dynamic pixel 131 receives the filtered light and the brightness change value;

[0061] 0122: Obtaining the electrical signal value corresponding to the time when the dynamic pixel 131 receives the filtered light in the preset electrical signal;

[0062] 0123: establishing a second mapping curve of brightness value and wavelength according to a preset mapping relationship between the electrical signal value and the wavelength band and the first mapping curve;

[0063] 0124: Obtaining the pixel value of each dynamic pixel 131 in a preset band according to the second mapping curve corresponding to each dynamic pixel 131; and

[0064] 0125: Generate a target image based on pixel values.

[0065] In some embodiments, the processor 30 is further used to establish a first mapping curve of brightness value and time according to the time when the dynamic pixel 131 receives the filtered light and the brightness change value; obtain the electric signal value corresponding to the time when the dynamic pixel 131 receives the filtered light in the preset electric signal; establish a second mapping curve of brightness value and wavelength according to the preset mapping relationship between the electric signal value and the band and the first mapping curve; obtain the pixel value of each dynamic pixel 131 in the preset band according to the second mapping curve corresponding to each dynamic pixel 131; and generate a target image according to the pixel value. That is, steps 0121 to 0125 can be executed by the processor 30.

[0066] Specifically, see Fig.11 , the dynamic pixel 131 has an initial brightness value (the initial brightness value is used as the first preset brightness value during multi-spectral imaging to calculate the brightness change value), and the initial brightness value can be a preset value, such as a preset value of 0, 1, etc. Alternatively, in order to more accurately calculate the brightness change value, the initial brightness value can be determined according to the brightness of the filtered light first received by the dynamic pixel 131 when performing multi-spectral imaging. For example, when the dynamic pixel 131 and the visible light pixel 132 (or infrared pixel, etc.) share a photosensitive unit, the dynamic pixel 131 and the visible light pixel 132 have the same brightness value, and the initial brightness value can be determined according to the pixel value of the visible light pixel 132.

[0067] When performing multi-spectral imaging, each time the wavelength band of the filtered light changes, the brightness change will be greater than the preset threshold, so that the dynamic pixel 131 outputs output information. The processor 30 first calculates the brightness change value of each dynamic pixel 131 according to the time and output information (including pixel address, brightness change direction and polarity) when each dynamic pixel 131 receives the filtered light, the preset brightness value (or initial brightness value), the preset threshold, the brightness change direction and polarity. If the preset brightness value is 2, the preset threshold is 2, the brightness change direction is brightening, and the polarity is 1, the brightness change value is 4. In this way, the brightness change value of the dynamic pixel 131 can be accurately calculated each time the brightness changes. Thus, a first mapping curve of brightness value and time is established for each dynamic pixel 131. The processor 30 can determine the brightness value of the filtered light at each adjustment of the wavelength band according to the brightness change value and the preset brightness value, and connect these brightness values ​​in sequence to generate a first mapping curve S1. In this way, time and brightness value correspond one to one.

[0068] Please combine Figure 4 , Fig.11 and Fig.12 , the processor 30 then obtains the electric signal value corresponding to the time when the dynamic pixel 131 receives the filtered light in the preset electric signal. It can be understood that the time when the filtered light is received has a corresponding electric signal value in the preset electric signal. If the preset electric signal is an electric signal curve (such as Figure 4 The processor 30 inputs the electric signal to the filter 12 according to the electric signal curve, and the electric signal at each moment can be directly obtained from the electric signal curve. That is to say, the time and the electric signal value also correspond one to one, and different electric signals can correspond to different wavelengths (such as the electric signal value, the width of the gap and the wavelength in the Fabry-Perot interferometer of the filter 12 correspond one to one). Therefore, the processor 30 can generate the second mapping curve S2 according to the mapping relationship between time and electric signal value, the preset mapping relationship between electric signal value and wavelength band, and the first mapping curve S1 to represent the one-to-one correspondence between brightness value and wavelength.

[0069] After obtaining the second mapping curve S2, the brightness value of the preset band corresponding to the second mapping curve S2 of each dynamic pixel 131 can be obtained. If the preset band is red light, the brightness value of the red light band corresponding to the second mapping curve is obtained to generate a pixel value, such as generating a pixel value according to the brightness values ​​corresponding to the two boundary wavelengths of the red light band (such as the difference between the brightness values ​​corresponding to the two boundary wavelengths as the pixel value). Alternatively, if the preset band includes red light and blue light, the brightness value of the red light band and the brightness value of the blue light band corresponding to the second mapping curve of each dynamic pixel 131 are obtained to generate a first pixel value and a second pixel value. The processor 30 can generate two target images respectively according to the first pixel value and the second pixel value of the preset band.

[0070] In this way, by receiving and responding to the filtered light of different bands by the dynamic pixel 131 and generating a second mapping curve, a target image of any band can be quickly obtained, thereby achieving the acquisition of target images of multiple bands, greatly improving the imaging efficiency of multispectral images.

[0071] See also Fig.13 In some embodiments, step 0125 further includes:

[0072] 01251: Obtain pixel values ​​of visible light pixels 132 to generate visible light images;

[0073] 01252: Identify target objects based on visible light images; and

[0074] 01253: Obtain pixel values ​​of the dynamic pixels 131 of the target object in the imaging area corresponding to the image sensor 13 in a preset band to generate a target image.

[0075] In some embodiments, the processor 30 is further configured to obtain pixel values ​​of the visible light pixels 132 to generate a visible light image; identify a target object according to the visible light image; and obtain pixel values ​​of the dynamic pixels 131 of the target object in a preset band within an imaging area corresponding to the image sensor 13 to generate a target image. That is, steps 01251 to 01253 may be executed by the processor 30.

[0076] Specifically, when performing multispectral imaging, such as fruit maturity detection, jade authenticity detection and other scenarios, it is only necessary to obtain an image of the target object. However, current object recognition algorithms are generally based on visible light images and infrared images. Therefore, before performing multispectral imaging, the pixel value of the visible light pixel 132 is first obtained to generate a visible light image, so as to identify the target object in the visible light image based on a preset image recognition algorithm, and then the target object can be quickly located in the imaging area corresponding to the image sensor 13 according to the position of the target object in the visible light image. It can be understood that at this time, when the processor 30 performs multispectral imaging, it only needs to obtain the pixel value of each dynamic pixel 131 in the imaging area in the preset band to obtain the multispectral image of the target object, which can be used to realize fruit maturity detection and jade authenticity detection.

[0077] See also Fig.14 The present application also provides a non-volatile computer-readable storage medium 200 including a computer program 201. When the computer program 201 is executed by one or more processors 3020, the one or more processors 3020 execute the control method of any of the above embodiments.

[0078] In the present application, unless otherwise clearly specified and limited, a first feature being “above” or “below” a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being “above”, “above”, and “above” a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being “below”, “below”, and “below” a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0079] In the description of this specification, the descriptions with reference to the terms "certain embodiments", "in an example", "exemplarily", etc., mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.

[0080] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0081] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. An imaging module, characterized in that: include: Lens; A filter, used for filtering the light entering the lens according to an input preset electrical signal to adjust the wavelength band of the filtered light, wherein the preset electrical signal includes a plurality of different electrical signal values, and different electrical signal values ​​correspond to at least two different wavelength bands; and The image sensor comprises dynamic pixels, wherein the dynamic pixels are used to receive and respond to brightness changes of the filtered light to output brightness change values.

2. The imaging module according to claim 1, characterized in that: There are a plurality of filters, and the plurality of filters cooperate to filter the light according to the preset electrical signal to adjust the wavelength band of the filtered light.

3. The imaging module according to claim 2, characterized in that: The filter includes a first filter and a second filter, the first filter and the second filter form a gap, and the first filter and the second filter are used to adjust the width of the gap according to the preset electrical signal to adjust the wavelength band of the filtered light.

4. The imaging module according to claim 2, characterized in that: When different filters are powered on, the wavelength bands of light that can pass through are at least partially different. Multiple filters are arranged overlappingly, and multiple filters are selectively powered on according to the preset electrical signal to adjust the wavelength band of the filtered light.

5. The imaging module according to claim 1, characterized in that: The image sensor further includes visible light pixels, and the visible light pixels and the dynamic pixels are arranged crosswise.

6. The imaging module according to claim 5, characterized in that: The visible light pixel is surrounded by the dynamic pixels, and the dynamic pixel is surrounded by the visible light pixels.

7. The imaging module according to claim 5, characterized in that: The visible light pixel and the dynamic pixel share the same photosensitive unit.

8. The imaging module according to claim 7, characterized in that: The initial brightness value of the dynamic pixel is determined according to the pixel value of the visible light pixel.

9. An electronic device, characterized in that: It comprises a shell and the imaging module according to any one of claims 1 to 8, wherein the imaging module is arranged in the shell.

10. The electronic device according to claim 9, characterized in that: The electronic device further comprises a processor, wherein the processor is configured to: Controlling the filter to adjust the wavelength band of the filtered light according to a preset electrical signal; A target image is generated according to the brightness change value.

11. The electronic device according to claim 10, characterized in that: The processor is further configured to: Establishing a first mapping curve between brightness value and time according to the time when the dynamic pixel receives the filtered light and the brightness change value; Acquire the electrical signal value corresponding to the time when the dynamic pixel receives the filtered light in the preset electrical signal; Establishing a second mapping curve between the brightness value and the wavelength band according to a preset mapping relationship between the electrical signal value and the wavelength band and the first mapping curve; According to the second mapping curve corresponding to each of the dynamic pixels, a pixel value of each of the dynamic pixels in a preset band is acquired; and A target image is generated according to the pixel values.

12. The electronic device according to claim 11, characterized in that: The processor is further configured to: Acquiring pixel values ​​of visible light pixels of the image sensor to generate a visible light image; Identify a target object according to the visible light image; and The pixel values ​​of the dynamic pixels of the target object in the imaging area corresponding to the image sensor in a preset band are obtained to generate the target image.

13. An imaging method, applied to an imaging module, characterized in that: The imaging module includes a lens, a filter and an image sensor, wherein the filter is used to filter the light entering the lens, and the image sensor includes dynamic pixels, wherein the dynamic pixels are used to receive and respond to the brightness change of the filtered light to output a brightness change value; the imaging method includes: Controlling the filter to filter the light according to a preset electrical signal to adjust the wavelength band of the filtered light, wherein the preset electrical signal includes a plurality of different electrical signal values, and different electrical signal values ​​correspond to at least two different wavelength bands; A target image is generated according to the brightness change value.

14. The imaging method according to claim 13, characterized in that: Generating a target image according to the brightness change value includes: Establishing a first mapping curve between brightness value and time according to the time when the dynamic pixel receives the filtered light and the brightness change value; Acquire the electrical signal value corresponding to the time when the dynamic pixel receives the filtered light in the preset electrical signal; Establishing a second mapping curve between the brightness value and the wavelength band according to a preset mapping relationship between the electrical signal value and the wavelength band and the first mapping curve; According to the second mapping curve corresponding to each of the dynamic pixels, a pixel value of each of the dynamic pixels in a preset band is obtained; and The target image is generated according to the pixel values.

15. The imaging method according to claim 14, characterized in that: The image sensor further includes visible light pixels, the visible light pixels and the dynamic pixels are cross-arranged, and the target image is generated according to the pixel values, further including: Obtaining pixel values ​​of the visible light pixels to generate a visible light image; Identify a target object according to the visible light image; and The pixel values ​​of the dynamic pixels of the target object in the imaging area corresponding to the image sensor in a preset band are obtained to generate the target image.

16. A non-volatile computer-readable storage medium comprising a computer program, wherein when the computer program is executed by a processor, the processor is caused to perform the imaging method according to any one of claims 13 to 15.

Images