Multispectral Imaging Structure and Method, Multispectral Imaging Chip, and Electronic Device

Abstract

The present application discloses a multi-spectral imaging structure and method, a multi-spectral imaging chip, and an electronic device, belonging to the field of imaging technology. The multi-spectral imaging structure includes a plurality of photosensitive pixel units distributed in an array, each of the photosensitive pixel units includes a plurality of photosensitive pixel sub-units, each of the photosensitive pixel sub-units includes at least one first photosensitive pixel and at least one second photosensitive pixel, the first photosensitive pixel includes a first photosensitive diode and a first filter located on the first photosensitive diode, the second photosensitive pixel includes a second photosensitive diode and a second filter located on the second photosensitive diode, the first filter is a narrow-band filter, and the second filter is a wide-band filter. In the present application, by combining a narrow-band filter and a wide-band filter, the spectral recognition accuracy and the application range of ambient brightness can be taken into account simultaneously, and the imaging quality is improved.

Description

Technical Field

[0001] This application belongs to the field of imaging technology, and particularly relates to a multispectral imaging structure and method, a multispectral imaging chip, and an electronic device. Background Art

[0002] Multispectral technology refers to a spectral detection technology that can simultaneously obtain spectral information of three or more channels. With the development of machine vision-related technologies, the hardware of multispectral detectors has evolved from traditional large spectral instruments to integrated camera spectral modules, and the development of multispectral detection (imaging) chips has played a crucial role. In the multispectral chip technology solution, there are two types of spectral filter curves: narrowband filtering and broadband filtering, and two spectral curve solutions.

[0003] The narrowband spectral technology solution has relatively high spectral detection accuracy. However, due to the small full width at half maximum (FWHM), the light energy utilization rate is low, a larger photosensitive pixel diode (PD) is required, and it cannot work properly in a low-brightness environment (such as a light environment below 10 Lux); while the broadband spectral technology solution has a wider FWHM of the filtered spectrum, which can effectively improve the light energy utilization rate and expand the brightness working range (such as a low brightness of 0.1 Lux); but due to the wide broadband filtering wavelength, there will be a spectral crosstalk problem between different filtered bands, seriously affecting the accuracy of spectral detection in the wide-spectrum solution and the calibration effect in the chip manufacturing stage.

[0004] Both the broadband and narrowband multispectral technology solutions have the above-mentioned defects, which limit the application scenarios of multispectral technology and the accuracy of spectral data testing. Summary of the Invention

[0005] The purpose of the embodiments of this application is to provide a multispectral imaging structure and method, a multispectral imaging chip, and an electronic device, which can solve the problem that the existing multispectral imaging technology cannot simultaneously take into account the recognition accuracy of Hong Pu and the application range of environmental brightness, and the imaging effect is poor.

[0006] In a first aspect, the embodiments of this application provide a multispectral imaging structure, including:

[0007] A plurality of photosensitive pixel units distributed in an array, each of the photosensitive pixel units includes a plurality of photosensitive pixel subunits, each of the photosensitive pixel subunits includes at least one first photosensitive pixel and at least one second photosensitive pixel, the first photosensitive pixel includes a first photosensitive diode and a first filter located on the first photosensitive diode, the second photosensitive pixel includes a second photosensitive diode and a second filter located on the second photosensitive diode, the first filter is a narrowband filter, and the second filter is a broadband filter.

[0008] Optionally, in each of the photosensitive pixel units, the wavelength ranges of the light passing through the first filters of the first photosensitive pixels in different photosensitive pixel subunits are different.

[0009] Optionally, in each of the photosensitive pixel subunits, the wavelength ranges of the light passing through the second filters of different second photosensitive pixels are different.

[0010] Optionally, the multispectral imaging structure further includes:

[0011] An adjustment unit, the adjustment unit is connected to the second filter of the second photosensitive pixel, and the adjustment unit calibrates the parameters of the second filter in the same photosensitive pixel subunit according to the response data of the first photosensitive pixel.

[0012] Optionally, each of the photosensitive pixel units includes nine photosensitive pixel subunits, and each of the photosensitive pixel subunits includes one first photosensitive pixel and eight second photosensitive pixels.

[0013] In a second aspect, an embodiment of the present application provides a multispectral imaging method, which is applied to the multispectral imaging structure as described in the first aspect. The method includes:

[0014] When the ambient brightness is greater than a preset threshold, first response data is generated according to the incident light sensed by the first photosensitive pixel, and second response data is generated according to the incident light sensed by the second photosensitive pixel;

[0015] Image data is generated according to the first response data and the second response data.

[0016] Optionally, the method further includes:

[0017] When the ambient brightness is less than a preset threshold, third response data is generated according to the incident light sensed by the second photosensitive pixel;

[0018] According to the third response data of the second photosensitive pixel in the same photosensitive pixel subunit, the predicted response data of the first photosensitive pixel in the same photosensitive pixel subunit is calculated;

[0019] Image data is generated according to the predicted response data and the third response data.

[0020] Optionally, before generating the first response data according to the incident light sensed by the first photosensitive pixel and / or generating the second response data according to the incident light sensed by the second photosensitive pixel, it further includes:

[0021] Placing the multispectral imaging structure in a standard light source, the standard light source includes a variety of narrow-band light sources and broadband light sources with known wavelengths;

[0022] Utilize the first photosensitive pixel to sense the incident light of the standard light source to generate narrowband response data;

[0023] Calibrate the parameters of the second filter in the same photosensitive pixel subunit according to the narrowband response data.

[0024] In a third aspect, an embodiment of the present application provides a multispectral imaging chip, including the multispectral imaging structure as described in the first aspect

[0025] In a fourth aspect, an embodiment of the present application provides an electronic device, and the electronic device includes the multispectral imaging chip as described in the third aspect.

[0026] In the embodiment of the present application, by combining the narrowband filter and the broadband filter, the spectral recognition accuracy can be improved, the application range of the environmental brightness can be expanded, the imaging quality is improved, and the application scenario is broadened. Description of the Drawings

[0027] Figure 1 It is a characteristic schematic diagram of broadband filtering;

[0028] Figure 2 It is a characteristic schematic diagram of narrowband filtering;

[0029] Figure 3 It is a schematic structural diagram of the photosensitive pixel unit provided by the embodiment of the present application;

[0030] Figure 4 It is a composition sequence diagram of the photosensitive pixel unit provided by the embodiment of the present application;

[0031] Figure 5 It is a schematic structural diagram of the photosensitive pixel provided by the embodiment of the present application;

[0032] Figure 6 It is a schematic diagram of the light bands passing through different photosensitive pixels in different photosensitive pixel subunits provided by the embodiment of the present application;

[0033] Figure 7 It is a schematic diagram of the light bands passing through the first photosensitive pixel in different photosensitive pixel subunits in the embodiment of the present application;

[0034] Figure 8 It is a filter characteristic schematic diagram of the second photosensitive pixel passing through different photosensitive pixel subunits in the embodiment of the present application;

[0035] Figure 9 It is a schematic flowchart of a multispectral imaging method provided by the embodiment of the present application;

[0036] Figure 10 It is a schematic flowchart of another multispectral imaging method provided by the embodiment of the present application;

[0037] Figure 11 This is a schematic flowchart of the parameter calibration method for the second filter provided by the embodiments of the present application. Detailed implementation manners

[0038] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are some, rather than all, of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0039] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such data may be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order different from those illustrated or described herein, and the objects distinguished by "first", "second", etc. generally belong to the same category, and the number of objects is not limited. For example, the first object may be one or multiple. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally represents an "or" relationship between the associated objects before and after.

[0040] Next, the multi-spectral imaging structure and method, multi-spectral imaging chip, and electronic device provided by the embodiments of the present application will be described in detail in conjunction with the accompanying drawings, through specific embodiments and their application scenarios.

[0041] Please refer to Figure 1 and Figure 2 , Figure 1 which is a characteristic schematic diagram of broadband filtering, Figure 2 and Figure 1 which is a characteristic schematic diagram of narrowband filtering. As shown in Figure 2 , broadband filtering has a relatively wide filtering wavelength range, which can improve the light energy utilization rate, thereby expanding the ambient brightness range in which normal operation is possible. Of course, this will also cause crosstalk problems between different filtering bands, affecting its accuracy. As shown in

[0042] Therefore, please refer to Figures 3 to 5 , Figure 3 which is a schematic structural diagram of the photosensitive pixel unit provided by the embodiments of the present application, Figure 4 and Figure 5This is a schematic structural diagram of a photosensitive pixel provided by an embodiment of the present application. As Figures 3 to 5 shown, an embodiment of the present application provides a multispectral imaging structure. The multispectral imaging structure includes a plurality of photosensitive pixel units 30 distributed in an array, that is, the plurality of photosensitive pixel units 30 are distributed in rows and columns. Among them, each photosensitive pixel unit 30 includes a plurality of photosensitive pixel subunits, and each photosensitive pixel subunit includes at least one first photosensitive pixel and at least one second photosensitive pixel. Specifically, the first photosensitive pixel includes a first photosensitive diode and a first filter located on the first photosensitive diode, and the second photosensitive pixel includes a second photosensitive diode and a second filter located on the second photosensitive diode. The first filter is a narrowband filter, and the second filter is a broadband filter. Incident light enters the first photosensitive diode through the first filter and then realizes the conversion of the optical signal into an electrical signal. Similarly, incident light enters the second photosensitive diode through the second filter and then realizes the conversion of the optical signal into an electrical signal. Since the first photosensitive pixel uses a narrowband filter and the second photosensitive pixel uses a broadband filter, the wavelength range of the light transmitted through the first filter is smaller than the wavelength range of the light transmitted through the second filter.

[0043] When performing photosensitive imaging by the above multispectral imaging structure, when the brightness of the ambient light falls within the first brightness range (for example, above 0.1 lux), photosensitive imaging can be performed simultaneously by the first photosensitive pixel and the second photosensitive pixel. When the brightness of the ambient light falls within the second brightness range (for example, below 10 lux), photosensitive imaging can be performed by the second photosensitive pixel.

[0044] Therefore, in the embodiment of the present application, by combining a narrowband filter and a broadband filter, the spectral recognition accuracy can be improved, the application range of the ambient brightness can be expanded, the imaging quality is improved, and the application scenario is broadened.

[0045] In some embodiments of the present application, the first photosensitive pixel may specifically include a lens 101, a first filter 102, a first photosensitive diode 103, a metal wiring layer 104, and a silicon substrate 105. After the lens 101 converges the incident light to the first filter 102, the first filter 102 transmits light of a specific wavelength band and is received by the first photosensitive diode 103. The first photosensitive diode 103 converts the received optical signal into an electrical signal and outputs it through the metal wiring layer 104. The metal wiring layer 104 is formed on the silicon substrate 105.

[0046] In the embodiment of the present application, the structure of the second photosensitive pixel is similar to that of the first photosensitive pixel, except that the first filter 102 is replaced by a second filter. To avoid repetition, it will not be described in detail here.

[0047] In some other embodiments of the present application, optionally, each of the photosensitive pixel units includes nine photosensitive pixel subunits, and each of the photosensitive pixel subunits includes one first photosensitive pixel and eight second photosensitive pixels. That is to say, one first photosensitive pixel and eight second photosensitive pixels form a photosensitive pixel subunit, and nine photosensitive pixel subunits form a photosensitive pixel unit. Of course, the above structural composition is only exemplary. It is also possible that one first photosensitive pixel and three second photosensitive pixels form a photosensitive pixel subunit, and four photosensitive pixel subunits form a photosensitive pixel unit, and so on.

[0048] In some embodiments of the present application, optionally, for a photosensitive pixel unit, the distance between the first photosensitive pixels in the multiple photosensitive pixel subunits that make up the photosensitive pixel unit can be appropriately reduced to improve the imaging effect.

[0049] Please refer to Figure 6 and Figure 7 , Figure 6 which is a schematic diagram of the wavelength bands of light passing through different photosensitive pixels in different photosensitive pixel subunits provided by the embodiments of the present application, Figure 7 which is a schematic diagram of the wavelength bands of light passing through the first photosensitive pixels in different photosensitive pixel subunits in the embodiments of the present application. In some embodiments of the present application, optionally, in the same photosensitive pixel unit, the wavelength band ranges of the light passing through the first filters of the first photosensitive pixels in different photosensitive pixel subunits are different. As Figure 6 and Figure 7 shown, taking a photosensitive pixel unit 30 including nine photosensitive pixel subunits as an example, that is, a total of nine photosensitive pixel subunits A-I, and each photosensitive pixel subunit further includes one first photosensitive pixel and eight second photosensitive pixels. Optionally, the first photosensitive pixel can be located at the center, and the eight second photosensitive pixels can be located on the outer periphery of the first photosensitive pixel. Then, the wavelengths of the light passing through the first photosensitive pixels in the photosensitive pixel subunits A-I are respectively corresponding to λA-λI, and λA-λI are all different. Exemplarily, λA-λI cover the range of 350nm to 1000nm. Thus, for a single photosensitive pixel unit, since the wavelength band ranges of the light passing through the first filters of the first photosensitive pixels in different photosensitive pixel subunits 20 are different, and the first filter of the first photosensitive pixel is a narrow-band filter, therefore, both the coverage range of the wavelength band of the transmitted light can be effectively expanded, and the detection accuracy in the wavelength band can be improved.

[0050] Please refer to Figure 8 , Figure 8 which is a schematic diagram of the filtering characteristics of the light passing through the second photosensitive pixels in different photosensitive pixel subunits in the embodiments of the present application. In some other embodiments of the present application, in the same photosensitive pixel subunit, the wavelength band ranges of the light passing through the second filters of different second photosensitive pixels are different. AsFigure 8 As shown, taking a photosensitive pixel unit 30 including 9 photosensitive pixel subunits as an example, that is, there are a total of 9 photosensitive pixel subunits A - I. Each photosensitive pixel subunit further includes a first photosensitive pixel and eight second photosensitive pixels. Then, for any one of the photosensitive pixel subunits A - I, the wavelengths of the light passing through the second photosensitive pixels therein are respectively corresponding to λ1 - λ8, and λ1 - λ8 are different from each other. Exemplarily, λ1 - λ8 cover the range of 350nm to 1000nm. Thus, for a single photosensitive pixel subunit, since the band ranges of the light passing through the second filters of different second photosensitive pixels are different, and the second filter of the second photosensitive pixel is a broadband filter, therefore, the coverage range of the band of the transmitted light can be effectively expanded, and the crosstalk of the light between different bands can be reduced.

[0051] In the embodiment of the present application, optionally, the multispectral imaging structure further includes an adjustment unit. The adjustment unit is connected to the second filter of the second photosensitive pixel, and the adjustment unit calibrates the parameters of the second filter in the same photosensitive pixel subunit according to the response data of the first photosensitive pixel. That is to say, since in the same photosensitive pixel unit 30, the band ranges of the light passing through the first filters of the first photosensitive pixels in different photosensitive pixel subunits are different, and in the same photosensitive pixel subunit, the band ranges of the light passing through the second filters of different second photosensitive pixels are different. Therefore, for each photosensitive pixel subunit, it can sense light through the first photosensitive pixel to generate response data. Since the first photosensitive pixel is a narrow - band filter, its detection accuracy is high. In the case of a known - band light source, the parameters of the second filter of the second photosensitive pixel can be calibrated according to the response data of the first photosensitive pixel, so that the band of the light passing through the second photosensitive pixel meets the corresponding requirements, achieving the effect of improving the detection accuracy.

[0052] In some optional embodiments, the adjustment unit can also be connected to the first photosensitive pixel, that is, the adjustment unit directly obtains the response data of the first photosensitive pixel, analyzes and processes the response data, and then calibrates the parameters of the second filter of the second photosensitive pixel according to the response data of the first photosensitive pixel; optionally, the adjustment unit can also be connected to a control module, and the control module is connected to the first photosensitive pixel. The control module obtains the response data of the first photosensitive pixel, analyzes and processes the response data, and then outputs a control signal to the adjustment unit accordingly, so as to calibrate the parameters of the second filter of the second photosensitive pixel by using the adjustment unit.

[0053] In the embodiment of the present application, the parameters of the second filter can be peak transmittance, central wavelength, half - bandwidth, cut - off range, optical density, incident angle, cut - off rate, cut - off band, start wavelength, cut - off wavelength, effective aperture, etc.

[0054] In summary, in the embodiments of the present application, by combining a narrow-band filter and a wide-band filter, that is, combining a first photosensitive pixel and a second photosensitive pixel, in normal brightness, the first photosensitive pixel and the second photosensitive pixel can sense light simultaneously, thereby improving the detection accuracy. In low brightness, the second photosensitive pixel can be used to sense light to ensure that imaging can be carried out. That is to say, it can not only improve the spectral recognition accuracy, but also expand the application range of ambient brightness, improve the imaging quality, and broaden the application scenarios.

[0055] Please refer to Figure 9 , Figure 9 which is a schematic flowchart of a multi-spectral imaging method provided by an embodiment of the present application. As Figure 9 shown, another embodiment of the embodiments of the present application further provides a multi-spectral imaging method, which is applied to the multi-spectral imaging structure described in any of the above embodiments. The method includes:

[0056] Step 901: When the ambient brightness is greater than a preset threshold, generate first response data according to the incident light sensed by the first photosensitive pixel, and generate second response data according to the incident light sensed by the second photosensitive pixel;

[0057] Step 902: Generate image data according to the first response data and the second response data.

[0058] In the embodiments of the present application, since each photosensitive pixel subunit includes at least one first photosensitive pixel and at least one second photosensitive pixel. Exemplarily, in the same photosensitive pixel unit, the wavelength ranges of the light passing through the first filters of the first photosensitive pixels in different photosensitive pixel subunits are different, and in the same photosensitive pixel subunit, the wavelength ranges of the light passing through the second filters of different second photosensitive pixels are different. Therefore, when the ambient brightness is greater than a certain preset threshold (for example, 10 lux), both the first photosensitive pixel and the second photosensitive pixel can work normally. Then, the two are used to sense light simultaneously to generate corresponding response data, and the accuracy of the image data obtained according to the first response data and the second response data is higher, and the imaging effect is better.

[0059] In the embodiments of the present application, optionally, the method further includes:

[0060] When the ambient brightness is less than the preset threshold, generate third response data according to the incident light sensed by the second photosensitive pixel;

[0061] Calculate the predicted response data of the first photosensitive pixel in the same photosensitive pixel subunit according to the third response data of the second photosensitive pixel in the same photosensitive pixel subunit;

[0062] Generate image data based on the predicted response data and the third response data.

[0063] That is, when the ambient brightness is less than a preset threshold (e.g., 10 lux), the first photosensitive pixel cannot sense light normally, but the second photosensitive pixel can still work normally. Then, the second photosensitive pixel is used to sense light to generate the third response data. Then, based on the third response data of each second photosensitive pixel in the same photosensitive pixel subunit, the predicted response data of the first photosensitive pixel in the same photosensitive pixel subunit can be inversely calculated. After that, image data can be generated based on the predicted response data and the third response data. By inversely calculating the response data of the first photosensitive pixel, the defect that the first photosensitive pixel cannot sense light normally can be compensated to ensure the imaging effect.

[0064] In some embodiments of the present application, optionally, before generating the first response data based on the incident light sensed by the first photosensitive pixel and / or generating the second response data based on the incident light sensed by the second photosensitive pixel, it further includes:

[0065] Place the multispectral imaging structure in a standard light source, where the standard light source includes a variety of narrowband light sources and broadband light sources with known wavelengths;

[0066] Use the first photosensitive pixel to sense the incident light of the standard light source to generate narrowband response data;

[0067] Calibrate the parameters of the second filter in the same photosensitive pixel subunit according to the narrowband response data.

[0068] In the present application, before imaging using the above multispectral imaging structure, the parameters of the second filter of the second photosensitive pixel can be calibrated using the first photosensitive pixel in the same photosensitive pixel subunit. Specifically, by placing the multispectral imaging structure in a standard light source including a variety of narrowband light sources and broadband light sources with known wavelengths, the first photosensitive pixel is used to sense the incident light of the standard light source to generate narrowband response data. Then, on the premise of the standard light source with known wavelengths, the parameters of the second filter in the same photosensitive pixel subunit can be calibrated according to the narrowband response data, so that the wavelength band of the light passing through the second photosensitive pixel meets the corresponding requirements, achieving the effect of improving the detection accuracy.

[0069] Please refer to Figure 10 , Figure 10 which is a schematic flowchart of another multispectral imaging method provided by an embodiment of the present application. The multispectral imaging method in the embodiment of the present application is applied to the Figure 6 multispectral imaging structure, and the method is as follows:

[0070] Detect the user's usage environment;

[0071] When in a high / normal brightness environment, the λA-λI narrowband spectral pixels respond, generating narrowband spectral pixel response data. At the same time, the λ1-λ8 broadband spectral pixels respond, generating broadband spectral pixel response data. Then, spectral / image data is formed based on the narrowband spectral pixel response data and the broadband spectral pixel response data and output.

[0072] When in a low brightness environment, the λA-λI narrowband spectral pixels do not respond, and the λ1-λ8 broadband spectral pixels respond, generating broadband spectral pixel response data. Then, based on the broadband spectral pixel response data in the same photosensitive pixel subunit, the narrowband spectral pixel response data is predicted. Then, spectral / image data is formed based on the broadband spectral pixel response data and the predicted response data and output.

[0073] Thus, in the embodiments of the present application, through the combination of the first photosensitive pixel and the second photosensitive pixel, in normal brightness, the first photosensitive pixel and the second photosensitive pixel can sense light simultaneously, thereby improving the detection accuracy. In low brightness, the second photosensitive pixel can sense light to ensure imaging. That is to say, it can not only improve the spectral recognition accuracy but also expand the application range of environmental brightness, improve the imaging quality, and broaden the application scenarios.

[0074] Please refer to Figure 11 , Figure 11 which is a schematic flowchart of the parameter calibration method for the second filter provided by the embodiments of the present application. As Figure 11 shown, the parameter calibration method for the second filter in the embodiments of the present application is specifically as follows:

[0075] Place the multispectral imaging structure in a standard light source containing multiple narrowband light sources and broadband light sources with known wavelengths;

[0076] The λA-λI narrowband spectral pixels respond, generating narrowband spectral pixel response data;

[0077] Use the narrowband spectral pixel response data to calibrate the λ1-λ8 narrowband spectral pixel response;

[0078] The corrected response data of the λ1-λ8 narrowband spectral pixels;

[0079] The λ1-λ8 broadband spectral pixels work normally and respond.

[0080] Thus, in the embodiments of the present application, the wavelength band of the light passing through the second photosensitive pixel can meet the corresponding requirements, achieving the effect of improving the detection accuracy.

[0081] In another aspect of the embodiments of the present application, a multispectral imaging chip is further provided. The multispectral imaging chip includes the multispectral imaging structure described in the above embodiments. Since the multispectral imaging structure in the above embodiments combines a narrowband filter and a broadband filter, that is, combines the first photosensitive pixel and the second photosensitive pixel, in normal brightness, the first photosensitive pixel and the second photosensitive pixel can sense light simultaneously, thereby improving the detection accuracy. And in low brightness, the second photosensitive pixel can be used to sense light to ensure that imaging can be carried out. That is to say, it can not only improve the spectral recognition accuracy, but also expand the application range of environmental brightness, improve the imaging quality, and broaden the application scenarios. Therefore, the multispectral imaging chip in the embodiments of the present application also correspondingly has the above beneficial effects. To avoid repetition, it will not be elaborated here.

[0082] In yet another aspect of the embodiments of the present application, an electronic device is further provided. The electronic device includes the multispectral imaging chip described in the above embodiments. Since the multispectral imaging chip in the above embodiments combines a narrowband filter and a broadband filter, that is, combines the first photosensitive pixel and the second photosensitive pixel, in normal brightness, the first photosensitive pixel and the second photosensitive pixel can sense light simultaneously, thereby improving the detection accuracy. And in low brightness, the second photosensitive pixel can be used to sense light to ensure that imaging can be carried out. That is to say, it can not only improve the spectral recognition accuracy, but also expand the application range of environmental brightness, improve the imaging quality, and broaden the application scenarios. Therefore, the electronic device in the embodiments of the present application also correspondingly has the above beneficial effects. To avoid repetition, it will not be elaborated here.

[0083] It should be understood that the chip mentioned in the embodiments of the present application can also be referred to as a system-on-chip, system chip, chip system, or system-on-chip, etc.

[0084] It should be noted that in this article, the term "comprising", "including" or any other variant thereof is intended to cover a non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, the features described with reference to certain examples may be combined in other examples.

[0085] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, in essence or the part that contributes to the prior art, can be embodied in the form of a computer software product. The computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes several instructions for causing a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present application.

[0086] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific implementation manners. The above specific implementation manners are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them belong to the protection scope of the present application.

Claims

1. A multispectral imaging structure, characterized in that, It includes a plurality of photosensitive pixel units distributed in an array. Each of the photosensitive pixel units includes a plurality of photosensitive pixel subunits. Each of the photosensitive pixel subunits includes at least one first photosensitive pixel and at least one second photosensitive pixel. The first photosensitive pixel includes a first photosensitive diode and a first filter located on the first photosensitive diode. The second photosensitive pixel includes a second photosensitive diode and a second filter located on the second photosensitive diode. The first filter is a narrowband filter, and the second filter is a broadband filter; The multispectral imaging structure further includes: an adjustment unit. The adjustment unit is connected to the second filter of the second photosensitive pixel. The adjustment unit calibrates the parameters of the second filter in the same photosensitive pixel subunit according to the response data of the first photosensitive pixel.

2. The multispectral imaging structure according to claim 1, characterized in that, In each of the photosensitive pixel units, the wavelength ranges of the light passing through the first filters of the first photosensitive pixels in different photosensitive pixel subunits are different.

3. The multispectral imaging structure according to claim 1 or 2, characterized in that, In each of the photosensitive pixel subunits, the wavelength ranges of the light passing through the second filters of different second photosensitive pixels are different.

4. The multispectral imaging structure according to claim 1, characterized in that, Each of the photosensitive pixel units includes nine photosensitive pixel subunits. Each of the photosensitive pixel subunits includes one first photosensitive pixel and eight second photosensitive pixels.

5. A multispectral imaging method, characterized in that, Applied to the multispectral imaging structure according to any one of claims 1 to 4, the method includes: When the ambient brightness is greater than a preset threshold, generating first response data according to the incident light sensed by the first photosensitive pixel, and generating second response data according to the incident light sensed by the second photosensitive pixel; Generating image data according to the first response data and the second response data; Before generating the first response data according to the incident light sensed by the first photosensitive pixel and / or generating the second response data according to the incident light sensed by the second photosensitive pixel, it further includes: Placing the multispectral imaging structure in a standard light source. The standard light source includes a plurality of narrowband light sources and broadband light sources with known wavelengths; Using the first photosensitive pixel to sense the incident light of the standard light source to generate narrowband response data; Calibrating the parameters of the second filter in the same photosensitive pixel subunit according to the narrowband response data.

6. The method according to claim 5, wherein It further includes: When the ambient brightness is less than a preset threshold, generating third response data according to the incident light sensed by the second photosensitive pixel; Calculating the predicted response data of the first photosensitive pixel in the same photosensitive pixel subunit according to the third response data of the second photosensitive pixel in the same photosensitive pixel subunit; Generating image data according to the predicted response data and the third response data.

7. A multispectral imaging chip, characterized in that, It includes the multispectral imaging structure according to any one of claims 1-4.

8. An electronic device, characterized in that, It includes the multispectral imaging chip according to claim 7.

Images