Spectrum calculation method, multispectral chip assembly and storage medium

Abstract

The invention provides a spectrum calculation method, a multispectral chip assembly and a storage medium. The spectrum calculation method comprises the following steps: acquiring an actual distance between a photosensitive unit and a measured object; based on the actual distance and a database, determining the proportion of light of different wavebands in the waveband set; wherein the database comprises the proportion of light of different wave bands in the wave band set when the light sensing unit and the measured object are located at different distances. According to the spectrum calculation method, the proportion of the light which can penetrate through the light filtering unit and is gathered in the wave bands, namely the proportion of the light of different wave bands in the mixed light received by the light sensing unit can be determined, decomposition of the mixed spectrum is achieved, the proportion of the components of the light of different wave bands in the mixed light can be determined, and the light sensing unit can receive the light of different wave bands at the same time; the light sensing unit can sense light of different wave bands at the same time, and optimization of a multispectral chip is facilitated.

Description

Technical Field

[0001] This application relates to the field of multispectral technology, and specifically relates to a spectral calculation method, a multispectral chip component, and a storage medium. Background Art

[0002] Multispectral chips have the advantages of small size, light weight, low power consumption, and fast analysis, so they have a wide range of applications in the field of spectral analysis. It can be used in fields such as spectral imaging, spectral sensing, chemical analysis, biomedical detection, etc., providing a new solution for real-time monitoring and fast analysis.

[0003] In the related-art multispectral chips, the photosensitive unit can only sense light of a single band. Therefore, each photosensitive unit needs to correspond to a filter unit, and the filter unit can only transmit light of one band, so that the photosensitive unit only receives light of a single band. Therefore, the multispectral chips in the related art still need to be optimized. Summary of the Invention

[0004] Embodiments of this application provide a spectral calculation method, a multispectral chip component, and a storage medium.

[0005] In a first aspect, embodiments of this application provide a spectral calculation method, which is applied to a multispectral chip component. The multispectral chip component includes a photosensitive unit and a filter unit that correspond one by one. The photosensitive unit is used to obtain light of different bands to obtain spectral information of each channel. Among them, different channels correspond to spectral information of different bands. The filter unit filters the light entering the photosensitive unit. The filter unit can transmit light of a band set, and the band set includes at least two different bands. The method includes:

[0006] Obtain the actual distance between the photosensitive unit and the object to be measured;

[0007] Based on the actual distance and the database, determine the proportion of light of different bands in the band set;

[0008] Among them, the database includes the proportion of light of different bands in the band set when the photosensitive unit and the object to be measured are at different distances.

[0009] In an embodiment, after the step of determining the proportion of light of different bands in the band set, the method further includes:

[0010] Based on the proportion of light of different bands in the band set and the photosensitive data of the photosensitive unit, determine the photosensitive data of light of different bands in the band set;

[0011] Determine an image result according to the photosensitive data of light of different bands in the band set.

[0012] In one embodiment, the step of determining the proportion of light of different bands in the band set based on the actual distance and the database includes:

[0013] Obtaining the actual incident angle of the light at the photosensitive unit;

[0014] Based on the actual distance, the actual incident angle, and the database, determining the proportion of light of different bands in the band set;

[0015] Wherein, the database includes: the proportion of light of different bands in the band set when the photosensitive unit and the object to be measured are at different distances and the light at the photosensitive unit has different incident angles.

[0016] In one embodiment, before the step of obtaining the actual distance between the photosensitive unit and the object to be measured, it includes:

[0017] Successively obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, where the mixed light includes the light of all bands in the band set;

[0018] Based on the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, the proportion of light of different bands in the band set;

[0019] Storing the proportion of light of different bands in the band set and the distance between the object to be measured and the photosensitive unit in the database;

[0020] When it is determined that the distance between the object to be measured and the photosensitive unit changes, repeating the steps of successively obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light to the step of storing in the database.

[0021] In one embodiment, the band set includes n different bands; the step of successively obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light includes:

[0022] Successively obtaining the photosensitive data I 11 、I 21 、......I m1 of the first band under m different light intensities, successively obtaining the photosensitive data I 12 、I 22 、......I m2 of the second band under m different light intensities,...... successively obtaining the photosensitive data I 1n 、I 2n 、......I mn;

[0023] Successively obtain the photosensitive data I1, I2......Im of the mixed light under m different light intensities m ;

[0024] The steps of the ratio of the light of different bands in the band set based on the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light include:

[0025] Based on formula (1) I1 = a1I 11 + a2I 12 +......+ a n I 1n , formula (2) I2 = a1I 21 + a2I 22 +......+ a n I 2n ,...... formula (m) I2 = a1I m1 + a2I m2 +......+ a n I mn , determine the ratio of the light of different bands in the band set.

[0026] In an embodiment, before the step of obtaining the actual distance between the photosensitive unit and the object to be measured, it includes:

[0027] Successively obtain the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, where the mixed light includes the light of all bands in the band set;

[0028] Based on the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, the ratio of the light of different bands in the band set;

[0029] Store the ratio of the light of different bands in the band set and the incident angle of the light at the photosensitive unit in the database;

[0030] Determine that the incident angle of the light at the photosensitive unit changes, and repeat the steps of successively obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light to the step of storing in the database.

[0031] Second aspect, embodiments of the present application provide a multispectral chip component for performing the spectral calculation method as described above. The multispectral chip component includes a corresponding photosensitive unit and a filter unit. The photosensitive unit is used to obtain light of different bands to obtain spectral information of each channel. Among them, different channels correspond to spectral information of different bands. The filter unit filters the light entering the photosensitive unit. The filter unit can transmit light of a band set, and the band set includes at least two different bands.

[0032] In one embodiment, the multispectral chip component further includes a ranging unit for measuring the distance between the object to be measured and the photosensitive unit.

[0033] In one embodiment, the multispectral chip component further includes an angle detection unit for detecting the incident angle of the light at the photosensitive unit.

[0034] According to a non-transitory computer-readable storage medium of an embodiment of the third aspect of the present application, the non-transitory computer-readable storage medium includes a computer program, and when the computer program is executed by a processor, the above-described spectral calculation method is implemented.

[0035] According to a computer program product of an embodiment of the fourth aspect of the present application, the computer program product includes a computer program, and when the computer program is executed by a processor, the above-described spectral calculation method is implemented.

[0036] Advantageous effects of the embodiments of the present application:

[0037] In the embodiments of the present application, the filter unit can filter the light reflected by the object to be measured. The filter unit can transmit light of at least two different bands, so that the photosensitive unit can receive light of at least two different bands. When the photosensitive unit receives light of different bands, the actual distance between the photosensitive unit and the object to be measured can be obtained, and the actual distance is compared with that in the database. Furthermore, the light of the band set that the filter unit can transmit can be determined, that is, the proportion of light of different bands in the mixed light received by the photosensitive unit, so as to realize the decomposition of the mixed spectrum and determine the proportion of the components of light of different bands in the mixed light. That is to say, the present application can make the filter unit transmit different lights at the same time, so that the photosensitive unit can receive light of different bands at the same time, and the photosensitive unit can sense light of different bands at the same time, which is beneficial to the optimization of the multispectral chip. Description of the Drawings

[0038] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those skilled in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0039] Figure 1 It is one of the schematic structural diagrams of the multi-spectral chip component provided by the embodiment of the present application;

[0040] Figure 2 It is the second of the schematic structural diagrams of the multi-spectral chip component provided by the embodiment of the present application;

[0041] Figure 3 It is the schematic structural diagram of the filter unit provided by the embodiment of the present application;

[0042] Figure 4 It is the schematic structural diagram of the first pixel structure provided by the embodiment of the present application;

[0043] Figure 5 It is the schematic structural diagram of the second pixel structure provided by the embodiment of the present application;

[0044] Figure 6 It is the schematic exploded view of the multi-spectral chip component provided by the embodiment of the present application;

[0045] Figure 7 It is the schematic diagram of the light band arrangement of the twelve-channel multi-spectral chip of the related art provided by the embodiment of the present application;

[0046] Figure 8 It is the schematic diagram of the pixel arrangement provided by the embodiment of the present application;

[0047] Figure 9 It is the flowchart of the spectral calculation method provided by the embodiment of the present application.

[0048] Explanation of reference numerals:

[0049] 1, photosensitive chip; 2, filter layer; 3, protective layer; 4, first pixel structure; 5, second pixel structure; 6, Fresnel lens; 7, lens; 8, ranging unit; 11, photosensitive unit; 21, filter unit; 211, first filter film; 212, second filter film. Detailed implementation manners

[0050] Next, in combination with the accompanying drawings in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative efforts belong to the scope of protection of the present application. In addition, it should be understood that the specific implementation manners described herein are only used to illustrate and explain the present application, and are not used to limit the present application. In the present application, unless otherwise stated, the orientation words such as "upper" and "lower" usually refer to the upper and lower in the actual use or working state of the device, specifically the drawing direction in the accompanying drawings; and "inner" and "outer" refer to the outline of the device.

[0051] Next, in combination with Figures 1 to 9 describe the spectral calculation method, multispectral chip component and storage medium of the present application.

[0052] According to an embodiment of the first aspect of the present application, as Figure 1 、 Figure 2 and Figure 9 , the spectral calculation method is applied to a multispectral chip component. The multispectral chip component includes a corresponding photosensitive unit and a filter unit. The photosensitive unit is used to obtain light of different bands to obtain spectral information of each channel. Among them, different channels correspond to spectral information of different bands. The filter unit filters the light entering the photosensitive unit. The filter unit can transmit light of a band set, and the band set includes at least two different bands; the method includes:

[0053] Step 101, obtain the actual distance between the photosensitive unit and the object to be measured;

[0054] It can be understood that after the light irradiates the object to be measured, after being reflected by the object to be measured, the light will be transmitted to the photosensitive unit. By obtaining the actual distance between the photosensitive unit and the object to be measured, the distance that the light travels from the object to be measured to the photosensitive unit can be determined.

[0055] In some examples, the distance between the photosensitive unit and the object to be measured can be detected by a distance measuring unit 8, such as a distance measuring component such as an ultrasonic distance measuring unit 8.

[0056] Step 102, based on the actual distance and the database, determine the proportion of light of different bands in the band set;

[0057] Among them, the database includes the proportion of light of different bands in the band set when the photosensitive unit and the object to be measured are at different distances.

[0058] It can be understood that after obtaining the actual distance between the object to be measured and the photosensitive unit, since the database stores the ratios of lights of different bands in the band set when the photosensitive unit and the object to be measured are at different distances, by comparing the actual distance with the data in the database, it can be known what the ratios of lights of different bands in the band set are at the current distance between the photosensitive unit and the object to be measured. Furthermore, the lights in the band set can be analyzed to obtain the weights of different monochromatic light components in the mixed light, thereby realizing the decomposition of the mixed spectrum corresponding to the band set.

[0059] According to the spectral calculation method of the embodiments of the present application, the filter unit can filter the light reflected by the object to be measured. The filter unit can transmit lights of at least two different bands, so that the photosensitive unit can receive lights of at least two different bands. When the photosensitive unit receives lights of different bands, the actual distance between the photosensitive unit and the object to be measured can be obtained, and the actual distance is compared with the database. Furthermore, the lights in the band set that the filter unit can transmit can be determined, that is, the ratios of lights of different bands in the mixed light received by the photosensitive unit, realizing the decomposition of the mixed spectrum, and the proportion of the components of lights of different bands in the mixed light can be determined. That is to say, the present application can enable the filter unit to transmit different lights simultaneously, so that the photosensitive unit can receive lights of different bands simultaneously, realizing that the photosensitive unit can sense lights of different bands simultaneously, which is beneficial to the optimization of the multi-spectral chip.

[0060] It should be noted that when the photosensitive unit and the object to be measured are at different distances, it means that the distance between the photosensitive unit and the object to be measured has different values. That is to say, the database includes the ratios of lights of different bands in the band set when the distance between the photosensitive unit and the object to be measured is the first distance, the ratios of lights of different bands in the band set when the distance between the photosensitive unit and the object to be measured is the second distance, and so on. The specific number of distances can be determined according to the actual situation.

[0061] It can be understood that in the related art, the core principle of separating different spectra from mixed light is to decompose the mixed light into monochromatic light of its constituent wavelengths through dispersion or filtering techniques. Common methods include prism dispersion method, diffraction grating method, interference method, fiber optic spectroscopy method, and filtering method. The prism dispersion method utilizes the different refractive indices of the prism for lights of different wavelengths, causing the mixed light to disperse after passing through the prism and separating spectra of different wavelengths. This method is simple and intuitive to implement, but is only applicable to the visible light range and has poor separation effects on ultraviolet and infrared lights. The diffraction grating method uses the diffraction characteristics of the grating to decompose the mixed light into spectra of different wavelengths. This method has high separation precision and is also applicable to a wide wavelength range, but the equipment cost is high and precise calibration is required. The interference method uses an interferometer to split the mixed light into two beams and separates lights of different wavelengths through interference fringes. This method has extremely high resolution and is applicable to complex spectral analysis, but the equipment is complex and the operation difficulty is large. The fiber optic spectroscopy method uses the combination of optical fibers and spectrometers to transmit the mixed light into the spectrometer for separation and analysis. This method is flexible and portable and is applicable to on-site detection, but is limited by the fiber optic transmission loss and has limited separation effects.

[0062] The filtering method uses an optical filter to selectively transmit light of a specific wavelength and filter out other wavelengths, and is widely used in multispectral imaging, fluorescence detection, and optical communication. This method has strong flexibility and can also select specific wavelengths according to requirements, and is the preferred method for spectral channel separation in multispectral imaging. Therefore, based on multispectral filtering imaging, this application proposes a method for inferring the contribution ratio of single-wavelength light from mixed light, which further enriches the multispectral imaging channels while retaining the advantages of multispectral filtering imaging, achieves high-precision spectral imaging at low cost, and can be iteratively upgraded quickly and at low cost.

[0063] That is to say, in the related art, the mixed spectral decomposition technology mainly focuses on two aspects. On the one hand, based on the characteristics of light, spectral splitting is achieved through specific devices, such as light dispersion, light diffraction, light interference, etc. Such technologies have high requirements for the accuracy of the devices, and the device cost is high, making it impossible to achieve low-cost and efficient promotion and application. On the other hand, the separation of the mixed spectrum is achieved through computational methods. Common methods include the mixed spectral decomposition method based on deep learning and the mixed light decomposition system based on sparse representation. The method based on deep learning has certain data dependencies and requires a large amount of labeled data for training, with high data acquisition costs. At the same time, the deep learning model has a large amount of calculations and relatively high requirements for hardware. The mixed light decomposition method based on sparse representation does not rely on large models, but this method is sensitive to noise, and the decomposition accuracy is easily limited, with low applicability. This application takes into account the advantages and disadvantages of the deep learning method and the sparse representation method, and proposes a method for inferring the contribution ratio of single wavelengths from mixed light at the algorithm level. This method is based on separately imaging monochromatic light and mixed light, and calculates the weights of different monochromatic light components in the mixed light through the imaging results of monochromatic light and mixed light, thereby achieving the decomposition of the mixed spectrum. It is also possible to combine different distances and different angles as variable conditions to simulate multi-spectral imaging under different environments, extract the proportional distribution of each monochromatic light component in the mixed light under this condition, establish a mixed light decomposition model, and achieve high-precision multi-spectral imaging under adaptive mixed light decomposition.

[0064] In some embodiments, after the step of determining the proportion of light of different bands in the band set, the method further includes:

[0065] Determining the light-sensitive data of light of different bands in the band set based on the proportion of light of different bands in the band set and the light-sensitive data of the light-sensitive unit;

[0066] Determining the image result according to the light-sensitive data of light of different bands in the band set.

[0067] It can be understood that the light-sensitive data of the light-sensitive unit is the light-sensitive data of all bands of light in the band set. After determining the proportion of light of different bands in the band set, the light-sensitive data of light of different bands in the band set can be determined based on the proportion of light of different bands in the band set and the light-sensitive data of the light-sensitive unit. Furthermore, the image result can be determined according to the light-sensitive data of light of different bands, realizing that one light-sensitive unit can simultaneously sense light of different bands.

[0068] It can be understood that in the related art, a photosensitive unit can only sense light of a single wavelength band to obtain photosensitive data corresponding to the light of the single wavelength band. When the photosensitive unit simultaneously receives light of two or more wavelength bands, the photosensitive data of different wavelength bands are mixed together, making it difficult to distinguish the photosensitive data of different wavelength bands, and it will be difficult to determine the image result based on the photosensitive data of the photosensitive unit. In this application, the contribution ratio of light of different wavelength bands in the wavelength band set can be determined first, and then, based on the photosensitive data of the mixed light corresponding to the wavelength band set, the photosensitive data corresponding to the light of different wavelength bands can be determined. Furthermore, the image result can be determined based on the photosensitive data. That is to say, this application can achieve the effects of multiple photosensitive units in the related art through one photosensitive unit.

[0069] In some embodiments, the step of determining the ratio of light of different wavelength bands in the wavelength band set based on the actual distance and the database includes:

[0070] Obtain the actual incident angle of the light at the photosensitive unit;

[0071] Based on the actual distance, the actual incident angle, and the database, determine the ratio of light of different wavelength bands in the wavelength band set;

[0072] Wherein, the database includes: the ratio of light of different wavelength bands in the wavelength band set when the photosensitive unit and the object to be measured are at different distances and the light at the photosensitive unit has different incident angles.

[0073] It can be understood that in addition to the distance between the photosensitive unit and the object to be measured having an impact on the ratio of light of different wavelength bands in the wavelength band set, the incident angle when the light reflected by the object to be measured irradiates the photosensitive unit may also have an impact on the ratio of light of different wavelength bands.

[0074] Therefore, when this application determines the ratio of light of different wavelength bands in the wavelength band set based on the actual distance and the database, it will also obtain the actual incident angle of the light at the photosensitive unit. Since the database stores the ratio of light of different wavelength bands in the wavelength band set when the photosensitive unit and the object to be measured are at different distances and the light at the photosensitive unit has different incident angles, by comparing the actual distance and the actual incident angle with the database, it is possible to know the ratio of light of different wavelength bands in the wavelength band set at the current distance between the photosensitive unit and the object to be measured and the current incident angle of the light at the photosensitive unit. Furthermore, the light in the wavelength band set can be analyzed to obtain the weights of different monochromatic light components in the mixed light, thereby realizing the decomposition of the mixed spectrum corresponding to the wavelength band set.

[0075] In some embodiments, before the step of obtaining the actual distance between the photosensitive unit and the object to be measured, it includes:

[0076] Successively obtain the photosensitive data of the light of each band in the band collection and the photosensitive data of the mixed light, where the mixed light includes the light of all bands in the band collection;

[0077] Based on the photosensitive data of the light of each band in the band collection and the photosensitive data of the mixed light, determine the proportion of the light of different bands in the band collection;

[0078] Store the proportion of the light of different bands in the band collection and the distance between the object to be measured and the photosensitive unit in the database;

[0079] Determine that the distance between the object to be measured and the photosensitive unit has changed, and repeat the steps from successively obtaining the photosensitive data of the light of each band in the band collection and the photosensitive data of the mixed light to the step of storing in the database.

[0080] It can be understood that when obtaining the actual distance between the photosensitive unit and the object to be measured, first construct the database. Specifically, first successively obtain the photosensitive data of the light of each band in the band collection and the photosensitive data of the mixed light. According to the photosensitive data of the light of each band and the photosensitive data of the mixed light, the proportion of the light of different bands in the band collection can be determined. Then store the current distance between the object to be measured and the photosensitive unit and the proportion of the light of different bands in the database. Then adjust the distance between the photosensitive unit and the object to be measured, and repeat the steps from successively obtaining the photosensitive data of the light of each band in the band collection and the photosensitive data of the mixed light to the step of storing in the database, so as to obtain the proportion of the light of different bands corresponding to when the photosensitive unit and the object to be measured are at different distances, and store them in the database. Furthermore, the construction of the database can be realized, so as to facilitate subsequent determination of the proportion of the light of different bands corresponding to the actual distance between the photosensitive unit and the object to be measured.

[0081] Exemplarily, the band collection includes the light of three different bands, namely the first band, the second band, and the third band.

[0082] It is understandable that successively obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light means that first, the light of the first band is irradiated from the object to be measured through the filter unit to the photosensitive unit, and the photosensitive data corresponding to the light of the first band is obtained. Then, the light of the second band is irradiated from the object to be measured through the filter unit to the photosensitive unit, and the photosensitive data corresponding to the light of the second band is obtained. Then, the light of the third band is irradiated from the object to be measured through the filter unit to the photosensitive unit, and the photosensitive data corresponding to the light of the third band is obtained. Finally, the mixed light of the first band, the second band, and the third band is irradiated from the object to be measured through the filter unit to the photosensitive unit, and the photosensitive data corresponding to the mixed light is obtained. It should be noted that here is only an example to illustrate that the band set includes the light of the first band, the second band, and the third band. The band set may also include the light of two different bands, or may include the light of more than three different bands, without special limitation.

[0083] In some embodiments, the band set includes n different bands; the steps of successively obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light include:

[0084] Successively obtaining the photosensitive data I 11 、I 21 、......I m1 of the 1st band under m different light intensities, successively obtaining the photosensitive data I 12 、I 22 、......I m2 of the 2nd band under m different light intensities,...... successively obtaining the photosensitive data I 1n 、I 2n 、......I mn of the nth band under m different light intensities;

[0085] Successively obtaining the photosensitive data I1, I2......I m of the mixed light under m different light intensities;

[0086] Based on the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, the steps of determining the proportion of the light of different bands in the band set include:

[0087] Based on formula (1) I1 = a1I 11 + a2I 12 +......+ a n I 1n , formula (2) I2 = a1I 21 + a2I 22 +......+ a n I 2n,...... Equation (m) I2 = a1I m1 + a2I m2 +...... + a n I mn , determine the proportion of light of different bands in the band set. Among them, a1, a2,... a n are the coefficients to be solved.

[0088] It can be understood that when successively obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, the photosensitive data of the light of the first band, the second band....., the nth band and the mixed light can be obtained first, and then the light intensity is adjusted, and the photosensitive data of the light of the first band, the second band....., the nth band and the mixed light are obtained again, and so on, until the photosensitive data of the light of the first band, the second band....., the nth band and the mixed light under m different light intensities are obtained.

[0089] It should be noted that it is also possible to first successively obtain the photosensitive data of the light of the first band under m different light intensities, and then successively obtain the photosensitive data of the light of the second band under m different light intensities, and so on, until the photosensitive data of the light of the nth band under m different light intensities are obtained, and then successively obtain the photosensitive data of the mixed light under m different light intensities. It should be noted that the m different light intensities corresponding to the first band, the second band,..... the first n bands and the mixed light are the same.

[0090] Therefore, when determining the proportion of the light of different bands in the band set based on the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, according to Equation (1) I1 = a1I 11 + a2I 12 +...... + a n I 1n , Equation (2) I2 = a1I 21 + a2I 22 +...... + a n I 2n ,...... Equation (m) I2 = a1I m1 + a2I m2 +...... + a n I mn , determine the values of a1, a2,... a n , and then the proportion of the light of different bands in the band set can be determined.

[0091] Exemplarily, m = n.

[0092] In some examples, the band set includes three different bands, namely the first band, the second band, and the third band, and the m different light intensities include three different light intensities, namely the first light intensity, the second light intensity, and the third light intensity.

[0093] When successively obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, the light intensity is maintained at the first light intensity, and then the photosensitive data of the light of the first band, the photosensitive data of the light of the second band, the photosensitive data of the light of the third band, and the photosensitive data of the mixed light are successively obtained. Then the light intensity is adjusted to the second light intensity, and the photosensitive data of the light of the first band, the photosensitive data of the light of the second band, the photosensitive data of the light of the third band, and the photosensitive data of the mixed light are obtained again. Then the light intensity is adjusted to the third light intensity, and then the photosensitive data of the light of the first band, the photosensitive data of the light of the second band, the photosensitive data of the light of the third band, and the photosensitive data of the mixed light are obtained.

[0094] And at the first light intensity, the photosensitive data of the mixed light is composed of the photosensitive data I 11 of the light of the first band, the photosensitive data I 12 of the light of the second band, and the photosensitive data I 13 of the light of the third band. Then the photosensitive data I1 of the mixed light = a1I 11 + a2I 12 +...... + a n I 13 ;

[0095] At the second light intensity, the photosensitive data of the mixed light is composed of the photosensitive data I 21 of the light of the second band, the photosensitive data I 22 of the light of the second band, and the photosensitive data I 23 of the light of the third band. Then the photosensitive data I2 of the mixed light = a1I 21 + a2I 22 +...... + a n I 23 ;

[0096] At the third light intensity, the photosensitive data of the mixed light is composed of the photosensitive data I 31 of the light of the third band, the photosensitive data I 32 of the light of the second band, and the photosensitive data I 33 of the light of the third band. Then the photosensitive data I3 of the mixed light = a1I 31 + a2I 32 +...... + a n I 33 ;

[0097] The above three formulas include three unknowns, a1, a2, and a3. By combining the three formulas, the specific values of a1, a2, and a3 can be solved, and further, the contribution ratios of the light in different bands in the band set can be determined.

[0098] In some embodiments, before the step of obtaining the actual distance between the photosensitive unit and the object to be measured, it includes:

[0099] Successively obtain the photosensitive data of the light in each band in the band set and the photosensitive data of the mixed light, where the mixed light includes the light in all bands in the band set;

[0100] Based on the photosensitive data of the light in each band in the band set and the photosensitive data of the mixed light, determine the ratio of the light in different bands in the band set;

[0101] Store the ratio of the light in different bands in the band set and the incident angle of the light at the photosensitive unit in the database;

[0102] Determine that the incident angle of the light at the photosensitive unit has changed, and repeat the steps from successively obtaining the photosensitive data of the light in each band in the band set and the photosensitive data of the mixed light to the step of storing in the database.

[0103] It can be understood that when obtaining the actual distance between the photosensitive unit and the object to be measured, first construct a database. Specifically, first successively obtain the photosensitive data of the light in each band in the band set and the photosensitive data of the mixed light. According to the photosensitive data of the light in each band and the photosensitive data of the mixed light, the ratio of the light in different bands in the band set can be determined. Then store the incident angle of the light at the current photosensitive unit and the ratio of the light in different bands in the database. Then adjust the incident angle of the light at the photosensitive unit, and repeat the steps from successively obtaining the photosensitive data of the light in each band in the band set and the photosensitive data of the mixed light to the step of storing in the database, so as to obtain the ratio of the light in different bands corresponding to different incident angles of the light at the photosensitive unit and store them in the database. Furthermore, the construction of the database can be realized, so as to subsequently determine the ratio of the light in different bands corresponding to the actual distance between the photosensitive unit and the object to be measured.

[0104] Exemplarily, the band set includes three different bands of light, namely the first band, the second band, and the third band.

[0105] It is understandable that obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light in sequence means first allowing the light of the first band to irradiate from the object to be measured through the filter unit to the photosensitive unit, and obtaining the photosensitive data corresponding to the light of the first band, then allowing the light of the second band to irradiate from the object to be measured through the filter unit to the photosensitive unit, and obtaining the photosensitive data corresponding to the light of the second band, then allowing the light of the third band to irradiate from the object to be measured through the filter unit to the photosensitive unit, and obtaining the photosensitive data corresponding to the light of the third band, and finally allowing the mixed light of the first band, the second band and the third band to irradiate from the object to be measured through the filter unit to the photosensitive unit, and obtaining the photosensitive data corresponding to the mixed light. It should be noted that here is only an example to illustrate that the band set includes the light of the first band, the second band and the third band. The band set may also include the light of two different bands, or may include the light of more than three different bands, without special limitation.

[0106] Specifically, before the step of obtaining the actual distance between the photosensitive unit and the object to be measured, it includes:

[0107] When the incident angle of the light at the photosensitive unit is the first angle,

[0108] Obtain the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light in sequence, and the mixed light includes the light of all bands in the band set;

[0109] Based on the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, the proportion of the light of different bands in the band set;

[0110] Store the proportion of the light of different bands in the band set and the incident angle of the light at the photosensitive unit in the database;

[0111] Determine that the distance between the object to be measured and the photosensitive unit has changed, and repeat the steps from obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light in sequence to storing in the database;

[0112] When the incident angle of the light at the photosensitive unit changes to the second angle,

[0113] Obtain the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light in sequence, and the mixed light includes the light of all bands in the band set;

[0114] Based on the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, the proportion of the light of different bands in the band set;

[0115] Store the proportion of the light of different bands in the band set and the incident angle of the light at the photosensitive unit in the database;

[0116] It is determined that the distance between the object to be measured and the photosensitive unit changes, and the steps of repeatedly obtaining the photosensitive data of the light in each band in the band set and the photosensitive data of the mixed light in sequence until the steps of storing in the database are repeated.

[0117] And so on, until the photosensitive data of the light in each band in the band set and the photosensitive data of the mixed light are obtained at different distances and different incident angles.

[0118] According to an embodiment of the second aspect of the present application, the multispectral chip component is used to execute the above spectral calculation method. The multispectral chip component includes a corresponding photosensitive unit and a filter unit. The photosensitive unit is used to obtain light of different bands to obtain the spectral information of each channel. Among them, different channels correspond to spectral information of different bands. The filter unit filters the light entering the photosensitive unit. The filter unit can transmit the light in the band set, and the band set includes at least two different bands.

[0119] According to the multispectral chip component of the embodiment of the present application, the filter unit can filter the light reflected by the object to be measured. The filter unit can transmit light of at least two different bands, so that the photosensitive unit can receive light of at least two different bands. When the photosensitive unit receives light of different bands, the actual distance between the photosensitive unit and the object to be measured can be obtained, and the actual distance is compared with that in the database. Furthermore, the light in the band set that the filter unit can transmit can be determined, that is, the proportion of the light of different bands in the mixed light received by the photosensitive unit, so as to realize the decomposition of the mixed spectrum, and the proportion of the components of the light of different bands in the mixed light can be determined. That is to say, the present application can enable the filter unit to transmit different lights at the same time, so that the photosensitive unit can receive light of different bands at the same time, and realize that the photosensitive unit can simultaneously sense light of different bands, which is beneficial to the optimization of the multispectral chip component.

[0120] In some embodiments, the multispectral chip component further includes a ranging unit 8, and the ranging unit 8 is used to measure the distance between the object to be measured and the photosensitive unit.

[0121] It can be understood that the distance between the object to be measured and the photosensitive unit can be detected by the ranging unit 8 to determine the distance between the object to be measured and the photosensitive unit. Furthermore, according to the distance between the object to be measured and the photosensitive unit and the database, the proportion of the light of different bands in the band set can be determined.

[0122] In some embodiments, the multispectral chip component further includes an angle detection unit, and the angle detection unit is used to detect the incident angle of the light at the photosensitive unit.

[0123] It can be understood that the angle detection unit can detect the incident angle of light at the photosensitive unit to determine the incident angle of light at the photosensitive unit, and then, based on the incident angle of light at the photosensitive unit and the database, determine the proportion of light of different bands in the band set.

[0124] In some examples, the angle detection unit is, for example, a quadrant photodetector or a position-sensitive detector or any other suitable component with the function of detecting the incident angle of light.

[0125] Figure 2 、 Figure 4 and Figure 5 The letters in Figure 2 represent different bands. For example, in Figure 1 , a, b, c, and d represent that the filter unit can pass light of the a band, b band, c band, and d band. In some embodiments, as in

[0126] A photosensitive chip 1, configured to obtain light of different bands to obtain spectral information of each channel, where different channels correspond to spectral information of different bands;

[0127] A filter layer 2, disposed outside the photosensitive chip 1, and the filter layer 2 is located on the light-sensing path of the photosensitive chip 1, so that the filter layer 2 can filter the light entering the photosensitive chip 1.

[0128] According to the multi-spectral chip component of the embodiment of the present application, the photosensitive chip 1 can obtain spectral information of different bands corresponding to different channels for spectral imaging, and the filter layer 2 can filter the light entering the photosensitive chip 1, so that light of a specific band enters the photosensitive chip 1.

[0129] The filter layer 2 is disposed outside the photosensitive chip 1, that is, the filter layer 2 does not need to be encapsulated in the photosensitive chip 1, and the filter layer 2 is independently disposed relative to the photosensitive chip 1. Furthermore, when manufacturing the multi-spectral chip component, the filter layer 2 can be manufactured separately, and the size of the filter layer 2 is not limited by the photosensitive chip 1, which is beneficial to simplifying the manufacturing process of the filter layer 2, reducing the manufacturing difficulty of the filter layer 2, reducing the manufacturing cost of the filter layer 2, and further reducing the manufacturing process difficulty of the multi-spectral chip component and the cost of the multi-spectral chip component.

[0130] It can be understood that in the multi-spectral chips in the related art, generally, the photosensitive unit 11 and the filter unit 21 are concentrated inside the chip together, so that the photosensitive unit 11 and the filter unit 21 correspond one by one. As a result, the size of the filter unit 21 is greatly restricted, leading to a relatively high requirement for the processing precision of the filter unit 21, a large processing difficulty, a complex process, and a high cost. In this application, the filter layer 2 is independent of the photosensitive chip 1. The size of the filter layer 2 in this application can be larger than that of the filter layer 2 in the related art, that is, the filter unit 21 in this application can be larger than the filter unit 21 of the multi-spectral chip in the related art, effectively reducing the processing precision requirements of the filter unit 21 and the filter layer 2, reducing the processing difficulty, and being conducive to the process simplification and cost reduction of the multi-spectral chip assembly.

[0131] It can be understood that in the multi-spectral chips in the related art, generally, the photosensitive unit 11 and the filter unit 21 are concentrated inside the chip together, then it is difficult to replace the filter unit 21. In this application, the filter layer 2 is arranged outside the photosensitive chip 1, facilitating the replacement of the filter unit 21 and the filter layer 2. Different multi-spectral imaging with different numbers and wavelengths can be realized by replacing the filter layer 2 that transmits different wavelengths of light and quantities, which is conducive to quickly realizing product iteration and expansion.

[0132] In some embodiments, the filter layer 2 is arranged at an interval from the photosensitive chip 1.

[0133] It can be understood that arranging the filter layer 2 at an interval from the photosensitive chip 1 makes the filter layer 2 independent of the photosensitive chip 1, so that the size of the filter layer 2 is not restricted by the photosensitive chip 1, which is conducive to simplifying the manufacturing process of the filter layer 2, reducing the manufacturing difficulty of the filter layer 2, reducing the manufacturing cost of the filter layer 2, and further reducing the manufacturing process difficulty of the multi-spectral chip assembly, reducing the cost of the multi-spectral chip assembly, accelerating the iteration speed of the multi-spectral chip, and shortening the R & D cycle.

[0134] In some embodiments, the filter layer 2 is arranged on the outer surface of the photosensitive chip 1.

[0135] It can be understood that connecting the filter layer 2 to the outer surface of the photosensitive chip 1 makes the filter layer 2 independent of the photosensitive chip 1, and at the same time, the filter layer 2 and the photosensitive chip 1 can be connected together, ensuring the integration degree and structural compactness of the multi-spectral chip assembly.

[0136] In some embodiments, the filter layer 2 is detachably connected to the photosensitive chip 1.

[0137] It can be understood that the filter layer 2 is detachably connected to the photosensitive chip 1, which facilitates the disassembly and assembly of the filter layer 2, and further facilitates the replacement of the filter layer 2. By replacing the filter layer 2 that transmits different wavelengths and amounts of light, multi-spectral imaging with different numbers and wavelengths can be achieved, which is conducive to quickly realizing product iteration and expansion.

[0138] In some embodiments, the photosensitive chip 1 includes photosensitive units 11, and the multi-spectral chip assembly further includes a protective layer. The protective layer is disposed between the filter layer and the photosensitive units, and the orthographic projection of the photosensitive units 11 on the protective layer is located within the orthographic projection of the filter layer 2 on the protective layer.

[0139] It can be understood that the orthographic projection of the photosensitive units 11 on the protective layer is located within the orthographic projection of the filter layer 2 on the protective layer, which ensures that the light entering the photosensitive units 11 will first pass through the filter layer 2, guaranteeing the filtering effect of the filter layer 2.

[0140] In some embodiments, such as Figure 2 , the filter layer 2 includes filter units 21, and the size of the filter units 21 is larger than the size of the photosensitive units 11.

[0141] It can be understood that since the filter layer 2 is disposed outside the photosensitive chip 1 and is not restricted by the photosensitive chip 1, the size of the filter units 21 of the filter layer 2 can be larger than the size of the photosensitive units 11. On the one hand, it guarantees the filtering effect of the filter units 21, and on the other hand, it can reduce the processing difficulty and cost of the filter units 21.

[0142] It should be noted that the size of the filter units can also be smaller than the size of the photosensitive units, as long as it is ensured that only the filtered wavelength band is transmitted to the photosensitive units. That is to say, light-shielding design needs to be carried out on the photosensitive channels to ensure that only the light passing through the filter units is incident on the photosensitive units and the light after the filter layer is not polluted.

[0143] In some examples, an optical amplification device is provided between the filter units and the photosensitive units to amplify the optical signal passing through the filter units.

[0144] In some examples, a solar panel can also be used as the photosensitive chip.

[0145] In some embodiments, the filter layer 2 includes filter units 21, the photosensitive chip 1 includes a plurality of photosensitive units 11, and the plurality of photosensitive units 11 are disposed opposite to the filter units 21. The filter units 21 are used to filter the light entering the plurality of photosensitive units 11.

[0146] It can be understood that a single filter unit 21 can simultaneously filter light for multiple photosensitive units 11, that is, multiple photosensitive units 11 share a single filter unit 21, eliminating the need to separately provide a corresponding filter unit 21 for each photosensitive unit 11. Moreover, the size of the filter unit 21 is enlarged, thereby reducing the processing difficulty and cost of the multispectral chip assembly.

[0147] In some embodiments, such as Figure 2 , the multispectral chip assembly includes a pixel structure. The pixel structure includes a photosensitive chip and a filter layer. The filter layer 2 includes filter units 21. The filter units 21 and the photosensitive units 11 can be in one-to-one correspondence, or one filter unit 21 can correspond to multiple photosensitive units 11. The filter unit 21 is located on the light-sensing path of the photosensitive unit 11. Among them, the filter unit 21 filters the light entering the photosensitive unit 11 and allows at least two different bands of light to pass through.

[0148] It can be understood that the photosensitive unit 11 can obtain spectral information of different bands corresponding to different channels for spectral imaging. The filter unit 21 can filter the light entering the photosensitive unit 11, enabling light of more than two specific bands to pass through the filter unit 21 and enter the photosensitive unit 11, so that the photosensitive unit 11 corresponding to one pixel can obtain spectral information of more than two different bands. That is to say, in the present application, by setting the filter unit 21 to be capable of transmitting light of at least two different bands, one pixel structure can simultaneously obtain spectral information of at least two different bands, reducing the physical interval between the two bands, improving the resolution, and not easily losing spectral information, which is beneficial to improving the later imaging effect.

[0149] It can be understood that in the related art, the implementation structure of a traditional RGB sensor is that each PD photosensitive unit 11 is combined with 1 corresponding filter unit 21 to form 1 pixel. To obtain spectral information of the red, yellow, and blue bands, at least 3 pixel units are required. Due to the human eye's sensitivity to green, two green filter units 21 are distributed among every 4 pixels. If more bands are to be obtained, such as 12 optical band information, at least 12 pixels are required. No matter what arrangement is used, it will cause too large a physical interval between pixels in the same band or adjacent bands, resulting in too low a resolution and loss of spectral information.

[0150] For example Figure 7 In a 12-band spectral arrangement of, for example, 12 different optical bands are arranged in a 4x3 format. Then, two adjacent identical channels (such as B12) are separated by 3 other band pixel units horizontally and 2 other band pixel units vertically. This easily causes excessive loss of spectral information in the same band and poor later imaging effects.

[0151] Such as Figure 8, in this application, by setting the filter unit 21 to be capable of transmitting light of at least two different wavelength bands, a pixel unit can simultaneously acquire spectral information of multiple wavelength bands. For example, the filter unit 21 can transmit through 12 wavelength bands, that is, a pixel unit can acquire 12 wavelength band information. Furthermore, there are no pixel units spaced between two adjacent identical channels horizontally or vertically, effectively reducing the physical interval between two wavelength bands, improving the resolution, and not easily losing spectral information, which is beneficial to improving the later imaging effect.

[0152] It can be understood that in the related art, 12 channels need to correspond to 12 pixels, that is, to implement the minimum photosensitive unit 11 of n wavelength bands, n pixel points are required. When the value of n is too large, it is easy to cause a decrease in spatial resolution. However, in this application, multiple channels (such as 12 channels) are integrated into one pixel. That is, when implementing the minimum photosensitive unit 11 of multiple wavelength bands, only 1 pixel point may be required, which is beneficial to improving the spatial resolution.

[0153] In some embodiments, such as Figure 3 , the filter unit 21 includes at least one first filter film 211 and at least one second filter film 212. The refractive index of the first filter film 211 is greater than that of the second filter film 212, and the first filter film 211 and the second filter film 212 are alternately arranged.

[0154] It can be understood that by alternately stacking the first filter film 211 and the second filter film 212 with different refractive indices together to form the filter unit 21, the filter unit 21 can transmit light of at least two different wavelength bands, enabling multiple different wavelength bands of light to be obtained using the same filter unit 21. That is, the spectral splitting structures of multiple wavelength bands are the same. Furthermore, when preparing the filter unit 21 of this application, there is no need for repeated etching, cleaning and other steps, the process is simple, and the cost is relatively low.

[0155] In some examples, this application adopts a multilayer film technology, which is composed of alternately stacking a high refractive index filter film (such as titanium oxide, specifically titanium oxide or titanium dioxide) and a low refractive index filter film (such as SiO2). By combining different thicknesses of the two, at least one narrowband transmission peak of the light wavelength band is transmitted through the filter unit 21, realizing that a single filter unit 21 transmits multiple independent narrowband transmission peak light wavelength bands, such as 2, 4, 7, etc. For example, 4 independent narrowband transmission peak wavelength bands with central wavelengths of 450 nm, 550 nm, 650 nm, and 750 nm are realized through 1 filter unit 21.

[0156] It should be noted that, according to the functional requirements and index parameter requirements, by adjusting the materials used for the first filter film 211 and the second filter film 212, the arrangement of the alternating stacking of high and low refractive index materials, and the thickness combination, the wavelength range of the transmitted narrowband transmission peak can be made to be the central wavelength ±(1nm - 100nm), and the full width at half maximum FWHM ≤(1nm - 100nm). For example, if the central wavelength of the transmitted light is 550nm, the actual wavelength range of the transmitted narrowband transmission peak is 550nm ±(1nm - 100nm); if the central wavelength is 450nm, the wavelength range of the narrowband transmission peak is 450nm ±(1nm - 100nm). The crosstalk suppression between multiple narrowband transmission peaks transmitted through the same filter unit 21 is low enough, such as the adjacent band isolation ≥30dB, so that the optical channel data after corresponding quantum response has sufficient independence.

[0157] In some examples, the materials of the first filter film 211 and the second filter film 212 can be any one of aluminum (Al), chromium (Cr), gold (Au), silver (Ag), silicon (Si), germanium (Ge), aluminum oxide (Al2O3), cerium oxide (CeO2), hafnium dioxide (HfO2), indium tin oxide (ITO), magnesium oxide (MgO), niobium pentoxide (Nb2O5), silicon monoxide (SiO), silicon dioxide (SiO2), titanium dioxide (TiO2), titanium trioxide (Ti3O5), tantalum pentoxide (Ta2O5), yttrium oxide (Y2O3), zinc oxide (ZnO), zirconium dioxide (ZrO2), aluminum fluoride (AlF3), magnesium fluoride (MgF2), calcium fluoride (CaF2), ytterbium fluoride (YbF3), yttrium fluoride (YF3), zinc sulfide (ZnS), and zinc selenide (ZnSe).

[0158] Specifically, the thicknesses of different first filter films 211 are different.

[0159] It can be understood that when the number of the first filter films 211 is at least two, by adjusting the thicknesses of different first filter films 211, the thicknesses of different first filter films 211 are made different, and thus the number of bands of light that can be transmitted by the filter unit 21 composed of the first filter films 211 can be changed, or the band range of the light that can be transmitted by the filter unit 21 can be changed.

[0160] Specifically, the thicknesses of different second filter films 212 are different.

[0161] It can be understood that when the number of the second filter films 212 is at least two, by adjusting the thicknesses of different second filter films 212, the thicknesses of different second filter films 212 are made different, and thus the number of bands of light that can be transmitted by the filter unit 21 composed of the second filter films 212 can be changed, or the band range of the light that can be transmitted by the filter unit 21 can be changed.

[0162] Specifically, the thicknesses of the first filter film 211 and the second filter film 212 are different.

[0163] It can be understood that by adjusting the thicknesses of the first filter film 211 and the second filter film 212 to be different, the number of light wavebands that can pass through the filter unit 21 composed of the first filter film 211 and the second filter film 212 can be changed, or the waveband range of the light rays that the filter unit 21 can pass through can be changed.

[0164] In some examples, the thicknesses of the first filter film 211 and the second filter film 212 may also be the same.

[0165] In some embodiments, the filter unit 21 includes at least two filter regions, and different filter regions can allow light of different wavebands to pass through.

[0166] It can be understood that different filter regions can transmit light rays of different wavebands, so that the filter unit 21 can transmit at least two different wavebands of light rays simultaneously.

[0167] Specifically, the thicknesses of different filter regions are different.

[0168] It can be understood that by making the thicknesses of the filter media in different filter regions different, different filter regions can transmit light rays of different wavebands.

[0169] Specifically, the materials of different filter regions are different.

[0170] It can be understood that by making the materials of the filter media in different filter regions different, different filter regions can transmit light rays of different wavebands.

[0171] In some embodiments, the pixel structure further includes a protective layer 3, and the protective layer 3 is disposed between the filter unit 21 and the photosensitive unit 11.

[0172] It can be understood that the protective layer 3 can protect the photosensitive unit 11 and prevent the photosensitive unit 11 from being damaged.

[0173] Specifically, the material of the protective layer 3 is yttrium oxide or yttrium trioxide or diamond or ytterbium oxide.

[0174] It can be understood that the protective layer 3 made of yttrium oxide or yttrium trioxide or diamond or ytterbium oxide has a stable structure and can resist multiple ion beam bombardments, ensuring that the protective layer 3 can effectively and stably protect the photosensitive unit 11.

[0175] In some embodiments, such as Figure 4 andFigure 5 , the multispectral chip component includes at least two pixel structures, and the at least two pixel structures include a first pixel structure 4 and a second pixel structure 5.

[0176] In some embodiments, the light filtering unit 21 of the first pixel structure 4 can transmit the light of the first band set, and the light filtering unit 21 of the second pixel structure 5 can transmit the light of the second band set, and the first band set and the second band set partially overlap.

[0177] It can be understood that the light filtering units 21 of different pixel structures can all transmit the light of multiple bands, that is, different pixel structures all have multiple channels. And the bands of the light that the light filtering units 21 of different pixel structures can transmit partially overlap, indicating that different pixel structures have at least one same channel. Furthermore, different pixel structures can be connected together through the same channel. That is, when the proportional relationship of the light of different bands in one of the pixel structures is calculated, the proportional relationship of the light of different bands in different pixel structures can be further calculated, so that a linear relationship is established between multiple pixels, and a linear relationship is established for all spectral data of different bands, thereby quickly realizing the expansion of multiple bands, and further facilitating the reduction of the algorithm complexity of the multispectral chip.

[0178] Specifically, among the bands that the first pixel structure 4 can transmit, at least one band is the same as the band that the second pixel structure 5 can transmit. When the component ratio of the light of different bands in the first pixel structure 4 is calculated and the imaging of the first pixel structure 4 is realized, through the common band of the first pixel structure 4 and the second pixel structure 5, the proportional relationship between multiple bands in the first pixel structure 4 and multiple bands in the second pixel structure 5 can be known, which is beneficial to the imaging of the second pixel structure 5 without separately calculating the component ratio of the light of different bands in the second pixel structure 5, and is beneficial to reducing the algorithm complexity of the multispectral chip.

[0179] In some examples, at each pixel point, through different thickness combinations of high and low refractive index materials, different numbers and different wavelength narrowband transmission peaks are transmitted by different pixel points, such as Figure 5 As shown, the light filtering unit 21 of the first pixel structure 4 transmits the light of A1, A2, A3,......, a bands, and the light filtering unit 21 of the second pixel structure 5 transmits the light of B1, A2, A3,......, a bands, where a represents the band with the same wavelength, and the purpose is to establish a connection between the gray values of pixels A and B. Figure 5In [the above], the number of optical wavelength bands passed by the first pixel structure 4 and the second pixel structure 5 is not necessarily the same. For example, the first pixel structure 4 can pass a total of 3 bands, namely 430 nm, 450 nm, and 480 nm, and the second pixel structure 5 can pass a total of 5 bands, namely 430 nm, 510 nm, 540 nm, 590 nm, and 650 nm, where 430 nm is the common wavelength band between the two.

[0180] In some embodiments, the first pixel structure 4 and the second pixel structure 5 are of the same structure.

[0181] It can be understood that when one pixel structure can meet the number of channels required by the multispectral chip, the first pixel structure 4 and the second pixel structure 5 can be designed to be of the same structure.

[0182] It can be understood that when the multispectral chip needs to implement An + Bn + 1 channels, the first pixel structure can implement An + 1 channels and the second pixel structure can implement Bn + 1 channels, and the first pixel structure and the second pixel structure are associated together using the common channels. When the multispectral chip needs An + 1 or Bn + 1 channels, it means that one pixel structure can meet the requirements. Therefore, the first pixel structure 4 and the second pixel structure 5 can be directly designed to be of the same structure, which is beneficial to reducing the production difficulty and improving the production efficiency.

[0183] Exemplarily, An = Bn.

[0184] According to the embodiments of the third aspect of the present application, as Figure 6 , the electronic device includes the above multispectral chip assembly.

[0185] In some embodiments, as Figure 6 , the electronic device further includes a Fresnel lens 6, and the Fresnel lens 6 is disposed on one side of the photosensitive chip 1, and the Fresnel lens 6 is located on the light sensing path of the photosensitive unit 11.

[0186] It can be understood that by disposing the Fresnel lens 6 on the light sensing path of the photosensitive unit 11, since the Fresnel lens 6 has functions such as light concentration, collimation, and beam expansion, the light intensity can be increased, which is beneficial to improving indexes such as the signal-to-noise ratio, light transmission amount, and channel ratio of the multispectral chip assembly.

[0187] Specifically, the filter layer 2 is located between the Fresnel lens 6 and the photosensitive chip 1.

[0188] It can be understood that after the light is concentrated by the Fresnel lens 6 and then transmitted to the filter layer 2, and after being filtered by the filter layer 2, the light of a specific wavelength band can be transmitted to the photosensitive chip 1.

[0189] Specifically, the Fresnel lens 6 is located between the photosensitive chip 1 and the filter layer 2.

[0190] It can be understood that after the light passes through the filtering of the filter layer 2, the light of a specific wavelength band is transmitted to the Fresnel lens 6, and then under the collimation of the Fresnel lens 6, the light is transmitted to the photosensitive chip 1.

[0191] In some embodiments, such as Figure 6 , the electronic device further includes a lens 7, and the lens 7 is located on the light-sensitive path of the photosensitive unit 11.

[0192] Specifically, the shape of the filter layer 2 is adapted to the shape of the Fresnel lens 6.

[0193] It can be understood that the shape of the filter layer 2 is adapted to the shape of the Fresnel lens, so that the filter layer 2 and the Fresnel lens 6 can be stacked together, which is beneficial to improving the structural compactness of the electronic device.

[0194] Specifically, the shape of the filter layer 2 is adapted to the shape of the lens 7.

[0195] It can be understood that the shape of the filter layer 2 is adapted to the shape of the lens 7, so that the filter layer 2 and the lens 7 can be stacked together, which is beneficial to improving the structural compactness of the electronic device.

[0196] Specifically, the shape of the Fresnel lens 6 is adapted to the shape of the lens 7.

[0197] It can be understood that the shape of the lens 7 is adapted to the shape of the Fresnel lens, so that the lens 7 and the Fresnel lens 6 can be stacked together, which is beneficial to improving the structural compactness of the electronic device.

[0198] In some embodiments, the electronic device includes a housing, the photosensitive chip 1 is installed in the housing, and the filter layer 2 is detachably connected to the housing so that the filter layer 2 can be switched between a first position and a second position. Wherein, in the first position, the filter layer 2 is located on the light-sensitive path of the photosensitive unit 11, and in the second position, the filter layer 2 is arranged at an interval from the light-sensitive path of the photosensitive unit 11.

[0199] It can be understood that the filter layer 2 is detachably connected to the housing, which is convenient for the disassembly and assembly of the filter layer 2 and for replacing the filter layer 2. When the electronic device is in use, the filter layer 2 is installed in the housing so that the filter layer 2 is in the first position, and the filter layer 2 can filter the light entering the photosensitive unit 11. When it is necessary to replace the filter layer 2, the current filter layer 2 is made to be in the second position, and then the new filter layer 2 is installed in the housing and made to be in the first position.

[0200] On the other hand, the present application also provides a computer program product. The computer program product includes a computer program stored on a non-transitory computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute the spectral calculation method provided by each of the above methods. The method includes:

[0201] Obtain the actual distance between the photosensitive unit and the object to be measured;

[0202] Based on the actual distance and the database, determine the proportion of light of different bands in the band set;

[0203] Wherein, the database includes the proportion of light of different bands in the band set when the photosensitive unit and the object to be measured are at different distances.

[0204] According to the embodiments of the fourth aspect of the present application, the present application also includes a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it is implemented to execute the spectral calculation method provided by each of the above. The method includes:

[0205] Obtain the actual distance between the photosensitive unit and the object to be measured;

[0206] Based on the actual distance and the database, determine the proportion of light of different bands in the band set;

[0207] Wherein, the database includes the proportion of light of different bands in the band set when the photosensitive unit and the object to be measured are at different distances.

[0208] The above has introduced the embodiments of the present application in detail. Specific examples are used in this article to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A spectral calculation method, applied to a multispectral chip component, characterized in that, The multi-spectral chip component includes a corresponding photosensitive unit and a filter unit. The photosensitive unit is used to obtain light of different bands to obtain spectral information of each channel. Among them, different channels correspond to spectral information of different bands. The filter unit filters the light entering the photosensitive unit. The filter unit can transmit light in a band set, and the band set includes at least two different bands. The method includes: Obtain the actual distance between the photosensitive unit and the object to be measured; Based on the actual distance and the database, determine the proportion of light of different bands in the band set; Among them, the database includes the proportion of light of different bands in the band set when the photosensitive unit and the object to be measured are at different distances.

2. The spectral calculation method according to claim 1, characterized in that, After the step of determining the proportion of light of different bands in the band set, it further includes: Based on the proportion of light of different bands in the band set and the photosensitive data of the photosensitive unit, determine the photosensitive data of light of different bands in the band set; Determine the image result according to the photosensitive data of light of different bands in the band set.

3. The spectral calculation method according to claim 1 or 2, characterized in that The step of determining the proportion of light of different bands in the band set based on the actual distance and the database includes: Obtain the actual incident angle of the light at the photosensitive unit; Based on the actual distance, the actual incident angle and the database, determine the proportion of light of different bands in the band set; Among them, the database includes: the proportion of light of different bands in the band set when the photosensitive unit and the object to be measured are at different distances and the light at the photosensitive unit has different incident angles.

4. The spectral calculation method according to claim 1 or 2, characterized in that, Before the step of obtaining the actual distance between the photosensitive unit and the object to be measured, it includes: Sequentially obtain the photosensitive data of light of each band in the band set and the photosensitive data of mixed light, and the mixed light includes light of all bands in the band set; Based on the photosensitive data of light of each band in the band set and the photosensitive data of mixed light, the proportion of light of different bands in the band set; Store the proportion of light of different bands in the band set and the distance between the object to be measured and the photosensitive unit in the database; Determine that the distance between the object to be measured and the photosensitive unit has changed, and repeat the steps from sequentially obtaining the photosensitive data of light of each band in the band set and the photosensitive data of mixed light to the step of storing in the database.

5. The spectral calculation method according to claim 4, wherein The band set includes n different bands. The step of sequentially obtaining the photosensitive data of light of each band in the band set and the photosensitive data of mixed light includes: Successively obtain the photosensitive data I of the first band under m different light intensities 11 , I 21 ,......I m1 , successively obtain the photosensitive data I of the second band under m different light intensities 12 , I 22 ,......I m2 ,......successively obtain the photosensitive data I of the nth band under m different light intensities 1n , I 2n ,......I mn ; Successively obtain the photosensitive data I1, I2......Im of the mixed light under m different light intensities m ; The step of determining the proportion of light of different bands in the band set based on the photosensitive data of light of each band in the band set and the photosensitive data of mixed light includes: Based on formula (1) I1 = a1I 11 + a2I 12 +......+ a n I 1n , formula (2) I2 = a1I 21 + a2I 22 +......+ a n I 2n ,...... formula (m) I2 = a1I m1 + a2I m2 +......+ a n I mn , determine the proportion of light of different bands in the band collection.

6. The spectral calculation method according to claim 1 or 2, characterized in that, Before the step of obtaining the actual distance between the photosensitive unit and the object to be measured, it includes: Sequentially obtain the photosensitive data of light of each band in the band set and the photosensitive data of mixed light, and the mixed light includes light of all bands in the band set; Based on the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light, the proportion of the light of different bands in the band set; Store the proportion of the light of different bands in the band set and the incident angle of the light at the photosensitive unit in the database; Determine that the incident angle of the light at the photosensitive unit changes, and repeat the steps of sequentially obtaining the photosensitive data of the light of each band in the band set and the photosensitive data of the mixed light to the step of storing in the database.

7. A multispectral chip component, characterized in that, The multispectral chip component is used to execute the spectral calculation method according to any one of claims 1 to 6. The multispectral chip component includes a corresponding photosensitive unit and a filter unit. The photosensitive unit is used to obtain light of different bands to obtain spectral information of each channel. Among them, different channels correspond to spectral information of different bands. The filter unit filters the light entering the photosensitive unit. The filter unit can transmit the light of the band set, and the band set includes at least two different bands.

8. The multispectral chip component according to claim 7, characterized in that The multispectral chip component further includes a ranging unit, and the ranging unit is used to measure the distance between the object to be measured and the photosensitive unit.

9. The multispectral chip component according to claim 7 or 8, characterized in that, The multispectral chip component further includes an angle detection unit, and the angle detection unit is used to detect the incident angle of the light at the photosensitive unit.

10. A computer-readable storage medium, characterized in that, A computer program is stored on a computer-readable storage medium. When the computer program is executed by a processor, the steps of the spectral calculation method according to any one of claims 1-6 are implemented.

Images