Spectral chip

By optimizing the arrangement of filter unit groups, especially the arrangement similar to the cross-shaped arrangement, the crosstalk of the central filter unit in the spectral chip is reduced, the crosstalk problem caused by the increase in the number of colorants in the multi-spectral chip is solved, the transmittance and resolution of the IR channel is improved, and the object recognition and tracking capabilities are enhanced.

WO2025167585A1PCT designated stage Publication Date: 2025-08-14BEIJING SEETRUM TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2025/073634
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-02-06
Filing Date
2025-01-21
Publication Date
2025-08-14

AI Technical Summary

Technical Problem

The increase in the number of colorants in multi-spectral chips leads to crosstalk problems, affecting chip performance, especially in terms of transmittance and resolution of IR channels.

Method used

By designing the arrangement of the filter unit groups, it is ensured that the colorants of the central filter unit are the same as those of the adjacent filter units or have a small crosstalk. The cross-talk amount of the central filter unit, especially the crosstalk of the IR channel, is adopted.

Benefits of technology

It effectively reduces the crosstalk amount of the central filter unit in the spectral chip, improves the transmittance and resolution of the IR channel, enhances object recognition and tracking capabilities, and improves the face recognition rate and live detection effect.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025073634_14082025_PF_FP_ABST
    Figure CN2025073634_14082025_PF_FP_ABST
Patent Text Reader

Abstract

A spectral chip, comprising a light sensing area (10) and a light modulation layer (20). The light modulation layer (20) is located above the light sensing area (10); the light modulation layer (20) comprises a plurality of colorants corresponding to transmission spectrums of different wave bands of incident light; the colorants of the light modulation layer (20) and physical pixels of the corresponding light sensing area (10) constitute a filter unit (111); the spectral chip comprises a plurality of filter unit groups (11) arranged in an array, wherein each filter unit group (11) comprises a central filter unit (111a) and a plurality of adjacent filter units (111b) arranged adjacent to the central filter unit (111a), and the colorant corresponding to at least one adjacent filter unit (111b) is the same as the colorant of the central filter unit (111a). Thus, the crosstalk amount in a channel corresponding to the central filter unit (111a) in the spectral chip is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Spectral chip Technical Field

[0001] The present invention relates to the field of chip technology, and in particular to a spectrum chip. Background Art

[0002] As the times change, people's demand for higher resolution sensors continues to increase, and they are also committed to developing smaller pixels. As the pixels gradually become smaller, the problem of chip pixel crosstalk becomes more and more important.

[0003] The RGBIR chip can capture both RGB color images and IR images through a single sensor, and has visibility both during the day and at night. It has important applications in object recognition and tracking, improving facial recognition rates, and liveness detection. The chip's IR channel has a low transmittance in the visible light portion but a high transmittance in the near-infrared portion.

[0004] In multispectral sensor applications, the IR channel is crucial for infrared light resolution. However, compared to standard RGBIR chips, multispectral chips use more colorants, which significantly increases the difficulty of process implementation and crosstalk between colorants. This crosstalk, in turn, limits the overall chip performance. Summary of the Invention

[0005] A major advantage of the present invention is that it provides a spectral chip in which the colorant arrangement is designed to control the distribution of colorants in some areas, thereby greatly reducing the impact of crosstalk between colorants on specific spectral channels.

[0006] Another advantage of the present invention is to provide a spectral chip, wherein the spectral chip is arranged so that at least one pure channel of a certain wavelength band set according to requirements, such as an IR channel, exists.

[0007] Another advantage of the present invention is that it provides a spectral chip, wherein the spectral chip does not modify the basic design of the pixels, and achieves the goal of spectral sensing only through the design combination of colorant materials.

[0008] Another advantage of the present invention is that it provides a spectral chip, wherein the spectral chip includes a plurality of filter unit groups arranged in an array, wherein the filter unit group presents five filter units in a cross-shaped shape, wherein the middle one is a pure filter unit (pure channel), and the four adjacent filter units can preferably be implemented with the same colorant as the filter unit, or can be implemented with a colorant with less crosstalk.

[0009] Another advantage of the present invention is that it provides a spectral chip, wherein the diagonal filter units of the filter unit group are also arranged to have smaller crosstalk, which is beneficial to further reduce the amount of crosstalk.

[0010] According to one aspect of the present invention, a spectral chip of the present invention that can achieve the aforementioned objects and other objects and advantages includes:

[0011] a light sensing area; and

[0012] A light modulation layer, wherein the light modulation layer is located above the light sensing area, the light modulation layer includes a plurality of colorants with different transmittance curves, the colorants of the light modulation layer and the corresponding physical pixels of the light sensing area constitute a filter unit, wherein the spectral chip includes at least one filter unit group, wherein the filter unit group includes a central filter unit and a plurality of adjacent filter units arranged adjacent to the central filter unit, wherein the colorant corresponding to at least one of the adjacent filter units is the same as the colorant of the central filter unit, so as to reduce the crosstalk amount of the channel corresponding to the central filter unit in the spectral chip.

[0013] According to an embodiment of the present invention, the adjacent filter units are four filter units arranged adjacent to each other in four directions: above, below, left and right of the central filter unit.

[0014] According to an embodiment of the present invention, the colorant of the central filter unit of the filter unit group is the same as the colorant of the four adjacent filter units.

[0015] According to one embodiment of the present invention, the filter unit group further includes a diagonal filter unit and a spaced filter unit, wherein the diagonal filter unit is adjacent to the adjacent filter unit and is arranged diagonally to the central filter unit; wherein the spaced filter unit is spaced from the central filter unit by one adjacent filter unit.

[0016] According to one embodiment of the present invention, the amount of crosstalk generated by the diagonal filter unit on the central filter unit is smaller than the amount of crosstalk generated by other colorants on the central filter unit.

[0017] According to one embodiment of the present invention, the total crosstalk amount of each of the interval filter units of the spectral chip to the central filter unit is smaller than the crosstalk amount generated by other colorants to the central filter unit.

[0018] According to one embodiment of the present invention, at least one of the adjacent filter units in the filter unit group has a different colorant from the central filter unit, and the colorant of the adjacent filter unit is the colorant that causes the least crosstalk to the central filter unit.

[0019] According to one embodiment of the present invention, at least two adjacent filter units in the filter unit group have different colorants from the central filter unit, and the colorants of the adjacent filter units are the colorants that cause the least crosstalk to the central filter unit.

[0020] According to one embodiment of the present invention, at least three adjacent filter units in the filter unit group have different colorants from the central filter unit, and the colorants of the adjacent filter units are colorants that minimize crosstalk to the central filter unit.

[0021] According to one embodiment of the present invention, the central filter unit of the filter unit group has the same colorant as the four adjacent filter units, which is the first colorant; the four diagonal filter units diagonally opposite the central filter unit have the same colorant, which is the second colorant; the spaced filter units adjacent to the other side of the adjacent filter unit have the same colorant, which is the third colorant; and the colorant adjacent to the diagonal filter unit is the same, which is the fourth colorant.

[0022] According to an embodiment of the present invention, the colorant corresponding to the central filter unit is selected from a group consisting of R, G, B, and IR colorants.

[0023] According to one embodiment of the present invention, the first colorant is an IR colorant, the second colorant is a blue colorant, the third colorant is a red colorant, and the fourth colorant is a green colorant.

[0024] According to one embodiment of the present invention, the crosstalk amount of colorant X can be defined as x X =α(λ)*(2*dn IR (λ))-2*α(λ)*dn X (λ), where x X is the crosstalk between the colorant X and the two IRs, dn IR (λ) is the DN value of the IR channel around the colorant X along the wavelength, dn X (λ) is the DN value of the colorant X itself along the wavelength.

[0025] According to one embodiment of the present invention, different colorants X and IR are calculated, and when the calculated value is the minimum, it is the colorant with the minimum crosstalk required.

[0026] Further objects and advantages of the present invention will be fully apparent from an understanding of the following description and accompanying drawings.

[0027] These and other objects, features and advantages of the present invention will be more fully understood from the following detailed description and accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. In the accompanying drawings, unless otherwise specified, the same reference numerals are used to represent the same components.

[0029] FIG1 is a schematic diagram of pixel unit distribution of a spectral chip.

[0030] FIG2 is a schematic structural diagram of a spectral chip according to a first preferred embodiment of the present invention.

[0031] FIG3 is a schematic diagram showing the arrangement of spectral pixels of the spectral chip according to the preferred embodiment of the present invention.

[0032] 4A to 4D are schematic diagrams of several filter units of the spectral chip according to the preferred embodiment of the present invention.

[0033] FIG5 is a schematic diagram of a filter unit of the spectral chip according to a second preferred embodiment of the present invention.

[0034] FIG6 is a schematic diagram of a filter unit of the spectral chip according to a third preferred embodiment of the present invention.

[0035] FIG7 is a schematic diagram of a filter unit of the spectral chip according to a fourth preferred embodiment of the present invention.

[0036] FIG8 is a schematic diagram of a filter unit of the spectral chip according to a fifth preferred embodiment of the present invention. DETAILED DESCRIPTION

[0037] It should be pointed out that the embodiments shown in the drawings are only used as examples to specifically and vividly explain and illustrate the concept of the present invention. Their size and structure are not necessarily drawn to scale, nor do they constitute a limitation to the concept of the present invention.

[0038] The directional terms such as up, down, left, right, front, back, front, back, top, and bottom mentioned or possibly mentioned in this specification are defined relative to the structure shown in the respective drawings. They are relative concepts and may vary accordingly depending on the position or usage of the device. Therefore, these or other directional terms should not be interpreted as restrictive.

[0039] It is to be understood that the term "one" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element may be one, while in another embodiment, the number of the elements may be multiple, and the term "one" should not be understood as a limitation on the quantity.

[0040] The spectral chip includes a light sensing area 10 and a light modulation layer 20 located above the light sensing area 10, wherein the light modulation layer 20 includes a plurality of colorants corresponding to the transmittance spectra of different wavelength bands of the incident light, such as R, G, and B colorants corresponding to RGB, IR colorants corresponding to IR, or colorants corresponding to other spectra, that is, different types of colorants have different transmittance curves.

[0041] The spectral chip comprises a light sensing area and a circuit and wiring area surrounding it. The light sensing area includes its photoelectric conversion component and a corresponding light modulation layer. The light sensing area is the core area for image acquisition, while the circuit and wiring area houses the sensor's necessary circuits and electronic components. The performance of the light sensing area of ​​the spectral chip determines factors such as the signal-to-noise ratio and dynamic range. The light sensing area of ​​the spectral chip is composed of a series of repeatedly arranged physical pixels.

[0042] It should be noted that in the prior art, the photoelectric conversion components of all pixel units are generally identical, but different filter materials (colorants) such as RGB, i.e., R, G, and B colorants, are used to divide all units into multiple groups of repeated pixels. Colors are then restored using corresponding algorithms. However, this method cannot capture detailed spectral information. Colorants can commonly be implemented as dyes or pigments.

[0043] The colorants of the light modulation layer 20 of the spectral chip correspond to the photoelectric conversion part (photodiode PD) of the light sensing area 10, wherein different types of colorants in the light modulation layer 20 have modulation effects corresponding to the transmittance spectra of different spectral bands, that is, different colorants correspond to different transmittance spectrum curves. As an example, in the present application, the light modulation layer 20 of the spectral chip includes a plurality of colorants, including but not limited to R, G, B colorants, IR colorants, etc. The colorants of the light modulation layer 20 further include colorants of a plurality of different colors, wherein the colorants of the light modulation layer 20 are located at the upper end of the photodiode of the light sensing area 10, wherein one colorant corresponds to one physical pixel (PD) or multiple physical pixels, for example, one colorant corresponds to one physical pixel, one colorant corresponds to four physical pixels, or nine physical pixels, etc. The colorants of the light modulation layer 20 and the corresponding physical pixels of the light sensing area 10 constitute a filter unit. The spectral sensing area of ​​the spectral chip includes a plurality of filter units arranged in an array. The colorants of the light modulation layer 20 and the corresponding physical pixels form spectral channels through which incident light can pass. Therefore, the spectral chip can be understood as having at least multiple channels, such as an R channel, a G channel, a B channel, and an IR channel.

[0044] It should be noted that different colorants correspond to different numbers of physical pixels. For example, if there are at least two colorants, one of which has a significantly higher transmittance than the other, the loss of incident light with a higher transmittance is smaller, and the response value received by the corresponding physical pixel will be larger, and the corresponding signal-to-noise ratio will also be larger, resulting in a better overall effect. However, for a colorant with a lower transmittance, the loss of incident light is larger, so even with the same number of physical pixels, the corresponding effect may not be good.

[0045] Therefore, in some embodiments, the number of physical pixels corresponding to the colorant with higher transmittance is smaller than the number of physical pixels corresponding to the colorant with lower transmittance; as for the transmittance, the transmittance curve can be integrated within a specific band range (such as the working band range of the spectral chip, such as one or more bands of visible light, infrared, and / or ultraviolet), and the larger the value, the greater the transmittance.

[0046] In spectral applications, the IR channel is crucial for scenarios requiring infrared light resolution. An IR channel is an IR filter element formed by placing a colorant with high IR band transmittance above a physical pixel. In practical applications, the presence of an IR channel can enhance imaging and be used for object recognition and tracking, for example, improving facial recognition, detecting liveness, and determining depth information in conjunction with an aperture. Due to limitations in colorant area and material properties, crosstalk occurs where different colorants meet. This means that some light entering one filter element will propagate to another. This phenomenon causes variations in the measured colorant transmittance. This crosstalk can lead to inaccurate information and poor application performance.

[0047] In the embodiments of this application, crosstalk refers to the phenomenon where, after light passes through a certain colorant in the light modulation layer, due to diffraction or other reasons, some of the light that theoretically falls on the projection area of ​​the image sensor corresponding to that colorant will enter the projection area of ​​the image sensor corresponding to another colorant. This light ultimately falls on the projection area of ​​the other colorant on the image sensor, causing the final digital quantization (DN) value of the other colorant to change.

[0048] In the spectral chip of the present application, the channel corresponding to at least one filter unit of the spectral chip can obtain pure (anti-crosstalk) spectral information. Taking colorant X as an example, the thickness of colorant X is fixed, and the transmittance curve measured when only one colorant X corresponds to all physical pixels of the chip is set to the curve with the highest purity. At the same thickness, the closer the transmittance curve measured by the spectral chip for the same colorant is to this curve, the purer it is. In the above description, closeness refers to the absolute value integral after subtracting the two curves; the smaller the integral value, the closer the two curves are.

[0049] It should be noted that the following text and the figures of this application are explained using the requirements of the IR channel as an example, but this does not constitute a limitation. It can be understood that if there is any colorant X and it is necessary to obtain pure information of its corresponding channel, the technical solution of the present invention can also be applied to achieve this, that is, the target filter unit, i.e., the IR channel (IR colorant), is replaced with the corresponding colorant X, and other colorants can be arranged according to the technical solution of the present invention.

[0050] In a specific example of the present application, in order to provide a spectral chip with improved anti-crosstalk effect, a definition of a crosstalk coefficient is provided in the embodiment of the present application. As shown in FIG1 , the colorant E and the eight colorants around it are formed on the image sensor 10, and the light modulation layer 20 uses this as the minimum repeating unit to obtain a colorant arrangement covering the entire image sensor (or the area covered as required). Light of different wavelengths passes through the colorant and enters the image sensor below. After being converted into an electrical signal, the signal is output in the form of a DN value. The following relationship exists: DN E =dn E -4*α*dn E +α*(dn B +dn D +dn F +dn H )

[0051] In the above formula, DN E is measured, which is represented by the actual DN value of the filter unit E in different bands (a vector), dn E The theoretical crosstalk-free DN value of the filter unit in different bands (a vector). B 、dn D 、dn F 、dn H is the theoretical crosstalk-free DN value (respectively vector) in different bands of the surrounding filter units B, D, F, and H. α is the crosstalk coefficient, which represents the proportion of light that is crosstalked from the filter unit E to a surrounding filter unit. The DN value can be understood as the light intensity measurement value obtained by the physical pixel after the light enters the colorant and reaches the physical pixel, where * is the dot product, that is, the multiplication of the elements between the vectors. In this example, it can be understood that general crosstalk is mainly formed between adjacent filter units, so when calculating the crosstalk coefficient, the four adjacent filter units are mainly considered. In individual embodiments of the present application, the eight adjacent filter units are considered, that is, if the filter unit E is considered, filter units A to I must be taken into account.

[0052] It should be noted that the present invention is based on the assumption that the crosstalk coefficients between the filter units are fixed and consistent everywhere. There may be certain differences in practice, but this does not deviate from the scope of the present invention. That is, regardless of whether there are differences, a corresponding crosstalk coefficient can be calculated, and then the crosstalk coefficient can be used to calculate the crosstalk amount.

[0053] Based on obtaining more accurate channel information (such as IR channel), a solution to optimize channel information is proposed. By designing the colorant arrangement and controlling the colorant distribution in some areas, the impact of crosstalk between colorants on the IR channel is greatly reduced. As can be seen from the above formula, DN E (λ)=dnE (λ)-4*α(λ)*dn E (λ)+α(λ)*(dn B (λ) +dn D (λ)+dn F (λ)+dn H (λ)

[0054] When a filter unit, for example, defines the crosstalk amount x under the colorant E e =α(λ)*(dn B (λ)+dn D (λ)+dn F (λ)+dn H (λ))-4*α(λ)*dn E (λ),

[0055] Get DN E (λ)=dn E (λ)+x e

[0056] When x e =0, DN E (λ)=dn E (λ), the structure does not have any crosstalk.

[0057] When the crosstalk coefficient is not zero, in order to make x e If it is zero, dn is required B (λ)+dn D (λ)+dn F (λ)+dn H (λ)=4*dn E (λ)

[0058] From the above formula, the simplest way is: let dn B (λ)=dn D (λ)=dn F (λ)=dn H (λ)=dn E (λ)

[0059] Assuming that colorant E is the corresponding IR colorant, applying this result to the optimization of the IR channel shows that ideally, all areas around IR should be arranged as IR.

[0060] The filter units referred to in the present invention are adjacent to each other.

[0061] At least one side is adjacent. If the filter unit is a rectangle, at least one side is adjacent. If the filter unit is circular or irregular in shape, it can be assumed that the filter units are periodically arranged, and there will be corresponding boundaries, and the boundaries are adjacent. Secondly, the interval setting means that the filter units have no adjacent boundaries, for example, it can be a diagonal setting (the diagonal setting can be understood as assuming that the filter units are regular rectangles, and the two filter units have no adjacent sides but have a common corner), it can be an interval setting, etc.

[0062] Correspondingly, the light sensing area of ​​the spectral chip described in the present invention includes at least one array-arranged filter unit group 11, wherein the filter unit group 11 further includes m*m filter units 111, for example, the filter unit group 11 includes 3*3 or 4*4 filter units 111, and there is a central filter unit 111a and x adjacent filter units 111b in the filter unit group 11. For example, the x adjacent filter units 111b are four filter units adjacent to the central filter unit 111a in the four directions of up, down, left and right, or four filter units arranged in the four directions of up, down, left, right and four diagonal directions.

[0063] In this application, to achieve crosstalk resistance in the central filter unit 111a, the colorant corresponding to at least one of the four adjacent filter units 111b (upper, lower, left, and right) is set to be consistent with the colorant of the central filter unit 111b, thereby minimizing the amount of crosstalk in the corresponding channel of the central filter unit 111 in the spectral chip. The filter unit group 11 further includes a diagonal filter unit 111c and a spaced filter unit 111d, wherein the diagonal filter unit 111c is adjacent to the adjacent filter unit 111b and is arranged diagonally with the central filter unit 111a; and the spaced filter unit 111d is separated from the central filter unit 111a by at least one of the adjacent filter units 111b.

[0064] In the present application, the colorants provided in the diagonal filter unit 111c and the spaced filter unit 111d cause as little crosstalk to the central filter unit 111a as possible, so as to reduce the crosstalk amount of the channel corresponding to the central filter unit 111a.

[0065] Preferably, the colorant of the central filter unit 111 a of the filter unit set 11 is the same as the colorant of the four adjacent filter units 111 b .

[0066] Referring to Figures 2 to 4D of the accompanying drawings of the present application, there are shown schematic diagrams of the arrangement of the filter units of the spectral chip of the first preferred embodiment of the present application, wherein the channel corresponding to at least one band of the spectral chip is an anti-crosstalk channel, the central filter unit 111a of the filter unit group 11 is the filter unit corresponding to the anti-crosstalk channel, and at least one of the four adjacent filter units 111b adjacent to the central filter unit 111a has the same colorant as the central filter unit 111a.

[0067] As shown in Figures 4A to 4C, in this preferred embodiment of the present application, the anti-crosstalk channel is implemented as an IR channel, that is, taking the IR channel as an example, the filter unit group 11 includes 3*3 filter units 111, wherein the central filter unit 111a is an IR filter unit, and the colorants of the four adjacent filter units 111b adjacent to the central filter unit 111a are the same as those of the central filter unit 111a, that is, the adjacent filter units 111b are also IR filter units.

[0068] Furthermore, the diagonal filter units 111c, which are arranged diagonally with the central filter unit 111a, are configured with several colorants that minimize IR crosstalk. Specifically, the diagonal filter units 111c generate less crosstalk on the central filter unit 111a than other colorants (excluding the colorant corresponding to the central filter unit) that are arranged at intervals. It is understood that the diagonal filter units 111c may be all different from each other, or some may be the same.

[0069] It is understood that in this preferred embodiment of the present application, the spectral chip includes a plurality of the aforementioned filter element groups 11, wherein the filter element group 11 includes 3*3 filter elements 111. It is understood that the spectral chip can be obtained by periodically arranging the same type of filter element groups 11, or by periodically arranging different types of filter element groups.

[0070] As shown in FIG4D , the spectral chip includes spaced filter units 111d, wherein at least one filter unit (an adjacent filter unit 111b or a diagonal filter unit 111c) exists between the colorant of each spaced filter unit 111d and the central filter unit 111a. After the central filter unit 111a, four adjacent filter units 111b, and four diagonal filter units 111c are arranged, the crosstalk between each spaced filter unit 111d is preferably calculated to obtain the crosstalk corresponding to each filter unit. The crosstalk values ​​of each spaced filter unit 111d are then summed to obtain the total crosstalk value, and the filter units are arranged according to the scheme that minimizes the total crosstalk value. Preferably, in this preferred embodiment of the present application, the total crosstalk value of the colorant corresponding to each spaced filter unit 111d of the spectral chip on the central filter unit 111a is minimized, that is, the total crosstalk value is less than the crosstalk value generated by other colorants on the central filter unit 111a.

[0071] In another optional embodiment of the present application, the filter unit group 11 constituting the spectral chip includes 4*4 filter units 111, wherein the filter unit group 11 includes the above-mentioned 3*3 filter unit group and another 7 filter units 111, namely 7 spaced filter units 111d, wherein the arrangement of the spaced filter units 111d has the smallest total crosstalk amount.

[0072] For example, each of the interval filter units 111d can calculate a crosstalk value x n After adding the crosstalk amounts of all the spaced filter units 111d, the sum of all the crosstalk amounts can be obtained as the total crosstalk amount of the spaced filter unit 111d, for example, recorded as x total , that is, assuming that the spectral pixel is composed of n filter units, the crosstalk amount x of the filter unit composed of each colorant can be calculated n , then x total =x1+x2+…+x n For example, taking the nine colorants shown in Figure 5 as an example, after arranging the IR, A, and B colorants, x total =x B +x C +x D +x E +x F +x G +x I After fixing the central filter element 111a to IR, the adjacent filter element 111b is also set to an IR filter element, and the diagonally opposite filter elements are set to A and B. The A and B colorants have less crosstalk with the IR colorant than with other colorants (non-IR colorants). Preferably, the total crosstalk of the A and B colorants with the IR colorant is minimized compared to the total crosstalk of other colorants.

[0073] It should be noted that in the present application, the diagonal filter units 111d and / or the spaced filter units 111c have different colorants and are positioned differently relative to the central filter unit 111a. Therefore, various arrangements of the filter units 111 are possible based on their position and colorants, and each arrangement has a specific total crosstalk amount. The total crosstalk amount varies with the arrangement, and the values ​​can be arranged from small to large. The total crosstalk amount of the filter units 111 of the spectral chip described in the present application ranks in the top 20% of the total crosstalk amounts of all arrangements of the filter units 111 (i.e., the total crosstalk amount described in the present application is as small as possible).

[0074] In this preferred embodiment of the present application, the crosstalk between the pigments is described, taking pigment X and pigment IR as an example. Other embodiments can adopt similar methods or similar definitions according to needs, wherein the crosstalk amount when arranging pigment X can be defined as x X =α(λ)*(2*dn IR (λ))-2*α(λ)*dn X (λ), where x X is the crosstalk between the colorant X and the two IRs, dn IR (λ) is the DN value of the IR channel around the colorant X along the wavelength, dn X (λ) is the DN value of the colorant X along the wavelength. Calculate different colorants X and IR. When the calculated x X When it is the smallest, it is the colorant with the smallest crosstalk.

[0075] It is understandable that the present application does not limit the method for determining the magnitude of crosstalk between two colorants, and other methods may also be used. However, the essence of the method is to reduce the crosstalk between adjacent filter units or close filter units.

[0076] As shown in Figure 5, it is a schematic diagram of the arrangement of the filter units of the spectral chip of the second preferred embodiment of the present application. What is different from the above preferred embodiment is that the colorant of at least one of the adjacent filter units 111b in the filter unit group 11 is different from that of the central filter unit 111a, and the colorant of the adjacent filter unit 111b is the colorant with the smallest crosstalk amount to the central filter unit 111a. It can be understood that the colorant in the filter unit group has the smallest crosstalk amount with the central filter unit 111a.

[0077] As an example, in this preferred embodiment of the present application, the colorant of the central filter unit 111a is an IR colorant, wherein the colorant A of the adjacent filter unit 111b located above, below, left and / or right of the central filter unit 111a has a smaller crosstalk amount to IR than the other colorants to the central filter unit 111a.

[0078] As shown in Figure 6, it is a schematic diagram of the arrangement of the filter units of the spectral chip of the third preferred embodiment of the present application. The difference from the above preferred embodiment is that the colorants of at least two adjacent filter units 111b in the filter unit group 11 are different from those of the central filter unit 111a, and the colorants of the adjacent filter units 111b are the colorants that minimize the amount of crosstalk to the central filter unit 111b.

[0079] As an example, in this preferred embodiment of the present application, the colorant of the central filtering unit 111a is an IR colorant, wherein the amount of crosstalk to IR by the colorant A and the colorant B of the adjacent filtering units 111b above, below, left and / or right of the central filtering unit 111a is less than the amount of crosstalk to the central filtering unit 111a by other colorants.

[0080] As shown in Figure 7, it is a schematic diagram of the arrangement of the filter units of the spectral chip of the fourth preferred embodiment of the present application. The difference from the above preferred embodiment is that the colorants of at least three adjacent filter units 111b in the filter unit group 11 are different from those of the central filter unit 111a, and the colorants of the adjacent filter units 111b are the colorants that minimize the amount of crosstalk to the central filter unit 111b.

[0081] As an example, in this preferred embodiment of the present application, the colorant of the central filter unit 111a is an IR colorant, wherein the amount of crosstalk to IR by the colorant A, colorant B, and colorant C of the adjacent filter units 111b above, below, left, and / or right of the central filter unit 111a is less than the amount of crosstalk to the central filter unit 111a by other colorants.

[0082] As shown in Figure 8, it is a schematic diagram of the arrangement of the filter units of the spectral chip of the fifth preferred embodiment of the present application. The difference from the above preferred embodiment is that the central filter unit 111a of the filter unit group 11 has the same colorant as the four adjacent filter units 111b, which is the first colorant; the four diagonal filter units 111c diagonally opposite to the central filter unit 111a have the same colorant, which is the second colorant; the spaced filter unit 111d adjacent to the other side of the adjacent filter unit 111b has the same colorant, which is the third colorant; and the colorant adjacent to the diagonal filter unit 111c is the same, which is the fourth colorant.

[0083] For example, in a specific embodiment of the present application, the first colorant is an IR colorant, the second colorant is a blue colorant, the third colorant is a red colorant, and the fourth colorant is a green colorant. It will be appreciated that, in the present application, the central filter unit 111a serves as an anti-crosstalk channel, and the crosstalk levels corresponding to R, G, and B are similar. The surrounding environment of each identical colorant is identical, resulting in relatively high consistency. All green pigments are surrounded by two blues, one red, and one IR; all blue pigments are surrounded by two IRs and two greens; and all red pigments are surrounded by two greens and two IRs.

[0084] In addition, this arrangement has a small overall crosstalk amount, and the blue-green pigment has the least contact with the red pigment that is prone to crosstalk, which meets the optimal process and has a small amount of crosstalk.

[0085] It's worth noting that in the aforementioned preferred embodiment of the present application, the spectral chip is arranged so that it includes at least one anti-crosstalk channel for a specific wavelength band, such as an IR channel, configured as needed. Based on this, in the aforementioned preferred embodiment of the present application, the central filter element 111a and the four adjacent filter elements 111b of the filter element group 11 of the spectral chip form a "cross"-like structure, with the central channel serving as the anti-crosstalk channel. The four adjacent filter elements 111b adjacent to the central filter element 111a are preferably implemented using the same colorant, or a colorant that exhibits minimal crosstalk.

[0086] As shown in Figure 2, in this preferred embodiment of the present application, taking the RGB-IR chip as an example, the spectral chip is centered on a cross, wherein the diagonal filter unit 111c is set to a filter unit group 11 of 3*3 filter units 111 composed of B, G, G, and R colorants, and then the filter unit group 11 is periodically arrayed. The IR channel in the center of the cross is an anti-crosstalk IR channel, and the RGGB channels can work together for visible light imaging.

[0087] Those skilled in the art will appreciate that the embodiments of the present invention described above and shown in the accompanying drawings are intended to be illustrative only and are not intended to limit the present invention. The objectives of the present invention have been fully and effectively achieved. The functional and structural principles of the present invention have been demonstrated and illustrated in the embodiments. Any variations or modifications may be made to the embodiments of the present invention without departing from the principles described.

[0088] The technical scope of the present invention is not limited to the contents of the above description. Those skilled in the art can make various deformations and modifications to the above embodiments without departing from the technical concept of the present invention, and these deformations and modifications all fall within the protection scope of the present invention.

Claims

1. Spectral chip, characterized in that, include: Light sensing area; and A light modulation layer, wherein the light modulation layer is located above the light sensing area, the light modulation layer includes a plurality of colorants with different transmittance curves, the colorants of the light modulation layer and the corresponding physical pixels of the light sensing area constitute a filter unit, wherein the spectral chip includes at least one filter unit group, wherein the filter unit group includes a central filter unit and a plurality of adjacent filter units arranged adjacent to the central filter unit, wherein the colorant corresponding to at least one of the adjacent filter units is the same as the colorant of the central filter unit, so as to reduce the crosstalk amount of the channel corresponding to the central filter unit in the spectral chip. 2 . The spectral chip according to claim 1 , wherein the adjacent filter units are four filter units arranged adjacent to each other in four directions: above, below, left, and right of the central filter unit. 3 . The spectral chip according to claim 2 , wherein the color material of the central filter unit of the filter unit group is the same as the color material of the four adjacent filter units.

4. The spectral chip according to claim 2, wherein the filter unit group further includes a diagonal filter unit and a spaced filter unit, wherein the diagonal filter unit is adjacent to the adjacent filter unit and is arranged diagonally with the central filter unit; wherein the spaced filter unit is spaced from the central filter unit by one adjacent filter unit. 5 . The spectral chip according to claim 4 , wherein the amount of crosstalk generated by the diagonal filter unit on the central filter unit is smaller than the amount of crosstalk generated by other colorants on the central filter unit.

6. The spectral chip according to claim 2, wherein the color material of at least one of the adjacent filter units in the filter unit group is different from that of the central filter unit, and the color material of the adjacent filter unit is the color material that minimizes the crosstalk amount to the central filter unit.

7. The spectral chip according to claim 2, wherein the color materials of at least two adjacent filter units in the filter unit group are different from the central filter unit, and the color materials of the adjacent filter units are the color materials that minimize the crosstalk amount to the central filter unit.

8. The spectral chip according to claim 2, wherein the color materials of at least three adjacent filter units in the filter unit group are different from those of the central filter unit, and the color materials of the adjacent filter units are the color materials that minimize the crosstalk to the central filter unit.

9. The spectral chip according to claim 2, wherein the central filter unit of the filter unit group has the same color material as the four adjacent filter units, which is the first color material; the four diagonal filter units diagonally opposite the central filter unit have the same color material, which is the second color material; the spaced filter units adjacent to the other side of the adjacent filter unit have the same color material, which is the third color material; and the color material adjacent to the diagonal filter unit is the same, which is the fourth color material.

10. The spectral chip according to any one of claims 1 to 9, wherein the colorant corresponding to the central filter unit is selected from a group consisting of R, G, B, and IR colorants. 11 . The spectral chip according to claim 10 , wherein the first colorant is an IR colorant, the second colorant is a blue colorant, the third colorant is a red colorant, and the fourth colorant is a green colorant.

12. The spectral chip according to claim 11, wherein the crosstalk amount of colorant X can be defined as x X =α(λ)*(2*dn IR (λ))-2*α(λ)*dn X (λ), where x X is the crosstalk between the colorant X and the two IRs, dn IR (λ) is the DN value of the IR channel around the colorant X along the wavelength, dn X (λ) is the DN value of the colorant X itself along the wavelength. 13 . The spectral chip according to claim 12 , wherein different colorants X and IR are calculated, and when the calculated value is the minimum, it is the colorant with the minimum crosstalk required.

Citation Information

Patent Citations

  • Automatic focusing method and system based on RGB-IR depth camera

    CN106412433A

  • Image sensor, mobile terminal, and image shooting method

    CN108965704A

  • Image sensor method and apparatus equipped with multiple contiguous infrared filter elements

    CN109417613A

  • Photoelectric sensor

    EP2763397A1

  • Multi-Spectral Color and IR Camera Based on Multi-Filter Array

    US20100295947A1