Image sensor and electronic device

Abstract

Disclosed in the present application are an image sensor and an electronic device. The image sensor provided in the present application comprises a pixel array and a color filter array, wherein the pixel array comprises at least one multispectral unit, and each multispectral unit comprises at least two first-type pixels for image imaging and at least one second-type pixel for multispectral imaging; the color filter array comprises a filter unit, and the filter unit comprises at least two first-type filter elements and at least one second-type filter element; the first-type filter elements are arranged opposite the first-type pixels; the second-type filter element is arranged opposite the second-type pixel; the wavelength range of light that can be transmitted through the first-type filter elements is different from the wavelength range of light that can be transmitted through the second-type filter element, and the at least one second-type filter element includes at least one type of filter element; and the filter unit comprises r first-type filter elements, the r first-type filter elements are distributed in a p×q array, the wavelength ranges of light that can be transmitted through the r first-type filter elements are the same, p and q are both positive integers, and r=p×q.

Description

Image sensors and electronic devices

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202510385342.8, filed on March 28, 2025, entitled "Image Sensor and Electronic Device", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application belongs to the field of camera device technology, specifically relating to an image sensor and electronic device. Background Technology

[0004] With the rapid development of mobile phones and other electronic devices, the types of sensors integrated into these devices are also increasing. Electronic devices generally use image sensors for taking pictures and videos. In order to optimize the image quality of smartphones under different lighting conditions and improve color reproduction and performance, multispectral sensors that can identify the spectral characteristics of the environment have become an indispensable feature of smartphones.

[0005] Currently, in scenarios where multispectral sensors assist image sensors in image capture, the environmental spectral features identified by the multispectral sensor are used to adjust the images captured by the image sensor, improving color reproduction and performance. While image sensors use a single imaging camera for taking pictures, multispectral sensors use a separate camera to capture spectral information across multiple wavelength ranges, leading to increased hardware power consumption. Summary of the Invention

[0006] This application provides an image sensor and an electronic device. The image sensor can perform both image imaging and multispectral imaging functions, eliminating the need for an additional multispectral sensor to identify multispectral information and reducing hardware power consumption.

[0007] In a first aspect, this application provides an image sensor, comprising: a pixel array and a color filter array; the pixel array includes at least one multispectral unit, the multispectral unit including at least two first-type pixels for image imaging and at least one second-type pixel for multispectral imaging; the color filter array includes filter units disposed opposite to the multispectral unit, the filter units including first-type filter elements and second-type filter elements, the first-type filter elements being disposed opposite to the first-type pixels; the second-type filter elements being disposed opposite to the second-type pixels; the wavelength range of light that can be transmitted by the first-type filter elements is different from the wavelength range of light that can be transmitted by the second-type filter elements, the second-type filter elements including multiple filter elements, each filter element corresponding to a wavelength range of light that can be transmitted, and the wavelength ranges of light that can be transmitted by the multiple filter elements being different; wherein, the filter unit includes r first-type filter elements, the r first-type filter elements are distributed in a p×q array, the wavelength range of light that can be transmitted by the r first-type filter elements is the same, p and q are both positive integers, and r = p×q.

[0008] Secondly, this application provides an electronic device including an image sensor as provided in the first aspect. In embodiments of this application, the image sensor includes a pixel array and a color filter array; the pixel array includes at least one multispectral unit, the multispectral unit including at least two first-type pixels for image imaging and at least one second-type pixel for multispectral imaging; the color filter array includes filter units disposed opposite to the multispectral unit, the filter units including at least two first-type filter elements and at least one second-type filter element, the first-type filter elements being disposed opposite to the first-type pixels; the second-type filter elements being disposed opposite to the second-type pixels; the first-type filter elements and the second-type filter elements have different transmittable wavelength ranges, and at least one second-type filter element includes at least one filter element; wherein, the filter unit includes r first-type filter elements, the r first-type filter elements are distributed in a p×q array, the r first-type filter elements have the same transmittable wavelength range, p and q are both positive integers, and r = p×q. Thus, in the image sensor, the multispectral unit includes a first type of pixel for image imaging and at least one second type of pixel for multispectral imaging. The filter unit includes a first type of filter element disposed opposite to the first type of pixel and a second type of filter element disposed opposite to the second type of pixel. The image sensor realizes image imaging through the color channel corresponding to the first type of filter element, and realizes multispectral imaging by recognizing multispectral information through the color channel corresponding to the second type of filter element. This allows the image sensor to perform both image imaging and multispectral imaging functions without the need for an additional multispectral sensor to recognize multispectral information, thereby reducing hardware power consumption. Attached Figure Description

[0009] Figure 1 is a schematic diagram of an image sensor provided in some embodiments of this application;

[0010] Figure 2 is a schematic diagram of an image sensor provided in some embodiments of this application;

[0011] Figure 3A is a schematic diagram of the smallest unit of an image sensor provided in some embodiments of this application;

[0012] Figure 3B is a schematic diagram of a filter unit provided in some embodiments of this application;

[0013] Figure 3C is a schematic diagram of a filter unit provided in some embodiments of this application;

[0014] Figure 3D is a schematic diagram of a filter unit provided in some embodiments of this application;

[0015] Figure 4A is a schematic diagram of a filter unit provided in some embodiments of this application;

[0016] Figure 4B is a schematic diagram of a filter unit provided in some embodiments of this application;

[0017] Figure 5A is a schematic diagram of a filter unit provided in some embodiments of this application;

[0018] Figure 5B is a schematic diagram of a filter unit provided in some embodiments of this application;

[0019] Figure 5C is a schematic diagram of a filter unit provided in some embodiments of this application;

[0020] Figure 5D is a schematic diagram of a filter unit provided in some embodiments of this application;

[0021] Figure 5E is a schematic diagram of a filter unit provided in some embodiments of this application;

[0022] Figure 6 is a schematic diagram of an electronic device provided in some embodiments of this application.

[0023] Explanation of reference numerals in the attached figures: 10-Image sensor; 100-Pixel array; 110-Multispectral unit; 111-First type pixel; 112-Second type pixel; 200-Color filter array; 210-Filter unit; 211-First type filter element; R-Red filter element; G-Green filter element; Gr-Green-red filter element; Gb-Green-blue filter element; B-Blue filter element; 212-Second type filter element; F1-First filter element; F2-Second filter element; F3-Third filter element; F4-Fourth filter element; F5-Fifth filter element; F6-Sixth filter element; F7-Seventh filter element; F8-Eighth filter element; 220-Minimum unit of image sensor; 300-Microlens array; 301-Microlens; 600-Electronic device. Detailed Implementation

[0024] The embodiments of this application will now be described in detail. Examples of these embodiments are illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain this application, and should not be construed as limiting this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0025] The terms "first" and "second" in the specification and claims of this application may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise stated, "multiple" means two or more. Furthermore, "and / or" in the specification and claims indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0026] In the description of this application, it should be understood that the terms "inner" and "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application.

[0027] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "connected" and "linked" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0028] The terminology used in the implementation section of this application is for the purpose of explaining specific embodiments of this application only, and is not intended to limit this application.

[0029] The terminology used in the embodiments of this application will be explained below.

[0030] Image sensor: A device that converts light signals into electrical signals and generates images based on the electrical signals. An image sensor may include a pixel array, a color filter array, and a microlens array stacked sequentially. The pixel array may include a first type of pixel and a second type of pixel, and the color filter array may include a first type of filter element and a second type of filter element.

[0031] Pixels can be divided into first-class pixels and second-class pixels. A pixel is the smallest element in a pixel array.

[0032] First-class pixels: First-class pixels are used for image formation. For example, an image is synthesized using pixel data output from first-class pixels. In practical applications, during image synthesis, first-class pixels can be considered as valid pixels, while second-class pixels can be treated as dead pixels.

[0033] Type II pixels: Type II pixels are used for multispectral imaging, which refers to imaging using multiple spectral information. For example, imaging can be performed using the multiple spectral information output by Type II pixels. In practical applications, during multispectral imaging, the multiple spectral information output by Type II pixels can effectively improve the color reproduction of the image.

[0034] Type I filter element: The type I filter element is the filter element corresponding to the type I pixel. The type I pixel can sense the light transmitted through the type I filter element.

[0035] Type II filter elements: Type II filter elements are filter elements corresponding to Type II pixels. Type II pixels can sense light passing through Type II filter elements.

[0036] The image sensor and electronic device provided in the embodiments of this application are described in detail below with reference to the accompanying drawings.

[0037] Figure 1 is a schematic structural diagram of an image sensor provided in an embodiment of this application.

[0038] As shown in FIG1, an embodiment of this application provides an image sensor 10, which may include: a pixel array 100 and a color filter array 200; the pixel array 100 may include at least one multispectral unit 110, the multispectral unit 110 including at least two first-type pixels 111 for image imaging and at least one second-type pixel 112 for multispectral imaging; the color filter array 200 includes a filter unit 210 disposed opposite to the multispectral unit, the filter unit 210 including at least two first-type filter elements 211 and at least one second-type filter element 212, the first-type filter element 211 being disposed opposite to the first-type pixels 111; the second-type filter element 212 being disposed opposite to the second-type pixels 112; the first-type filter element 211 and the second-type filter element 212 have different transmittance wavelength ranges, and at least one second-type filter element 212 includes at least one filter element.

[0039] In this embodiment, the first type of pixels 111 is used for image imaging. For example, an image is generated using the pixel data output by the first type of pixels 111. In practical applications, during the image generation process, the first type of pixels 111 can be considered as valid pixels, and the second type of pixels 112 can be treated as dead pixels.

[0040] In some embodiments of this application, the second type of pixel 112 is used for multispectral imaging, which refers to imaging using multiple spectral information. For example, imaging is performed using the multiple spectral information output by the second type of pixel 112. In practical applications, during multispectral imaging, the multiple spectral information output by the second type of pixel 112 can effectively improve the color performance of the image.

[0041] In some embodiments of this application, when the second type of filter element 212 includes multiple filter elements, each filter element corresponds to a range of transmittable light wavelengths, and the range of transmittable light wavelengths of the multiple filter elements are different.

[0042] In some embodiments of this application, as shown in FIG2, the pixel array 100 and the color filter array 200 can be stacked. The pixel array 100 may include multiple pixels, and the color filter array 200 may include multiple filter elements, with one pixel corresponding to one filter element.

[0043] For example, as shown in Figure 2, an image sensor may include a pixel array 100, a color filter array 200, and a microlens array 300 stacked sequentially. In the microlens array 300, each microlens 301 is used to better collect light; in the color filter array 200, filter elements such as first-type filter elements 211 and second-type filter elements 212 are used to filter light of different colors; in the pixel array 100, pixels such as first-type pixels 111 and second-type pixels 112 can sense the light transmitted through the filter elements, perform photoelectric conversion processing, and output an electrical signal.

[0044] In the pixel array 100, pixels such as the first type pixel 111 and the second type pixel 112 can adopt a typical four-transistor pinned photodiode (4T-PPD) pixel structure. The 4T-PPD pixel structure includes a sensing area of ​​one PPD and four transistors. Its working principle includes the following six steps: Step 1, Exposure. Electron-hole pairs generated by light irradiation separate due to the presence of the PPD's electric field; electrons move to the n-region, and holes move to the p-region. Step 2, Reset. At the end of exposure, the RST transistor is activated, resetting the readout area, i.e., the n+ region of the PPD, to a high level. Step 3, Reset Level Readout. After reset, the reset level is read out, including the op-amp's offset noise, 1 / f noise, and kTC noise introduced by the reset. The readout signal is stored in the first capacitor. Step 4, Charge Transfer. The TX transistor is activated, completely transferring charge from the photosensitive area to the n+ region for readout; this mechanism is similar to charge transfer in a CCD. Step 5, Signal Level Readout. The voltage signal in the n+ region is read out to the second capacitor. This signal includes: the signal generated by photoelectric conversion, the offset generated by the operational amplifier, 1 / f noise, and kTC noise introduced by the reset. Step six: Signal output. The signals stored in the two capacitors are subtracted, and the resulting signal is then amplified analogally and sampled by an analog-to-digital converter (ADC) for digital signal output.

[0045] Of course, in the pixel array 100, pixels such as the first type of pixel 111 and the second type of pixel 112 can also adopt other pixel circuit structures, and this application does not impose specific restrictions on them.

[0046] In some embodiments of this application, the pixel array 100 may include at least one multispectral unit 110, and the color filter array 200 may include at least one filter unit 210. One multispectral unit 110 corresponds to one filter unit 210, and the number of multispectral units 110 is the same as the number of filter units 210. Furthermore, one pixel in one multispectral unit 110 corresponds to one filter element in one filter unit 210.

[0047] In some embodiments of this application, for a microlens array, one microlens can correspond to at least one filter element. For example, referring to FIG2, a filter element 111 can collect light using a single microlens 301. Alternatively, in other embodiments, multiple filter elements can share a single microlens to collect light, and this application does not impose specific limitations on this.

[0048] In the image sensor provided in this application embodiment, a multispectral unit 110 in the pixel array 100 consists of a first type of pixel 111 for image imaging and at least one second type of pixel 112 for multispectral imaging. Correspondingly, a filter unit 210 in the color filter array 200 consists of a first type of filter element 211 corresponding to the first type of pixel 111 and a second type of filter element 212 corresponding to the second type of pixel 112. Thus, the image sensor 10 achieves image imaging through the color channel corresponding to the first type of filter element 211, and recognizes multispectral information through the color channel corresponding to the second type of filter element 212 to achieve multispectral imaging. This allows the image sensor 10 to simultaneously perform image imaging and multispectral imaging functions without requiring an additional multispectral sensor to recognize multispectral information, thereby reducing hardware power consumption.

[0049] An image sensor provided according to an embodiment of this application includes an image sensor comprising a pixel array and a color filter array; the pixel array includes at least one multispectral unit, the multispectral unit including at least two first-type pixels for image imaging and at least one second-type pixel for multispectral imaging; the color filter array includes filter units disposed opposite to the multispectral unit, the filter units including at least two first-type filter elements and at least one second-type filter element, the first-type filter elements being disposed opposite to the first-type pixels; the second-type filter elements being disposed opposite to the second-type pixels; the first-type filter elements and the second-type filter elements have different transmittance wavelength ranges, and at least one second-type filter element includes at least one filter element. Thus, in the image sensor, the multispectral unit includes a first type of pixel for image imaging and at least one second type of pixel for multispectral imaging. The filter unit includes a first type of filter element disposed opposite to the first type of pixel and a second type of filter element disposed opposite to the second type of pixel. The image sensor realizes image imaging through the color channel corresponding to the first type of filter element, and realizes multispectral imaging by recognizing multispectral information through the color channel corresponding to the second type of filter element. This allows the image sensor to perform both image imaging and multispectral imaging functions without the need for an additional multispectral sensor to recognize multispectral information, thereby reducing hardware power consumption.

[0050] In some embodiments of this application, in the color filter array 200, the first type of filter element 211 may include at least one color filter element, wherein the color filter element may include a red filter element R, a green filter element G, a blue filter element B, a cyan filter element C, a magenta filter element M, a yellow filter element Y, and an all-pass filter element W.

[0051] In one specific embodiment, taking the first type of filter element 211 as an example, which includes three types of filter elements, the three types of filter elements can transmit light from three color channels. The first type of filter element 211 can be arranged in the color filter array 200 according to RGGB, RYYB, RWWB or other methods to achieve the function of image imaging. This application does not impose specific limitations on the type and arrangement of the filter elements of the first type of filter element 211.

[0052] For example, taking the first type of filter element 211 as an example, which includes three types of filter elements, the first type of filter element 211 may include a red filter element R and a blue filter element B; the first type of filter element 211 may also include at least one of a green filter element G, a yellow filter element Y, and an all-pass filter element W. Among them, the wavelength range of light that can be transmitted by the red filter element R is the red light band, the wavelength range of light that can be transmitted by the blue filter element B is the blue light band, the wavelength range of light that can be transmitted by the green filter element G is the green light band, the wavelength range of light that can be transmitted by the yellow filter element Y is the yellow light band, and the wavelength range of light that can be transmitted by the all-pass filter element W is the global light band, which is white light.

[0053] For example, as shown in Figure 3A, when the first type of filter elements includes a red filter element R, a green filter element G, and a blue filter element B, the color filter array can include multiple minimum units. In one minimum unit 220 of the color filter array, the ratio of the number of red filter elements R, green filter elements G, and blue filter elements B is 1:2:1. The green filter element G adjacent to the red filter element R can be a green-to-red filter element Gr, and the green filter element G adjacent to the blue filter element B can be a green-to-blue filter element Gb. Thus, the first type of filter elements in the color filter array 200 can be arranged in an RGGB pattern, and a color filter array arranged in an RGGB pattern can be called a Bayer array.

[0054] For example, in other embodiments, when the first type of filter elements includes a red filter element R, a yellow filter element Y, and a blue filter element B, the ratio of the number of red filter elements R, yellow filter elements Y, and blue filter elements B in the color filter array 200 is 1:2:1. Thus, compared to the embodiment shown in FIG. 3A, the green filter element G in the first type of filter elements can be replaced with the yellow filter element Y, and the first type of filter elements are arranged in the color filter array 200 in an RYYB pattern.

[0055] For example, in other embodiments, when the first type of filter elements includes a red filter element R, an all-pass filter element W, and a blue filter element B, the ratio of the number of red filter elements R, all-pass filter elements W, and blue filter elements B in the color filter array 200 is 1:2:1. Thus, compared to the embodiment shown in FIG. 3A, the green filter element G in the first type of filter elements can be replaced with the all-pass filter element W, and the first type of filter elements are arranged in the color filter array 200 in an RWWB configuration. This application does not impose specific limitations on the arrangement of the first type of filter elements in the color filter array.

[0056] In some embodiments of this application, in order to achieve multispectral imaging, the color channel corresponding to the second type of filter element can identify spectral information in multiple band ranges, and there can be multiple types of filter elements corresponding to the second type of filter element 212.

[0057] In some embodiments of this application, the second type of filter element 212 may include visible light filter elements, infrared light filter elements, and ultraviolet light filter elements, etc.

[0058] For example, for visible light filtering elements, the second type of filtering element 212 may include filtering elements for various colors of light, such as cyan filtering element C, yellow filtering element Y, magenta filtering element M, violet filtering element P, orange filtering element O, and all-pass filtering element W.

[0059] The second type of filter element 212 may include filter elements with the same spectral curve but different transmittance. For example, the second type of filter element 212 may include a lighter-colored filter element with the same spectral shape and a transmittance of 80%, or a darker-colored filter element with the same spectral shape and a transmittance of 30%, and so on. For example, the second type of filter element 212 may include a yellow filter element Y, which may be further divided into a light yellow filter element with a transmittance of 80%, a dark yellow filter element with a transmittance of 30%, and so on. In this embodiment, the transmittance of the second type of filter element 212 under the same spectral shape is not specifically set.

[0060] The second type of filter element 212 may also include filter elements with different spectral forms, and different spectral forms correspond to different colors that the human eye can perceive within the visible light range. For example, the second type of filter element 212 may include a yellow-green filter element or a cyan-blue filter element in the visible light range, etc., and may include a near-infrared filter element that transmits 940nm to 945nm, a short-wave infrared filter element that transmits 1400nm to 1500nm, etc. in the non-visible light band. In this embodiment, the spectral curve that the second type of filter element 212 can transmit is not specifically set.

[0061] In some embodiments of this application, in the color filter array 200, the first type of filter element 211 may include at least one filter element, and the at least one filter element can transmit at least one optical wavelength range to obtain at least one color channel information for image imaging. The second type of filter element 212 may include at least one filter element, and the at least one filter element can transmit at least one optical wavelength range to satisfy the function of multispectral imaging.

[0062] In some embodiments of this application, the second type of filter element 212 may also include narrow-band filter elements and wide-band filter elements, etc.

[0063] The second type of filter element 212 can transmit light wavelengths of either a narrow or wide band, and this application does not impose any restrictions on this. The difference between narrow and wide band types lies in the following: when using spectral feature information for multispectral imaging, a single narrow band wavelength range can characterize one spectral feature, while at least two wide band wavelength ranges, after being processed as source data, can characterize another spectral feature. Furthermore, narrow band wavelength ranges are generally narrower and can directly characterize the spectral information of a specific color; while wide band wavelength ranges are generally wider, resulting in a greater amount of light entering the filter element and a larger amount of signal acquired.

[0064] For example, taking the case where the wavelength range of light that can be transmitted by the second type of filter element is a wide band type, as shown in Figures 3B to 3D, in a spectral unit 210, at least one second type of filter element may include at least four of the following filter elements: first filter element F1, second filter element F2, third filter element F3, fourth filter element F4, fifth filter element F5, sixth filter element F6, seventh filter element F7, and eighth filter element F8.

[0065] Among them, at least four types of filter elements can transmit light with different wavelength ranges.

[0066] For example, in some specific embodiments of this application, in a spectral unit 210, at least one second-type filter element may include four of the following: a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, a sixth filter element F6, a seventh filter element F7, and an eighth filter element F8. For example, in a spectral unit 210, at least one second-type filter element may include the first filter element F1, the second filter element F2, the third filter element F3, and the fourth filter element F4. For example, in a spectral unit 210, at least one second-type filter element may include the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8. For example, in a spectral unit 210, at least one second-type filter element may include the first filter element F1, the second filter element F2, the third filter element F3, and the fifth filter element F5. For example, in a spectral unit 210, at least one second type of filter element may include a first filter element F1, a second filter element F2, a third filter element F3, and a sixth filter element F6.

[0067] For example, in some specific embodiments of this application, in a spectral unit 210, at least one second-type filter element may include five of the following: a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, a sixth filter element F6, a seventh filter element F7, and an eighth filter element F8. For example, in some specific embodiments of this application, in a spectral unit 210, at least one second-type filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, and the fifth filter element F5. For example, in some specific embodiments of this application, in a spectral unit 210, at least one second-type filter element may include the first filter element F1, the third filter element F3, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8.

[0068] For example, in some specific embodiments of this application, in a spectral unit 210, at least one second-type filter element may include six of the following: a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, a sixth filter element F6, a seventh filter element F7, and an eighth filter element F8. For example, in a spectral unit 210, at least one second-type filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, and the sixth filter element F6. For example, in a spectral unit 210, at least one second-type filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, and the seventh filter element F7. For example, in a spectral unit 210, at least one second type of filter element may include a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, and an eighth filter element F8.

[0069] For example, in some specific embodiments of this application, in a spectral unit 210, at least one second-type filter element may include seven of the following: a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, a sixth filter element F6, a seventh filter element F7, and an eighth filter element F8. For example, in a spectral unit 210, at least one second-type filter element may include the following: a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, a sixth filter element F6, and a seventh filter element F7. For example, in a spectral unit 210, at least one second-type filter element may include the following: a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, a sixth filter element F6, and an eighth filter element F8. For example, in a spectral unit 210, at least one second type of filter element may include a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, a seventh filter element F7, and an eighth filter element F8.

[0070] For example, in some specific embodiments of this application, in a spectral unit 210, at least one second type of filter element may include a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, a sixth filter element F6, a seventh filter element F7, and an eighth filter element F8.

[0071] It should be noted that the type and number of the second type of filter element can be set according to actual needs in the embodiments of this application, and this application does not impose specific restrictions on this.

[0072] Thus, by setting at least four of the following filter elements as the second type of filter elements—first filter element F1, second filter element F2, third filter element F3, fourth filter element F4, fifth filter element F5, sixth filter element F6, seventh filter element F7, and eighth filter element F8—in this embodiment of the application, the image sensor can achieve multispectral imaging function by recognizing at least four types of spectral information.

[0073] Furthermore, when the second type of filter element 212 includes at least four types of filter elements selected from the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7 and the eighth filter element F8, there is an overlap in the wavelength range of light that at least two of the at least four filter elements can transmit.

[0074] For example, in some specific embodiments of this application, in a spectral unit 210, at least one second type of filter element may include a first filter element F1, a second filter element F2, a third filter element F3, and a fourth filter element F4, wherein the wavelength ranges of light that the second filter element F2 and the fourth filter element F4 can transmit overlap.

[0075] For example, in some specific embodiments of this application, in a spectral unit 210, at least one second type of filter element may include a fifth filter element F5, a sixth filter element F6, a seventh filter element F7, and an eighth filter element F8, wherein the wavelength ranges of light that the fifth filter element F5 and the sixth filter element F6 can transmit overlap, the wavelength ranges of light that the fifth filter element F5 and the seventh filter element F7 can transmit overlap, and the wavelength ranges of light that the sixth filter element F6 and the eighth filter element F8 can transmit overlap.

[0076] Specifically, when performing multispectral imaging using spectral feature information obtained from the second type of filter element 212, the wavelength ranges of light that can be transmitted by at least two of the filter elements in the second type of filter element 212 are used as source data for calculation and processing, which can characterize a spectral feature information. Furthermore, since the wavelength ranges of light that can be transmitted by at least four types of filter elements are relatively wide, the amount of light entering the corresponding filter elements is more sufficient, and the amount of signal collected is greater.

[0077] In a specific example, the more types of filters a second type of filter element has, the richer the multispectral information it can identify, and the better its multispectral imaging function. For example, as shown in Figure 5B, in a spectral unit 210, at least one second type of filter element may include a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, a sixth filter element F6, a seventh filter element F7, and an eighth filter element F8.

[0078] Furthermore, the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8 can transmit different wavelength ranges of light.

[0079] Thus, by setting eight types of filter elements in the second type of filter element 212, the image sensor can achieve multispectral imaging by recognizing eight types of spectral information. Furthermore, since the eight transmittable light wavelengths cover a wide range, the corresponding filter elements receive more light, resulting in a larger amount of signal collected.

[0080] In a specific example, the first filter element F1 can transmit light in the wavelength range of 420 nm to 460 nm; the second filter element F2 can transmit light in the wavelength range of 670 nm to 700 nm; the third filter element F3 can transmit light in the wavelength range of 520 nm to 610 nm; the fourth filter element F4 can transmit light in the wavelength range of 610 nm to 700 nm; the fifth filter element F5 can transmit light in the wavelength range of 430 nm to 510 nm; the sixth filter element F6 can transmit light in the wavelength range of 450 nm to 590 nm; the seventh filter element F7 can transmit light in the wavelength range of 400 nm to 440 nm; and the eighth filter element F8 can transmit light in the wavelength range of 560 nm to 700 nm.

[0081] Thus, among the eight types of filter elements F1 to F8, there are overlaps in the wavelength ranges that can be transmitted by two or more filter elements. When performing multispectral imaging using the spectral feature information obtained based on the eight types of filter elements, at least two of the second type of filter elements 212 have overlaps in the wavelength ranges that can be transmitted by the filter elements. After processing the corresponding at least two types of pixel data as source data, a spectral feature information can be characterized. In this way, because the wavelength ranges that can be transmitted by the eight types of filter elements are relatively wide, and the wavelength ranges that can be transmitted by two or more filter elements overlap, the amount of light entering the corresponding filter elements is more sufficient, and the amount of signal collected is greater.

[0082] In practical applications, image sensors typically use a traditional Bayer array arrangement, where each filter element (i.e., a first-type filter element) has its own microlens to collect light. However, the image sensor provided in this application uses p×q OCL (On-Chip Lens) technology, where adjacent p×q first-type filter elements of the same color share a single optical unit to collect light. This optical unit can be an OCL. This approach achieves greater light integration while maintaining light transmission efficiency and provides higher phase-detection autofocus accuracy in low-light environments, thus significantly improving phase-detection autofocus performance.

[0083] For example, in a specific embodiment, the image sensor provided in this application embodiment may include r first-type filter elements 211, the r first-type filter elements are distributed in a p×q array, the r first-type filter elements 211 can transmit light in the same wavelength range, p and q are both positive integers, and r = p×q.

[0084] Among them, r first-type filter elements 211 can share one optical unit.

[0085] In a filter unit, at least two first-type filter elements may include p×q filter elements, the p×q filter elements share one optical unit, and the wavelength range of light that can be transmitted by the p×q filter elements is the same.

[0086] In this way, when the first type of pixel corresponding to the first type of filter element is used as the PDAF (Phase Detection Auto Focus) pixel, in the first type of filter element, p×q filter elements share one optical unit, which can achieve more light integration while maintaining light transmission efficiency, and can provide higher phase focusing accuracy in low light environment, thereby significantly improving phase focusing performance.

[0087] For example, taking a 2×2 OCL Bayer array image sensor as an example, where p is 2 and q is 2, a Bayer array refers to a color filter array arranged in RGGB pattern, and 2×2 OCL means that four adjacent color filter elements share a microlens. The green filter element G can specifically include: a green-to-red filter element Gr positioned adjacent to the red filter element R, and a green-to-blue filter element Gb positioned adjacent to the blue filter element B. The first type of filter element 211 can include the red filter element R, the green-to-blue filter element Gb, the green-to-red filter element Gr, and the blue filter element B. The p×q filter elements are the same type of filter element selected from the red filter element R, the green-to-blue filter element Gb, the green-to-red filter element Gr, and the blue filter element B.

[0088] As shown in Figure 3A, in the 2×2 OCL Bayer array image sensor, the smallest unit 220 consists of 16 filter elements. The smallest unit 220 may include 4 red filter elements R, 4 green-to-red filter elements Gr, 4 green-to-blue filter elements Gb, and 4 blue filter elements B.

[0089] In the smallest unit 220, four red filter elements R are arranged in a 2×2 array, each corresponding to one of the four first-type pixels, and all four red filter elements R share one optical unit; the optical unit is represented by a dashed circle or ellipse. Similarly, four green-to-red filter elements Gr are arranged in a 2×2 array, each corresponding to one of the four first-type pixels, and all four green-to-red filter elements Gr share one optical unit. Furthermore, four green-to-blue filter elements Gb are arranged in a 2×2 array, each corresponding to one of the four first-type pixels, and all four green-to-blue filter elements Gb share one optical unit. Finally, four blue filter elements B are arranged in a 2×2 array, each corresponding to one of the four first-type pixels, and all four blue filter elements B share one optical unit.

[0090] In this case, in the first type of filter element, 2×2 filter elements of the same color share one optical unit, and the amount of light entering a single color channel is increased to four times the original amount, which can achieve more light integration while maintaining light transmission efficiency.

[0091] In this way, when the first type of pixels corresponding to the red filter element R, the green-to-blue filter element Gb, the green-to-red filter element Gr, and the blue filter element B are used as PDAF pixels, 2×2 red filter elements R share one optical unit, 2×2 green-to-blue filter elements Gb share one optical unit, 2×2 green-to-red filter elements Gr share one optical unit, and 2×2 blue filter elements B share one optical unit. This can achieve more light integration while maintaining light transmission efficiency, and can provide higher phase focusing accuracy in low-light environments, thereby significantly improving phase focusing performance.

[0092] Furthermore, since this embodiment also includes at least one second-type pixel 112 for multispectral imaging and a second-type filter element 212 corresponding to the second-type pixel 112 in the image sensor, this embodiment can also use the second-type pixel 112 as a PDAF pixel. When the second-type pixel 112 is a PDAF pixel, since the second-type filter element 212 corresponding to the second-type pixel 112 has richer color channels, introducing the color channel information of the second-type filter element 212 into the PDAF algorithm can significantly improve phase focusing accuracy.

[0093] For example, in a specific embodiment, in a filter unit, the filter unit 210 may include t second-type filter elements 212, the t second-type filter elements 212 are distributed in an m×n array, the t second-type filter elements 212 share one optical unit, and the light wavelength range that the t second-type filter elements 212 can transmit is the same, where m and n are both positive integers, and t = m×n.

[0094] Where m×n is greater than or equal to 1. When m×n equals 1, it corresponds to a 1×1 OCL image sensor design, where one type II filter element uses a single OCL to collect light. When m×n is greater than 1, multiple type II filter elements share one OCL to collect light. When multiple type II filter elements share one OCL, more light is integrated while maintaining light transmission efficiency, and higher phase-detection autofocus accuracy is provided in low-light environments, thus significantly improving phase-detection autofocus performance. Furthermore, since the type II filter element 212 corresponds to a richer color channel, incorporating the color channel information of the type II filter element 212 into the PDAF algorithm can further improve phase-detection autofocus accuracy.

[0095] In some embodiments of this application, referring to Figures 5B to 5D, when the second type of filter elements includes at least four types of filter elements selected from the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8, the t second type of filter elements 212 can be the same filter element selected from the above at least four filter elements, and the wavelength ranges of light that can be transmitted by at least two of the above at least four filter elements overlap.

[0096] For example, with m=1 and n=2, the multispectral unit 110 may include two second-type pixels arranged in a 1×2 array, and the filter unit 210 may include two second-type filter elements arranged in a 1×2 array. The two second-type pixels and the two second-type filter elements are set in a one-to-one correspondence.

[0097] In this configuration, 1×2 filter elements cover 1×2 second-type pixels, and the 1×2 filter elements and 1×2 second-type pixels can be aligned in the vertical direction.

[0098] As shown in Figure 3D, in the filter unit 210, the second type of filter elements are the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8. 1×2 fifth filter elements F5 share one optical unit, 1×2 sixth filter elements F6 share one optical unit, 1×2 seventh filter elements F7 share one optical unit, and 1×2 eighth filter elements F8 share one optical unit.

[0099] Furthermore, 1×2 fifth filter elements F5 are configured one-to-one with 2×1 second-type pixels in the multispectral unit 110, 1×2 sixth filter elements F6 are configured one-to-one with 1×2 second-type pixels in the multispectral unit 110, 1×2 seventh filter elements F7 are configured one-to-one with 1×2 second-type pixels in the multispectral unit 110, and 1×2 eighth filter elements F8 are configured one-to-one with 1×2 second-type pixels in the multispectral unit 110.

[0100] For example, with m=2 and n=1, the multispectral unit 110 may include two second-type pixels arranged in a 2×1 array, and the filter unit 210 may include two second-type filter elements arranged in a 2×1 array. The two second-type pixels and the two second-type filter elements are set in a one-to-one correspondence.

[0101] Among them, 2×1 filter elements cover 2×1 second-type pixels, and the 2×1 filter elements and 2×1 second-type pixels can be aligned in the vertical direction.

[0102] As shown in Figure 4A, in the filter unit 210, the second type of filter elements are a first filter element F1, a second filter element F2, a third filter element F3, and a fourth filter element F4. Two × one first filter elements F1 share one optical unit, two × one second filter elements F2 share one optical unit, two × one third filter elements F3 share one optical unit, and two × one fourth filter elements F4 share one optical unit.

[0103] Furthermore, 2×1 first filter elements F1 are configured one-to-one with 2×1 second-type pixels in the multispectral unit 110, 2×1 second filter elements F2 are configured one-to-one with 2×1 second-type pixels in the multispectral unit 110, 2×1 third filter elements F3 are configured one-to-one with 2×1 second-type pixels in the multispectral unit 110, and 2×1 fourth filter elements F4 are configured one-to-one with 2×1 second-type pixels in the multispectral unit 110.

[0104] In this case, in the second type of filter element, 1×2 filter elements share one optical unit, or 2×1 filter elements share one optical unit, and the amount of light entering a single color channel is increased to twice the original amount, which can achieve more light integration while maintaining light transmission efficiency.

[0105] For example, with m=2 and n=2, the multispectral unit 110 may include four second-type pixels arranged in a 2×2 array, and the filter unit 210 may include four second-type filter elements arranged in a 2×2 array. The four second-type pixels and the four second-type filter elements are set in a one-to-one correspondence.

[0106] Among them, 2×2 filter elements cover 2×2 second-type pixels, and the 2×2 filter elements and 2×2 second-type pixels can be aligned in the vertical direction.

[0107] As shown in Figure 4B, in a filter unit 210, the second type of filter elements are a first filter element F1, a second filter element F2, a third filter element F3, and a fourth filter element F4. Two × two first filter elements F1 share one optical unit, two × two second filter elements F2 share one optical unit, two × two third filter elements F3 share one optical unit, and two × two fourth filter elements F4 share one optical unit.

[0108] Furthermore, 2×2 first filter elements F1 are configured one-to-one with 2×2 second type pixels in the multispectral unit 110, 2×2 second filter elements F2 are configured one-to-one with 2×2 second type pixels in the multispectral unit 110, 2×2 third filter elements F3 are configured one-to-one with 2×1 second type pixels in the multispectral unit 110, and 2×1 fourth filter elements F4 are configured one-to-one with 2×1 second type pixels in the multispectral unit 110.

[0109] In this case, in the second type of filter element, 2×2 filter elements share one optical unit, and the amount of light entering a single color channel is increased to four times the original amount, which can achieve more light integration while maintaining light transmission efficiency.

[0110] Thus, by using the second type of pixels corresponding to the second type of filter element as PDAF pixels, in the second type of filter element, m×n filter elements share one optical unit, which can achieve more light integration while maintaining light transmission efficiency, and provide higher phase focusing accuracy in low-light environments, thereby significantly improving phase focusing performance. Furthermore, since the second type of filter element corresponds to a richer color channel, incorporating the color channel information of the second type of filter element into the PDAF algorithm can further improve phase focusing accuracy.

[0111] In practical applications, taking the RGGB Bayer array designed with 2×2OCL as an example, in the image sensor provided by this application, some of the original RGB filter elements in the Bayer array can be replaced with second-type filter elements to obtain filter unit 210 composed of first-type filter element 211 and second-type filter element 212, and at least one filter unit 210 constitutes a color filter array 200.

[0112] In some embodiments of this application, the second type of filter elements can be uniformly distributed in the filter unit 210 at a certain density. For example, in a filter unit 210 corresponding to a multispectral unit, the percentage of the number of second type filter elements ranges from 1% to 100%.

[0113] The proportion of the second type of filter element is the ratio of the number of the second type of filter element to the total number of filter elements in the filter unit 210.

[0114] Thus, in some embodiments of this application, a second type of filter element can be set in a filter unit 210 corresponding to a multispectral unit, with a proportion range of 1% to 100%, so that the second type of filter element is uniformly distributed in the filter unit 210 at a certain density.

[0115] It should be noted that the larger the proportion of the second type of filter elements, the greater the multispectral channel density of the color filter array, the greater the impact on image imaging function, and the better the effect of multispectral imaging function.

[0116] In the process of image formation using first-type pixels with first-type filter elements, second-type pixels with second-type filter elements can be treated as defective pixels. To avoid excessive defective pixels affecting the quality of the generated image, in a filter unit 210 corresponding to a multispectral unit, the proportion of first-type filter elements can be greater than the proportion of second-type filter elements. Specifically, the proportion of first-type filter elements is the ratio of the number of first-type filter elements to the total number of filter elements in filter unit 210, and the proportion of second-type filter elements is the ratio of the number of second-type filter elements to the total number of filter elements in filter unit 210.

[0117] For example, in some embodiments of this application, in a filter unit 210 corresponding to a multispectral unit, the proportion of the second type of filter element 212 ranges from 1% to 50%.

[0118] The proportion of the second type of filter element is the ratio of the number of the second type of filter element to the total number of filter elements in the filter unit 210.

[0119] In a filter unit, the proportion of the second type of filter element can be understood as the multispectral channel density range of the color filter array.

[0120] In this way, by setting the multispectral channel density range to 1% to 50%, it is possible to avoid the multispectral channel density range being too large and occupying too much of the color channel of the first type of pixel, thus affecting the image quality generated based on the first type of pixel.

[0121] In one specific embodiment, experiments have shown that the proportion of the second type of filter element in a filter unit 210 is 6%. Therefore, with a multispectral channel density of 6%, the image sensor can better balance image imaging function and multispectral imaging function.

[0122] Of course, in other embodiments, the proportion of the number of second-type filter elements can be set to 1%, 5.5%, 7%, 50%, 60%, 70%, 80%, 100%, or other values, etc., according to actual needs. This application does not impose specific limitations on this.

[0123] For example, taking the Bayer array with a 2×2 OCL design as an example, the image sensor provided in this application, as shown in Figure 3A, has a minimum unit 220 composed of 16 filter elements. The optical units are represented by dashed circles. In the minimum unit, 2×2 red filter elements R share one optical unit, 2×2 green-to-blue filter elements Gb share one optical unit, 2×2 green-to-red filter elements Gr share one optical unit, and 2×2 blue filter elements B share one optical unit.

[0124] In this embodiment, multiple minimum units 220 can be divided into a filter unit 210, and a filter unit 210 can include multiple minimum units. This application can select at least one minimum unit from the multiple minimum units and replace at least one first-type filter element in the at least one minimum unit with a second-type filter element, resulting in a filter unit 210 composed of a majority of first-type filter elements and a small portion of second-type filter elements.

[0125] In one filter unit 210, the number of minimum units can be set according to actual needs. For example, one filter unit 210 may include 5×5 minimum units, or 4×4 minimum units, etc. This application does not impose specific restrictions on this.

[0126] In some embodiments of this application, compared with the minimum unit 220 shown in Figure 3A, the red filter element R, blue filter element B and other filter elements in the minimum unit 220 can be replaced with second type filter elements to obtain a filter unit.

[0127] For example, as shown in FIG3B, in the embodiments of this application, the red filter element R in the smallest unit 220 can be replaced with a second type of filter element, such as the first filter element F1 and the second filter element F2.

[0128] For example, as shown in FIG3C, in the embodiments of this application, the blue filter element B in the smallest unit 220 can also be replaced with a second type of filter element, such as the third filter element F3 and the fourth filter element F4.

[0129] For example, as shown in FIG3D, in the embodiments of this application, the red filter element R and the blue filter element B in the smallest unit 220 can also be replaced with a second type of filter element, such as the fifth filter element F5, the sixth filter element F6, the seventh filter element F7 and the eighth filter element F8.

[0130] Alternatively, as shown in Figure 4A, a filter unit 210 can also be composed of one minimum unit, or as shown in Figure 4B, a filter unit 210 can also be composed of 2×2 minimum units. In this embodiment, the red filter element R and the blue filter element B in the minimum unit 220 can also be replaced with a second type of filter element, such as the first filter element F1, the second filter element F2, the third filter element F3 and the fourth filter element F4.

[0131] Furthermore, in other embodiments of this application, the green-to-blue filter element Gb or the green-to-red filter element Gr can be replaced with a second type of filter element, and this application does not limit this.

[0132] In some embodiments of this application, as shown in Figures 5A to 5E, the filter unit 210 may also be composed of 4×4 minimum units, each minimum unit comprising 4×4 filter elements, and one filter unit 210 may comprise 16×16 = 256 filter elements. The proportion of the second type of filter elements can be selected as 1%, 6%, 5.5%, 7%, or 50%, etc., and this application does not limit the specific value of the proportion of the second type of filter elements.

[0133] In some embodiments of this application, as shown in FIG5A, taking a 1% proportion of second-type filter elements as an example, 256 × 1% = 2.56. This application can provide three second-type filter elements in a filter unit 210 composed of 400 filter elements. The second-type filter elements provided in the filter unit 210 may include two first filter elements F1 and one second filter element F2. Thus, three second-type filter elements are provided in the filter unit 210 composed of 256 filter elements, resulting in a multispectral channel density of approximately 1%.

[0134] In some embodiments of this application, as shown in FIG5B, taking a 6% proportion of second-type filter elements as an example, 256 × 6% = 15.36, 16 second-type filter elements can be set in one filter unit 210, including two first filter elements F1, two second filter elements F2, two third filter elements F3, two fourth filter elements F4, two fifth filter elements F5, two sixth filter elements F6, two seventh filter elements F7, and two eighth filter elements F8. Thus, 16 second-type filter elements are set in the filter unit 210 composed of 256 filter elements, and the multispectral channel density is approximately 6%.

[0135] In some embodiments of this application, as shown in FIG5C, taking a 5.5% proportion of second-type filter elements as an example, 256 × 5.5% = 14.08. Therefore, 14 second-type filter elements can be set in the filter unit 210 composed of 256 filter elements, including two first filter elements F1, two second filter elements F2, two third filter elements F3, two fourth filter elements F4, two sixth filter elements F6, two seventh filter elements F7, and two eighth filter elements F8. Thus, with 14 second-type filter elements set in the filter unit 210 composed of 256 filter elements, the multispectral channel density is approximately 5.5%. Furthermore, compared to a 6% multispectral channel density, the image imaging function is better due to the higher proportion of first-type filter elements.

[0136] In some embodiments of this application, as shown in FIG5D, taking a 7% proportion of second-type filter elements as an example, 256 × 7% = 17.92. Therefore, 18 second-type filter elements can be set in the filter unit 210 composed of 400 filter elements, including four first filter elements F1, two second filter elements F2, two third filter elements F3, two fourth filter elements F4, two sixth filter elements F6, two seventh filter elements F7, and two eighth filter elements F8. Thus, 18 second-type filter elements are set in the filter unit 210 composed of 256 filter elements, resulting in a multispectral channel density of approximately 7%. Furthermore, compared to a 6% multispectral channel density, the multispectral imaging function is better due to the higher proportion of second-type filter elements.

[0137] In some embodiments of this application, as shown in FIG5E, taking a 50% proportion of second-type filter elements as an example, 256 × 50% = 128. Therefore, this application can provide 128 second-type filter elements in a filter unit 210 composed of 256 filter elements. Thus, with 128 second-type filter elements provided in the filter unit 210 composed of 256 filter elements, the multispectral channel density is 50%.

[0138] In other embodiments of this application, the proportion of second-type filter elements in a filter unit 210 can be 60%, 256 × 60% = 153.6. Therefore, this application can provide 154 second-type filter elements in a filter unit 210 composed of 256 filter elements. Thus, with 154 second-type filter elements provided in a filter unit 210 composed of 256 filter elements, the multispectral channel density is 60%.

[0139] In other embodiments of this application, the proportion of second-type filter elements in a filter unit 210 can be 70%, 256 × 70% = 179.2. Therefore, this application can provide 180 second-type filter elements in a filter unit 210 composed of 256 filter elements. Thus, 180 second-type filter elements are provided in the filter unit 210 composed of 256 filter elements, and the multispectral channel density is 70%.

[0140] In other embodiments of this application, the proportion of second-type filter elements in a filter unit 210 can be 80%, 256 × 80% = 204.8. Therefore, this application can provide 205 second-type filter elements in a filter unit 210 composed of 256 filter elements. Thus, 205 second-type filter elements are provided in the filter unit 210 composed of 256 filter elements, and the multispectral channel density is 80%.

[0141] In other embodiments of this application, in a filter unit 210, the proportion of second-type filter elements can be 100%, 256 × 100% = 256. Therefore, this application can provide 256 second-type filter elements in a filter unit 210 composed of 256 filter elements. Thus, with 256 second-type filter elements provided in the filter unit 210 composed of 256 filter elements, the multispectral channel density is 100%.

[0142] It should be noted that in some embodiments of this application, the larger the proportion of the second type of filter elements in a filter unit 210, the greater the proportion of the second type of filter elements, the greater the multispectral channel density of the color filter array, the greater the impact on the image imaging function, and the better the effect of the multispectral imaging function.

[0143] In some embodiments of this application, the filter surface shape of filter elements such as the first type of filter element 211 and the second type of filter element 212 in the color filter array 200 can be any shape, such as square, circle, triangle or hexagon, etc. This application does not impose specific limitations in this regard.

[0144] For example, the filter surface shape of the first type of filter element 211 can be square, triangular, hexagonal, or other shapes. The filter surface shape of the second type of filter element 212 can also be square, triangular, hexagonal, or other shapes. This application embodiment does not impose specific limitations on the filter surface shape of the filter elements.

[0145] Among them, square filters have better regularity, making them easier to implement on actual image input / output devices. Compared to square filters, hexagonal filters have a more uniform distribution, higher angular resolution, and better symmetry, which helps reduce the amount of filtering computation.

[0146] Based on the same concept as the image sensor provided in any of the above embodiments, this application also provides an electronic device.

[0147] As shown in Figure 6, this application embodiment provides an electronic device 600, including an image sensor 10.

[0148] It should be noted that the electronic device provided in this application includes the image sensor provided in any of the above embodiments, and can realize all the functions of the image sensor. To avoid repetition, it will not be described again here.

[0149] In the embodiments of this application, the electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a smartwatch, mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), etc. The embodiments of this application do not specifically limit the scope.

[0150] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0151] Although embodiments of this application have been shown and described, those skilled in the art will understand that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of this application, the scope of which is defined by the claims and their equivalents.

Claims

1. An image sensor, comprising: Pixel array and color filter array; The pixel array includes at least one multispectral unit, which includes at least two first-class pixels for image imaging and at least one second-class pixel for multispectral imaging. The color filter array includes filter units disposed opposite to the multispectral unit. Each filter unit includes at least two first-type filter elements and at least one second-type filter element. The first-type filter elements are disposed opposite to the first-type pixels, and the second-type filter elements are disposed opposite to the second-type pixels. The first type of filter element and the second type of filter element can transmit light wavelengths in different ranges, and the at least one second type of filter element includes at least one filter element; The filtering unit includes r first-type filtering elements, which are arranged in a p×q array. The r first-type filtering elements can transmit light in the same wavelength range, where p and q are both positive integers, and r = p×q.

2. The image sensor according to claim 1, wherein, The r first-type filter elements share one optical unit; p is 2 and q is 2.

3. The image sensor according to claim 1, wherein, The at least one second-type filter element includes at least four of the following filter elements: a first filter element, a second filter element, a third filter element, a fourth filter element, a fifth filter element, a sixth filter element, a seventh filter element, and an eighth filter element; The at least four types of filter elements can transmit light in different wavelength ranges.

4. The image sensor according to claim 3, wherein, The at least one second-type filter element includes a first filter element, a second filter element, a third filter element, a fourth filter element, a fifth filter element, a sixth filter element, a seventh filter element, and an eighth filter element; The first filter element, the second filter element, the third filter element, the fourth filter element, the fifth filter element, the sixth filter element, the seventh filter element, and the eighth filter element can transmit light wavelengths in different ranges.

5. The image sensor according to claim 3 or 4, wherein, The first filter element can transmit light in the wavelength range of 420 nm to 460 nm; The second filter element can transmit light in the wavelength range of 670 nm to 700 nm; The third filter element can transmit light wavelengths in the range of 520 nm to 610 nm. The fourth filter element can transmit light in the wavelength range of 610 nm to 700 nm. The fifth filter element can transmit light wavelengths ranging from 430 nanometers to 510 nanometers. The sixth filter element can transmit light wavelengths ranging from 450 nanometers to 590 nanometers. The seventh filter element can transmit light in the wavelength range of 400 nm to 440 nm; The eighth filter element can transmit light in the wavelength range of 560 nm to 700 nm.

6. The image sensor according to claim 3, wherein, The filtering unit includes t second-type filtering elements, which are arranged in an m×n array. The t second-type filtering elements share a single optical unit, and the wavelength range of light that can be transmitted by the t second-type filtering elements is the same. m and n are both positive integers, and t = m×n.

7. The image sensor according to claim 6, wherein, The t second-type filter elements are the same filter element selected from the at least four types of filter elements; At least two of the at least four filter elements have overlapping wavelength ranges that can be transmitted.

8. The image sensor according to claim 6, wherein, m is 1, n is 2; The multispectral unit includes two second-type pixels arranged in a 1×2 array, and the filter unit includes two second-type filter elements arranged in a 1×2 array. The two second-type pixels and the two second-type filter elements are arranged in a one-to-one correspondence.

9. The image sensor according to claim 6, wherein, m is 2, n is 1; The multispectral unit includes two second-type pixels arranged in a 2×1 array, and the filter unit includes two second-type filter elements arranged in a 2×1 array. The two second-type pixels and the two second-type filter elements are arranged in a one-to-one correspondence.

10. The image sensor according to claim 6, wherein, m is 2, n is 2; The multispectral unit includes four second-type pixels arranged in a 2×2 array, and the filter unit includes four second-type filter elements arranged in a 2×2 array. The four second-type pixels and the four second-type filter elements are arranged in a one-to-one correspondence.

11. The image sensor according to any one of claims 1-4, wherein, In a filter unit corresponding to a multispectral unit, the proportion of the second type of filter element ranges from 1% to 100%. The proportion of the second type of filter element is the ratio of the number of the second type of filter element to the total number of filter elements in the filter unit.

12. The image sensor according to any one of claims 1-4, wherein, In a filter unit corresponding to a multispectral unit, the proportion of the second type of filter element ranges from 1% to 50%. The proportion of the second type of filter element is the ratio of the number of the second type of filter element to the total number of filter elements in the filter unit.

13. The image sensor according to claim 11, wherein, The second type of filter element accounts for 6% of the total number.

14. An electronic device comprising the image sensor according to any one of claims 1-13.

Images